Professional Documents
Culture Documents
Cognitive Psychology by Nick Braisby Angus Gellatly
Cognitive Psychology by Nick Braisby Angus Gellatly
E D IT E D BY
N I C K B R A I S BY A N D A N G U S G E L L ATLY
1
1
Great Clarendon Street, Oxford, OX2 6DP,
United Kingdom
Oxford University Press is a department of the University of Oxford.
It furthers the University’s objective of excellence in research, scholarship,
and education by publishing worldwide. Oxford is a registered trade mark of
Oxford University Press in the UK and in certain other countries
© Oxford University Press 2012
The moral rights of the authors have been asserted
First Edition copyright 2005
Impression: 1
All rights reserved. No part of this publication may be reproduced, stored in
a retrieval system, or transmitted, in any form or by any means, without the
prior permission in writing of Oxford University Press, or as expressly permitted
by law, by licence or under terms agreed with the appropriate reprographics
rights organization. Enquiries concerning reproduction outside the scope of the
above should be sent to the Rights Department, Oxford University Press, at the
address above
You must not circulate this work in any other form
and you must impose this same condition on any acquirer
British Library Cataloguing in Publication Data
Data available
Library of Congress Cataloguing in Publication Data
Library of Congress Control Number: 2011943537
ISBN 978–0–19–923699–2
Printed in Italy by
L.E.G.O. S.p.A.—Lavis TN
Th is edition is adapted and reproduced from Cognitive Psychology edited by Nick Braisby and
Angus Gellatly (2005) and Cognitive Psychology: a Methods Companion edited by Nick Braisby (2005),
by permission of the Open University.
Links to third party websites are provided by Oxford in good faith and
for information only. Oxford disclaims any responsibility for the materials
contained in any third party website referenced in this work.
PREFACE TO THE
SECOND EDITION
Book structure
The chapters in this book are organized in six parts. The first four parts focus on
broad and well-established topic areas within cognitive psychology, such as percep-
tual processes, language, memory, and thinking and reasoning. All these chapters
have been updated, and in some cases considerably revised, since the first edition. The
fifth part is entirely new. It comprises three chapters reflecting the increasing and
exciting interplay between cognitive psychology and the cognitive neurosciences. The
sixth part comprises five updated and revised chapters that consider a range of chal-
lenges, themes, and issues – topics that have been thought to present challenges to the
cognitive approach, such as emotion and consciousness; themes such as cognitive
modelling and modularity; and issues such as the relation of cognition to biology.
The first chapter is not located in one of these parts. It attempts to give a historical
and conceptual introduction to cognitive psychology, laying out the foundations of
the subject and raising some of the important themes and issues that are revisited in
later chapters. Some of these themes are also developed in the introductions to each
of the subsequent parts; we recommend that students read these introductions prior
to reading their associated parts, and re-read them afterwards.
Chapter structure
Each chapter has been structured according to certain conventions.
An emboldened term signifies the introduction of a key concept or term that is
either explicitly or implicitly defined in the surrounding text and/or explained in the
glossary at the end of the book. The locations of these defined terms are also flagged
in bold in the index.
vi PREFACE TO THE SECOND EDITION
Each chapter contains a number of activities. Often these may be simple thought
exercises that may take no more than a minute or so. Others are more involved. Each
activity has been integrated into the design of the chapter and is aimed at enhancing
students’ understanding of the material. We recommend that student readers attempt
as many of these activities as possible and, where appropriate, revisit them after com-
pleting each chapter. Educators may wish to select these activities as the basis for in-
class exercises.
The chapters in this book also make use of text boxes. Each box has been written
to amplify a particular aspect of the material without interrupting the ongoing narra-
tive. Though the boxes illuminate a wide range of issues, many focus on aspects of
research studies and methods. Students may find that they wish to finish a section
before reading a particular box.
Each substantive main section finishes with a section summary, often a bullet
point list reminding the student of the key points established in that section. We hope
that students will use these as useful barometers of their understanding and re-read
sections where the summary points are not clearly understood.
Each chapter makes a number of explicit links to other chapters in the book, often
to specific numbered sections. It would be tedious in the extreme to continually fol-
low each and every link, flicking to the relevant pages and reading the relevant ‘linked’
section. Rather, these links are intended to help students perceive the interconnected
nature of cognitive psychology, identifying connections between topics that other-
wise might seem disparate. Of course, we hope that students will be motivated to
follow some of these links, either on first reading or on a later reading, perhaps as a
revision aid.
As well as a list of references, each chapter ends with some specific suggestions for
further reading. While each chapter is designed to be self-contained, inevitably some
issues get less attention than they deserve, and so interested readers may wish to pur-
sue some of these suggestions for a more in-depth treatment. Moreover, it is always
worth approaching a topic from more than one direction – consulting different texts,
including other general texts on cognitive psychology, can help achieve a richer
understanding and we recommend this approach to all students. Educators may wish
to use these further readings as the basis for seminar discussions.
for the earlier chapters. By focusing more on earlier or later chapters, courses can
vary somewhat in the degree of difficulty of the material they present.
Acknowledgements
There are a very considerable number of people we would like to thank, without
whose contributions this second edition would not have been possible. We would like
to thank all of those involved in the production of the first edition and of course all of
the authors, some of whom are new to this second edition, for their work in updating
and revising their chapters. We would like to say a special thank you to the hard-
working team at Oxford University Press: Holly, Laura, Bethan, Siân, and Jonathan.
We cannot recall how many times this project, and especially the editors, have been
kept on track by their hard work behind the scenes, and their gentle but insistent
prompting.
Lastly, we would like to pay a special tribute to the late Tony Stone, first author of
Chapter 20. Tony was a fine illustration of the permeability of cognitive psychology;
its openness to contributions from other disciplines. Tony was first and foremost a
philosopher, but one who had increasingly turned his mind to the subject matter of
cognitive psychology. His chapter on theoretical issues in the first edition of this book
was very highly regarded and perfectly demonstrated his skills of analysis and com-
munication. Tony was excited by cognitive psychology in part because it wrestles with
deep questions concerning the nature of the mind, and we are sure he would be
delighted if this volume served to stimulate a similar interest in the next generation of
scholars. We hope it will.
This book has been produced as the core text for the Open University’s level 3 course
in Cognitive Psychology (DD303). However, it has been designed to serve students
taking other courses in cognitive psychology as well, either as essential or recom-
mended reading. There are a number of features of the design of this text that we
hope will serve students learning about cognitive psychology and educators teaching
the subject.
Book structure
The chapters in this book are organized in five parts. The first four parts focus on
broad and well-established topic areas within cognitive psychology, such as percep-
tual processes and memory. The fifth considers a range of challenges, themes, and
issues – topics that have been thought to present challenges to the cognitive approach,
such as emotion and consciousness; themes such as cognitive modelling and modu-
larity; and issues such as the relation of cognition to biology.
The first chapter is not located in one of these parts. It attempts to give a historical
and conceptual introduction to cognitive psychology, laying out the foundations of
the subject and raising some of the important themes and issues that are revisited in
later chapters. Some of these themes are also developed in the introductions to each
of the subsequent parts; we recommend that students read these introductions prior
to reading their associated parts and re-read them afterwards.
Chapter structure
Each chapter has been structured according to certain conventions.
An emboldened term signifies the introduction of a key concept or term that is
either explicitly or implicitly defined in the surrounding text. The locations of these
defined terms are also flagged in bold in the index.
Each chapter contains a number of activities. Often these may be simple thought
exercises that may take no more than a minute or so. Others are more involved. Each
activity has been integrated into the design of the chapter and is aimed at enhancing
students’ understanding of the material. We recommend that student readers attempt
x PREFACE TO THE FIRST EDITION
as many of these activities as possible and, where appropriate, revisit them after
completing each chapter.
The chapters in this book also make use of text boxes. Each box has been written
to amplify a particular aspect of the material without interrupting the ongoing narra-
tive. Though the boxes illuminate a wide range of issues, many focus on aspects of
research studies and methods. Students may find that they wish to finish a section
before reading a particular box.
Each substantive main section finishes with a section summary, often a bullet
point list reminding the student of the key points established in that section. We hope
that students will use these as useful barometers of their understanding and re-read
sections where the summary points are not clearly understood.
Each chapter makes a number of explicit links to other chapters in the book, often
to specific numbered sections. It would be tedious in the extreme to continually fol-
low each and every link, flicking to the relevant pages and reading the relevant ‘linked’
section. Rather, these links are intended to help students perceive the interconnected
nature of cognitive psychology, identifying connections between topics that other-
wise might seem disparate. Of course, we hope that students will be motivated to
follow some of these links, either on first reading or on a later reading, perhaps as a
revision aid.
As well as a list of references, each chapter ends with some specific suggestions for
further reading. While each chapter is designed to be self-contained, inevitably some
issues get less attention than they deserve, and so interested readers may wish to pur-
sue some of these suggestions for a more in-depth treatment. Moreover, it is always
worth approaching a topic from more than one direction – consulting different texts,
including other general texts on cognitive psychology, can help achieve a richer
understanding and we recommend this approach to all students.
Companion volume
Accompanying this book is a companion publication, Cognitive Psychology: A
Methods Companion, also published by Oxford University Press and also designed as
a key teaching text for the Open University’s level 3 course in Cognitive Psychology.
The Methods Companion considers in detail a number of key methodological issues
in cognitive psychology, including ethics, connectionism, symbolic modelling, neu-
roimaging, neuropsychology, and statistics.
Acknowledgements
Developing the Open University’s level 3 course in Cognitive Psychology (DD303)
has been a major undertaking, involving the production of two books, various pieces
of software and associated files, audio materials, web sites and web-based materials,
and numerous other additional items and activities. To say that such a course, and
that this text, could not have been produced without the help and cooperation of a
large number of people is an understatement. We extend our grateful and sincere
thanks to all those who have made this enterprise possible.
PART 3 MEMORY
INTRODUCTION 226
8 LONG-TERM MEMORY
Encoding to retrieval
Andrew Rutherford, Gerasimos Markopoulos, Davide Bruno,
and Mirjam Brady-Van den Bos 229
9 WORKING MEMORY Graham J. Hitch 266
PART 4 THINKING
INTRODUCTION 298
10 PROBLEM SOLVING Alison J.K. Green and Ken Gilhooly 301
11 JUDGEMENT AND DECISION MAKING Peter Ayton 334
12 REASONING Mike Oaksford 366
Epilogue 681
Glossary 685
Index 707
CONTENTS IN FULL
6 Level-dependent explanations 23
6.1 The computational level 23
6.2 The algorithmic level 24
6.3 The implementational level 25
6.4 Using Marr’s levels 25
7 Conclusions 26
FURTHER READING 27
REFERENCES 27
2 Visual attention 40
2.1 Knowing about unseen information 41
2.2 Towards a theory of parallel processing 43
2.3 Rapid serial visual presentation 44
2.4 Masking and attention 47
xvi CONTENTS IN FULL
FURTHER READING 62
REFERENCES 62
7 Conclusion 96
FURTHER READING 97
REFERENCES 98
4 Conclusion 165
FURTHER READING 166
REFERENCES 166
5 Conclusion 193
FURTHER READING 194
REFERENCES 194
4 Conclusions 220
CONTENTS IN FULL xix
PART 3 MEMORY
INTRODUCTION 226
8 LONG-TERM MEMORY
Encoding to retrieval
Andrew Rutherford, Gerasimos Markopoulos,
Davide Bruno, and Mirjam Brady-Van den Bos 229
1 Introduction 229
2 Encoding 230
2.1 Levels of processing 231
2.2 Item-specific and relational processing 233
2.3 Other forms of encoding processing 234
4 Retrieval 243
4.1 Encoding specificity and transfer appropriate processing 243
4.2 The diagnostic value of retrieval cues 245
4.3 Accounts of recognition memory 246
4.4 Remembering and knowing 250
6 Conclusions 258
FURTHER READING 259
REFERENCES 259
5 Conclusion 290
FURTHER READING 291
REFERENCES 291
PART 4 THINKING
INTRODUCTION 298
6 Conclusions 329
FURTHER READING 330
REFERENCES 330
6 Discussion 387
6.1 Theoretical evaluation 387
6.2 Integrative approaches 389
3 Dementia 473
3.1 Alzheimer’s disease 474
3.2 Vascular dementia 475
3.3 Dementia with Lewy bodies (DLB) 475
3.4 Fronto-temporal dementia 476
3.5 Mild cognitive impairment 476
5 Depression 484
5.1 Emotion 484
5.2 Neuroanatomical correlates of depression 485
5.3 Depression phenotype and how it relates to cognition 486
5.4 Stroke 486
5.5 Traumatic brain injury 488
5.6 Pseudodementia 490
3 Modularity 651
3.1 An outline of Fodor’s theory of modularity 652
3.2 The central systems 656
3.3 Debates about modularity 659
6 Conclusion 674
FURTHER READING 675
REFERENCES 676
Epilogue 681
Glossary 685
Index 707
LIST OF CONTRIBUTORS
Dr Nicola Brace
Department of Psychology, The Open University
Dr Davide Bruno
Nathan S. Kline Institute for Psychiatric Research; and Department of Psychiatry,
New York University
Dr Gianna Cocchini
Psychology Department, Goldsmiths College, University of London
Dr Graham Edgar
Department of Natural and Social Science, University of Gloucestershire
Dr Helen Edgar
Department of Natural and Social Science, University of Gloucestershire
Dr Alison Green
Department of Psychology, The Open University
Dr Olaf Hauk
MRC Cognition and Brain Sciences Unit, Cambridge University
Dr Ingrid S. Johnsrude
Department of Psychology, Queen's University, Ontario, Canada
Dr Bundy Mackintosh
School of Medicine, University of East Anglia
Dr Gerasimos Markopoulos
Department of Neurology, Otto-von-Guericke University
Dr Chris Moulin
Institute of Psychological Sciences, University of Leeds
Dr Paul Mulholland
Knowledge Media Institute and Centre for Research in Computing, The Open
University
Dr Peter Naish
Sackler Centre for Consciousness Science, University of Sussex
Dr David Okai
Institute of Psychiatry, King's College, University of London
Dr Graham Pike
Department of Psychology, The Open University
Dr Clare Rathbone
School of Psychology and Clinical Language Sciences, University of Reading
Dr Andrew Rutherford
School of Psychology, Keele University
LIST OF CONTRIBUTORS xxix
Mr George Savulich
Institute of Psychiatry, King's College, University of London
Dr Stuart Watt
Ontario Institute for Cancer Research, Toronto, Ontario, Canada
Dr Jenny Yiend
Institute of Psychiatry, King's College, University of London
This page intentionally left blank
CHAPTER 1
FOU NDATION S
OF COG NITIVE
P SYCHOLOGY
Nick Braisby and Angus Gellatly
1 INTRODUCTION
How does memory work? How do we understand lan- can we hope to understand completely the behaviour
guage and produce it so that others can understand? of employees in an organization unless we first under-
How do we perceive our environment? How do we stand their perceptions and memories, and how they
infer from patterns of light or sound the presence of reason and attempt to solve problems? How can we
objects in our environment, and their properties? understand the way in which people interact to shape
How do we reason and solve problems? How do we one another’s opinions if we do not understand how
think? And how might the study of abnormal func- people understand and process language and how
tioning, of brain-damaged or psychiatric patients, they make judgements?
shed light on these issues? Throughout this book, the various authors tackle
These are just some of the foundational questions these and other questions and show you how much of
that cognitive psychology examines. They are founda- these foundations cognitive psychologists have so far
tional partly because each concerns the nature of a uncovered. The book begins with an exploration of per-
basic psychological ability, abilities that we often take ceptual processes, moves to a discussion of categoriza-
for granted, yet that are vital to our normal, healthy tion and language, through to memory, and then to
functioning and key to our understanding of what it thinking processes. It considers how cognitive psychol-
means to be human. And they are foundational partly ogy has been augmented by other methods of study,
because they are important for psychology as a whole, such as those used to examine patients suffering from
and not just cognitive psychology. For instance, how brain damage or psychiatric conditions, and techniques
2 CHAPTER 1 FOUNDATIONS OF COGNITIVE PSYCHOLOGY
that provide us with detailed images of brain activity and and other disciplines (such as philosophy, comput-
structure. Finally, the last part of the book is devoted to ing, and linguistics).
wider issues: to topics that have been thought to present There are many substantial issues that we only
a challenge to cognitive psychology – such as conscious- touch on – it is not easy to define the relationship
ness and emotion – and to some of the themes and theo- between two academic disciplines, for example – and
retical questions that pervade the cognitive approach. so we only hope to convey something of their flavour
In this chapter we try to answer the question, here. Our aim in this chapter is therefore merely to
‘What is cognitive psychology?’. In so doing, we out- introduce cognitive psychology, to explain some of its
line some of the foundational assumptions that cog- key distinguishing features, and to uncover some of
nitive psychologists tend to make, as well as some of the many broad issues lying beneath its surface. You
the reasons why it is such an important and fascinat- will obtain a richer and more complete overview of
ing subject – not least the fact that it raises many cognitive psychology from reading subsequent chap-
deep and important questions concerning the mind. ters, especially Chapter 20. You may find that the
We consider some of the issues that have attracted current chapter raises as many questions as it answers
and continue to attract the interest of cognitive psy- and that, as your reading of this book progresses, you
chologists, and some of the assumptions they make periodically want to revisit this chapter to gain a
in order to develop models and theories. We also better understanding of issues that, on first reading,
reflect upon the cognitive approach in general and seemed hazy. If this chapter only raises questions
the kinds of explanation cognitive psychologists that you have in mind when you read subsequent
favour, briefly considering the relations between chapters, and arouses your curiosity sufficiently
cognitive psychology and other sub-disciplines of that you periodically revisit it, it will have served its
psychology, and those between cognitive psychology purpose well.
2WHAT IS COGNITIVE
PSYCHOLOGY?
What is cognitive psychology? Well, as with most to the scientific study of the mind. Straightforward as
questions, there can be short or long answers. The this may seem, to understand the nature of cogni-
short, though not uncontentious, answer is that cogni- tive psychology means digging deeper. And it is an
tive psychology is the branch of psychology devoted excavation that raises all manner of substantial and
ACTIVIT Y 1.1
Given the above defi nition that cognitive psychol- ‘scientifi c’ approach within psychology generally,
ogy is the scientifi c study of the mind, take a few and you might want to list some of the character-
minutes to write down some examples of what istic topics you would expect cognitive psycholo-
you would expect its characteristic features to gists to study.
be. For example, you might want to list what Keep your list ready to refer to as you read the
you take to be the characteristic features of a rest of this chapter.
CHAPTER 1 FOUNDATIONS OF COGNITIVE PSYCHOLOGY 3
interesting issues – as diverse as the nature of normal- evidence from brain-damaged patients to normal
ity and computation, and the importance of individual cognition.
differences and brain images. ‘Cognitive psychology’ can also be used to refer
Activity 1.1 raises a number of interesting ques- to activities in a variety of other disciplines and sub-
tions about the nature and scope of cognitive psy- disciplines (did your list refer to other disciplines?).
chology. What does it mean for a psychology to be Some sub-disciplines, like cognitive neuropsychology,
‘cognitive’, for example? Did your list make any ref- developmental cognitive neuropsychology, cognitive
erence to normality? Well, when we say that cogni- neuropsychiatry, and cognitive neuroscience, include
tive psychology is the scientific study of the mind, the cognitive signifier in their own titles. Others, such
this usually means ‘normally-functioning human as behavioural neurobiology, linguistics, and artificial
minds’. We can develop an understanding of the intelligence, do not; some practitioners of these might
normal human mind in various ways: by studying well object to finding themselves included under
people with normal minds and normal brains, but the cognitive psychology umbrella. As you will see in
also by studying people with abnormal minds or Chapter 5, uncertainty and negotiation regarding
abnormal brains, and by studying animals of other membership are characteristic of many if not all of our
species, and even devices such as computers, with conceptual categories. Our advice is not to worry too
no brain at all. With respect to just this one issue – much about such definitional issues at this stage, and
normality – cognitive psychology is clearly a broad perhaps not even later on. But one thing that is clear is
enterprise. Box 1.1 gives a brief illustration of how that there is no easily identified boundary between
evidence from people with brain damage can cognitive psychology and work carried on in other
inform our understanding of normal cognition. disciplines with which cognitive psychologists fre-
Don’t worry too much if you cannot follow all of quently engage.
the details at this stage – just try to get a feel for Your list of features of cognitive psychology may
how cognitive psychologists have tried to relate have referred to some of the methods that cognitive
Warrington and Shallice (1984) describe four These studies have suggested to researchers that,
patients with specific impairments in recognizing in normal cognition, the categories of living and non-
living things. Because the impairment was thought living things might be represented and/or processed
to be specific to the category of living things, it has differently. For example, one suggestion, that has
been called a category-specific impairment. One since been much debated, was that in normal cogni-
patient, JBR, experienced brain damage after tion the functional and sensory properties of catego-
suffering from herpes simplex encephalitis. As a ries are represented differently, and that living things
result, when asked to name pictures, he correctly tend to depend more on the sensory properties,
named only approximately 6 per cent of the pic- while non-living things depend more on functional
tures of living things, yet around 90 per cent of the properties (Warrington and Shallice, 1984). This sug-
pictures of non-living things. Other patients, though gestion was also at first thought to help explain why
fewer of them, have been found to show an oppo- JBR, on the assumption that he has an impairment for
site impairment – that is, an impairment primarily sensory properties, was also found to show impair-
to the category of non-living things (Hillis and ments for some non-living categories, such as the
Caramazza, 1991). categories of musical instruments and foods.
4 CHAPTER 1 FOUNDATIONS OF COGNITIVE PSYCHOLOGY
Devlin et al. (2000) combined features of experi- identify regions of the brain that are particularly
mental and neuroimaging methods to investigate active during the performance of a task. Critically,
whether the categories of living and non-living things Devlin et al. found no differences between the cat-
could be associated with representations in differ- egories of living and non-living things in terms of
ent parts of the brain. One technique they used was active regions of the brain in either the PET study or
a lexical decision task. In this task, participants the fMRI study (see Figures 1.1 and 1.2). So the dif-
either hear or see strings of letters (e.g. they might ferences in representation discussed in Box 1.1 may
see the strings ‘warnd’ or ‘world’) and have to judge not be associated with different brain regions (or
whether each string is a word or not. Experimenters perhaps these techniques were not sensitive enough
typically record both the judgement made and the to detect such differences).
amount of time participants take to make their However, Kriegeskorte et al. (2008), examining
response (perhaps by pressing the appropriate but- brain activity both in human volunteers and mon-
ton on a keyboard or response pad). Another task, keys, did find evidence that the brain represents
which Devlin et al. called a semantic categorization categories in different ways. Focusing on the infero-
task, required participants, having seen three words temporal cortex, they found that in both species,
presented one after another, to judge whether a viewing photographs of objects from the same cat-
fourth word belonged to the same category as the egory tended to elicit similar patterns of activity.
first three. Devlin et al. carefully matched words for Moreover, photographs of objects from different
word frequency and letter length. Whilst perform- categories produced different patterns. Using a
ing the lexical decision and semantic categorization technique known as cluster analysis, Kriegeskorte
tasks described above, participants were scanned et al. asked whether the patterns of activity them-
using positron emission tomography (PET) technol- selves showed evidence of a category structure.
ogy. Another group of participants performed the The analysis showed that the patterns could be
semantic categorization task using pictures that grouped according to a distinction similar to, but
were matched for visual complexity; these partici- not the same as, that between living and non-living
pants were scanned using functional magnetic reso- categories. Specifically, they found that both in
nance imaging (fMRI) technology. Both of these humans and monkeys, patterns of activity in the
scanning technologies enable experimenters to inferotemporal cortex were different for animate
FIGU RE 1.1 Results of PET studies using written words in lexical decision and semantic categorization tasks.
Red areas show activated regions. No region showed a significant difference in activation between living and
non-living things. Source: Tyler and Moss, 2001, Figure 1
CHAPTER 1 FOUNDATIONS OF COGNITIVE PSYCHOLOGY 5
(the categories of faces and bodies) and inanimate participants also included examples of non-human
objects (though strangely, the ‘inanimate’ category bodies, such as snakes and a wolf-like creature).
derived from the brain activity of the human See Chapter 14 for further discussion of this study.
FIGU RE 1. 2 Results of fMRI study using pictures of living and non-living things in a semantic categorization task.
The active brain regions are associated with non-living things (a) and living things (b). No regions showed
significant differential activation for living and non-living things. Source: Tyler and Moss, 2001, Figure 2
psychologists employ: experiments, models (including typically study, as, of course, will previous study of
computer models), neuropsychological investigations, psychology. Certainly, the topics of perception, atten-
and neuroimaging (or brain scans). Box 1.2 continues tion, language, categorization, reasoning, problem
the discussion of category-specific impairments and solving, and memory are central to the study of cogni-
describes a study that combines features of experimen- tion. And cognition has broadened to include topics
tal and neuroimaging methods. that have not always been seen as readily amenable to
Box 1.3 describes a study employing cognitive a cognitive approach (e.g. consciousness and emo-
modelling methods to examine category-specific tion). The subsequent chapters will have much more
impairments. to say about these issues than we can here. Activity 1.2
Boxes 1.1 to 1.3 illustrate some of the methods that provides another way of thinking about the topics that
will be referred to throughout this book, and about interest cognitive psychologists.
some of which we will say more later. But, perhaps more Activity 1.2 shows how everyday behaviour can be
obvious than any of these issues, Activity 1.1 raises the explained in a number of different ways, involving
question of the subject matter of cognitive psychology. many different kinds of cognitive process. In fact, all
What is it that cognitive psychologists study? of the types of explanation referred to in the comment
An easy way of answering this question (and one on Activity 1.2 are ones that will be developed at some
you might have adopted for Activity 1.1) is by scan- length in this book. However, a corollary of the obser-
ning this book’s table of contents. This will give you vations made in Activity 1.2 is that cognitive psychol-
a good idea of the topics cognitive psychologists ogists try to devise studies that isolate the particular
6 CHAPTER 1 FOUNDATIONS OF COGNITIVE PSYCHOLOGY
120
100
Shared properties of non-living things
80
% error
60
40
20
Shared properties of living things
0
0 10 20 30 40 50 60 70 80 90 100
% semantic connections lesioned
FIGU RE 1.4 The results of ‘lesioning’ the model to simulate brain damage. As predicted by Greer et al., the
shared properties of living things were better preserved than the shared properties of non-living things, owing to
the greater correlations between them. Source: Tyler and Moss, 2001, Figure 11, p.249
CHAPTER 1 FOUNDATIONS OF COGNITIVE PSYCHOLOGY 7
ACTIVIT Y 1.2
At this moment your behaviour involves getting book – perhaps faced with different ways of spending
information from this book. Your eyes may be scan- your time, you judged that this would be the most
ning across the page and detecting patterns of col- beneficial (we’ll try not to let you down!). You might
our and light and shade, or, if you are listening to this have thought that there are processes going on in
book on audio CD or it is being machine-read from your mind to do with reasoning, problem solving, and
an electronic copy, your ears will be detecting sound decision making.
waves of varying intensity and pitch. Your behaviour It might be that you are reading this chapter for a
can also be seen in a wider context: it is just one second time because you want to make sure you
aspect of what is involved in studying psychology. remember it. So, your explanation adverts to memory
Take a few minutes to jot down your explanation for and the processes that are responsible for things
your behaviour – if someone were to ask why you being remembered (and forgotten).
are behaving in this way, what would your answers How else might you have explained your behav-
be? Try to think of as many different ways of answer- iour? You might have suggested that you were trying
ing the question as you can. Also list any processes to understand the chapter; that you behaved the way
that you think might be going on in your mind – how you did because you were involved in understanding
would you describe them? words, phrases, and sentences. You may have indi-
cated that there must be processes for understanding
COM M ENT
language. Perhaps there were other explanations you
The first thing to note is that your behaviour can be
offered. Maybe you explained your reading of the
explained in many different ways. For example, you
book by saying ‘That is what books are for’ – because
might have noted that your reading is bound up with
you categorized it as a book. Maybe you suggested you
a feeling of elation – perhaps you love studying cogni-
were scanning your eyes across the page in order to
tive psychology – or a feeling of anxiety – perhaps you
perceive and recognize words. And, just maybe, you
are uncertain of obtaining a good course grade. Your
suggested that your behaviour was happening
explanation adverts to emotions. Perhaps you jotted
because you were paying attention and not being dis-
down as an answer that you reasoned that you ought
tracted by a telephone or a doorbell.
to read this book since you want to do well on
The words in emphasis in the previous paragraphs
your course. Perhaps doing well on your course is
all provide important means for explaining behaviour
part of a strategy to reach a goal, or solve a problem
that are used by cognitive psychologists, and are all
such as how to improve your qualifications. You might
major topics of this book.
also have suggested that you decided to read this
cognitive processes under investigation. For example, to 1.3 try to focus exclusively on the issue of category
a researcher interested in language processing will try specificity. Indeed, it is a general strategy within cog-
to devise their studies so that they measure language nitive psychology to try to isolate particular cognitive
processes only and are not unwittingly influenced by processes for further investigation. Table 1.1 lists
other processes, such as emotion or reasoning. some prevalent assumptions that this strategy gives
Consider also how the studies referred to in Boxes 1.1 rise to.
8 CHAPTER 1 FOUNDATIONS OF COGNITIVE PSYCHOLOGY
1 Cognitive capacities can be partitioned so that individual capacities can be studied in isolation (e.g. so that language can be
studied in isolation from memory)
2 Cognitive psychology tends to focus on the individual and their natural environment (relatively de-emphasizing the roles of
culture and society)
3 Cognitive capacities are relative autonomous when compared with non-cognitive capacities (e.g. affect, motivation, etc.)
4 It is useful (and meaningful) to distinguish ‘normal’ from ‘abnormal’ cognition
5 Adults are sufficiently alike that we can talk of a ‘typical’ cognizer, and generalize across cognizers, ignoring individual
differences
6 Answers to basic, empirical questions can be given in terms of information processing
7 Answers to basic, empirical questions should be justified on empirical grounds
8 Answers to the basic, empirical questions must be constrained by the findings of neuroscience (as and when these are
relevant)
SUMMARY OF SECTION 2
• Cognitive psychology can be characterized as the scientific study of the mind.
• Cognitive psychology can be characterized in terms of its methods:
– experimental studies of normal cognition
– neuropsychological studies that relate normal to abnormal cognition
– neuroimaging studies that reveal the location and/or the time course of brain activity
– computational models that can be tested and compared with experimental data.
• Cognitive psychology can be characterized in terms of its subject matter (see the table of contents
for this book).
• Everyday behaviour involves multiple cognitive processes:
– cognitive studies tend to isolate one process or set of processes for study.
century by such people as Donders, Fechner, themselves. Put simply, the Liepzig school held
Helmholtz, and Mach. When Wundt established the that the contents of consciousness are constructed
first dedicated psychology laboratory in Liepzig in ‘bottom-up’ from simple sensations combined in
1879, he sought to build upon the efforts of these pio- accordance with the strength of associations between
neers. He took consciousness to be the proper subject them (something like the connectionism you can read
matter of psychology. According to Wundt, physical about in Chapters 4, 19, and 20, and elsewhere). The
scientists study the objects of the physical world either Würzburg school, on the other hand, held that the
directly or, more often, through observation of the contents of consciousness are determined in a much
readings on instruments. In either case, observation is more ‘top-down’ fashion by the nature of the task that
mediated by conscious experience, but for physical one is engaged upon. Külpe and his colleagues some-
scientists things in the world are the object of study, times studied simple tasks, but tended to favour more
not the conscious experience by means of which we complex ones in which mental acts such as attending,
know them. Psychology would be different in that it recognizing, discriminating, and willing played a
would take as its subject matter conscious experience larger role.
itself. Introspectionism went into a terminal decline dur-
Wundt adopted introspection as a research method, ing the first two decades of the twentieth century. The
believing that properly trained psychologists should details of the many unresolved disagreements between
be able to make observations of their own experience the two schools of introspectionism need not detain
in a manner similar to the way that properly trained us here, but it is worth noting two things. First, the
physicists make selective observations of the world. introspectionists developed elaborate classifications of
Wundt fully understood the need to design experi- conscious experience, a topic that has quite recently
ments with adequate controls and produce replicable begun to attract the attention of psychologists once
results. He also made use of objective measures of per- again (see Chapter 18). Second, although psycholo-
formance, such as reaction time (RT). The focus of his gists began to lose interest in consciousness during
interest, however, was the conscious experience that those two decades, the exploration of consciousness
preceded the response. For example, if one condition still remained central to developments in the visual
in an experiment yielded longer RTs than another, he and literary arts (e.g. cubism and expressionism in
wanted to know how the two preceding conscious painting, and James Joyce, Virginia Woolf, and
experiences differed. Wundt was not concerned with Gertrude Stein in literature).
the unconscious processes involved in responding to a
simple stimulus – the rapid information-processing
operations that, as you will find in the following chap- 3.2 Gestalt psychology
ters, form much of the subject matter of modern cog-
nitive psychology. He considered these to lie in the The perceived failures of introspectionism provoked a
realm of physiology rather than psychology. number of intellectual reactions. In Europe, the Gestalt
In opposition to Wundt’s Liepzig school was the psychologists built upon the work of the Würzburg
Würzburg school of introspection. Its leader, Külpe, school and argued that the contents of consciousness
was a former student of Wundt’s, who with his col- cannot be analysed into simple component sensations.
leagues and students developed an alternative view of According to Wundt, the perception of movement
conscious experience and what could be revealed by results from a sequence of sensations corresponding to
introspection. We can characterize the main differ- an object occupying successive locations over time.
ence between the two schools in terms of a distinction However, Wertheimer argued in 1912 that ‘pure move-
that will be more fully introduced in Chapter 3 in rela- ment’ can be perceived directly; it does not have to be
tion to the topic of perception, although the prota- ‘inferred’ from changes in the location of an object. A
gonists would not have used these exact terms good example is when we see the wind gust through
10 CHAPTER 1 FOUNDATIONS OF COGNITIVE PSYCHOLOGY
grass. Blades of grass bend in succession but no blade areas. Not all behaviourists were as zealous as Watson
changes location. What we perceive is pure motion (of when it came to applying psychology, but one belief
the invisible wind) without a moving object. (Modern they did have in common was that psychology should
studies show that motion perception can, in fact, arise be scientific and objective; by this they meant that its
either on the basis of the changing location of an object subject matter should be as publicly observable as pos-
or from successive changes across space without a sible. Consciousness is (at best) only privately observ-
moving object.) Gestalt psychologists also emphasized able. What can be publicly observed are stimuli,
the importance of the perception of stimulus pattern- behaviour, and reinforcers. So psychologists such as
ing to our conscious experience. A tune played in one Thorndike, Watson, and later Skinner, Eysenck, and
key on one sort of instrument remains the same tune others argued that psychology should be scientific in
when played in another key or on a different instru- its approach, and should seek to explain behaviour
ment. Since the notes, or the sounds making up the through reference mainly to such observables. We say
notes, have changed, there must be more to the tune ‘mainly’ because it is impossible to convey briefly all
than can be found by an analysis into simple auditory the complexities and nuances of the varied schools of
sensations. The tune is in the perceived relationships behaviourism. For example, Eysenck’s theory included
between the notes, their patterning. individual differences in a biologically rooted propen-
Meanwhile, in the USA, William James opposed sity to seek or avoid stimulation. Nevertheless, the
introspectionism with his ‘functionalist psychology’. behaviourist emphasis on public observation was
Sounding remarkably like an exponent of what is now intended to place psychology on an objective footing,
called evolutionary psychology, James stated that, akin to the natural sciences like physics and chemis-
‘Our various ways of feeling and thinking have grown try, and it reflected a wider philosophical consensus as
to be what they are because of their utility in shaping to the proper nature of scientific enquiry.
our reactions to the outer world’. These functions of
the mind were, in James’s view, the proper subject 3.3.1 Science and the unobservable
matter for psychology. Perceiving and thinking, grief In all human efforts to comprehend the world there is
and religious experience, as psychological functions, a tension between on the one hand observable events,
were themselves to be the focus of interest, rather than and on the other hand the often encountered need
the evanescent contents of consciousness on which when explaining them to postulate unobservable the-
the introspectionists had fixated. However, James’s oretical entities and forces, whether gods or atoms.
ideas were soon to be largely swept aside by another This tension is central to science. A key idea in the
more powerful current in US thought: behaviourism. development of science has been that knowledge
should be empirical, based on experience and not on
received wisdom or purely rational calculation.
3.3 Behaviourism Observation is one of the touchstones of science, but
scientific theories also refer to unobservables. The
The founders of behaviourism were driven by various explanation that physics offers for an apple falling to
motives, not all shared in common. Watson, the prin- Earth invokes the notion of a gravitational force,
cipal standard-bearer for the new kind of psychology, something that is not directly observable. Similarly, in
was especially keen to move psychological research explaining why a compass needle points to magnetic
out of the laboratory and into ‘the real world’. He was north, physicists talk of magnetic fields and lines of
less interested in fine distinctions of conscious experi- magnetic force. But these things too are unobservable.
ence than in how people act in everyday life, and how If you have ever placed iron filings near a magnet you
they can be influenced. He wanted to see psychologi- will have seen that they move to orient themselves
cal knowledge applied to education, clinical problems, along the lines of the magnetic field. But, strictly, we
and advertising, and he initiated work in all these don’t observe the magnetic field or the lines of
CHAPTER 1 FOUNDATIONS OF COGNITIVE PSYCHOLOGY 11
magnetic force, but rather their influence upon the crisis of classical physics that would culminate in the
iron filings. All natural sciences employ unobservable, birth of quantum theory and relativity theory, the late
theoretical constructs that are invoked in order to nineteenth and early twentieth century was a period
explain observations. For example, chemistry appeals during which scientists were particularly intolerant of
to notions such as the energy levels of electrons in unobservables. The importance of observation became
order to explain why compounds react. These levels enshrined in the assumption known as operationism.
are unobservable too, of course. So, the fact that a dis- This is the idea that theoretical concepts are only
cipline is committed to explaining observed behaviour meaningful to the extent that they can be exhaustively
by reference to hypothesized, unobservable constructs analysed in terms of things that can be observed.
does not in itself render the discipline unscientific.
However, to find scientific acceptance, unobserva- 3.3.2 Back to behaviourism
ble constructs have to be seen to do useful theoretical The bias against unobservables affected all the tradi-
work. When Newton proposed the notion of a gravita- tional sciences and also the newer, aspirant scientific
tional force, certain critics immediately accused him disciplines such as physiology and psychology. The
of introducing a mystical notion into ‘the new science’. introspectionists, with their ‘observations’ of conscious-
Newton’s ideas gained acceptance only because they ness, had responded to it, but the intellectual climate
met other scientific criteria – such as elegance, sim- seems to have been especially suited to propagating an
plicity, and rigour – and because the concept of gravi- emphasis on what could be publicly observed. With the
tation, despite its somewhat mysterious nature, had a decline of introspectionism, behaviourism was taken up
wide range of applications. Gravitation explained not enthusiastically, first in the USA and then more widely.
just the fall of objects to the ground but also the While behaviourists could, perhaps, concede the
rhythm of the tides and the movements of the planets. existence of consciousness while arguing that it was not
It could also be precisely formulated mathematically appropriate for scientific study, at least some of them
as an inverse square law: the attraction between any felt that operationism committed them to the stronger
two bodies is proportional to the square of the dis- claim that talk of consciousness was not even mean-
tance between them. In other words, the willingness ingful. Of course, behaviourism has never been a sin-
of the scientific community to countenance a hypo- gle view, and since the time of Watson and Thorndike
thetical unobservable depends on how useful it is behaviourists of various hues have modified their posi-
judged to be on a range of criteria. tions. Skinner, for example, conceded that internal
Science has had to live with the necessity for unob- mental events, including conscious experiences, might
servables. But acceptance through necessity is not the exist (indeed they were construed as forms of covert
same as liking, and science always receives a boost behaviour). But despite this rejection of operationism,
when a technical breakthrough brings a previously even Skinner still thought that talk of internal events
unobserved entity into the realm of observation for the should be avoided within a scientific psychology.
first time. For example, Mendel postulated ‘units of You might think that avoiding talk of internal
heredity’ on the basis of his plant-breeding observa- events might make it impossible to explain many, or
tions, but these ideas were felt to be on a firmer footing even most, psychological phenomena. However,
once new technology made it possible to see chromo- behaviourists were concerned to show how even com-
somes and genes. Thus, scientists are forced somewhat plex phenomena might be understood in terms of
grudgingly to accept the need for postulating unob- principles of learning, with behaviour seen as being
servables. And because science – like all human insti- made up of learned responses to particular stimuli.
tutions – is subject to swings of fashion, the willingness One view of language production, for example, was
to countenance unobservable theoretical entities that the utterance of a word could be seen as a learned
fluctuates over time. For reasons that we are unable response. The utterance of a whole sentence could be
to describe here, but that were rooted in the growing seen as involving a chain of stimulus–response pairs,
12 CHAPTER 1 FOUNDATIONS OF COGNITIVE PSYCHOLOGY
in which each response (the utterance of a word) also tennis players adjust their whole posture in response
serves as the stimulus that leads to the production of to an incoming fast service. Lashley’s alternative to the
the next response (the next word). chaining of behaviour segments was to suppose that
Despite the possibility of giving behaviourist explana- complex sequences are planned and organized in
tions of complex activities such as the utterance of a sen- advance of being initiated. The speech errors dis-
tence, behaviourists tended not to offer accounts of what cussed in Chapter 7 of this book provide especially
we now refer to as higher mental processes – processes compelling examples of the kind of planning and
such as producing and understanding language, plan- organization that underlie skilled behaviour.
ning, problem solving, remembering, paying attention, Lashley’s view that behaviourism could not properly
consciousness, and so on. As the years passed, however, explain how people produce (or comprehend) lan-
some psychologists came to see this as a major failing. guage was later reinforced by a review of Skinner’s
book Verbal Behavior (1957) by the linguist Noam
Chomsky (1959). Chomsky argued, contra behaviour-
3.4 The return of the cognitive ism, that language could not be thought of as a set of
learned responses to a set of stimulus events. His argu-
In 1948, at a meeting known as the Hixon symposium, ment had a number of different aspects. For example,
Karl Lashley gave a talk entitled ‘The problem of serial he argued that children seem to acquire their first lan-
order in behaviour’ (Lashley, 1951). In this, he gave guage too effortlessly – if you have tried to learn a sec-
prominence to the problems posed for behaviourist ond language you can perhaps testify to the difference
accounts by complex actions in which behaviour seg- between learning a first and learning a second lan-
ments are somehow linked together in a sequence, guage. While the latter seems to require intensive and
and where two segments depend upon one another effortful study, the former is something that pretty
even though they may be separated by many interven- much everyone does without the need for formal
ing segments. Language, as you might have guessed, schooling. He also argued that if the behaviourists
provides a prime example. In fact, the last sentence were right, then exposing children to impoverished or
illustrates the point nicely: when I came to write the ungrammatical language should hinder their learning
word ‘provides’ in the previous sentence I chose to end of the correct stimulus–response relationships. Yet
it with the letter ‘s’. I did so, of course, because this studies show that much of the speech to which young
verb has to agree grammatically with the singular children are exposed is indeed ungrammatical and
noun ‘language’, the subject of the sentence. In my otherwise impoverished, and this in no way prevents
actual sentence, these two words were separated by a them from learning the grammar of their native
clause, and so my action at the time of writing the tongue. Similarly, Chomsky argued that general intel-
word ‘provides’ depended upon a much earlier behav- ligence ought to influence the learning of stimulus–
iour segment – my writing of the word ‘language’. response relationships. Again, however, intelligence
Lashley argued that since the production of some does not seem to influence whether or not children
words in a sequence could be shown to depend upon learn the underlying grammatical rules of their lan-
words produced much earlier, the simple view that guage. Chomsky presented many other arguments to
each word is the stimulus that produces the subse- the same effect, and though many of these have been
quent word as a response could not properly explain thought to be contentious, his position was extremely
language production. influential in setting up an alternative, cognitive
He also argued that many behaviour sequences are conception of language. Most significantly, Chomsky
executed simply too rapidly for feedback from one proposed that language is rule-based and that, far from
segment to serve as the trigger for the next. He cited children learning language by learning how to respond
examples such as the speed with which pianists and to particular stimuli, their acquisition of language
typists sometimes move their fingers, or with which involves acquiring its rule-base. On this view, my being
CHAPTER 1 FOUNDATIONS OF COGNITIVE PSYCHOLOGY 13
able to write grammatical sentences involves deploying were influencing the ability of scientists to conceptual-
my (generally implicit, or unconscious) knowledge of ize the workings of complex systems. One of the most
the rules of language. In referring to such implicit crucial issues related to the type of causal explanation
knowledge, Chomsky proposed that an understanding that is appropriate to explain the behaviour of such a
of how people produce, comprehend, or acquire lan- system. Purposive, or teleological, explanations had
guage will necessarily involve reference to something been taboo in Western science since the time of think-
that cannot be directly observed – their knowledge of ers such as Galileo and Newton. Where, for example,
the underlying rules, or organization, of the language. an ancient Greek philosopher might have said that a
Although this emphasis on the role of planning, stone falls to Earth ‘in order to’ reach its natural rest-
organization, and rules in the generation of behaviour ing place at the centre of the Earth (which was also the
was to be hugely influential from the 1950s onwards, centre of the Greek universe), Newton said that the
these ideas were certainly not new to psychology. As stone falls because it is acted upon by the force of grav-
mentioned previously, the Gestalt psychologists had ity. The strategy of explaining phenomena in terms of
drawn attention earlier in the century to the impor- causes that precede and ‘push’ their effects, rather than
tance of patterning, or organization, for perception, and in terms of goals or final states towards which events
the same point was also made in relation to action. are ‘pulled’, had proved highly successful in the physi-
Someone who has learned to sing or hum a tune can cal sciences. The move from goal-directed, purposive
very probably manage to whistle it thereafter. Yet sing- explanations to mechanical cause-effect explanations
ing, humming, and whistling call for very different was usually considered to be a move from pre-
sequences of muscle movements. This indicates that scientific, animistic thinking to proper scientific
learning a tune must involve learning a set of abstract thinking. Behaviourism was, and still is, an attempt to
relationships between notes, which can be instantiated bring psychology into step with this way of analysing
as any of a variety of muscular productions. A similar phenomena. A strict emphasis on an organism’s his-
idea, that what is learned must often be more abstract tory of conditioning allows an explanation of behav-
than straightforward stimulus–response connections, iour in terms of prior causes rather than future goals.
was also expressed by the school of ‘cognitive behav- However, the development of progressively more
iourists’ associated with Tolman (1932). Rats that had complex artificial devices started to call into question
learned, for example, to turn left repeatedly in a maze to the universal applicability of explanations in terms
find food were shown to swim left when the maze was only of prior causes. It became increasingly clear that,
flooded. Since the muscle movements of running and while the functioning of the mechanical parts of any
swimming are completely different from one another, such system can be explained in cause-effect terms,
the rats must clearly have learned something more such explanations will never capture the function
abstract than a particular chain of muscular responses. (or purpose) of the whole system.
Even before the writings of the Gestalt psycholo- Central to the new kind of apparently purposive
gists or the work of Tolman, psychologists studying machines (known as servomechanisms) was a reliance
the acquisition of skills had realized the importance of on feedback loops. Feedback is information about the
planning and organization for the production of match or mismatch between a desired goal-state and
skilled behaviour, such as in Morse telegraphy or an existing state of affairs. The classic example is the
typing (Bryan and Harter, 1899). At the time of the domestic central heating system, in which the thermo-
Hixon symposium, therefore, there were already exist- stat setting selected by the householder is the goal-state
ing traditions within psychology upon which the and the temperature measured by an air thermometer
renewed interest in the planning and structure of is the existing state. The two are compared mechani-
behaviour could draw. And of course, the intellectual cally. If the existing temperature is less than the desired
climate of the mid-twentieth century was changing temperature, this negative feedback is transmitted to
rapidly in many other ways too. New technologies the boiler controls causing the boiler to be switched on.
14 CHAPTER 1 FOUNDATIONS OF COGNITIVE PSYCHOLOGY
The boiler continues to fire until information has been position. Apply too much force and the gun will over-
fed back to the boiler controls that the discrepancy shoot and will have to be pulled back, in what can turn
between the actual and desired temperatures has been into a series of increasingly wild oscillations. Engineers
eliminated. The system as a whole exhibits a simple but discovered that the smoothest performance was
dynamic behaviour, with the boiler turning on and off achieved by using feedback loops to dynamically con-
in a manner that maintains room temperature at or trol the turning force applied to the gun.
about the desired level. Importantly, the function of Weiner, and other cyberneticists such as Ashby,
maintaining a steady temperature cannot be localized recognized the importance of feedback and self-
to any one component of the heating system, such as correction in the functioning of these new and complex
the thermostat, the thermometer, the boiler, or its con- technological devices, and they also saw analogies with
trols, but is a property of the system – as a whole. complex natural systems. Weiner drew parallels between
Far more complicated servomechanisms with more the effects of certain neurological conditions and damage
complex feedback controls were also being developed. to the feedback control of behaviour. For example, the
Anti-aircraft gunnery may not seem very pertinent to tremors observed in Parkinsonian patients were likened
an understanding of animal and human behaviour, but to the oscillations of an anti-aircraft gun when its move-
it was partly as a result of working on gunnery prob- ment is insufficiently ‘damped’ by feedback control.
lems in the Second World War that the mathematician An important intellectual leap for cognitive psy-
Norbert Weiner developed the notion of ‘cybernetics’, chology came with the realization that just the same
the science of self-governing, or goal-directed, sys- kind of analysis can be applied at any level of behav-
tems. Accurate anti-aircraft gunnery requires that a ioural control. In other words, it is not just automatic
projectile is fired and timed to explode not at the pre- homeostatic functions or unconsciously executed
sent location of the target aircraft, but at its future loca- movements that can be analysed in terms of feedback
tion. This means not only predicting the future position loops, but any function/behaviour from the wholly
of the plane but also rotating the gun so it faces in the non-conscious to the fully conscious and intended.
appropriate direction and with the correct elevation. Miller et al. (1960) developed the notion of feedback
Clearly, humans successfully extrapolate flight paths control into the hypothesis that behaviour (of animals,
and aim at future positions when, for example, shoot- humans, or machines) can be analysed into what they
ing game birds. However, for planes flying at ever called TOTE units. TOTE stands for Test-Operate-
greater heights and speeds, calculation of the necessary Test-Exit. A test is a comparison between a current
trajectory of the projectile exceeds human capabilities state and a goal-state. If a discrepancy is registered,
and must be computed automatically. Moreover, using some relevant operation intended to reduce the dis-
motors to move a gun weighing many tons is a very crepancy will be performed (e.g. switch on the boiler).
different matter from moving a shotgun, or indeed a A second test, or comparison, is then conducted. If a
bow and arrow, held in your arms. Although we are discrepancy remains, the operation can be repeated,
mostly unconscious of it, normal bodily movement is followed by another test. If the discrepancy has been
based upon continuous muscle, tendon, and visual eliminated, the system exits the TOTE unit.
feedback about how the movement is proceeding. Miller et al. conceived of the TOTE unit as an advance
Unless similar feedback is designed into the gun con- on the conditioned reflex notion of Pavlov and the con-
trol system, the swinging anti-aircraft gun may easily ditioned response notion of Watson and Skinner, both
undershoot or overshoot the intended position, par- of which can be conceptualized as TOTEs. The aim was
ticularly as, depending on the air temperature, the to develop a unit of analysis of behaviour that could
grease packed round the mechanism will be more or apply to everything from a dog’s conditioned salivatory
less ‘stiff ’. Apply too little power and the gun will response to deliberate, planned action. The TOTE pro-
undershoot the intended position, a second push vides a basic pattern in which plans are cast; the test
will be required, and the gun will ‘stutter’ towards its phase specifies what knowledge is necessary for a
CHAPTER 1 FOUNDATIONS OF COGNITIVE PSYCHOLOGY 15
comparison to be made, and the operation phase speci- In parallel with these developments, the 1930s and
fies what the organism does about the outcome of the 1940s saw pioneering theoretical developments in
comparison. Although this scheme makes it possible to computation and information processing. Turing, in
talk about purposive behaviour and about unobservable 1936, developed an abstract specification for a
goals and comparison operations, there is continuity machine (a Turing machine) that could compute any
from behaviourism. Cognitive psychology generally function that in principle could be computed. In the
attempts to retain the scientific rigour of behaviourism 1940s, Shannon and Weaver used the tools of mathe-
while at the same time escaping from the behaviouristic matics to propose a formal account of information
restrictions in relation to unobservables. and of how it could be transmitted.
An important property of TOTEs is that they can be Technological progress was also rapid. In 1941,
nested within hierarchies. The operation segment of Konrad Zuse of Berlin developed the world’s first pro-
any TOTE can itself be composed of one or more TOTE grammable, general-purpose computer. In 1943,
units. For example, the TOTE for starting the car might Colossus, a special-purpose computer designed to
be nested within the operation of a larger TOTE for break wartime codes, became operational at Bletchley
driving to the shops, which might itself be nested within Park in Buckinghamshire. In 1946, John von Neumann
a still larger unit having the goal of buying a present. articulated a set of architectural proposals for design-
This nesting of feedback loop units provides a way to ing programmable, general-purpose computers. These
conceptualize how behaviour can be complexly struc- were adopted almost universally and computers have
tured. In this scheme, moment-to-moment control of since also been known as von Neumann machines. In
behaviour passes in sequence between a series of TOTE 1948, the Manchester University Mark I programma-
goal-states, with the TOTE units themselves nested in ble, general-purpose computer became operational,
hierarchies. Miller et al. explicitly likened this ‘flow of and in 1951, Ferranti Ltd began producing, selling,
control’ of behaviour to the way in which control in a and installing versions of the Manchester Mark I – the
computer program switches in orderly fashion from world’s first commercially available, programmable,
command line to command line as the execution of any general-purpose computer.
particular sub-routine is completed. (Note: what ‘flows’ These developments, fascinating though they were in
around a TOTE can be energy, information, or, at the their own right, also seemed to carry important impli-
highest level of conceptual abstraction, control.) cations for our understanding and study of the mind.
They appeared to show, for instance, that reasoning, a
3.4.1 Computers and the mind central feature of the human mind, could be imple-
Another development in the mid-twentieth century mented in a digital computer. If that were the case, then
with a huge import for the development of cognitive not only could the computer be used as a tool to aid our
psychology was the opening up of a new field con- understanding of the mind, but the question would also
cerned with the possibility of designing and then arise as to whether minds and computers are essentially
building computers. Building on earlier work that alike. Indeed, in 1950 Turing proposed a test – the
developed a formal or mathematical approach to logi- Turing test – by which he thought we should judge
cal reasoning, Claude Shannon in 1938 showed how whether two entities have the same intelligence. Turing
core aspects of reasoning could be implemented in believed that, should the situation ever arise whereby
simple electrical circuits. In the 1940s, McCulloch and we could not distinguish the intelligence of a human
Pitts showed how it was possible to model the behav- from the ‘intelligence’ of a computer, then we ought to
iour of simple (and idealized) neurons in terms of concede that both were equally intelligent. Moreover,
logic. Taken together, these developments suggested since we are in agreement that humans are capable of
something that at the time seemed extraordinary – thought, we ought to concede that computers are also
that the brain’s activity could, at least in principle, be capable of thought! Box 1.4 outlines the Turing test and
implemented by simple electrical circuits. considers what it might take for it to be passed.
16 CHAPTER 1 FOUNDATIONS OF COGNITIVE PSYCHOLOGY
BOX 1.4 RESEARCH STUDY The Turing test: can computers think?
Turing proposed that we could determine whether human behaviour). C wins the game if A cannot reli-
a computer can think by judging whether it succeeds ably identify C as the computer. Turing’s claim was
in what he called the imitation game. In the game that if a computer could simulate human behaviour
there are three participants, two humans (A and B) so successfully that another human could not tell
and a computer (C). The arrangement of the par- that it was a computer, then the computer could
ticipants and the communication flow between legitimately be said to think.
them is schematically indicated in Figure 1.5.
The participants are positioned in separate rooms,
so each one is unable to see, hear, or touch the oth- B C
ers. However, one of the human participants (A) is
connected via a VDU terminal connection to the
other human participant (B) and also to the com-
puter (C). A can communicate electronically with
both B and C. The goal for A is to ascertain which of A
B and C is the computer and which is the human. The
goal of B, the other human, is to assist A in making
the correct identification (perhaps by trying to appear
as human as possible). C’s goal, by contrast, is to lead FIGU RE 1. 5 The arrangement of the participants in
A into making the wrong identification (by imitating Turing’s imitation game.
Turing’s position remains controversial, of course, processes govern the behaviour we observe. Each
though it certainly captured the imagination of the chapter will also consider the extent to which we
time. In 1956, at the Dartmouth Conference (held in understand how the mind processes information, and
Dartmouth, New Hampshire), John McCarthy coined how that information is represented. Cognitive psy-
the phrase ‘artificial intelligence’ (or AI). He founded chology also has a major commitment to the use of
AI labs at MIT in 1957 and then at Stanford in 1963, computers as devices for aiding our understanding of
and so began a new academic discipline, predicated the mind. First, computers are used as research equip-
on the possibility that humans are not the only ones ment to control experiments, to present stimuli, to
capable of exhibiting human-like intelligence. record responses, and to tabulate and analyse data.
You have now been introduced to a variety of the Second, computers are also used as a research tool – if
influences that go to make up cognitive psychology. we can implement reasoning in a computer, for exam-
Cognitive psychology inherits some of the behaviour- ple, we may gain insight into how reasoning might be
ist concerns with scientific method. Throughout this implemented in the brain. So, most of the chapters in
book you will see that almost constant reference is this book will also discuss ways in which researchers
made to systematic observations of human behaviour have used computer models to help us understand
(and sometimes animal behaviour too). Almost every how the mind processes and represents information
chapter will present the results of empirical investiga- when people perform certain behaviours. Third, and
tions, and these are fundamental in guiding our more controversially, computers are also considered
understanding. But cognitive psychology rejects the to be candidate ‘thinkers’ in their own right.
exclusive focus on what is observable. As Chomsky Understanding more about the nature of computation
implied, understanding the mind requires us to con- itself may shed light on the nature of thinking and on
sider what lies behind behaviour – to ask what rules or the nature of the mind.
CHAPTER 1 FOUNDATIONS OF COGNITIVE PSYCHOLOGY 17
SUMMARY OF SECTION 3
• Cognitive psychology inherits some of the behaviourist concerns with scientific method. Almost
every chapter in this book presents the results of empirical investigations, investigations that are
fundamental in guiding our understanding.
• Cognitive psychology rejects an exclusive focus on what is observable. Almost every chapter consid-
ers the extent to which we understand how the mind processes information and how that informa-
tion is represented.
• Cognitive psychology is committed to using computers as a tool for aiding our understanding of the
mind.
• Introspectionist and Gestaltist interest in conscious experience was replaced by the behaviourist
focus on what is publicly observable.
• There is always a tension in science between the emphasis on observation and the need to postulate
unobservable theoretical entities.
• Behaviourists did not necessarily deny the importance of higher mental functions but rarely offered
accounts of them.
• Cognitive psychology has many roots; it has been heavily influenced by technological developments
and the way they help us to understand complex behaviours.
just the starting point. The challenge for cognitive psy- one person to hold all the relevant details in mind.
chologists has been to say more. They have to develop This problem affects others too – meteorologists
models of these mental structures and processes, show increasingly use computer models of weather
how they give rise to the observed behaviour, and, systems and economists use computer models of
importantly, show how successfully they predict the economy. The phenomena involved are so
behaviour that has not yet been systematically studied complicated that, without computers, they would
in experiments. be almost impossible to model.
Developing a model is not easy; Newton apparently 2. It is not always easy to work out the predictions of
needed the inspiration provided by an apple falling to a model. Programming a model can allow
Earth (or so the story goes). And much of the chal- researchers to simulate the effects of different
lenge facing cognitive psychologists is to harness their conditions and so find out how the model
creativity and imagination in order to suggest plausi- behaves, and whether this behaviour accurately
ble models. Throughout your reading of this book, predicts how humans will behave.
you might wish to consider how you would have
3. Perhaps most important of all, by programming
responded to some of the problems described. You
a model into a computer researchers can
might want to consider what would constrain your
determine whether the model is internally
choice of model, what kinds of model you would have
consistent (whether there are statements in the
developed, and how you would have set about doing
model that contradict one another) and whether
this. Without doubt, these are difficult questions – so
the model is already clearly and precisely stated.
don’t lose too much sleep over them! – but they at least
If it is, the computer program will run;
serve to show how creative cognitive psychology is.
otherwise, it will crash.
The matter of devising studies in order to evaluate a
model is also creative. By working out the predictions So cognitive psychology can posit the existence of
a model might make, psychologists can evaluate it by unobservable (cognitive) processes and structures and
devising studies to test its predictions and by then still be scientific. Not only is this true of other disci-
making the relevant behavioural observations. plines like physics and chemistry but, like those disci-
Creating models and designing studies to test them plines, the gap between observable behaviour and
is not easy, but cognitive psychologists can use com- unobservable processes and structures can be bridged
puters to help. The previous section suggested two via the creation and evaluation of models.
ways in which computers are important to cognitive There is, however, a new possibility for linking
psychology other than as experimental equipment – cognitive processes with a focus on observation, and
computers might be capable of thought, and they can this leads to the third answer to the question with
also serve as tools for implementing models such as a which this section began. The advent of new tech-
model of language processes. Now, perhaps, you can niques for imaging the brain suggests that, just pos-
see how they might contribute to the scientific objec- sibly, mental processes and structures may not be
tives of cognitive psychology – researchers can use entirely unobservable (as the behaviourists once
computers in order to create models. Just as computer believed).
programmers can build programs to do things such as Functional MRI studies (and other kinds of imag-
word processing or financial accounts, so researchers ing) allow us to see which parts of the brain become
in cognitive psychology can program computers to especially active when people are engaged in a certain
behave according to a particular model of the mind. task (relative to when they are engaged in some
Using computers to program particular models can be control task or tasks). There is considerable debate in
helpful on a number of counts: the cognitive community as to the usefulness of imag-
ing techniques for helping researchers to develop the-
1. Models can rapidly become very complicated – ories of cognition. Activity 1.3 will help you get a sense
too complicated to be expressed verbally, or for of the issues involved.
CHAPTER 1 FOUNDATIONS OF COGNITIVE PSYCHOLOGY 19
ACTIVIT Y 1. 3
Consider again the brain images in Figures 1.1 and very much. Seemingly, what is crucially needed is fur-
1.2. First, think about what you could infer from the ther evidence as to what information each brain
images alone. What does the indication of activity in region processes. That is, we need to know the func-
particular brain regions tell you? Second, think tion of the active regions. One way of trying to iden-
about the processes going on inside participants’ tify the function of different brain regions is to
minds. What additional information would you compare brain images for different kinds of task –
need in order to be able to say what the brain activ- regions that are active for all tasks may be implicated
ity represents? Suppose you were given very in information processing that is common to those
detailed anatomical descriptions of the active tasks. This assumes we have good models for the
regions – what would that enable you to conclude? information-processing characteristics of different
tasks. If so, and also using anatomical and neuropsy-
COM M ENT
chological evidence, researchers can then tentatively
It is one thing to say that there is activity in particular
begin to identify particular regions with particular
regions of the brain, but quite another to say exactly
functions. This in turn can help researchers to inter-
what cognitive processes and structures are involved.
pret and design further brain-imaging studies.
An image of brain activity, on its own, does not help
One criticism of imaging studies is that, at best, other visual tasks and that the second task induced
they help researchers to localize a particular function – activity in areas known to be engaged by auditory
that is, researchers can identify the function with a tasks would increase our confidence in the theory.
particular region of the brain – but that they do not Without prejudging the ongoing debate in this area,
improve our theories of cognition. However, this is a it is likely that imaging techniques will contribute to
bit like saying that being able to see chromosomes and cognitive theory in various ways. Sometimes the con-
genes down a microscope does not improve the the- tribution will be at the level of theoretical deduction;
ory of genetic inheritance. In one sense that is true, sometimes it may be at a less palpable level, as when it
but making visible entities that were previously only adds to the confidence in a theory. When genes were
theoretical does increase overall confidence in the first made visible, genetic engineering was a very dis-
theory. Similarly, suppose a cognitive theory says that tant prospect, but it is hard to imagine the latter with-
reading some words involves using a visual processing out the former. The advances in cognitive sciences to
route and reading other words involves using an audi- which neuroimaging will contribute are equally hard
tory processing route. Finding that the first task to predict but we shall be surprised if they do not
induced activity in areas known to be engaged by prove to be many and varied.
SUMMARY OF SECTION 4
• Cognitive psychology can be scientific, while being interested in what goes on, unseen, inside the
mind, for a number of reasons:
– other natural sciences invoke unobservable entities and are not as a consequence rendered
unscientific
– like other sciences, cognitive psychology proceeds by modelling unobservables to produce predic-
tions that can be tested by conducting appropriate studies
– the advent of brain-imaging technology, though undoubtedly contentious, raises the prospect of
observing processes that were previously unobservable.
20 CHAPTER 1 FOUNDATIONS OF COGNITIVE PSYCHOLOGY
act of believing, and a content, namely the content psychologists tend to view the mind as computational,
that Rosie is lazy. Brentano thought that mental states as well as representational.
can differ, even if they involve the same mental act. So, Von Eckardt (1993) suggests that there are two
for example, my believing that Rosie is lazy, and my assumptions involved in construing the mind as com-
believing that all cats are lazy, would represent two dif- putational. First is a linking assumption – the assump-
ferent mental states. The same act is common to both, tion that the mind is a computational device of some
but the beliefs are differentiated by their content: one kind and that its capacities are computational capaci-
is about Rosie; the other is about all cats. ties. The assumption serves to link minds (things that
The consequence for Brentano was that psychology we wish to understand better) with computers (things
needs to consider not only the internal features of the that are already well understood). Second is the sys-
mind or brain, but also what these features are about or tem assumption – this fleshes out what is meant by a
represent in the world. Perhaps now you can see why it computational device. Generally, the assumption
is not straightforward to decide what kind of science tends to be that computers are systems that represent
cognitive psychology is. Whereas physics and chemis- information, input, store, manipulate, and output rep-
try study the material world of atoms and molecules resentations, and which operate according to rules.
(which do not have this representational quality), The two assumptions work together to provide a
cognitive psychology studies mental states whose rep- framework for understanding the (relatively) un-
resentational nature cannot be ignored. Consequently, known mind in terms of the known computer.
cognitive psychology studies something intrinsically Just as with the representational assumption, the
relational – something that spans what is in the mind assumption that minds are computational raises many
and what it relates to in the world. Indeed, the issue of questions. One of the more pressing for cognitive psy-
representation tends to distinguish the social sciences chology has been the precise form that computational
(such as sociology) from the natural sciences (like phys- models should take. This is in fact a major debate
ics). Cognitive psychology, focusing on both what is within contemporary cognitive psychology, and the
represented (the world) and what does the representing issue will be referred to in one way or another in many
(the mind), does not fall neatly into either category. chapters in this book (especially in Chapters 19 and
20). Broadly speaking, there have been two main pro-
posals as to the computational models we should use
5.2 Computation to understand the mind: symbolic models and con-
nectionist models.
In Section 3 we considered some of the technological
and theoretical antecedents to cognitive psychology. 5.2.1 Symbol systems
What emerged from the advances concerning theories One way of understanding the idea that the mind is
of information and computation was the view that both representational and computational has been to
computers process information and provide a means suggest that the mind is a symbol system. In this view
for modelling and understanding the mind. As David the representational qualities of the mind are
Marr put it, ‘If . . . vision is really an information pro- expressed via the claim that the mind is symbolic and
cessing task, then I should be able to make my com- contains symbols. So, for example, my mental state
puter do it . . .’ (Marr, 1982, p.4). that Rosie is lazy might be described as involving
Marr’s statement hints at a deep relation between symbols for Rosie and laziness. The symbols together
the computer and the mind. If computers process represent what the belief is about. To say that the
information, and information processing is what char- mind is computational is to say none other than that
acterizes minds, then perhaps, at some deep level, the the mind embodies (computational) mechanisms for
mind is computational. This claim provides a further manipulating these symbolic representations. My
key assumption of the cognitive approach: cognitive believing that Rosie is lazy would then involve my
22 CHAPTER 1 FOUNDATIONS OF COGNITIVE PSYCHOLOGY
appropriately manipulating the symbol for Rosie Connectionist models typically draw their inspi-
and the symbol for laziness. ration from some of the known characteristics of the
Newell and Simon (1976) were the first to propose brain. So, for example, we know that neurons are
that the mind is a symbol system. In their view, sym- highly interconnected. Seemingly they can pass
bolic representations and their manipulation are the information on to neurons with which they are con-
very building blocks of intelligent thought and action. nected either through inhibiting or enhancing the
Newell and Simon proposed many different proper- activity of those neurons. They appear to be able to
ties of symbol systems but we need consider only a process information in parallel – neurons are capa-
few. Symbol systems should comprise a basic set of ble of firing concurrently. And there are many
symbols that can be combined to form larger symbol more properties besides. Connectionism describes
structures (just as the symbols for ‘Rosie’ and ‘lazy’ attempts to build models of cognition out of building
could be combined to form the symbolic expression blocks that preserve these important properties of
‘Rosie is lazy’). Symbol systems should contain pro- neural information processing. Typically, researchers
cesses that operate on symbol structures to produce simulate connectionist networks on a computer, net-
other symbol structures. Finally, symbol structures works that involve a number of layers of neuron-like
should represent, or be about, objects. computing units. The appeal of connectionism lies in
Newell and Simon’s proposal that the mind is a sym- the hope that connectionist models may ultimately
bol system amounts to the claim that the cognitive pro- stand a better chance of being successful models of
cesses that underlie language, perception, memory, cognition.
thinking, categorization, and problem solving will ulti- Consider the process of constructing symbolic and
mately turn out to involve processes of manipulating connectionist models in the area of language under-
and transforming symbolic representations. The pro- standing, for example. A symbolic modeller might
posal is, of course, an empirical one, and in principle first seek to understand the representations involved
the evidence could turn out either way. One way of in understanding language. They might posit sym-
addressing the issue is to develop models of symbol sys- bolic representations of words and their meaning, of
tems and compare these with empirical data (e.g. from rules of grammar, and so on. They would then con-
human participants in an experiment). As you will see struct a computer program to encode the representa-
throughout this book, the strategy of producing com- tions and manipulate them so that the program
puter models and comparing their performance with behaves sensibly. Given an input of written language,
human data is a common one (see especially Chapter for example, the program might generate a represen-
19 for such comparisons for symbolic models). tation of its meaning. This would be an exceptionally
However, it is worth noting that disagreement with hard task but, were it to be successful, we could then
empirical evidence does not necessarily imply that the compare the output of the program with the judge-
cognitive processes in question are not symbolic. It may ments of human language understanders to see if the
well be that a different symbolic model would agree program generated sensible answers.
with the data much better. So, although the claim that In contrast, a connectionist modeller, though trying
the mind is a symbol system is empirical, it will require to represent the same kinds of information, would do
a considerable amount of empirical evidence to show this in a different way. They would seek to represent
either that the mind is symbolic or that it is not. information in terms of neuron-like computing units
and their interconnections. Rather than freely writing
5.2.2 Connectionism a computer program, they would seek to explain lan-
Cognitive psychologists have also sought to under- guage understanding in terms of the kinds of informa-
stand the mind’s representational and computational tion processing that the neuron-like units engage in.
qualities via an alternative framework, known as Thus connectionists seek to restrict themselves to
connectionism. models that have some prima facie plausibility in terms
CHAPTER 1 FOUNDATIONS OF COGNITIVE PSYCHOLOGY 23
of what we know of the information-processing prop- sensible generalization (e.g. ambitious, driven, etc.). It
erties of the brain. turns out that connectionist models tend to be able to
One of the exciting findings associated with con- generalize quite spontaneously, with no need for this
nectionism has been that this brain-like information cognitive property to be explicitly programmed.
processing tends to produce interesting cognitive This brief discussion aimed only to introduce these
properties all on its own (some properties do not have different kinds of computational model; it has of
to be explicitly programmed, unlike the case of sym- course skated over many complexities. In particular,
bolic models). For example, people tend to be good at the question as to whether the mind is better modelled
generalizing from just a few instances – though in all as a symbol system or as a connectionist network has
likelihood you have encountered few UK Prime been and continues to be hotly debated (see, for exam-
Ministers, if you were asked to describe the typical UK ple, Fodor and Pylyshyn, 1988; Smolensky, 1987), as
Prime Minister you could probably come up with a you will see in Chapters 19 and 20 particularly.
SUMMARY OF SECTION 5
• Cognitive psychology is committed to the assumption that the mind is both representational and
computational.
• Representations are understood as having a property of aboutness.
• Computations are understood as processes of inputting, storing, manipulating, and outputting infor-
mation.
• Within cognitive psychology the mind tends to be understood in relation to either of two broad
conceptions of computation:
– computation as rule-based symbol manipulation
– computation as neurally-inspired, as in connectionist networks.
6LEVEL-DEPENDENT
EXPL ANATIONS
Linking the mind with computers raises many inter- computational system actually computes and why.
esting and challenging questions. One view, com- The specification can be given in terms of a map-
monly attributed to Marr (1982), is that cognition can ping between appropriate sets of inputs and their
be understood at (at least) three different levels. corresponding outputs. Consider a system that
performs addition. A level 1 explanation would
therefore refer to the ‘plus’ function, partially indi-
6.1 The computational level cated in Table 1.2.
Marr also believed that level 1 explanations should
The first of Marr’s levels (level 1) is commonly specify why the system should compute the function
referred to as the computational level. An explana- that it does in order to complete a particular task. Why
tion of cognition at this level specifies what a is it, for example, that the plus function (as opposed to
24 CHAPTER 1 FOUNDATIONS OF COGNITIVE PSYCHOLOGY
TABLE 1.2 Level 1 specification for addition. The inputs time so that they are adjacent to the two. These algo-
are pairs of numbers to be added and the output is rithms, and the sequence of steps they would generate,
their sum
are shown in Table 1.3.
Inputs Outputs
Note that these two sequences of steps achieve the
same end result, 5 dots (•••••) representing the num-
0,0 0
ber 5. That is, although they are distinct processes, and
0,1 1
hence distinct algorithms, at level 1 they are indistin-
1,0 1
guishable. In fact, it can be proved that there are an
2,3 5
infinite number of different algorithms for any level 1
87,123 210
specification.
This obviously makes it very difficult for a cognitive
multiplication) is the right function for the task of psychologist to work out what algorithm to choose in
adding two numbers together? order to model human performance successfully.
Thus, cognitive psychologists who seek to explain However, there are ways of distinguishing different
some aspect of cognition at the computational level algorithms. For example, algorithms can bestow a con-
need to explain or describe the function that is com- siderable benefit to anyone (or anything) that deploys
puted (what the inputs and outputs are) and why that them. Even though a task may appear to be insoluble, or
function is the appropriate one. For example, an expla- its solution appear to impose impractical demands on
nation of language understanding might describe inputs resources, with appropriate algorithms it may be solu-
that correspond to sentences or questions, and outputs ble with a modicum of resources. Note how algorithm 2
that correspond to appropriate comments or responses. in Table 1.3 completes the task in one less step than
algorithm 1.
Less trivially, consider chess. One way of playing
6.2 The algorithmic level chess would be to consider all possible moves by look-
ing ahead a certain number of steps. As one looks fur-
Marr’s level 2, commonly referred to as the algorithmic ther ahead, however, the number of possible moves
level, specifies how a computation is to be achieved. A grows exponentially, and so this particular strategy
level 2 explanation might describe the representations of would require vast amounts of memory and time. By
input and output that a system employs and the algo- deploying more sophisticated algorithms, ones involv-
rithms that operate over these representations. For exam- ing heuristics and strategies that restrict the number
ple, in computing the ‘plus’ function, input numbers of possible moves that need to be considered, the
could be represented in a number of different ways: in resource demands of the task fall rapidly. Thus, appro-
denary or binary notation, as Arabic or Roman numer- priate algorithms may render soluble tasks that appear
als, or as appropriate numbers of dots. The algorithm
specifies the steps involved in transforming the input TAB LE 1. 3 Two algorithms and the steps they generate
representations into appropriate output representations. for computing 2 + 3
To return to the example of addition, one way of
Algorithm 1 (move Step Algorithm 2 (move
representing two numbers (say, the numbers 2 and 3) one dot at a time one dot at a time
involves representing them in terms of appropriate from right to left) from left to right)
numbers of dots (i.e. •• and •••). One algorithm for Left Right Left Right
adding the numbers might involve moving the two
•• ••• 0 •• •••
dots one at a time so that they are adjacent to the three
••• •• 1 • ••••
to yield an output representation (not dissimilar to
•••• • 2 •••••
adding using an abacus). Another (formally) distinct
••••• 3
algorithm would be to move the three dots one at a
CHAPTER 1 FOUNDATIONS OF COGNITIVE PSYCHOLOGY 25
insoluble, and also render them soluble within practi- implemented using an abacus, an explanation would
cal resource limits (Chapter 10 considers some of the make reference to beads sliding on rods. Were we to
stratagems of real chess experts). explain human cognitive processing in terms of Marr’s
To see this, consider different algorithms for multi- level 3, then we would make reference to neurons,
plying 253 by 375. One option is to add 253 to itself 375 neurotransmitters, and so on.
times. Another would involve adding 375 to itself 253 Explaining cognitive processing at the implementa-
times. Yet another way would be to remember the prod- tional level presents a very real challenge. In our
ucts of all pairs of numbers up to, say, 400. The first and example of language understanding, we would have to
second algorithms would require a pencil and paper and make reference to the real neural circuits that imple-
a very large amount of time. By contrast, the third strat- ment language understanding, and to their actual
egy would potentially require little time but a very large activities whilst doing so. Though neuropsychological
and efficient memory. A better algorithm, perhaps, and neuroimaging evidence, as well as neuroscientific
would involve knowing by rote some products (say, advances, accumulate, such an explanation exceeds
5 × 200 = 1,000, 3 × 5 = 15, etc.) and knowing that the the abilities of our current understanding.
product asked for can be decomposed as follows:
SUMMARY OF SECTION 6
• Marr’s levels provide a framework for understanding explanations of cognition.
• Explanations can be pitched at one of three levels:
– computational level
– algorithmic level
– implementational level.
• Cognitive psychological explanations are typically expressed at levels 1 (functional) and 2 (process),
but are assumed to be constrained by what is known about level 3.
7 CONCLUSIONS
In the previous sections we have attempted to outline In such a short chapter we have omitted much, and
some of the history of cognitive psychology, its subject this chapter should be regarded as a partial survey of
matter, and also some of its core assumptions. As we the foundations of cognitive psychology, intended to
have seen, cognitive psychology has a relatively long help you make the most of the chapters that follow.
history and has made and continues to make many Most notably, we have barely touched on the different
connections with other disciplines. To understand the methods of cognitive psychology, though the follow-
nature of cognitive psychology, we have had to con- ing chapters make clear just how central these meth-
sider a wide range of issues, from computation to neu- ods are to the cognitive approach.
roimaging, from mundane but complex behaviour We have not intended to suggest that cognitive psy-
such as understanding language to the behaviour chology faces no real challenges or problems. Far from
involved in anti-aircraft gunnery. Our survey has it. Most if not all of the topics we will consider in this
touched on action, perception, thinking, language, book are still not fully understood – though cognitive
problem solving, categorization, and consciousness. psychology has proved remarkably successful so far, it
We have considered the nature of scientific investiga- remains to be seen just how well it will deliver such a
tion, the importance of observation, and the need for, full understanding. Indeed, while in topics such as
and practice of, sciences to posit theoretical entities attention and perception cognitive psychologists have
that cannot be observed. We have also touched on the made great progress, others, such as consciousness
possibility that cognitive psychology may be a special and emotion, still present real challenges. This is not
science, perhaps somewhere between a social and a to say that cognitive psychologists have not contrib-
natural science. uted greatly. As you will see in Chapters 16, 17, and 18
ACTIVIT Y 1.4
In Activity 1.1, we asked you to write down what your list – are there some features you would want
you took to be the characteristic features of a scien- to add to the list? And are there any you would want
tific study of the mind. Take a few minutes to review to remove?
CHAPTER 1 FOUNDATIONS OF COGNITIVE PSYCHOLOGY 27
among others, progress has been made even though chapters, testify to the importance of developing a
foundational questions remain. systematic and rigorous understanding of the mind. It
The breadth of the many issues we have raised, as also hints at the fascination and enjoyment that can be
well as the results and promise of the cognitive gained from studying cognitive psychology, something
approach that you will encounter in subsequent that we hope you will soon experience for yourself.
FURTHER READING
Bechtel, W. (1988) Philosophy of Mind: An Overview for networks, the philosophical debates that surround this style of
Cognitive Science, Hillsdale, NJ, Lawrence Erlbaum Associates. modelling, and the theoretical and technical aspects of key
Designed for cognitive scientists rather than philosophers, this is models.
an excellent introduction to some of the more important philo- Gardner, H. (1985) The Mind’s New Science: A History of the
sophical issues that challenge any study of the mind. Cognitive Revolution, New York, Basic Books. This book still
Bechtel, W. and Abrahamsen, A. (2002) Connectionism provides an excellent introduction to and history of the key theo-
and the Mind: Parallel Processing, Dynamics, and Evolution in retical and conceptual advances that have led to our contempo-
Networks, 2nd edition, Oxford, Blackwell. This updated edition rary study of the mind.
provides an excellent introduction to connectionism, or neural
REFERENCES
Bryan, W.L. and Harter, N. (1899) ‘Studies on the telegraphic categorical object representations in inferior temporal cortex
language: the acquisition of a hierarchy of habits’, Psychological of man and monkey’, Neuron, vol.60, no.6, pp.1126–41.
Review, vol.6, pp.345–75. Lashley, K.S. (1951) ‘The problem of serial order in behav-
Chomsky, N. (1959) ‘A review of B.F. Skinner’s Verbal iour’, in Jeffress, L.A. (ed.) Cerebral Mechanisms in Behaviour:
Behavior’, Language, vol.35, no.1, pp.26–58. The Hixon Symposium, New York, John Wiley.
Devlin, J.T., Russell, R.P., Davis, M.H., Price, C.J., Wilson, J., Marr, D. (1982) Vision: A Computational Investigation into
Moss, H.E., Matthews, P.M., and Tyler, L.K. (2000) the Human Representation and Processing of Visual
‘Susceptibility-induced loss of signal: comparing PET and Information, New York, W.H. Freeman & Company.
fMRI on a semantic task’, NeuroImage, vol.11, pp.589–600. Martin, A. (2007) ‘The representations of object concepts
Fodor, J.A. (1974) ‘Special sciences’, Synthese, vol.28, in the brain’, Annual Review of Psychology, vol.58, pp.25–45.
pp.77–115. Miller, G.A., Galanter, E., and Pribam, K. (1960) Plans and
Fodor, J.A. and Pylyshyn, Z.W. (1988) ‘Connectionism and the Structure of Behaviour, New York, Holt, Rinehart and
cognitive architecture: a critical analysis’, Cognition, vol.28, Winston.
pp.3–71. Moss, H.E., Tyler, L.K., and Taylor, K.I. (2009) ‘Conceptual
Greer, M.J., van Casteren, M., McLellan, S.A., Moss, H.E., structure’, In Gaskell, G.M. (ed.) The Oxford Handbook of
Rodd, J., Rogers, T.T., and Tyler, L.K. (2001) ‘The emergence of Psycholinguistics, Oxford, Oxford University Press.
semantic categories from distributed featural representations’, Newell, A. and Simon, H.A. (1976) ‘Computer science as
Proceedings of the 23rd Annual Conference of the Cognitive empirical enquiry: symbols and search’, Communications of
Science Society, London, Lawrence Erlbaum Associates. the Association for Computing Machinery, vol.19, pp.113–26.
Hillis, A.E. and Caramazza, A. (1991) ‘Category-specific Skinner, B.F. (1957) Verbal Behavior, New York, Appleton-
naming and comprehension impairment: a double dissocia- Century-Crofts.
tion’, Brain Language, vol.114, pp.2081–94. Smolensky, P. (1987) ‘The constituent structure of connec-
Kriegeskorte, N., Mur, M., Ruff, D., Kiani, R., Bodurka, J., tionist mental states: a reply to Fodor and Pylyshyn’, The
Esteky, H., Tanaka, K., and Bandettini, P. (2008) ‘Matching Southern Journal of Philosophy, Supplement, vol.26, pp.137–61.
28 CHAPTER 1 FOUNDATIONS OF COGNITIVE PSYCHOLOGY
Tolman, E.C. (1932) Purposive Behaviour in Animals and Von Eckardt, B. (1993) What Is Cognitive Science?,
Man, New York, Century. Cambridge, MA, MIT Press.
Turing, A.M. (1950) ‘Computing machinery and intelli- Warrington, E.K. and Shallice, T. (1984) ‘Category specific
gence’, Mind, vol.59, pp.433–60. semantic impairments’, Brain, vol.107, pp.829–54.
Tyler, L.K. and Moss, H.E. (2001) ‘Towards a distributed Wertheimer, M. (1912) ‘Experimentelle Studien über das
account of conceptual knowledge’, Trends in Cognitive Sciences, Sehen von Bewegung’, Zeitschrift Für Psychologie, vol.61,
vol.5, no.6, pp.244–52. pp.161–265.
PERCEP TUAL
PROCESS ES
Introduction
2 Attention
Peter Naish
3 Perception
Graham Pike, Graham Edgar, and Helen Edgar
4 Recognition
Graham Pike and Nicola Brace
30 PART 1 PERCEPTUAL PROCESSES
INTRODUCTION
In Part 1 you will find chapters on attention, percep- A further key issue that emerges in all three chapters
tion, and recognition. Why do we begin with these is the fractionation of functions. It turns out that there
particular topics? Well, there is a fairly strong tradition is not just one sort of attention but many different
of placing these topics early in books on cognition, and forms of it. Similarly, it transpires that visual percep-
there are at least two reasons for this. First, there is a tion is far from being a unitary function; in fact, vision
strong applied psychology theme to all these topics, is made up of such a multitude of component process-
whether it is finding better ways to present relevant ing streams that Chapter 3 has space to mention only
information to people in safety-critical occupations, some of them. As indicated in the previous paragraph,
such as aircraft pilots, devising techniques for improv- recognition can also be separated into different pro-
ing eye-witness identification, or designing machines cesses, and a similar fractionation will recur in later
that can ‘see’ and ‘recognize’. Second, attention, percep- chapters in relation to other mental functions such as
tion, and recognition are all topics that concern the memory. (How we should conceptualize all these cog-
relationship between the mind and the world, which nitive functions and their sub-components is some-
seems a good place to start trying to understand the thing it might be useful to consider in the light of
mind itself. Other chapters – for example, Chapter 6 on Chapter 5 on categorization.) Allied to the issue of
language processing – also address the issue of how how cognitive functions can be analysed into compo-
information from the world gets ‘into’ the mind, but nent processes are questions about which of these
the topics of attention, perception, and recognition processes result in representations that are or are not
provide particularly direct questions relating to it. Why consciously experienced, and which can be carried
do we become aware of some aspects of the environ- out in parallel, and which only one at a time.
ment rather than others? How is it that we manage to A common theme across all the chapters is the use
perceive those things we do become aware of? And for of neuropsychological evidence to help elucidate key
those things we do consciously perceive, how do we issues such as those we have just identified. Injury to
come to recognize what they are? the brain can affect attention, perception, and recog-
As you will see, these turn out to be far from simple nition in quite unexpected ways. Studying the behav-
questions and to require far from simple answers. A ioural and phenomenological consequences of injury
key issue that comes up in all three chapters has to do to specific parts of the brain, relating neuroanatomy to
with distinguishing between aspects of the world (the behaviour and conscious experience, throws light
domain of physics), how these aspects affect the body upon the structure of cognition by providing both
and especially the nervous system (physiology), and tests of psychological theories and grounds from
what mental representations result (cognitive psychol- which theories may be derived.
ogy). In Chapter 2 you will learn what kinds of physical Another issue common to all the chapters is the
energy the auditory system uses to represent the loca- extent to which stored knowledge enters into the
tion of a sound source; in Chapter 3 you will encounter functions of attention, perception, and recognition.
a theory of how the visual system comes to represent These functions might be purely stimulus-driven; that
Gestalt organization, which is easily mistaken for a is, driven by physical properties of the world. But if
property of the world rather than of the mind; and in they are not, then at what stage in processing does
Chapter 4 you will see how different aspects of the prior knowledge exert its influence? Do we necessarily
same physical face – familiarity, identity, emotional identify a plant before picking it, for example? If not,
tone – are processed by different physiological path- why would we tend to avoid picking stinging nettles
ways and have separate cognitive representations. with bare hands? Do we perceive familiar faces in the
INTRODUCTION 31
same way that we perceive unfamiliar faces? If not, They also introduce and evaluate Marr’s computational
does familiarity also affect perception of other classes framework for a bottom-up theory of perception.
of object? It is important that answers to such ques- Lastly, in Chapter 4, Graham Pike and Nicola Brace
tions are given within a theoretical context. When you describe and contrast two theories of object percep-
have read the chapters, you should reflect on how well tion, as well as a model of face perception that has been
or how badly cognitive psychological theories have implemented as a connectionist network (a type of
fared in recent decades. computer model). Across the chapters you will encoun-
In Chapter 2, Peter Naish describes such different ter theories being tested and sometimes confirmed and
forms of attention as attention to regions of space, sometimes found wanting. You will also meet the idea
attention to objects, and attention for action, but that different theories may be complements of one
attempts finally to summarize them all under a single another rather than simply alternatives. One theory
fairly abstract definition of the term. He shows how may succeed in one domain but fail in another, and
ideas about attention have changed and diversified vice versa for a second theory. You will also see how
over the last 50 years and considers how well the early confidence in a theory varies with its range of applica-
theories have stood up to examination. He also consid- tion, and how confidence can be boosted if it proves
ers the relationship between attention and conscious- possible to implement the theory as a working com-
ness, and what research on hypnosis can teach us about puter model. The challenge for the future is for theo-
this. In Chapter 3, Graham Pike, Graham Edgar, and rists to develop more detailed and implementable
Helen Edgar consider top-down and bottom-up theo- theories of attention, perception, and recognition
ries of perception, and propose a resolution in terms of whilst allowing that different people may find distinct
perception for recognition and perception for action. ways of doing the same thing.
This page intentionally left blank
CHAPTER 2
AT TENTION
Peter Naish
1 AUDITORY ATTENTION
For many of us the concept of attention may have follow an approximately historical sequence, showing
rather negative connotations. At school we were told how generations of psychologists have tackled the
to pay attention, making us all too aware that it was issues and gradually refined and developed their the-
not possible to listen to the teacher while at the same ories. You will discover that initially there seemed to
time being lost in more interesting thoughts. Neither them to be only one role for attention, but that gradu-
does it seem possible to listen effectively to two differ- ally it has been implicated in an ever-widening range
ent things at the same time. How many parents with of mental processes. As we work through the subject,
young children would love to be able to do that! One two basic issues will emerge. One is concerned with
could be excused for feeling that evolution has let us the mechanisms of attention and raises questions
down by failing to enable us to process more than one such as:
thing at a time. If that is how you feel, then this chap-
• How much material can we take in at once?
ter might add insult to injury because it will cite evi-
dence that we do in fact process a good deal of the • What happens to information to which we did not
material to which we are not attending. Why, you attend?
might ask, do we go to the trouble of analysing incom- • In what circumstances does attention fail, allowing
ing information, only to remain ignorant of the unwanted information to influence or distract us?
results? To attempt an answer it is necessary to con-
sider a range of issues, stretching from registration of The other theme has more to do with the purpose
information by the sense organs, through the pro- behind the mechanisms and raises questions concern-
cesses of perception, to the nature of awareness and ing why we experience the apparent limitations of
consciousness. Attention is a broad and intriguing attention:
topic. That breadth makes it very difficult to offer a
simple definition of the term, so I will not attempt to • Are the limitations simply an inevitable
do so until the end of the chapter. characteristic of a finite brain?
To cover some of this topic (we have only a chapter, • Have we evolved to exhibit attention – that is, does
and there are whole books on the subject) I shall it confer advantages?
34 PART 1 PERCEPTUAL PROCESSES
We shall begin to explore these issues by looking at the superimposed messages on the same piece of paper
ways in which one of our senses (hearing) has devel- and we then attempted to pick out one of the mes-
oped to facilitate attention. sages and read it. Because that kind of visual superim-
position does not normally occur, there have been no
evolutionary pressures for the visual system to find a
1.1 Disentangling sounds solution to the problem (though see below). The situ-
ation is different with hearing, but the possession of
If you are still feeling aggrieved about the shortcom- two ears has provided the basis for a solution.
ings of evolution, then you might take heart from the Figure 2.1 shows a plot of sound waves recorded
remarkable way in which the auditory system has from inside a listener’s ears. You can think of the up
evolved so as to avoid a serious potential problem. and down movements of the wavy lines as representing
Unlike our eyes, our ears cannot be directed so as to the in and out vibrations of the listener’s ear drums.
avoid registering material that we wish to ignore; The sound was of a single hand clap, taking place to the
whatever sounds are present in the environment, we front left of the listener. You will notice that the wave
must inevitably be exposed to them. In a busy setting for the right ear (i.e. the one further from the sound)
such as a party we are swamped by simultaneous comes slightly later than the left (shown by the plot
sounds – people in different parts of the room all being shifted to the right). This right-ear plot also goes
talking at the same time. Indeed, our ability to listen up and down far less, indicating that it was less intense,
to just one out of a medley of sounds is known as or in hearing terms that it sounded less loud at that ear.
the cocktail party effect. An analogous situation for These differences in timing and intensity are important
the visual system would be if several people wrote to the auditory system, as will be explained.
FIGU RE 2 .1 The waveform of a hand clap, recorded at the left (upper trace) and right (lower trace) ears. Horizontal
squares represent durations of 500 microseconds (a microsecond is one-millionth of a second); vertical divisions are
an arbitrary measure of sound intensity.
CHAPTER 2 ATTENTION 35
Figure 2.2(a) represents sound waves spreading how large it is compared with a wavelength. The wave-
out from a source and passing a listener’s head. Sound length is the distance from one wave crest to the next.
waves spread through the air in a very similar way to Sounds that we perceive as low-pitched have long
the waves (ripples) spreading across a pond when a wavelengths – longer in fact than the width of the
stone is thrown in. For ease of drawing, the figure just head. As a result, the waves pass by almost as if the
indicates a ‘snapshot’ of the positions of the wave head was not there. This means that there is negligible
crests at a particular moment in time. Two effects are intensity shadowing, so the intensity cue is not avail-
shown. First, the ear further from the sound is slightly able for direction judgement with low-pitched sounds.
shadowed by the head, so receives a somewhat qui- In contrast, sounds that we experience as high pitched
eter sound (as in Figure 2.1). The head is not a very (e.g. the jingling of coins) have wavelengths that are
large obstacle, so the intensity difference between the shorter than head width. For these waves the head is a
ears is not great; however, the difference is sufficient significant obstacle and shadowing results. To sum-
for the auditory system to register and use it. If the marize, intensity cues are available only for sounds of
sound source were straight ahead there would be no short wavelength.
difference, so the size of the disparity gives an indica- In contrast to the shadowing effect, detecting that
tion of the sound direction. The figure also shows a the two ears are at different positions on the wave
second difference between the ears: a different wave works well for long wavelength sounds. However, it
part (crest) has reached the nearer left ear compared produces ambiguities for shorter waves. The reason is
with the right (which is positioned somewhere in a that if the wave crests were closer than the distance
trough between two peaks). Once again, the inter- from ear to ear, the system would not be able to judge
aural difference is eliminated for sounds coming from whether additional waves should be allowed for. Figure
straight ahead, so the size of this difference also 2.2(b) shows an extreme example of the problem. The
indicates direction. two ears are actually detecting identical parts of the
Why should we make use of both intensity and wave, a situation that is normally interpreted as indi-
wave-position differences? The reason is that neither cating sound coming from the front. As can be seen,
alone is effective for all sounds. I mentioned that the this wave actually comes from the side. Our auditory
head is not a very large obstacle; what really counts is system has evolved so that this inter-ear comparison is
(a) (b)
FIGU RE 2 . 2 Curved lines represent wave crests of a sound approaching from a listener’s front left. In (b) the sound
has a shorter wavelength (higher pitched) than in (a), so waves are closer together with a crest at each ear.
36 PART 1 PERCEPTUAL PROCESSES
made only for waves that are longer than the head manufacturers seemed to have followed the same
width, so the possibility of the above error occurring is principle. To my ears they appeared to be using ring
eliminated. Consequently, this method of direction tones with frequencies that made it impossible to
finding is effective only for sounds with long wave- know whether it was one’s own or someone else’s
lengths, such as deeper speech sounds. phone that was ringing!
You will notice that the two locating processes
complement each other perfectly, with the change
from one to the other taking place where wavelengths 1.2 Attending to sounds
match head width. Naturally occurring sounds usu-
ally contain a whole range of wavelengths, so both From the above, you will appreciate that the auditory
direction-sensing systems come into play and we are system is able to separate different, superimposed
quite good at judging where a sound is coming from. sounds on the basis of their different source direc-
However, if the only wavelengths present are about tions. This makes it possible to attend to any one
head size, then neither process is fully effective and sound without confusion, and we have the sensation
we become poor at sensing the direction. Interestingly, of moving our ‘listening attention’ to focus on the
animals have evolved to exploit this weakness. For desired sound. For example, as I write this I can listen
example, pheasant chicks (that live on the ground and to the quiet hum of the computer in front of me, or
cannot fly to escape predators) emit chirps that are in swing my attention to the bird song outside the win-
the ‘difficult’ wavelength range for the auditory sys- dow to my right. Making that change feels almost like
tem of a fox. The chicks’ mother, with her bird-sized swinging my eyes from the computer to the window,
head, does not have any problems at the chirp wave- and the term spotlight of attention has been used to
length, so can find her offspring easily. Before the describe the way in which we can bring our attention
advent of personalized ring tones, mobile telephone to bear on a desired part of the environment.
ACTIVIT Y 2 .1
1 Set up a sound source (the radio, say) and then 2 Do the same as before, but this time you do
listen to it from across the room. Turn sideways-on not need to be sideways-on to the sound. If you
so that one ear faces the source. Now place a finger compare your experiences with and without the
in that nearer ear, so that you can hear the sound finger in one ear you will probably notice that,
only via the more distant ear. You should find that when you have the obstruction, the sound is more
the sound seems more muffled and deeper, as if ‘boomy’ and unclear. This lack of clarity results from
someone had turned down the treble on the tone the main sound, which comes directly from the
control. This occurs because the shorter wavelength source, being partly smothered by slightly later ech-
(higher pitched) sounds cannot get round your head oes, which take longer routes to your ear via many
to the uncovered ear. In fact you may still hear a lit- different paths involving reflections off the walls,
tle of those sounds, because they can reflect from etc. These echoes are still there when both ears are
the walls and so reach your uncovered ear ‘the long uncovered, but with two ears your auditory system
way round’. Most rooms have sufficient furnishings is able to detect that the echoes are coming from
(carpets, curtains, etc.) to reduce these reflections, different directions from the main sound source,
so you probably will not hear much of the higher enabling you to ignore them. People with hearing
sounds. However, if you are able to find a rather impairment are sometimes unable to use inter-aural
bare room (bathrooms often have hard, shiny sur- differences, so find noisy or echoing surroundings
faces) you can use it to experience the next effect. difficult.
CHAPTER 2 ATTENTION 37
My account so far has explained the mechanisms the unattended ear. Only when the attended message
that stop sounds becoming ‘jumbled’ and reminds us lasted more than a few seconds was the material in the
that, subjectively, we listen to just one of the disentan- other ear lost. The system behaved as if there were a
gled sounds. It seems obvious that they would need short-lived store that could hold a small segment of
disentangling to become intelligible, but why do we the unattended material until analysis of the attended
then attend to only one? That question leads us into words was complete. The store’s quality of hanging on
the early history of attention research. to a sound for a short time, like a dying echo, led to it
One of the first modern researchers to investigate being termed the echoic memory.
formally the nature of auditory attention was It was also shown that people would often be aware
Broadbent (1952, 1954), who used an experimental of whether an unattended voice had been male or
technique known as dichotic listening. This offers a female, and they could use that distinction to follow a
way of presenting listeners with a simplified, more message. Two sequences of words were recorded, one
easily manipulated version of the real world of multi- set by a woman and the other by a man. Instead of
ple sounds. Participants wear a pair of headphones playing one of these voice sequences to each head-
and receive a different sound in each ear; in many phone, the words were made to alternate. Thus, the
studies the sounds are recorded speech, with each ear man’s voice jumped back and forth, left to right to left,
receiving a different message. Broadbent and others while the woman’s switched right to left to right. In
(e.g. Treisman, 1960) showed that, after attending to this situation participants were able to abandon the
the message in one ear, a participant could remember normal ‘attending by ear’ procedure, and instead
virtually nothing of the unattended message that had report what a particular speaker had said; instead of
been played to the other ear, often not even whether it using location as a cue for attention, they were using
had been spoken in a foreign language. the pitch of the voice.
Broadbent’s experiments showed that the last state- The explanation for these findings seemed straight-
ment needed some refinement. If the two messages forward. Clearly the brain had to process the informa-
were very short, say just three words in each ear, then tion in a sound in order to understand it as speech. In
the participant could report what had been heard by this respect, the brain was rather like a computer
processing information (computers were beginning to name could be explained by an attenuation process. To
appear at that time), and everyone knew that comput- attenuate means to reduce the intensity, so the process
ers could only process one thing at a time – that is, would function as if there were a filter, ‘turning the vol-
serially. Obviously (theorists thought) the brain must ume down’ for all but the attended signal. Although
be serial too, so while processing the information of that would leave most unattended material so attenu-
interest, it needed to be protected from all the rest: it ated as to be unnoticed, for a signal to which we were
needed to attend and select. However, the earliest very sensitive, such as our own name, there would be
stages of processing would have to take place in sufficient residual information for it to be processed
parallel (i.e. taking in everything simultaneously), and hence attract our attention. Treisman devised a
ensuring that all information would potentially be series of ingenious experiments that supported this
available. These initial processes would have to utilize idea. Many of her studies involved shadowing, a
selection procedures based upon very simple charac- dichotic listening technique that requires the partici-
teristics of the signals, because anything more com- pant to repeat aloud everything that is heard in one ear,
plex would demand serial processing and that couldn’t following like a shadow close behind the spoken mes-
start until after the selection. The selection processes sage. (NB This is not to be confused with the very dif-
identified were indeed simple: attention was directed ferent ‘head shadowing’ referred to earlier.) This task
either on the basis of the direction of a sound, or on demands full concentration on the shadowed message,
whether it was higher or lower pitched. Broadbent’s so when it ceases the participant appears to be com-
(1954) theory was that, after the first early stage of par- pletely ignorant of what was said in the other ear.
allel information capture, a ‘gate’ was opened to one In one experiment Treisman actually made the sto-
stream of information and closed to the rest. rylines in the messages swap ears in the middle of
what was being said. Thus, the left ear might hear:
participants to indicate as quickly as possible whether was a response. Moreover, a GSR was detected even to
or not a string of letters spells a real word) people can words of the same category that had not been pre-
respond much more quickly to a word if it is preceded sented during the shock-association phase. This gen-
by another related to it. For example, the ‘Yes’ is given eralizing of the response to un-presented words
to doctor (yes, because it is a word) more quickly when strengthens the claim that their meanings were estab-
presented after the word nurse than when following lished, even when not consciously perceived.
the word cook. Not surprisingly, at this stage of research into audi-
Treisman’s ideas stimulated a succession of experi- tory attention a number of psychologists began to
ments, some seeming to show that information could question the idea that the brain could not process more
‘get through’ from a wider range of stimuli than one’s than one signal at a time. Deutsch and Deutsch (1963)
own name or a highly predictable word in a sentence. suggested that all messages received the same process-
For example, Corteen and Wood (1972) carried out a ing whether they were attended or not; Norman (1968)
two-part experiment. Initially they presented their proposed that unattended information must at least
participants with a series of words, and each time a receive sufficient processing to activate relevant seman-
word from a particular category (city name) appeared tic memories (i.e. the memory system that stores the
the participant was given a mild electric shock. In this meanings of words; see Chapter 8). These suggestions
way, an association was formed between the shock certainly explained the intriguing dichotic listening
and the category. Although the shocks were not really results, showing people to be influenced by material of
painful, they inevitably resulted in something like which they seemed to have no knowledge. However,
apprehension when one of the critical words was pre- the ideas, if true, would require the brain to be far more
sented. This response (which once learned did not parallel in its function than had been supposed. At that
require the shocks in order for it to continue for a time there was neither an analogue by which parallel
while) could be detected as a momentary change in processing could be conceptualized, nor sufficient neu-
skin electrical resistance. The sweat glands of a nerv- roanatomical information to contribute to the debate.
ous person begin to secrete and the salty fluid is a Today there is ample evidence of the parallel nature of
good conductor of electricity, so it lowers the skin’s much of the brain’s processing and, additionally, com-
resistance to a small (non-shocking) current. The puters have advanced to the stage where brain-like par-
change is known as the galvanic skin response (GSR) allel processing can be emulated (see Chapter 19).
and has been used in so-called lie detectors; a person Thus, modern researchers have no difficulty in concep-
trying to hide the truth may be expected to be nerv- tualizing parallel processing and the nature of the
ous, hence they produce the electrical effect. Corteen attention debate has shifted somewhat. Nevertheless,
and Wood connected their participants to GSR appa- recent studies have also revealed that early stages of
ratus when they started the second part of the experi- analysis are modified by attention, effects that
ment: a dichotic listening task. As usual, participants Broadbent would have immediately recognized as
could later remember nothing about the unattended examples of filtering. We shall explore these issues in
message, but the GSR showed that each time the more depth, after first considering the nature of atten-
ignored ear received one of the ‘shocked’ words there tion in visual processing.
SUMMARY OF SECTION 1
The auditory system is able to process sounds in such a way that, although several may be present
simultaneously, it is possible to focus upon the message of interest. However, in experiments on audi-
tory attention there have been contradictory results concerning the fate of the unattended material:
• The auditory system processes mixed sounds in such a way that it is possible to focus upon a single
wanted message.
40 PART 1 PERCEPTUAL PROCESSES
2 VISUAL ATTENTION
I introduced Section 1 by suggesting that the auditory evidence of this shortly, but I shall first draw your
system had a special problem: unlike the visual sys- attention to another area of similarity between hear-
tem, it needed processes that would permit a listener ing and seeing.
to attend to a specific set of sounds without being con- I pointed out at the start of Section 1.1 that, whereas
fused by the overlap of other, irrelevant noises. The we often have to follow one speech stream while
implication of that line of argument was that vision ignoring others, we do not normally have to disentan-
had no need of any such system. However, although gle overlapping handwriting. However, it is worth
we do not see simultaneously everything that sur- bearing in mind that visual objects do overlap and
rounds us, we can certainly see more than one thing at hide parts of each other, and the brain certainly has
a time. Earlier, I wrote of attending to the sound of the the problem of establishing which components of the
computer in front of me, or of the birds to one side. image on the retina ‘go together’ to form an object.
I can do much the same visually. While keeping my This issue is examined in more depth in Chapter 3.
eyes directed to the computer screen, I can either As with hearing, a variety of cues are available to
attend to the text I am typing or, out of the corner of help in directing visual attention. Taking my window
my eye, I can be aware of the window and detect a bird again as an example, I can either look at the glass and
when it flies past. If our eyes can receive a wide range see a smear (I really must get round to washing the
of information in parallel, does that give the brain an window!) or I can look through that to the magpie sit-
attentional problem analogous to that of disentangling ting chattering in the apple tree. In this kind of situa-
sounds? If visual information is handled in much the tion we use distance to help separate objects, in much
same way as auditory information seems to be, then the same way as we use direction in hearing. However,
we might expect the various items in the field of view we can deploy our attention in a more sophisticated
to activate representations in memory simultaneously. way than simply on the basis of distance, as can be
That should lead to effects equivalent to those found demonstrated by another aircraft-related example.
in listening experiments; in other words, it might be Military jets are often flown very fast and close to
possible to show that we are influenced by items that the ground (to avoid radar detection), requiring the
we did not know we had seen. We shall examine pilot to attend intently to the outside view. At the same
CHAPTER 2 ATTENTION 41
time, there are various pieces of information, tradi- information was investigated by Sperling (1960), who
tionally displayed on instruments within the cockpit, showed participants grids of letters, arranged as three
which the pilot must check frequently. To avoid the rows of four letters each. If such a display was presented
pilot having to look down into the cockpit, the head- for 50 ms (i.e. 50 milliseconds, which is one twentieth
up display (HUD) was developed. This comprises a of a second), people were typically able to report three
piece of glass, just in front of the pilot, in which all the or four of the letters; the rest seemed to have remained
vital information is reflected. The pilot can read the unregistered in that brief period of time.
reflection, or look through it to the outside world, just Sperling explored this further. He cued partici-
as one can look at reflections in a shop window, or pants with a tone, indicating which of the three rows
look through to the goods on display. With a simple of letters they should try to report; a high note for the
reflection, the pilot would still have to change focus, top row, lower for middle, and deep for bottom.
like me looking at the smear or the bird. However, Crucially, the tones were not presented until just after
modern HUDs use an optical system that makes the display had disappeared, meaning that partici-
the information reflected in the display appear to be as pants were not able to shift their attention in prepara-
far away as the outside scene. This saves valuable tion for the relevant row of letters when presented; it
re-focusing time. Nevertheless, although the numerals had already been presented. Strange as it seemed,
in the HUD now appear to be located at the same dis- people were still able to report three or four items
tance as, say, a runway, pilots still have the sensation of from the cued row. Since they did not know until after
focusing on one or the other; if they are reading their the display had gone which row would be cued, this
altitude they are relatively unaware of the scene on result implied that they must have already registered
which it is superimposed. This suggests (as we shall most of the letters in every row; in other words,
see in more detail later) that visual attention can be between 9 and 12 letters in total. This apparent para-
linked to specific objects rather than to general regions dox, of seeming to know about a larger proportion of
of space, very much as auditory attention can follow a the items when asked only to report on some of them,
particular speaker’s voice or the sense of a sentence. is called the partial report superiority effect. The
effect was also observed if letters were printed with
six in red and six in black ink, then two tones used to
indicate which colour to report. Participants seemed
2.1Knowing about unseen to know as much about one half (the red, say) as they
information did about all 12, implying that, although they could
not report all the letters, there was a brief moment
An obvious difference between hearing and seeing is when they did have access to the full set and could
that the former is extended in time, while the latter choose where to direct their attention. The ‘brief
extends over space. So, for example, we can listen to a moment’ was equivalent to the echoic memory asso-
spoken sentence coming from one place, but it takes ciated with dichotic listening experiments, so the
some time to hear it all. In contrast, a written sentence visual counterpart was termed an iconic memory (an
is spread over an area (of paper, say) but, as long as it is icon being an image). All the material seemed to be
reasonably short, the whole thing can be seen almost captured in parallel, and for a short time was held in
instantly. Nevertheless, seeing does require some finite iconic memory. Some was selected for further, serial
time to capture and analyse the information. This pro- processing on the basis of position or colour, these
cess can be explored by presenting letters or words for a being analogous to position and voice pitch in
short, measured period of time; nowadays they are dichotic listening tasks. Unselected material (the
shown on a computer screen, but early research used a remaining letters) could not be remembered.
dedicated piece of apparatus called a tachistoscope. Just With the close parallels between these auditory and
how long was required to register a small amount of visual experiments, you will not be surprised to learn
42 PART 1 PERCEPTUAL PROCESSES
that the simple selection and serial processing story earlier study, they showed a potential prime (e.g.
was again soon challenged, and in very similar ways. ‘lion’), followed by a hard-to-see masked target (e.g.
Where the hearing research used shadowing to prevent ‘tiger’). However, there were two changes in this
conscious processing of material, the visual experi- study. First, the priming word could be displayed
ments used backward masking. Masking is a procedure either for a very short time, so that it was allegedly
in which one stimulus (the target) is rendered unde- undetectable, or it was shown for a duration of 1 sec-
tectable by the presentation of another (the mask); in ond, giving ample time for reading and guaranteeing
backward masking the mask is presented after the tar- a priming effect.
get, usually appearing in the order of 10–50 ms after The second change was to use two sets of trials. In
the target first appeared. The time between the onset one, the following target was almost always (90 per
of the target display and the onset of the mask is called cent of the time) related to the prime (e.g. ‘lion’ fol-
the stimulus onset asynchrony (SOA). The target might lowed by ‘tiger’, ‘bread’ then ‘butter’, etc.). In the other
be an array of letters or words; this disappears after a set of trials only 10 per cent of trials used related
few tens of milliseconds to be replaced by the mask, words. For remaining trials the stimuli were unre-
which is often a random pattern of lines. The SOA can lated, so that the first word was not strictly a prime
be adjusted until participants report that they do not (e.g. ‘list’ followed by ‘tiger’). The results of this study
even know whether there has been a target, let alone are summarized in Table 2.1.
what it was. In such circumstances the influence of the The effects are best appreciated by looking first at
masked material seems sometimes still to be detected the final two columns of figures, showing the results
via priming effects. Thus, Evett and Humphreys (1981) when the first word was displayed for 1 second. For
used stimulus sequences containing two words, both the condition where only 10 per cent of targets were
of which were masked. The first was supposed to be related to the preceding word, 70 per cent of those tar-
impossible to see, while the second was very difficult. It gets were correctly identified when there was a rela-
was found that when the second word was related to tionship. The hit rate fell to 55 per cent when the
the first (e.g. ‘tiger’ following ‘lion’) it was more likely targets were not related, so the priming effect pro-
to be reported accurately; the first, ‘invisible’ word duced a 15 percentage point advantage (70 – 55 = 15).
apparently acted as a prime. The last column shows a massive 91 per cent hit rate
Claims such as these have not gone unchallenged. for related words when there was a 90 per cent chance
For example, Cheesman and Merikle (1984) pointed that they would be related to the preceding prime. The
out that although participants say they cannot see
masked words, they often do better than chance when
forced to guess whether or not one had actually been TAB LE 2 .1 The percentage of targets correctly
presented. These researchers insisted that proper con- reported under various priming conditions
clusions about extracting meaning from unseen mate-
Short duration 1 second
rial could be made only if the material was truly
prime prime
unseen; that is, when the participants could do no bet-
ter than chance at guessing whether there had been a 10% 90% 10% 90%
related related related related
word displayed. Under these conditions they found no
evidence for priming by masked words. However, Related 56 52 70 91
words
more recently researchers have provided persuasive
Unrelated 49 43 55 51
evidence that meaning can be extracted from material words
of which the participant is unaware. This is worth Priming 7 9 15 40
examining in more detail. advantage
Pecher et al. (2002) used the Evett and Humphreys
(1981) technique, but with modifications. As in the Source: adapted from Pecher et al., 2002
CHAPTER 2 ATTENTION 43
priming advantage in this condition has risen to offered an elegant solution to this problem, built
40 points. Why does the benefit of a related prime around the semantic/episodic distinction used when
jump from 15 to 40 when the targets are more likely to describing memory (see Chapter 8). In the context of
be related to the primes? The answer is that, when letters, semantic information would be the basic
there is a high chance that they will be related, partici- knowledge of letter identity. Episodic detail links the
pants spot the connection and try to guess what the general identity to a specific occurrence; detail such as
target must have been: they often guess correctly. the fact that ‘N’ is in upper-case type, is printed in red,
Notice that they can do this only because the prime and appears at the start of the third row of letters.
word was clearly visible. Look now at the correspond- Coltheart proposed that items do not normally reach
ing figures for when the prime was displayed very conscious awareness unless both the semantic and epi-
briefly. Here the priming advantages (7 and 9 percent- sodic detail are detected. So, for example, one would
age points) are far more modest (but statistically sig- not expect to be having an ‘N-feeling’ (semantic) if
nificant). However, the important result is that the there were not a letter with some specific characteris-
change from 10 per cent to 90 per cent relatedness tics (size, colour, etc.) in the field of view!
does not produce the large increase in the priming It has become clear from electrophysiological stud-
effect observed in the 1 second condition. The small ies that visual item identification occurs in a different
increase from 7 per cent to 9 per cent was not statisti- region of the cortex from the areas that respond to col-
cally significant. It can be concluded that participants our or location. These different kinds of information
were unable to guess in the brief condition, so pre- have to be united, and this process, Coltheart (1980)
sumably had not been able to identify the prime suggests, takes time and attention. According to this
words. Nevertheless, those words did produce a small account, Sperling’s 12 letters, or even Evett and
priming effect, so they must have received sufficient Humphrey’s lion, are indeed processed in parallel to
analysis to activate their meaning. cause semantic activation, but the viewer will not
become aware of this unless they are able to assign
the corresponding episodic details. Nevertheless, if
pressed, the participant may sometimes admit to ‘hav-
Towards a theory of
2.2
ing a feeling’ that an item might have been presented,
parallel processing although they do not know what it looked like (see
also Chapter 8 for a discussion of the semantic–
When people are asked to guess about masked mate- episodic distinction).
rial, they are commonly able to provide some informa- The important point to note in the above account is
tion, but it often lacks detail. For example, if participants that attention is no longer being described as the pro-
in a Sperling-type experiment have recalled three let- cess that selects material for complex serial process-
ters but are pressed for more, then they can often pro- ing (e.g. word identification). Instead, Coltheart
vide one or two. However, they generally do not know suggests that attention is required to join the prod-
information such as whereabouts in the display the let- ucts of two parallel processes: the identification and
ters occurred or what colour they were. These, of the episodic characterization. This idea, that attention
course, are exactly the kinds of details that can be used is concerned with uniting the components of a stimu-
to select items for report, and were believed to be usa- lus, is not unlike a theory that Treisman has devel-
ble in that role because they were characteristics that oped (after her early auditory attention work she
could be processed quickly and in parallel. The guess- turned to visual attentive processes). We shall shortly
ing results seem to turn the logic on its head because consider Treisman’s work (which does not involve
the presumed complex information, such as letter backward masking) but first we should look a little
identities, is discovered, while the simple colour and further at what masking actually does to the process-
position information is unavailable. Coltheart (1980) ing of a stimulus.
44 PART 1 PERCEPTUAL PROCESSES
Z Target 1 (T1)
80
Detection rate for T2 (%)
70
60
50
40
1 2 3 4 5 6 7 8
(b) Position of T2 after T1
FIGURE 2.3 The RSVP technique: (a) The sequence of stimuli, shown in the same location on a computer screen, in which
the participant has to identify a white letter and then decide whether an X was also present; (b) Typical results, showing
the likelihood of detecting the X when presented in the first and subsequent positions following the white target.
participants were attempting to report these items, when they were unable to report seeing rope. This
they were also being monitored using EEG (electro- sounds rather like some of the material discussed ear-
encephalography). The pattern of electrical activity lier, where backward masking prevented conscious
measured via scalp electrodes is known to produce a awareness of material that had clearly been detected.
characteristic ‘signature’ when what might be called a However, the target in the RSVP situation appears
mismatch is encountered. For example, if a participant to be affected by something that happened earlier
reads the sentence He went to the café and asked for a (i.e. T1), rather than by a following mask. The differ-
cup of tin, the signature appears when tin is reached. ence needs exploring and explaining.
The Vogel et al. (1998) participants produced just Presumably something is happening as a result of
such an effect with sequences such as shoe – rope, even processing the first target (T1) that temporarily
46 PART 1 PERCEPTUAL PROCESSES
makes awareness of the second (T2) very difficult. way of referring to the difficulty of reporting T2).
Measurements show that for about 500 to 700 ms fol- Raymond et al. (1992) used a typical sequence of
lowing T1, detection of T2 is lower than usual. It is as RSVP stimuli but omitted the item immediately fol-
if the system requires time to become prepared to pro- lowing the first target. In other words, there was a
cess something fresh, a gap that is sometimes known 100 ms gap rather than another item following.
as a refractory period, but that in this context is more Effectively, this meant that the degree of backward
often called the attentional blink, abbreviated to AB. masking was reduced, and not surprisingly this
While the system is ‘blinking’ it is unable to attend to resulted in some improvement in the report rate for
new information. T1. Very surprisingly, it also produced a considerable
Time turns out not to be the only factor in observ- improvement in the reporting of T2; the AB effect had
ing an AB effect (‘AB effect’ will be used as a shorthand vanished (see Figure 2.4(a)). How did removing the
V ‘Definitely a W
...and an X.’
N
S Target 2
Z Target 1
(a)
‘Could be a V,
but definitely an
X that time.’
S Target 2
Z Target 1
(b)
FIGU RE 2 .4 (a) Target 2 is seen more easily when Target 1 is made easier to see by removing the following item;
(b) Target 2 is also seen easily when items following it are omitted.
CHAPTER 2 ATTENTION 47
mask for one target lead to an even larger improve- putting the participant’s own name in the T2 position
ment for another target that was yet to be presented? and, rather like the auditory ‘own name effect’, their
To return to our earlier analogy, if the shopkeeper is name was detected without difficulty as if there was no
having some trouble in dealing with the first customer, attentional blink. In the auditory analogue (Section
then the second is kept waiting and suffers. That 1.3) we saw the effect explained by suggesting that
doesn’t explain how the waiting queue suffers (if it unattended material was attenuated but still ‘loud’
were me I should probably chat to the person behind enough to trigger something as well-primed as one’s
and forget what I had come for), but that question was name. However, if you have followed the story so far,
also addressed by removing items from the sequence. you will no longer think of attention as working like a
Giesbrecht and Di Lollo (1998) removed the items volume control. Rather, it seems to be the ‘glue’ that
following T2 so that it was the last in the list; again, the unites the different elements of a stimulus and so ena-
AB effect disappeared (see Figure 2.4(b)). So, no mat- bles us to be aware of it. Does our own name not
ter what was going on with T1, T2 could be seen if it require ‘gluing’? We will try to answer this question
was not itself masked. To explain this result, together when we come to look at yet another of Broadbent’s
with the fact that making T1 easier to see also helps studies, in Section 3.3.
T2, Giesbrecht and Di Lollo developed a two-stage
model of visual processing. At Stage 1, a range of
information about target characteristics is captured in 2.4 Masking and attention
parallel: identity, size, colour, position, and so on. In
the second stage, they proposed, serial processes act Before I summarize the material in this section and we
upon the information, preparing it for awareness and move on to consider attentional processes with
report. While Stage 2 is engaged, later information clearly-seen displays, it would be appropriate to con-
cannot be processed, so has to remain at Stage 1. Any sider the relevance of the masking studies to the issue
kind of disruption to T1, such as masking, makes it of attention. We began the whole subject by enquiring
harder to process, so information from T2 is kept about the fate of material that was, in principle, avail-
waiting longer. This has little detrimental impact upon able for processing, but happened not to be at the
T2 unless it too is masked by a following stimulus focus of attention. Somehow we have moved into a
(I don’t forget what I came to buy if there is no-one different enquiry, concerning the fate of material that
else in the queue to chat with). When T2 is kept wait- a participant was trying to attend to, but did not have
ing it can be overwritten by the following stimulus. time to process. This seemed a natural progression as
The overwriting process will be damaging principally the chapter unfolded, but are the two issues really
to the episodic information; an item cannot be both related? Merikle and Joordens (1997) addressed this
white and black, for example. However, semantic very question; they characterized it as a distinction
information may be better able to survive; there is no between perception without awareness (such as in
reason why shoe and rope should not both become masking studies) and perception without attention (as
activated. Consequently, even when there is insuffi- with dichotic listening). They carried out a number of
cient information for Stage 2 to yield a fully processed studies in which processing was rendered difficult
target, it may nevertheless reveal its presence through either by masking, or by giving the participants two
priming or EEG effects. There is an obvious similarity tasks so that they could not focus on the target. They
between this account and Coltheart’s (1980) sugges- concluded that the results were entirely comparable,
tion: both propose the need to join semantic and and that the same underlying processes are at work in
episodic detail. both kinds of study.
So often, nice explanations need to be reconsidered However, over the space of a decade a different kind
in the light of other findings; there is an example of of evidence has become available: that from brain
this in the RSVP literature. Shapiro et al. (1997) tried scanning. Scanning techniques can reveal the impact
48 PART 1 PERCEPTUAL PROCESSES
of a stimulus ‘downstream’ as the information moves tion is available for only an exceedingly short time.
away from the primary sensory areas of the brain to This can barely have an impact upon the sensory sys-
receive further processing in more distant regions. This tem and, sure enough, brain scanning shows the influ-
kind of information makes it very clear that we should ence of the stimulus ‘fizzling out’ as the information
distinguish between those stimuli that we don’t see as a moves on for further analysis. In contrast, clear stimuli
result of masking and those that we miss through inat- that do not receive attention do at least succeed in acti-
tention. In the masking situation the ‘invisible’ item is vating many regions of the brain. Kouider and Dehaene
generally at the focus of attention, and the only reason (2007) see this as an important distinction, and we
that we fail to see it (consciously) is that the informa- shall have to return to this theme later.
SUMMARY OF SECTION 2
The results of the visual attention experiments we have considered can be interpreted as follows.
• Attention can be directed selectively towards different areas of the visual field, much as it can be
directed to different sounds.
• The inability to report much detail from brief, masked visual displays appears from brain scanning
evidence to be linked to the need to assemble the various information components for an item to be
visible.
• Where visual information is available it is captured in parallel, but assembly is a serial process.
• Episodic detail (e.g. colour, position) is vulnerable to the passage of time or to ‘overwriting’ by a mask.
• Semantic information (i.e. identity/meaning) is relatively enduring but does not reach conscious
awareness unless bound to the episodic information.
• Attention, in this context, is the process of binding the information about an item’s identity to its
particular episodic characteristics.
• ‘Unbound’ semantic activation can be detected by priming and electrophysiological techniques.
X X X X X
X X X
X X X
O O
X X X X X
X O X X X X X
X X XX O
X X X
X X O O X
X X
FIGU RE 2 . 5 Typical stimuli used in Triesman’s experiments. Find the odd item in each of the groups (a), (b), and (c).
You probably felt that the odd items in Figures display is easy, so easy in fact that the whole display
2.5(a) and 2.5(b) simply ‘popped out’ and were imme- seems to be taken in at a glance, no matter how many
diately obvious, whereas the red X in Figure 2.5(c) items there are. In other words, all the different items
took you slightly longer to find. These kinds of are processed at the same time, in parallel. The situa-
effect have been explored formally by Treisman (e.g. tion is very different when shape and colour have to be
Treisman and Gelade, 1980). The odd item is referred combined because they are determined in different
to as the target and the others as the distractors. brain areas; somehow the two types of information
Treisman showed her participants a series of displays have to be brought together. You will recall from
of this nature and measured how long it took them to Section 2 that attention appears necessary to unite
decide whether or not a display contained a target. She episodic and semantic information. Treisman pro-
was particularly interested in the effect of varying the posed that it is also required to link simple features.
number of distractors surrounding the targets. It was Each item in the display has to receive attention just
found that for displays similar to Figures 2.5(a) and long enough for its two features (shape and colour) to
2.5(b) it made no difference to decision times whether be combined, and this has to be done one item at a
there were few or many distractors. In contrast, with time until the target is found. In other words, the pro-
the 2.5(c) type of display, participants took longer to cessing is serial, so takes longer when there are more
decide when there were more distractor items; each items to process.
additional distractor added approximately 60 ms to It has been known for some time that the parietal
the decision time. region of the brain (part of the cortex that sits like a
How is that pattern of results to be explained? saddle across the top of the brain) is one of the areas
Treisman pointed out that the first two displays have involved in attention. A fuller account of the problems
target items that differ from the rest on only one that result from damage to this area will be given in
dimension; the target is either a round letter (O), Section 5.1; at this point it is relevant to mention that
among ‘crossed-line’ letters (X), or a red letter among Treisman (1998) reports investigations with a patient
blue letters. The 2.5(c) display type is different; to who had suffered strokes in that region. This patient
identify the target it is necessary to consider two was shown simple displays containing just two letters
dimensions. It has to be an X (but there are others, so from a set of three (T, X, and O); they were printed in
on its own being an X does not define the target) and different colours, again from a choice of three (red,
it has to be red (but again, there are other red letters). blue, or yellow). He was asked to describe the first let-
Only when X and red are combined does it become ter he noticed from the two presented. On a particular
clear that this is an ‘odd one out’. All these features occasion he might be shown a blue T and a red O.
(various colours and shapes) are quite simple and are Although he often made mistakes, he would rarely
derived in the early stages of visual processing, but respond ‘Yellow X’ to that display; that is, he did not
importantly different types of analysis (e.g. of shape or claim to see features that were not there at all, so he
colour) take place in different parts of the brain. To see was not simply guessing. What he did say quite often
whether there is just ‘redness’ or just ‘roundness’ in a would be something like ‘Blue O’. He had correctly
50 PART 1 PERCEPTUAL PROCESSES
identified features that were present but was unable to to be recognized. The following section also describes
join them appropriately. The implication of this is that evidence that non-targets are recognized, but in this
both the detection and the integration of features are case the recognition appears to take place in parallel.
necessary steps in normal perception, and that inte- That really does deserve closer examination, because,
gration requires attention. if true, it would imply that all the previous evidence
for serial feature combination may have been misin-
terpreted.
3.2 Non-target effects
Treisman’s feature integration theory has been very 3.3 The ‘flanker’ effect
influential but it does not appear to explain all experi-
mental observations, and there have been alternative A potential problem for the feature integration theory
accounts of the feature-binding process. Duncan and is the fact that the time taken to understand the mean-
Humphreys (1989) reported effects that do not fit too ing of a printed word can be influenced by other,
well within the basic Treisman account. They required nearby words. In itself this is not surprising, because it
participants to search for the letter ‘L’ (the target) is well known that one word can prime (i.e. speed deci-
within a number of ‘Ts’ (the non-targets). You may get sions to) another related word; the example nurse –
a feel for the relative difficulty of different versions of doctor was given in Section 1.3. However, Shaffer and
their task by examining Figure 2.6. LaBerge (1979) found priming effects even when they
The task can be conceptualized as looking for two presented words in a way that might have been
lines that meet at a corner (the L), rather than forming expected to eliminate priming. For their experiment a
a T-junction. It should not make much difference word was presented on a screen, and as quickly as pos-
whether the T-junctions are vertical or horizontal (as sible a participant had to decide to what category it
in Figure 2.6(a) and 2.6(b)) and, indeed, the search belonged; for example, an animal or a vegetable. The
times for these two sorts of display are similar. participant was required to press one button for animal
However, when the Ts are mixed, as in Figure 2.6(c), it names and another for vegetables. This sounds
takes longer to find the target. This finding would not straightforward, but the target word was not presented
have been predicted by a simple feature integration in isolation; above and below it another word was also
theory. Duncan and Humphreys (1989) argued that printed, making a column of three words. The target,
part of finding the target actually involves rejecting about which a decision was to be made, was always in
the non-targets and that this is a harder task when the centre. The words repeated above and below the
they come in a greater variety. target were termed the ‘flankers’. Before the three words
This explanation does not rule out the idea that fea- were displayed, markers in the field of view showed
tures need to be integrated to achieve recognition, but exactly where the target would appear. Figure 2.7
it does suggest that non-targets as well as targets need shows examples of possible displays.
T
T
TT T
TT T T
T
T T
T TT T
T T cat pea
T TT T
T
TT
T
T L T T
TT T
T T T TTT
T T T
T T T TT T L
TT T T
TL T T dog dog
T
T TT
T
T
T
TT T T
T T T TT T T cat pea
T
T
FIGU RE 2 .6 Examples of the kinds of stimuli used by FIGU RE 2 .7 The flanker effect. It takes longer to
Duncan and Humphreys (1989). Find the letter L in each decide ‘dog’ is an animal when it is surrounded by words
of the groups (a), (b), and (c). of another category, as in (b).
CHAPTER 2 ATTENTION 51
You will probably not be surprised to learn that ‘save’ the feature integration theory. He suggested that
people make category judgements more quickly for the central target word primed the flankers so effec-
examples such as that shown in Figure 2.7(a) than for tively that they could be detected with the minimum
the 2.7(b) type of stimulus. Presumably, while the tar- of attention. Taking the items in Figure 2.7 as an
get information is being processed, details about the example, if this explanation were true it would have to
flankers are also being analysed, in parallel. When be argued that ‘dog’ primes ‘cat’, which being another
they turn out to be from the category associated with animal leads to faster decision times. ‘Dog’ cannot
pressing the other button they slow the response. This prime ‘pea’, as they are unrelated, so there is nothing to
slowing is very much like the impact of the conflicting make the decision any quicker. In other words, it is not
colour names in the Stroop effect (see Box 2.2). that ‘pea’ makes responses to ‘dog’ harder; rather, ‘cat’
However, recall that Treisman’s theory suggests that makes them easier. Broadbent and Gathercole tested
focused, serial attention is required to join features this explanation with an ingenious modification to the
together. A printed word has many features and it usual way of presenting targets and flankers. Instead
would be thought that they require joining before the of displaying all three words simultaneously, the target
word can be recognized; it should not be possible to appeared first, to be joined by the flankers 40 ms later.
process the three words simultaneously. A participant The sequence is represented in Figure 2.9.
focusing on the target could not (according to the The reasoning behind this change was as follows. If
theory) also be processing the flankers. Broadbent and Gathercole were correct that the flank-
Broadbent addressed this problem (Broadbent and ers were analysed only because of priming from the
Gathercole, 1990) and produced an explanation to target word, then giving the target a ‘head start’ should
printed in non-matching coloured inks (see Figure 2.8). Small Sleep Black Purple
A variant is the ‘emotional Stroop task’, which can Window Chair Red Blue
Great Great Yellow Yellow
be used in therapeutic diagnoses. For example, severe
Sleep Door Purple Green
depression produces cognitive impairment and, in the
Long Long Grey Grey
elderly, it is difficult to distinguish this from the effects
Chair Cat Blue Red
of the onset of dementia. Dudley et al. (2002) used
Great Small Yellow Black
colours to print a list of words, some of which were
Sleep Chair Purple Blue
associated with negative emotions (e.g. the word sad- Cat Great Red Yellow
ness). Depressed people have an attentional bias Window Sleep Pink Purple
towards such depression-related material. Patients Long Door Grey Green
were required to name the ink colours for each word as
FIGURE 2.8 The Stroop effect. The task is, as quickly as
quickly as possible. Both depressed patients and those
possible, to name the colour in which each word is
in the early stages of Alzheimer’s disease were slower
printed; do not read the words. Try the first two
than a control group, but only the patients with depres- columns to start with – the task is not too difficult. Then
sion were extra slow in responding to negative words. try the next two columns. The conflicting colour words
The technique permits an appropriate diagnosis. are very disruptive.
52 PART 1 PERCEPTUAL PROCESSES
pea
Time dog
pea
After 40 ms flankers are shown too
dog
FIGU RE 2 .9 The Broadbent and Gathercole (1990) modification: the flankers are delayed for 40 ms.
enable it to prime even more effectively; the flanker tested a large range of variations on their basic idea,
effect would be even stronger. On the other hand, if but the underlying concept and findings were as fol-
interference from the flankers was merely an example lows. Inside or outside the rectangle a word (two
of processing not being as ‘serial’ as Treisman sup- words if on the outside, i.e. like the flanker stimuli)
posed, then making flankers arrive late, when target was also presented. If the words were colour names,
processing had already started, should reduce the different from the rectangle colour, then the
flankers’ impact. Well, the delayed flankers produced a responses were slower, just as with the conventional
strong effect (i.e. faster responses with same-category Stroop test. As well as colour words another type of
flankers), suggesting that the priming idea was cor- word was sometimes used – people’s names. You will
rect. However, there is another interpretation of the recall that the emotional Stroop test (Box 2.2) detects
Broadbent and Gathercole results. It has been well slowing caused by emotionally salient words. One’s
established that an item suddenly appearing in the own name is just such a word; if you try to name the
visual field will capture attention (e.g. Gellatly et al., colour used to print your name you take longer than
1999). By making the flankers appear later, Broadbent if it is someone else’s name. So, Gronau et al. used
and Gathercole may have ensured that they would names, either inside or outside the rectangle, and
attract attention away from the target. This could sometimes the name was the participant’s own. Just
explain why the flankers showed a particularly strong as with the conflicting colour words, the personal
effect with this style of presentation. Although the name caused slowing, but only when it was presented
Broadbent and Gathercole idea of staggering the dis- inside the rectangle.
play times of the stimuli was ingenious, to investigate What are we to make of that? To recap, colour name
parallel processing convincingly requires all the differ- words caused typical Stroop interference, whether
ent stimuli to be presented at the same time. inside or outside the target rectangle, but personal
Gronau et al. (2003, 2009) have used a variant of names interfered only if inside. The difference between
the Stroop task to investigate the extent to which these classes of word is that colour names were relevant
simultaneously presented, unattended material can to the task, which was itself about naming colours; it
influence response times. They used coloured words was not about people’s names. The results tell us some-
and rectangles, all presented at the same time, in thing about the narrowness of the focus of attention.
somewhat the same way as with the flanker task. The The task was to name the colour of the rectangle, so
target was a coloured rectangle, presented on a attention was focused upon that. Inevitably, anything
screen, and participants had to indicate, as quickly as within the rectangle would fall under the ‘spotlight of
possible, what the colour was. These researchers attention’ too, and that is why both the colour words
CHAPTER 2 ATTENTION 53
and the names caused slowing when they were pre- necessary to explain the processing of the flankers;
sented within the rectangle. Personal names did not they were processed because they were relevant to the
slow responses when they were outside the rectangle, so task, i.e. deciding upon category membership. This
that region was obviously outside the area of attention. does leave us with two questions, and we shall have to
However, the colour words did interfere, even when in return to these. First, exactly how does the relevant
the unattended area, so they must have been processed material become processed if attention is normally
without requiring any attention. It would seem that required to unite (‘glue together’) the stimulus compo-
items that are relevant to the task in hand (colour nam- nents? The second question raises a different sort of
ing here) can be processed without attention, whereas issue: why does one’s name not get processed when
irrelevant material, such as personal names, cannot be unattended, if the ‘own name’ results (Section 1.3)
processed unless it receives attention. imply that it is sometimes processed in exactly those
The above finding suggests that Broadbent and circumstances?
Gathercole were wrong to think that priming was
SUMMARY OF SECTION 3
When consciously perceiving complex material, such as when looking for a particular letter of a par-
ticular colour:
In the context of dichotic listening (Section 1.2) it resulted in the perception of three ‘streams’ of speech,
was shown that ignored auditory material may never- one on the left saying ‘kay, kay, kay . . .’, one in the
theless be processed, and hence its meaning influences middle repeating ‘ell’, and the last on the right saying
perception of attended material. However, meaning ‘em’. The significant point is that instead of hearing a
appears to have no special impact when speech inter- continually changing sequence, the new way of play-
feres with memory for visually presented material. ing exactly the same sounds resulted in them sounding
Thus, hearing numbers spoken while trying to remem- like three separate sequences, each of which never
ber digits is no more damaging than listening to other changed. Remarkably, the result was that they were no
irrelevant speech items (Buchner et al., 1996). In fact, longer as disruptive to the visual recall task.
even a foreign language or English played backwards This section has taken the concept of attention into
are no less disruptive than intelligible speech (Jones a new area. Previously we have seen it as a means of
et al., 1990). On the other hand, simple white noise (a separating information or of directing the assembly of
constant hissing like a mistuned radio) is almost as different aspects of the attended item. In most of the
benign as silence. Interference presumably results earlier examples it has appeared that a great deal of
from speech because, unlike white noise, it is not con- processing can take place in parallel, although the
stant; it is broken into different sounds. results may not all reach conscious awareness. The
The importance of ‘difference’ in the speech can be impact of irrelevant speech shows that parallel pro-
shown by presenting lists of either rhyming or non- cessing is not always possible. It seems to break down
rhyming words. It turns out that a sequence such as in this case because demands are made on the same
‘cat, hat, sat, bat . . .’ is less disruptive than a sequence process – the process that places items in a sequence.
such as ‘cat, dog, hit, bus . . .’ (Jones and Macken, Here it would seem that we have a situation where
1995). Jones (1999) proposes that, whether listening there really is a ‘bottleneck’ of the sort envisaged in
to speech, music, or many other types of sound, the early theories of attention (see Sections 1.2 and 1.3).
process requires the string of sounds to be organized What of trying to study with music? Undoubtedly
into perceptual ‘objects’. To recognize an auditory ‘silence is golden’, but if music is to be played then my
object, such as a word or melody, requires that the suggestion is that it should perhaps be something that
segments of the stream of sounds are identified, and it changes very slowly, such as the pieces produced by
is also necessary to keep track of the order of the seg- some of the minimalist composers.
ments. This ordering process, which occurs automati-
cally, interferes with attempts to remember the order
of visually presented items. When the sounds contain 4.2 Attending across modalities
simple repetitions (as with the rhyming ‘at’ sound) the
ordering becomes simpler, so the memory task is less The preceding section raised the issue of attention
disrupted. This was demonstrated in a surprising but operating (and to some extent failing) across two sen-
convincing way by Jones et al. (1999). Their partici- sory modalities. By focusing on distraction we ignored
pants attempted to remember visually presented lists the fact that sight and sound (and other senses) often
while listening through headphones to a repeating convey mutually supporting information. A classic
sequence of three syllables, such as the letter names example is lip-reading. Although few of us would
‘k . . . l . . . m . . . k . . . l . . . m’. These were disruptive, claim any lip-reading skills, it turns out that, particu-
since the three letters have quite different sounds. The larly in noisy surroundings, we supplement our hear-
experimenters then changed the way in which the ing considerably by watching lip movements. You can
speech was delivered. The ‘l’ was played through both observe this at a nightclub (the music always seems to
headphones, so sounded in the middle (see Section be at an ear-damaging intensity) where people trying
1.2, Box 2.1) but the ‘k’ was played only to the left ear to hold a conversation watch each other’s faces very
and the ‘m’ was heard in the right. This manipulation closely. If attention is concerned with uniting elements
CHAPTER 2 ATTENTION 55
of stimuli from within one sense, then we might to be shadowed. By lip-reading, participants could
expect it to be involved in cross-modal (i.e. across cope to some extent with this difficult task. Driver
senses) feature binding too. In this section we will then moved the monitor to the side, away from the
look briefly at one such process. loudspeaker. This had the effect of making the
A striking example of the impact of visual lip appropriate message seem to be coming from
movements upon auditory perception is found in the lips. Since the other message did not get ‘moved’
the ventriloquism effect. This is most commonly in this way, the two now felt spatially separate and,
encountered at the cinema, where the loudspeakers although in reality the sounds had not changed, the
are situated to the side of the screen. Nevertheless, shadowing actually became easier!
the actor’s voice appears to emanate from the face on These kinds of effects have further implications at a
the screen, rather than from off to the side. Driver practical level. The use of mobile telephones while
(1996) demonstrated just how powerful this effect driving a car has been identified as dangerous, and the
could be. He presented participants with an audi- danger is not limited to the case where the driver tries
tory task that was rather like shadowing in dichotic to hold the phone in one hand, change gear with the
listening (Section 1.3) – only much harder! The two other, and steer with the knees! If a hands-free headset
messages, one of which was to be shadowed, did not is used of the type that delivers sound via an earpiece
go one to each ear; they both came from the same to just one ear, the caller’s voice sounds as if it is com-
loudspeaker and were spoken in the same voice. To ing from one side. Attending to this signal has the
give a clue as to which was to be shadowed a TV effect of pulling visual attention towards the lateral
monitor was placed just above the loudspeaker, message, reducing the driver’s responsiveness to
showing the face of the person reading the message events ahead (Spence, 2002).
SUMMARY OF SECTION 4
We have seen that attentive processes will ‘work hard’ to unite information into a coherent whole.
• Even spatially separate visual and auditory stimuli can be joined if they appear to be synchronous (the
ventriloquism effect).
• When stimuli are not synchronous the system attempts to order the segments of the stimuli inde-
pendently, resulting in distraction and lost information.
• It is a ‘bottleneck’ in the ordering process that results in one stream of information interfering with
the processing of another.
left right
the mid-line, is for them to report just one, from the This is reminiscent of the experience of pilots using a
spared field of view. However, they did much better head-up display (HUD) (see Section 2) where focus-
when the pictures would, in real life, be linked by an ing on flight information displayed in the HUD makes
action, such as a bottle and corkscrew, which would of the outside scene feel less ‘visible’. Surprising as it may
course be screwed into the top of the bottle. This sound, it seems necessary to deduce from these effects
advantage was obtained when the screw was actually that we all experience the world as a series of objects.
pointed at the bottle top, as if ready for use, but lost if it However, unless our attentive process has been dam-
was positioned to point at the base of the bottle. It aged, we can shift the attention so rapidly from one
would seem that seeing objects in a position that object to another that we perceive them all as being
implied their normal use somehow served to combine present simultaneously. Exactly what constitutes an
them, so that the part of the combination that was in object depends upon the situation; Balint patients are
the neglected field of view could be ‘rescued’. revealing here because they see only one object at a
We have been describing attention as a mechanism time. Baylis et al. (1994) described a patient who could
for assembling the sub-components of items in a not report the letters making up an isolated word.
scene, so it is not difficult to conceptualize a fault lead- Viewed in this way, each letter was a small object and
ing to some components being omitted. This account it was not possible to switch attention from one to the
sees attention as an essential element of the perceptual next. However, the patient could read the whole word,
process, helping to organize incoming information. since for this purpose it was a single object.
However, neglect is not limited to objects that are Early visual processing takes place in two major
physically present. Bisiach and Luzzatti (1978) asked pathways in the brain known as the ventral and dorsal
their patient to imagine standing in the cathedral streams (these are described in Section 6 of Chapter
square of the Italian city where he grew up. He was to 3); the parietal region is part of the dorsal pathway.
imagine looking towards the cathedral and to describe Damage to the ventral stream results in different
all that was in the square. He did this very well, except kinds of integration problems; patients are aware of
that he failed to mention any of the buildings down all aspects of a scene but to the patient they remain
the left-hand side of the square (his brain injury was segmented into small elements. For example, an indi-
on the right). He was then asked to imagine standing vidual shown a photograph of a paintbrush described
on the cathedral steps, looking back towards his previ- seeing a wooden stick and a black object (the bris-
ous viewpoint. Again, he only reported details from tles), which he could not recognize. Humphreys
the right. However, with the change of view, this meant (2001) suggests that the varieties of different prob-
that he was now describing previously ignored build- lems are evidence that the binding together of differ-
ings! Clearly his memory was intact, but in some way ent features takes place in several different stages and
not entirely accessible. Equally clearly, attentive pro- brain locations. This is underlined by recent work of
cesses are involved in the assembly of remembered Humphreys and colleagues (Humphreys et al., 2010).
material as well as of physically present stimuli. They built upon the finding that picturing objects as if
An even more extreme form of neglect is encoun- ready for use saved them from being missed by
tered in a condition known as Balint’s syndrome. It neglect patients. The extent of this saving has now
occurs when a patient is unfortunate enough to suffer been shown to be even more marked when the objects
damage to both parietal lobes, which results in it being are correctly located for the patient’s personal way of
extremely difficult to shift attention from one object to using them. For example, a left-handed patient would
another. Thus, when trying to light a cigarette, the perform best if a teapot were pictured on the left with
patient may find that their attention has been ‘cap- the cup to the right, because they would have held a
tured’ by the flame, to the extent that they can no real teapot in their left hand. The authors conclude
longer see the cigarette. One patient complained, that, in addition to the visual-based grouping
‘When I see your spectacles I cannot see your face.’ achieved by placing objects appropriately with respect
58 PART 1 PERCEPTUAL PROCESSES
to each other, there is another grouping that can be gives a clue as to where in this sequence they are
thought of as motor-based (i.e. using movement), being generated.
which comes into play when objects are placed appro- Woldorff et al. (1993) examined ERPs evoked by
priately for the viewer. sounds. These included signals occurring as soon as
10 ms after the auditory event. To generate a response
so quickly, these ERPs must have originated in the
5.2 Event-related potentials brain stem, in the first ‘relay’ between ear and audi-
tory cortex. The earliest stages of registration at the
When a sense organ (eye, ear, etc.) receives a stimu- auditory cortex were detected after about 20–50 ms.
lus, the event eventually causes neurons to ‘fire’ (i.e. It was of particular interest that, whereas the 10 ms
produce electrical discharges) in the receiving area signal was not affected by attention, the magnitude of
of the brain. The information is sent on from these the electrical activity in the cortex was smaller when
first sites to other brain areas. With appropriate the sounds were played to an unattended ear. This
apparatus and techniques it is possible to record shows that, at a very early stage of cortical analysis,
the electrical signals using electrodes attached to attending away from a stimulus actually reduces the
the scalp. The electrical potentials recorded are intensity of the signal in the brain. The result lends a
called event-related potentials (ERPs) because they good deal of support to the theory that attention is
dependably follow the triggering sensory event. In exercised by controlling a filter early in the processing
fact a whole series of electrical changes are detected, sequence (see Section 1.3). Note, however, that the
first from the receiving brain areas and then later unattended signal is only attenuated, not eliminated.
from subsequent sites. The timing of the ERPs
SUMMARY OF SECTION 5
Many familiar themes have re-emerged in this section, together with the recognition that attention is
involved in the assembly of remembered material as well as of current perceptions.
experiences of brain-damaged patients suggest that principle, be able to perceive many things at once,
this feature-assembly role ensures that our conscious there are situations where it would be counterpro-
perceptions are generally of objects rather than of their ductive to attempt to do more than one thing. Allport
constituent parts. Cross-modal research has demon- gave fruit-gathering as an example. When we look at
strated that the gathering together of related informa- a bush of berries we need to focus attention upon one
tion from different senses is also controlled by attention. at a time, since that is how they have to be picked. If
Attention has a role to play in dealing with compe- animals had not evolved this ability to select, if all
tition. The early researchers believed that attention the food items remained equally salient, they would
was vital because the brain would be able to deal with starve as they hovered over them all, unable to move
only one signal at a time; a ‘winning’ signal had to be toward any one! From this perspective, attention is
picked from among the competitors. Although we the process that saves us from trying to carry out
have shown that a good deal of analysis can actually incompatible actions simultaneously. However, eve-
take place in parallel, there are also results that suggest ryday experience reminds us that the issue of con-
that more complex analysis is largely serial, thus sciousness remains relevant. For example, novice
requiring a mechanism to select from the competing drivers experience considerable difficulty in trying
stimuli. Often, the parallel processes have to be dem- simultaneously to perform all the actions needed to
onstrated rather obliquely, since their results do not control a vehicle; in Allport’s view they are trying to
become consciously available. Thus attention has to ‘attend-for-action’ to more than one thing at a time.
do with what reaches conscious awareness. Why However, this could be restated as an attempt to be
should this be so? Why should we not be equally aware conscious of more than one thing at a time. Once the
of several items simultaneously? driver has become more skilful, the difficulty of com-
Allport (1987) offered an answer that suggests bining actions disappears, but so too does the driv-
yet another role for attention: as hinted at in Section er’s conscious awareness of performing them: they
5.1, it is to direct actions. Although we might, in have become automatic.
Naish (2010) used a temporal order judgement the order can differ, depending whether the order
(TOJ) task to explore hemispheric effects in hyp- is left-right or right-left; this is assumed to be
nosis. TOJ is a task in which two events occur and a because one hemisphere processes faster than the
participant has to say which came first. If the events other. Naish tested people who were highly
are short and the gap between them is brief it responsive to hypnosis and also those who were
becomes impossible to judge which was first, so non-responsive; testing was carried out both with-
the gap is adjusted to find the amount of time that out hypnosis and following a hypnotic induction.
is required to be just able to do the task. Naish Results indicated that people who did not respond
used flashes of light from two small light-emitting to hypnosis had a slight right hemisphere advantage
diodes (LEDs) as the two events. The LEDs were (left-first gap smaller) and this did not change
positioned on either side of the face, near the outer significantly when an attempt was made to hypno-
corners of the eyes. In these positions the light tize them. In contrast, hypnotizable participants
stimuli would each be processed in one hemisphere showed a marked left hemisphere advantage out-
of the brain; because of the contralateral arrange- side hypnosis, which changed to a strong right
ment of the brain, the left light would be ‘seen’ in advantage when they were hypnotized. It is sug-
the right hemisphere and vice versa. When the TOJ gested that this cross-over facilitates the processes
is used in this situation the gaps needed to detect that generate hallucinations.
60 PART 1 PERCEPTUAL PROCESSES
One might well ask how the term ‘attention’ has another example of experiencing changes to con-
come to be applied to so many roles and processes; it sciousness. There are a number of parallels between
might have been better to use different labels to distin- schizophrenia and hypnosis, the latter also producing
guish between them. To use one word with so many hallucinations and the feeling that actions somehow
aspects certainly makes a unitary definition very dif- happen ‘by themselves’; De Pascalis (2007) describes
ficult to formulate. I suspect that the single term has loss of gamma synchronization in hypnosis too. Naish
stuck because ultimately all these facets of attention (2010) has shown that when susceptible people are
do lead to one result: conscious awareness. hypnotized there is a shift in activity towards the right
hemisphere (see Box 2.3). There is also evidence that
something similar may happen in schizophrenia
(Caligiuri et al., 2005). Might the right hemisphere
Attention as the
6.1
have some special role in generating hallucinations? It
generator of consciousness was mentioned in Section 5.1 that this hemisphere is
more crucially involved in the processes that lead to
Consciousness as a topic is dealt with in Chapter 18, but spatial awareness; Naish (2010) argues that this hemi-
it is appropriate here to consider its close association sphere is more likely to take the lead in generating
with attention. It was mentioned above, and in several hallucinations. Since, by definition, a hallucination
other sections of this chapter, that attention is required cannot be supported by incoming sensory data, it fol-
to unite the elements of a stimulus, but we have never lows that the experience is a top-down process, pre-
stopped to consider how the unification takes place. sumably initiated by the prefrontal region. How might
Neural oscillations occur across the brain at a range of this come about?
different frequencies; you may have heard of alpha (α) In Section 2.4 the distinction was made between
waves, which can be seen clearly in EEG recordings two kinds of stimulus that fail to result in conscious
when a participant relaxes with eyes closed. α-waves awareness. One kind is the heavily masked stimulus,
have a frequency of about 10 Hz (i.e. ten cycles per sec- which, although at the centre of attention, is unable to
ond) and seem to arise principally from the visual initiate sufficient neural activity to reach stages that
region of the brain. Another wave type is referred to as are associated with consciousness. The other kind of
gamma (γ), oscillating at about 40 Hz and found widely stimulus generates ample neural activity but fails to
across the cortex. There is growing evidence that when reach consciousness because it is not attended. In
different brain regions are contributing to the same uni- what way does that lack of attention disadvantage the
fied perception their respective γ-waves become syn- signal? The answer is based on the fact that we now
chronized. This is analogous to an orchestra (the brain) know that, at every level of processing, the brain has
where a subset of the players follows the conductor, connections that lead ‘backwards’ in addition to those
while the rest ‘do their own thing’ quietly in the back- that carry the information forwards to the next stage.
ground. The analogy invites the question: Where is the Thus, the output of every stage appears to feed back
conductor? The answer appears to be in the prefrontal into that same stage of analysis, a process that can
cortex; it contains neurons with long axons, stretching speed the analysis, produce more distinct output, and,
back to the sensory regions of the brain. importantly, produce a localized cycle of activity that
Altered states of consciousness cast some light on continues to reverberate for a short while, like a bell
the effects of γ-wave synchronization and its absence. that has been struck. This kind of feedback is termed
People suffering from schizophrenia experience hal- re-entrant processing, and it explains many of the
lucinations and feel that their actions are ‘not their effects of masking. Kouider and Dehaene (2007) use
own’ but controlled from outside. There appears to be the results of brain scanning to support the idea that
a breakdown in normal gamma activity in these very brief, masked stimuli are too weak to initiate the
patients (Haig et al., 2000). Being hypnotized is local reverberation. Presumably it is this reverberation
CHAPTER 2 ATTENTION 61
that preserves the second target in RSVP (Section 2.3) The experiencing of neglect when trying to recall a
just so long as it is not changed to a new pattern by a visual scene (Section 5.1) is a reminder of the close
following stimulus. The ‘preservation’ of T2 is await- links between the processes that bring a current stimu-
ing attention, and that involves the establishing of lus into conscious awareness, and those that generate
long-range feedback and reverberation from the pre- recollections or imagined events. It seems likely that
frontal cortex. This reverberation is much like that of the same long-range feedback loops are involved in the
the earlier stages, except in one crucial detail: the feed- two situations; brain scanning certainly shows that the
back that makes it possible is not automatic, it is flex- overall patterns of activity during real and imagined
ible and depends upon the deployment of attention. experiences are very similar – but not identical.
Once these long-range circuits are established the Residual differences may result from the fact that activ-
activity initiates a conscious experience (Lamme, ity due to imagination must be generated entirely from
2003; Kouider and Dehaene, 2007). top-down processes. This was proposed earlier for the
It now becomes clearer why numerous stimuli can production of hallucinations, but the results clearly feel
receive extensive processing in parallel, while nor- more realistic than when simply imagining. Scanning
mally only one is successful in reaching conscious during hypnotically-generated hallucinations shows
awareness. If the fronto-posterior (i.e. front-to-back) that whether these are visual (Kosslyn et al., 2000) or
reverberation is synonymous with the γ-band syn- auditory (Szechtman et al., 1998), the patterns are vir-
chronization described earlier, then conscious experi- tually identical to the genuine experience. Naish (2007)
ence would become meaningless if all analysed signals has suggested that it is the behaviour of a specific part
were synchronized. Remember that the idea of a con- of the frontal brain, the anterior cingulate cortex
ductor picking out a subset of players was an analogy (ACC), that determines the level of reality experienced,
for uniting the elements that belonged to one stimu- and that the ACC serves to regulate the degree of influ-
lus; if everything were synchronized and united we ence that the prefrontal cortex can exert.
would experience a very strange stimulus indeed! In a
sense, attention imposes a bottleneck, rather than sav-
ing a bottleneck from being overloaded as the earlier 6.2 Conclusions
researchers had supposed. The width of the neck is
variable and depends in part upon what is considered So there we have it, attention is the process that not
to be a unitary stimulus. The finding that neglect can only unites the elements that go to make up a stimu-
be defeated when items are in a ‘used together’ con- lus, but also brings the result to conscious awareness.
figuration (Section 5.1) suggests that there may be Indeed, uniting and consciousness appear to be one
situations where a rather wide range of elements from and the same.
different stimuli are brought together. Can that be right? A good case can be made for sug-
Presumably the synchronizing feedback is deployed gesting that consciousness evolved to enable us to
strategically and can shift rapidly. Our expectations ‘replay’ memories and to imagine, as described above.
speed our recognition of words, so it may be assumed Baumeister and Masicampo (2010) have taken this a
that the feedback loops are being established just little further and suggest that it is because we were
ahead of the arriving stimulus. In this way it is easy for evolving to be a complex social animal that we needed
conscious awareness to pick up an expected story in this facility to observe and revisit our own behaviour.
the ‘wrong’ ear during dichotic listening (Section 1.3). The implication is that less complex creatures do not
Similarly, task demands will influence the feedback have consciousness as we do (something many people
circuits, so that relevant words not actually at the would have assumed anyway). Yet it seems very likely
focus of spatial attention can nevertheless gain some that all but the very simplest must have a mechanism
benefit from the synchronizing enhancement and for uniting the components of a stimulus. This implies
influence decisions (Section 3.3). that there may be at least some animals that can unite
62 PART 1 PERCEPTUAL PROCESSES
the elements of stimuli, yet not have conscious aware- will agree that it was broad – and we haven’t covered
ness of the result. Perhaps the suggestion made above, half of it, nor reached an entirely satisfactory
that uniting and consciousness are effectively two sides definition – but I hope you are now intrigued too. It
of the same coin, is not true after all. Clearly there is is generally accepted that readers cannot continue to
still room for more research in this tantalizing field! devote attention to text that goes on too long, so
I promised at the start of this chapter that atten- I trust that I have stimulated, rather than sated,
tion was a broad and intriguing topic. I am sure you your attention!
FURTHER READING
Styles, E.A. (1997) The Psychology of Attention, Hove, Kouider, S. and Dehaene, S. (2007) ‘Levels of processing
Psychology Press. A very readable textbook, which covers and during non-conscious perception: a critical review of visual
extends the topics introduced in this chapter. masking’, Philosophical Transactions of the Royal Society, B,
Pashler, H. (ed.) (1998) Attention, Hove, Psychology Press. vol.362, pp.857–75. A very readable overview of the develop-
An edited book with contributors from North America and the ment of theories concerned with attending to hard-to-see stimuli.
UK. Topics are dealt with in rather more depth than in the Styles
book.
REFERENCES
Allport, D.A. (1987) ‘Selection for action: some behavioural Broadbent, D.E. and Gathercole, S.E. (1990) ‘The process-
and neurophysiological considerations of attention and ing of non-target words: semantic or not?’ Quarterly Journal of
action’, in Heuer, H. and Sanders, A.F. (eds.) Perspectives on Experimental Psychology, vol.42A, pp.3–37.
Perception and Action, Hillsdale, NJ, Lawrence Erlbaum Buchner, A., Irmen, L., and Erdfelder, E. (1996) ‘On the
Associates. irrelevance of semantic information for the “Irrelevant
Baumeister, R.F. and Masicampo, E.J. (2010) ‘Conscious Speech” effect’, Quarterly Journal of Experimental Psychology,
thought is for facilitating social and cultural interactions: how vol.49A, pp.765–79.
mental simulations serve the animal-culture interface’, Caligiuri, M.P., Hellige, J.B., Cherry, B.J., Kwok, W., Lulow,
Psychological Review, vol.117, pp.945–71. L.L., and Lohr, J.B. (2005) ‘Lateralized cognitive dysfunction
Baylis, G.C., Driver, J., Baylis, L., and Rafal, R.D. (1994) and psychotic symptoms in schizophrenia’, Schizophrenia
‘Reading of letters and words in a patient with Balint’s syn- Research, vol.80, pp.151–61.
drome’, Neuropsychological, vol.32, pp.1273–86. Cheesman, J. and Merikle, P.M. (1984) ‘Priming with and
Bisiach, E. and Luzzatti, C. (1978) ‘Unilateral neglect of without awareness’, Perception and Psychophysics, vol.36,
representational space’, Cortex, vol.14, pp.129–33. pp.387–95.
Broadbent, D.E. (1952) ‘Listening to one of two synchro- Coltheart, M. (1980) ‘Iconic memory and visible persis-
nous messages’, Journal of Experimental Psychology, vol.44, tence’, Perception and Psychophysics, vol.27, pp.183–228.
pp.51–5. Corteen, R.S. and Wood, B. (1972) ‘Autonomous responses
Broadbent, D.E. (1954) ‘The role of auditory localization in to shock-associated words in an unattended channel’, Journal
attention and memory span’, Journal of Experimental of Experimental Psychology, vol.94, pp.308–313.
Psychology, vol.47, pp.191–6. De Pascalis, V. (2007) ‘Phase-ordered gamma oscillations
Broadbent, D.E. and Broadbent, M.H.P. (1987) ‘From and the modulation of hypnotic experience’, in Jamieson, G.
detection to identification: response to multiple targets in (ed.) Hypnosis and Conscious States: The Cognitive-
rapid serial visual presentation’, Perception and Psychophysics, Neuroscience Perspective, Oxford, Oxford University Press.
vol.42, pp.105–13.
CHAPTER 2 ATTENTION 63
Deutsch, J.A. and Deutsch, D. (1963) ‘Attention: some theo- Jones, D.M. (1999) ‘The cognitive psychology of auditory
retical considerations’, Psychological Review, vol.70, pp.80–90. distraction’, British Journal of Psychology, vol.90, pp.167–87.
Driver, J. (1996) ‘Enhancement of selective listening by illu- Jones, D.M. and Macken, W.J. (1995) ‘Phonological simi-
sory mislocation of speech sounds due to lip-reading’, Nature, larity in the irrelevant speech effect: within- or between-
vol.381, pp.66–8. stream similarity?’ Journal of Experimental Psychology:
Driver, J. and Halligan, P.W. (1991) ‘Can visual neglect Learning, Memory and Cognition, vol.21, pp.103–15.
operate in object centred co-ordinates? An affirmative case Jones, D.M., Miles, C., and Page, J. (1990) ‘Disruption of
study’, Cognitive Neuropsychology, vol.8, pp.475–96. reading by irrelevant speech: effects of attention, arousal or
Dudley, R., O’Brien, J., Barnett, N., McGuckin, L., and memory?’ Applied Cognitive Psychology, vol.4, pp.89–108.
Britton, P. (2002) ‘Distinguishing depression from dementia Jones, D.M., Saint-Aubin, J., and Tremblay, S. (1999)
in later life: a pilot study employing the emotional Stroop task’, ‘Modulation of the irrelevant sound effect by organizational
International Journal of Geriatric Psychiatry, vol.17, pp.48–53. factors: further evidence from streaming by location’,
Duncan, J. and Humphreys, G.W. (1989) ‘Visual search and Quarterly Journal of Psychology, vol.52A, pp.545–54.
visual similarity’, Psychological Review, vol.96, pp.433–58. Kolers, P.A. (1968) ‘Some psychological aspects of pattern
Evett, L.J. and Humphreys, G.W. (1981) ‘The use of abstract recognition’, in Kolers, P.A. and Eden, M. (eds.) Recognizing
graphemic information in lexical access’, Quarterly Journal of Patterns, Cambridge, MA, MIT Press.
Experimental Psychology: Human Experimental Psychology, Kosslyn, S.M., Thompson, W.L., Costantini-Ferrando,
vol.33A, pp.325–50. M.F., Alpert, N.M., and Spiegel, D. (2000) ‘Hypnotic visual
Gellatly, A., Cole, G., and Blurton, A. (1999) ‘Do equilumi- illusion alters color processing in the brain’, American Journal
nant object onsets capture visual attention?’ Journal of of Psychiatry, vol.157, pp.1279–84.
Experimental Psychology: Human Perception and Performance, Kouider, S. and Dehaene, S. (2007) ‘Levels of processing
vol.25, pp.1609–24. during non-conscious perception: a critical review of visual
Giesbrecht, B. and Di Lollo, V. (1998) ‘Beyond the atten- masking’, Philosophical Transactions of the Royal Society, B,
tional blink: visual masking by object substitution’, Journal of vol.362, pp.857–75.
Experimental Psychology: Human Perception and Performance, Lamme, V.A.F. (2003) ‘Why visual attention and awareness
vol.24, pp.1454–66. are different’, Trends in Cognitive Sciences, vol.7, pp.12–18.
Gronau, N., Cohen, A., and Ben-Shakhar, G. (2003) Merikle, P.M. and Joordens, S. (1997) ‘Parallels between
‘Dissociations of personally significant and task-relevant dis- perception without attention and perception without aware-
tractors inside and outside the focus of attention: a combined ness’, Consciousness and Cognition, vol.6, pp.219–36.
behavioral and psychophysiological study’, Journal of Naish, P.L.N. (1990) ‘Simulating directionality in airborne
Experimental Psychology: General, vol.132, pp.512–29. auditory warnings and messages’, in Life, M.A., Narborough-
Gronau, N., Cohen, A., and Ben-Shakhar, G. (2009) Hall, C.S., and Hamilton, W.I. (eds.) Simulation and the User
‘Distractor interference in focused attention tasks is not medi- Interface, London and New York, Taylor and Francis.
ated by attention capture’, Quarterly Journal of Experimental Naish, P.L.N. (2007) ‘Time distortion, and the nature of
Psychology, vol.62, pp.1685–95. hypnosis and consciousness’, in Jamieson, G. (ed.) Hypnosis
Haig, A.R., Gordon, E., De Pascalis, V., Meares, R.A., and Conscious States: The Cognitive Neuroscience Perspective,
Bahramali, H., and Harris, A. (2000) ‘Gamma activity in Oxford, Oxford University Press.
schizophrenia: evidence of impaired network binding?’ Naish, P.L.N. (2010) ‘Hypnosis and hemispheric asymme-
Clinical Neurophysiology, vol.111, pp.1461–8. try’, Consciousness and Cognition, vol.19, pp.230–4.
Humphreys, G.W. (2001) ‘A multi-stage account of binding Norman, D.A. (1968) ‘Towards a theory of memory and
in vision: neuropsychological evidence’, Visual Cognition, attention’, Psychological Review, vol.75, pp.522–36.
vol.8, pp.381–410. Pecher, D., Zeelenberg, R., and Raaijmakers, G.W. (2002)
Humphreys, G.W., Riddoch, M.J., Forti, S., and Ackroyd, K. ‘Associative priming in a masked perceptual identification
(2004) ‘Action influences spatial perception: neuropsychologi- task: evidence for automatic processes’, Quarterly Journal of
cal evidence’, Visual Cognition, vol.11, pp.401–27. Experimental Psychology: Human Experimental Psychology,
Humphreys, G.W., Wulff, M., Yoon, E.Y., and Riddoch, M.J. vol.55A, pp.1157–73.
(2010) ‘Neuropsychological evidence for visual- and motor- Raymond, J.E., Shapiro, K.L., and Arnell, K.A. (1992)
based affordance: effects of reference frame and object–hand ‘Temporary suppression of visual processing in an RSVP task:
congruence’, Journal of Experimental Psychology: Learning, an attentional blink?’ Journal of Experimental Psychology:
Memory and Cognition, vol.36, pp.659–70. Human Perception and Performance, vol.18, pp.849–60.
64 PART 1 PERCEPTUAL PROCESSES
Riddoch, M.J., Humphreys, G.W., Edwards, S., Baker, T., Proceedings of the National Academy of Sciences, vol.95,
and Willson, K. (2003) ‘Actions glue objects but associations pp.1956–60.
glue words: neuropsychological evidence for multiple object Treisman, A. (1960) ‘Contextual cues in selective listening’,
selection’, Nature Neuroscience, vol.6, pp.82–9. Quarterly Journal of Experimental Psychology, vol.12, pp.242–8.
Shaffer, W.O. and LaBerge, D. (1979) ‘Automatic semantic Treisman, A. (1998) ‘Feature binding, attention and object
processing of unattended words’, Journal of Verbal Learning perception’, Philosophical Transactions of the Royal Society of
and Verbal Behaviour, vol.18, pp.413–26. London, B, vol.353, pp.1295–306.
Shapiro, K.L., Caldwell, J., and Sorensen, R.E. (1997) Treisman, A. and Gelade, G. (1980) ‘A feature-integration
‘Personal names and the attentional blink: a visual “cocktail theory of attention’, Cognitive Psychology, vol.12, pp.97–136.
party” effect’, Journal of Experimental Psychology: Human Turvey, M.T. (1973) ‘On peripheral and central processes in
Perception and Performance, vol.23, pp.504–514. vision: inferences from an information-processing analysis of
Spence, C. (2002) ‘Multisensory integration, attention and masking with patterned stimuli’, Psychological Review, vol.80,
perception’, in Roberts, D. (ed.) Signals and Perception: The pp.1–52.
Fundamentals of Human Sensation, Basingstoke, Hampshire/ Vogel, E.K., Luck, S.J., and Shapiro, K.L. (1998)
New York, Palgrave Macmillan. ‘Electrophysiological evidence for a postperceptual locus
Sperling, G. (1960) ‘The information available in brief vis- of suppression during the attentional blink’, Journal of
ual presentations’, Psychological Monographs, vol.74, pp. 1–29. Experimental Psychology: Human Perception and Performance,
Stroop, J.R. (1935) ‘Studies of interference in serial verbal vol.24, pp.1656–74.
reactions’, Journal of Experimental Psychology, vol.18, Woldorff, M.G., Gallen, C.C., Hampson, S.A., Hillyard,
pp.643–62. S.A., Pantev, C., Sobel, D., and Bloom, F.E. (1993) ‘Modulation
Szechtman, H., Woody, E., Bowers, K.S., and Nahmias, C. of early sensory processing in human auditory cortex during
(1998) ‘Where the imaginal appears real: a positron auditory selective attention’, Proceedings of the National
emission tomography study of auditory hallucinations’, Academy of Sciences of the USA, vol.90, pp.8722–6.
PERCEP TION
Graham Pike, Graham Edgar, and Helen Edgar
1 INTRODUCTION
If you have ever searched frantically for an object that If the cognitive processes involved in perception
turns out to have been right in front of you all along, were simple, then it would be hard to see how the
then this chapter may make you feel better. For, as you effects in Figure 3.1 could occur. After all, they are all
will see, perception of even the simplest object is actu- based on very straightforward geometric shapes that
ally a very complex affair. So, next time you turn the should be easy to perceive accurately. Activity 3.1 dem-
house upside down looking for your keys and then onstrates that there must be more sophisticated pro-
find them in the first place you looked, remember that cesses that have been developed to perceive the
your brain is using extremely sophisticated processes, complex visual environment, which get confused or
many of which are beyond even the most advanced tricked by elements of these images. In fact the three
computer programs available today (not that com- effects above are likely to be caused because our visual
puter programs ever lose their keys!). system has evolved to perceive solid, three-dimen-
The sophistication of the cognitive processes that sional (3D) objects and attempts to interpret the two-
allow us to perceive visually is perhaps, if perversely, dimensional (2D) shapes as resulting from 3D scenes.
revealed best through the errors that our perceptual sys- Perceptual errors arising from localized damage to
tem can make. Figure 3.1 contains three very simple the brain also demonstrate the complexities involved
visual illusions that illustrate this. Image (a) is the Müller– in visual perception. Some of the problems faced by
Lyer illusion, in which the vertical line on the left is per- people suffering from specific neuropsychological
ceived as being longer even though both lines are of an conditions include: being able to recognize objects but
identical length. Image (b) is a Necker cube, in which it not faces (prosopagnosia); being able to perceive indi-
is possible to perceive the cube in either of two perspec- vidual parts of the environment but not to integrate
tives (although you can never see both at the same time these parts into a whole; believing that one’s family has
so please do not strain your eyes trying). Image (c) is been replaced by robots/aliens or impostors of the
Kanizsa’s (1976) illusory square, in which a square is same appearance (Capgras syndrome); and only being
perceived even though the image does not contain a able to perceive one side of an object (visual, or sen-
square but only four three-quarter-complete circles. sory, neglect – see Chapter 2, Section 5.1).
66 PART 1 PERCEPTUAL PROCESSES
(b)
(a)
(c)
FIGU RE 3.1 Three visual phenomena: (a) Müller–Lyer illusion; (b) Necker cube; (c) Kanizsa’s illusory square.
ACTIVIT Y 3.1
Look at each of the three visual illusions in Figure can’t think of an answer, it may help to look at
3.1 and try to work out why it occurs. If you Figure 3.2.
(b)
(a) (c)
FIGU RE 3. 2 Some clues as to why the illusions in Figure 3.1 may occur.
CHAPTER 3 PERCEPTION 67
1.1 Perceiving and sensing or sound waves). However, to sense information does
not entail making sense of it. There is a key difference
The term perception has different meanings, although between being able to detect the presence of a certain
a common element in most meanings is that percep- type of energy and being able to make use of that
tion involves the analysis of sensory information. energy to provide information as to the nature of the
When cognitive psychologists talk about perception, environment surrounding us. Thus we use the term
they are usually referring to the basic cognitive pro- ‘sensation’ to refer to that initial detection and the
cesses that analyse information from the senses. term ‘perception’ to refer to the process of construct-
Throughout this chapter we shall be examining ing a description of the surrounding world. For exam-
research and theories that have attempted to reveal ple, there is a difference between the cells in a person’s
and describe the cognitive processes responsible for eye reacting to light (sensation) and that person
analysing sensory information and providing a basic knowing that their course tutor is offering them a cup
description of our environment; basically, how we of tea (perception).
make sense of our senses! You may have noticed that we have begun to focus
There has been considerable debate about the role on visual perception rather than any of the other
played by sensory information in our perception of senses. Although the other senses, particularly hear-
the world, with some philosophers rejecting the idea ing and touch, are undoubtedly important, there has
that it plays any part at all in the perception of objects. been far more research on vision than on the other
Atherton (2002) suggested that this may be because modalities. This is because when we interact with the
the notion of a sensation is rather problematic: world we rely more on vision than on our other senses.
‘Sensations seem to be annoying, extra little entities . . . As a result, far more of the primate brain is engaged in
that somehow intervene between the round dish and processing visual information than in processing
our perception of it as round’ (Atherton, 2002, p.4). information from any of the other senses. We use
We will not delve into this philosophical debate here, vision in both quite basic ways, such as avoiding
other than to note the distinction between sensation objects, and in more advanced ways, such as in read-
and perception. Throughout this chapter we will use ing or recognizing faces and objects. So, although the
the term ‘sensation’ to refer to the ability of our sense previous chapter examined auditory perception and
organs to detect various forms of energy (such as light Chapter 4 will explore haptic perception (touch) as
68 PART 1 PERCEPTUAL PROCESSES
Anterior
chamber Retina
Cornea
Incoming
light rays
Aqueous
humour
Vitreous
humour
well as visual perception, we will devote the present rods and cones are sensitive to light, although the
chapter to examining research into, and theories of, rods respond better than the cones at low light levels
visual perception. and are therefore the cells responsible for maintain-
ing some vision in poor light. The cones are responsi-
ble for our ability to detect fine detail and different
1.2 The eye colours and are the basis of our vision at higher (day-
light) light levels. Many animals, such as dogs and
The logical place to start any consideration of visual cats, have a higher ratio of rods to cones than humans
perception is with the eye. A cross-section of the do. This allows them to see better in poor light, but
human eye is presented in Figure 3.3. Incoming light means that they are not so good at seeing either
passes through the cornea into a small compartment colour or fine detail.
called the anterior chamber (filled with fluid termed One area of the retina that is of particular interest is
aqueous humour) and then through the lens into the the central portion known as the macula lutea (it is
major chamber of the eye that is filled with a viscous yellow in colour and ‘lutea’ derives from a Latin word
jelly called vitreous humour. The light is focused by that means yellow), which contains almost all of the
the lens/cornea combination onto the retina on the cones within the human retina. Within the macula,
back surface of the eye. It is the receptor cells in the there is a small indentation called the fovea. The fovea
retina that ‘sense’ the light. is the area of the retina that contains the highest
The retina consists of two broad classes of receptor density of cones and is responsible for the perception
cell, rods and cones (so called for their shapes). Both of fine detail.
ACTIVIT Y 3.2
Place your thumbs together and hold them out at two thumb widths away from where your eyes are
arm’s length from your eyes. Now slowly move your focused, it appears to go out of focus. This is
left thumb to the left whilst keeping your eyes because the light being reflected into your eyes
focused on your right thumb. You will find that after from the left thumb is no longer striking the fovea,
you have moved your left thumb more than about meaning that you cannot perceive it in fine detail.
CHAPTER 3 PERCEPTION 69
Approaches to
1.3 mechanisms (Milner and Goodale, 1998). But,
although it is important to make the distinction
perception between perception for action and perception for rec-
ognition, we should not see them as being entirely
Psychologists have taken many different approaches independent. Sometimes the object that is about to hit
to studying perception. One important distinction your head could be the football that David Beckham
between approaches is whether the ‘goal’ of percep- has just crossed from the wing, requiring a very differ-
tion is assumed to be action or recognition. It is pos- ent response from that to the crystal tumbler.
sible to conceive of recognition and action as being Another way of differentiating approaches to per-
stages in the same perceptual process, so that action ception is to consider the ‘flow of information’ through
would only happen once recognition had taken place. the perceptual system. To see what we mean by this
However, our reaction to objects in the environment phrase, try Activity 3.3.
sometimes has to be very quick indeed, so that first So, in the case of touch, perception of the environ-
having to work out what an object may be would be ment can involve information ‘flowing’ through the
inconvenient to say the least. For example, if I see a relevant perceptual system in two directions. But what
moving object on a trajectory that means it will hit me about vision? If we were to remove the blindfold from
in the head, then the most important thing is to move our student in Activity 3.3, they would instantly be able
my head out of the way. Working out that the object is to tell what the unknown object was or to spot the
the crystal tumbler containing vodka and tonic that book in front of them. Does this mean that there is not
was only moments ago in the hand of my somewhat a similar flow of information when the sense being
angry-looking partner is, for the moment at least, of used is vision?
secondary importance. I need to act to get out of the To answer this question, let’s try to formulate the
way of the object regardless of what the object actually stages involved in the student perceiving that there is
is or who threw it. a book in front of them. One approach might be:
As we shall see, there is evidence that perception
for action and perception for recognition are quite • Light reflected from the book strikes the retina and
different processes that may involve different neural is analysed by the brain.
ACTIVIT Y 3. 3
Consider these two scenarios: feeling it. A common strategy to employ for the sec-
1 A blindfolded student trying to work out ond scenario is to hold in your mind the likely shape
what the unknown object they have been handed and texture of the book and to search the environ-
might be. ment for an object that shares these characteristics.
2 A blindfolded student searching for their The key difference between these scenarios is the
textbook. direction in which information about the object is
Imagine you are the blindfolded student. What strat- ‘flowing’, demonstrated by how the student’s existing
egies do you think you might employ to complete the knowledge of what objects look like is being utilized.
above two tasks successfully? Can you identify any In the first scenario, information is flowing ‘upward’,
key differences in these strategies? starting with an analysis of the information derived
from the senses (in this case via touch). In the second
COM M ENT
scenario, information is flowing ‘downward’, starting
A common strategy to employ for the first scenario is
with the knowledge of what books tend to feel like.
to try to build up a ‘picture’ of the object by gradually
70 PART 1 PERCEPTUAL PROCESSES
• This analysis reveals four sudden changes in book appearance could come in very useful in finding
brightness (caused by the edges of the book against the textbook. Instead of building up a picture of the
whatever is behind it). environment by analysing sensory information alone,
• Two of these are vertical edges and two are it could be that the student uses existing knowledge of
horizontal edges (the left/right and top/bottom of what books look like to find this particular book. For
the book). example, they might progress like this:
SUMMARY OF SECTION 1
• Even the perception of simple images involves sophisticated cognitive processing, as demonstrated
by visual illusions and neuropsychological disorders.
• We use the term sensation to refer to the detection of a particular form of energy by one of the senses
and the term perception to refer to the process of making sense of the information sent by the senses.
• In the human eye the lens and cornea focus light onto the retina, which contains receptor cells that
are sensitive to light.
• Perception can have different goals. The most common goals are perception for action and percep-
tion for recognition.
• The bottom-up approach to perception sees sensory information as the starting point, with perception
occurring through the analysis of this information to generate an internal description of the environment.
• The top-down approach to perception involves making greater use of prior knowledge, with this
guiding the perceptual process.
CHAPTER 3 PERCEPTION 71
SUMMARY OF SECTION 2
• The Gestalt approach to perception involved studying the principles by which individual elements
tend to be organized together.
• Organizing principles include closure, good continuation, proximity, and similarity.
• The stimuli used by Gestalt researchers tended to be quite simple, two-dimensional geometric
patterns.
CHAPTER 3 PERCEPTION 73
3GIBSON’S THEORY OF
PERCEPTION
In Section 1.3 we stated that one way of classifying dif- direct, in that the information present in light is suf-
ferent approaches to perception was according to ficient to allow a person to move through and inter-
whether they were primarily bottom-up or top-down. act with the environment. One implication of this is
If visual perception is based primarily around bottom- that, whereas perception of a real environment is
up processing, we must be capable of taking the infor- direct, perception of a 2D image in a laboratory
mation from the light waves that reach our eyes and experiment (or any 2D image come to that) would be
refining it into a description of the visual environ- indirect. When confronted with an image, our direct
ment. Bottom-up perception requires that the light perception is that it is an image; that it is two-dimen-
arriving at the retina is rich in information about the sional and printed on paper, for example. Our per-
environment. One bottom-up approach to perception, ception of whatever is being depicted by the image is
that of J.J. Gibson (1950, 1966), is based on the prem- only indirect. For this reason, Gibson thought that
ise that the information available from the visual envi- perception could never be fully explored using labo-
ronment is so rich that no cognitive processing is ratory experiments.
required at all. As Gibson himself said: When you look at Figure 3.7, what do you see?
Your first reaction is probably to say ‘a pipe’. But if
When the senses are considered as a perceptual sys- what you are seeing is a pipe, then why can’t you pick
tem, all theories of perception become at one stroke it up and smoke it? As Magritte informs us, what you
unnecessary. It is no longer a question of how the are seeing is not a pipe but a picture of a pipe. Like
mind operates on the deliverances of sense, or how Gibson, Magritte is drawing a distinction between
past experience can organize the data, or even how direct perception (paint on canvas) and indirect per-
the brain can process the inputs of the nerves, but ception (that the painting depicts a pipe).
simply how information is picked up.
(Gibson, 1966, p.319)
3.1 An ecological approach addition, the objects themselves will consist of real
surfaces that also contain texture. To explain percep-
tion, we need to be able to explain how these surfaces
At the heart of Gibson’s approach to perception is the and textures provide information about the world
idea that the world around us structures the light that around us.
reaches the retina. Gibson believed perception should
be studied by determining how the real environment
structures the light that reaches our retina. From the
importance placed on the ‘real world’ it is clear why
3.2The optic array and
Gibson called his theory of perception ecological invariant information
optics. Gibson referred to theories that were based on
experiments employing artificial, isolated, flat (or The structure that is imposed on light reflected by
plane) shapes as ‘air’ theories, whilst he referred to his the textured surfaces in the world around us is what
own as a ‘ground’ theory, as it emphasized the role Gibson termed the ambient optic array. The basic
played by the real, textured surface of the ground in structure of the optic array is that the light reflected
providing information about distance. As Gibson from surfaces in the environment converges at
stated: ‘A surface is substantial; a plane is not. A sur- the point in space occupied by the observer (see
face is textured; a plane is not. A surface is never per- Figure 3.8). As you can see from Figure 3.9, as you
fectly transparent; a plane is. A surface can be seen; a stand up, the position of your head with respect to
plane can only be visualized’ (Gibson, 1979, p.35). the environment is altered and the optic array
The impetus for Gibson’s theory came from his changes accordingly.
work training pilots to land and take off during the You can see from Figures 3.8 and 3.9 that the pri-
Second World War. When approaching a runway, it is mary structure of the optic array is a series of angles
very important that a pilot is able to judge accurately that are formed by light reflecting into the eyes from the
the distance between the plane and the ground. The surfaces within the environment. For example, an angle
perceptual skill involved in this judgement is that of may be formed between the light that is reflected from
‘depth perception’, this being the ability to judge how the near edge of a table and that from the far edge.
far you are from an object or surface. However, Gibson In addition to the primary structure of the optic
found that tests based on pictorial stimuli did not dis- array, Gibson maintained that there were additional,
tinguish good from bad pilots and that training with higher-order features that could provide unambigu-
pictorial stimuli had little impact on actual landing ous information as to the nature of the environment.
performance (Gibson, 1947). Extrapolating from this He referred to these higher-order features as invariants
problem, Gibson suggested that psychological experi- and believed that an observer could perceive the
mentation based on the use of pictorial stimuli is not surrounding world by actively sampling the optic
an apt method for studying perception. array in order to detect invariant information.
His point was that the experience of perception in One of the most commonly cited forms of invari-
the real world is very different from the experience of ant information was explored by Sedgwick (1973).
looking at 2D experimental stimuli in a laboratory. In Sedgwick demonstrated the ‘horizon ratio relation’,
the real world, objects are not set against a blank which specifies that the ratio of how much of an object
background but against the ground, which consists of is above the horizon to how much is below it remains
a very large number of surfaces that vary in their dis- constant (or invariant) as the object travels either
tance from and orientation to the observer. In their toward or away from you (see Figure 3.10). This form
turn, these surfaces are not perfectly smooth planes of invariant information allows you to judge the rela-
but consist of smaller elements, such as sand, earth, tive heights of different objects regardless of how far
and stone, which give them a textured appearance. In away they are. The proportion of the object that is
CHAPTER 3 PERCEPTION 75
FIGU RE 3. 8 The ambient optic array. Source: Gibson, 1979, Figure 5.3
‘above’ the horizon increases with the overall height of disparity. There are three main forms of texture gradi-
the object (see Figure 3.11). ent relating to the density, perspective, and compres-
One of the most important forms of invariant infor- sion of texture elements. The exact nature of a texture
mation in Gibson’s theory is texture gradient, although element will change from surface to surface (see
he also discusses gradients of colour, intensity, and Figure 3.12); in a carpet the elements are caused by the
FIGU RE 3.9 Change in the optic array caused by movement of the observer. Source: Gibson, 1979, Figure 5.4
76 PART 1 PERCEPTUAL PROCESSES
1m 10m 20m
FIGU RE 3.10 The horizon ratio relation: same height objects at different distances.
individual twists of material, while on a road they are elements (number of elements per square metre) will
caused by the small stones that make up the surface. In increase with distance. For example, the surface in
making use of texture gradients, we assume that the Figure 3.13(a) appears to recede as the density of tex-
texture of the surface is uniform; for example, that the ture elements (the individual squares) increases
road surface consists of stones of similar size through- toward the top of the image.
out its length. Therefore, any change in the apparent In a similar fashion, the perspective gradient (the
nature of the texture provides us with information width of individual elements) and the compression
regarding the distance, orientation, and curvature of gradient (the height of individual elements) can reveal
the surface. the shape and orientation of a surface. As you can see
Using texture gradients as a guide, we can tell if from Figure 3.13(b), we do not see this surface as flat
a surface is receding because the density of texture because the width and height of the individual texture
1.8m
1.4m
1m
FIGU RE 3.11 The horizon ratio relation: different height objects at same distance.
CHAPTER 3 PERCEPTION 77
FIGU RE 3.12 Examples of texture elements. Source: Gibson, 1979, Figure 2.1
(a) (b)
FIGU RE 3.13 (a) How texture gradient can reveal that a surface is receding; (b) How perspective and compression
gradients reveal the shape and orientation of a surface.
78 PART 1 PERCEPTUAL PROCESSES
elements changes, making the surface appear to be appear to move past much faster than the cows at the
slanting and curved. back of the field. Thus, the degree of apparent motion
Without texture, considerable ambiguity about shape is directly related to the distance of the object from the
and orientation can be introduced into the stimulus observer.
and this poses a problem for experiments that make use A second means by which observer motion can
of planar geometric shapes (as you saw with the Necker provide information about the shape and position of
cube in Activity 3.1). So, texture gradient is a powerful objects is through occlusion. Imagine the same
source of invariant information provided by the struc- observer described above travelling past the same field
ture of light within the optic array. It furnishes us with a of cows. Their motion will cause the cows nearest to
wealth of information regarding the distance, size, and the train to pass in front of, or occlude, the cows graz-
orientation of surfaces in the environment. ing further away. This allows the observer to deduce
that the occluded cows (i.e. the ones that become hid-
den by other cows) are further away than those doing
the occluding.
Flow in the ambient
3.3
Gibson dealt with the motion of the observer
optic array through reference to flow patterns in the optic
array. As our train driver looks at the grazing cows
What is clear to me now that was not clear before is by the side of the track, the entire optic array will
that structure as such, frozen structure, is a myth, or appear to flow past from left to right, assuming that
at least a limiting case. Invariants of structure do not the driver looks out of the right-hand window (see
exist except in relation to variants. Figure 3.14).
(Gibson, 1979, p.87) When the train driver becomes bored of cow watch-
ing and returns their attention to the track in front of
In the above quotation Gibson is highlighting the the train, the flow patterns in the optic array will
importance of another intrinsic aspect of perception change so that the texture elements appear to be radi-
that is often missing from laboratory stimuli – that of ating from the direction in which the train is travelling
motion. His argument is that invariant information (the apparent origin of this radiating flow pattern is
can only be perceived in relation to variant informa- known as the pole). The texture elements that make up
tion, so to perceive invariant information we have to the surfaces in the environment will appear to emerge
see the environment change over time. from the pole, stream toward the observer, and then
There are two basic forms of movement: motion of disappear from view (see Figure 3.15).
the observer and motion of objects within the envi- This pattern would be completely reversed if the
ronment. Motion of the observer tends to produce the guard at the rear of the train were to look back toward
greatest degree of movement as the entire optic array the direction from which the train had come (see
is transformed (see Figure 3.9). Gibson suggested that Figure 3.16).
this transformation provides valuable information Gibson proposed a set of rules that linked flow in
about the position and shape of surfaces and objects. the optic array to the movement of the observer
For example, information about shape and particu- through the environment (Gibson, 1979):
larly position is revealed by a phenomenon known as
motion parallax. The principle of motion parallax is • If there is flow in the ambient optic array, the
that the further an object is from an observer, the less observer is in motion; if there is no flow, the
it will appear to move as the observer travels past it. observer is not moving.
Imagine the driver of a moving inter-city train looking • Outflow of the optic array from the pole specifies
out of their side-window at a herd of cows grazing in a approach by the observer and inflow to the pole
large field next to the line. The cows near the train will specifies retreat.
CHAPTER 3 PERCEPTION 79
FIGU RE 3.14 Flow patterns in the optic array parallel to the direction of the observer’s motion.
• The direction of the pole specifies the direction in tance that he saw the perceptual system as not being
which the observer is moving. limited to the eyes and other sense organs, but consti-
• A change in the direction of the pole specifies that tuting a hierarchy of organs in which the eyes are linked
the observer is moving in a new direction. to a head that can turn, which is linked to a body that
can move. As Gibson said: ‘Perceiving is an act, not a
For Gibson, the movement of the observer was a critical response, an act of attention, not a triggered impres-
part of perception. In fact, he deemed it of such impor- sion, an achievement, not a reflex’ (Gibson, 1979, p.21).
FIGU RE 3.15 Flow patterns in the optic array in the direction of the observer’s motion.
80 PART 1 PERCEPTUAL PROCESSES
FIGU RE 3.16 Flow patterns in the optic array in the opposite direction to the observer’s motion.
Affordances and
3.4 ment can be directly ‘picked up’ from the structure of
the optic array, the observer can interact with surfaces
resonance and objects in the environment directly through
affordance.
We began our discussion of Gibson’s theory by stating Second, Gibson saw no role for memory in percep-
that he saw information as being directly perceived or tion, as the observer does not have to consult their
‘picked up’ from the environment. In his later work prior experience in order to be able to interact with
Gibson (1979) took this idea of information being the world around them. Instead he states that the per-
‘picked up’ one step further and suggested that the end ceptual system resonates to invariant information in
point of the perceptual process was not a visual the optic array. Although the definition of ‘resonates’
description of the surrounding world, but rather that and the identity of what is doing the resonating is left
objects directly ‘afforded’ their use. very vague by Gibson, the point is that ‘global’ infor-
At its simplest (and least controversial) level, the mation about the optic array (in the form of invariant
concept of affordance builds on earlier research con- information) is dealt with by the perceptual system
ducted by the Gestalt psychologists, in which the fea- without the need to analyse more ‘local’ information
tures of objects were seen as providing information as such as lines and edges.
to their use. For instance, the features of a rock would These assertions may seem unreasonable to you, as
suggest that it could be stood upon, the features of a they have done to other researchers. If we are studying
fallen branch that it could be picked up, and the fea- psychology, then surely the cognitive processes that
tures of a fruit that it could be eaten. allow us to perceive must be one focus of our atten-
However, Gibson makes two claims regarding tion. In addition, if when perceiving the world we do
affordances that are rather harder to accept and have not make use of our prior experiences, how will we
proven to be far more controversial. First, he states ever learn from our mistakes? In the next two sections
that affordances act as a bridge between perception we shall turn to theories that attempt to deal with
and action and do not require the intervention of any these issues and to explain exactly how the brain
cognitive processes. Just as the nature of the environ- makes sense of the world around us.
CHAPTER 3 PERCEPTION 81
However, even if Gibson’s theory does not enlighten and images of brain activity while viewing these
us as to the nature of the cognitive processes that are can be captured in a way that would have been
involved in perception, it has still been extremely difficult to envisage a century ago. However, the sim-
influential, and researchers in perception still need to ulated lure of the screen (or even a pair of screens)
bear in mind his criticisms of the laboratory approach should not blind experimenters and theorists to
that makes use of artificial stimuli: the differences that exist between the virtual and
the real.
Experiments using dynamic naturalistic stimuli can
(Wade and Bruce, 2001, p.105)
now be conducted, virtual scenes can be constructed,
SUMMARY OF SECTION 3
• Gibson developed an ecological approach to perception and placed great emphasis on the way in
which real objects and surfaces structure light – he termed this the ambient optic array.
• He suggested that invariant information (such as texture gradient) could be ‘picked up’ from the optic
array to provide cues as to the position, orientation, and shape of surfaces.
• Invariant information could also be revealed by motion, which produces variants such as flow
patterns in the optic array.
• The importance of real surfaces and of motion led Gibson to suggest that perception could not be
studied using artificial stimuli in a laboratory setting.
• Gibson did not see perception as a product of complex cognitive analysis, but suggested that objects
could ‘afford’ their use directly.
• Interaction with the environment is at the heart of Gibson’s theory; action is seen as the ‘goal’ of
perception.
for analysing the retinal image were central. Marr’s the- need not be involved in obtaining descriptions of the
ory is therefore strongly ‘bottom-up’, in that it sees the shape of objects and the layout of the environment. In
retinal image as the starting point of perception and fact, the modular nature of perception was a funda-
explores how this image might be analysed in order to mental part of Marr’s theory:
produce a description of the environment. This meant
that, unlike Gibson who saw action as the end point of Computer scientists call the separate pieces of a process
perception, Marr concentrated on the perceptual pro- its modules, and the idea that a large computation can
cesses involved in object recognition. be split up and implemented as a collection of parts
Marr saw the analysis of the retinal image as occur- that are as nearly independent of one another as the
ring in four distinct stages, with each stage taking the overall task allows, is so important that I was moved to
output of the previous one and performing a new set elevate it to a principle; the principle of modular design.
of analyses on it. The four stages were: (Marr, 1982, p.102)
ACTIVIT Y 3.7
Find a wooden table or chair and place it where it is intensity of the reflected light caused by the object in
both well illuminated and against a light background. question being darker than the background. In addi-
Describe how the intensity of the light reflected tion, there are smaller changes in intensity caused by
from the table/chair changes across its surface and the individual parts of the table/chair and by the tex-
in comparison with the background. ture of the wood. You may also have noticed other
changes in the intensity of the reflected light that did
COM M ENT
not correspond to the edge of the object, its parts, or
You should be able to see that the edges of the table/
its texture.
chair are marked by a quite large, sharp change in the
intensity. Activity 3.7 may help you understand what of the circle are weighted more than those at the
this means. edges in a way identical to a normal (or Gaussian)
It is possible to group changes in the intensity of the distribution.
reflected light into three categories: By changing the size of the circle in which intensity
values are averaged, it is possible to produce a range of
• Relatively large changes in intensity produced by images blurred to different degrees. Figure 3.17 shows
the edge of an object. images that have been produced in this manner. The
• Smaller changes in intensity caused by the parts original (i.e. unblurred) image is shown in (a). As you
and texture of an object. can see, using a wider circle (b) produces a more
blurred image than using a narrower circle (c).
• Still smaller changes in intensity due to random
Marr and Hildreth’s algorithm works by compar-
fluctuations in the light reflected.
ing images that have been blurred to different degrees.
Marr and Hildreth (1980) proposed an algorithm If an intensity change is visible at two or more adja-
that could be used to determine which intensity cent levels of blurring, then it is assumed that it can-
changes corresponded to the edges of objects, mean- not correspond to a random fluctuation and must
ing that changes in intensity due to random fluctua- relate to the edge of an object. Although this algo-
tions could be discarded. The algorithm made use of rithm was implemented by Marr and Hildreth on a
a technique called Gaussian blurring, which involves computer, there is evidence that retinal processing
averaging the intensity values in circular regions of delivers descriptions that have been blurred to differ-
the greyscale description. The values at the centre ent degrees.
FIGU RE 3.17 Examples of Gaussian blurred images. Source: Marr and Hildreth, 1980, p.190
84 PART 1 PERCEPTUAL PROCESSES
FIGU RE 3.18 Primitives used in the raw primal sketch: (a) blobs; (b) edge-segments; and (c) bars. Source: Marr, 1982,
Figure 2.21, p.72
By analysing the changes in intensity values in the small, enclosed area bounded by changes in inten-
blurred images, it is possible to form a symbolic rep- sity. In Figure 3.18 you can see how the image shown
resentation consisting of four primitives correspond- in Figure 3.17(a) would be represented using three of
ing to four types of intensity change. Marr referred to these primitives, whilst Figure 3.19 shows how three
these primitives as ‘edge-segments’, ‘bars’, ‘termina- simple lines would be represented in the raw primal
tions’, and ‘blobs’. An edge-segment represented a sketch.
sudden change in intensity; a bar represented two As you can see from Figure 3.19, although the raw
parallel edge-segments; a termination represented a primal sketch contains a lot of information about details
sudden discontinuity; and a blob corresponded to a in the image, it does not contain explicit information
(a)
(b)
(c)
FIGU RE 3.19 Representation of three simple lines in the raw primal sketch: ‘The raw primal sketch represents a
straight line as a termination, several oriented segments, and a second termination (a). If the line is replaced by a
smooth curve, the orientations of the inner segments will gradually change (b). If the line changes its orientation
suddenly in the middle (c), its representation will include an explicit pointer to this discontinuity. Thus in this
representation, smoothness and continuity are assumed to hold unless explicitly negated by an assertion’. Source: Marr,
1982, Figure 2.22, p.74
CHAPTER 3 PERCEPTION 85
about the global structure of the objects in view. The which the layout of surfaces and objects is specified in
next step is therefore to transform the raw primal sketch relation to the particular view that the observer has at
into a description, known as the full primal sketch, that time. Up until now we have been looking at how
which contains information about how the image is the shape of objects and surfaces can be recovered
organized, particularly the location, shape, texture, and from the retinal image. However, in order to specify
internal parts of any objects that are in view. the layout of surfaces, we need to now include other
Basically, the idea is that place tokens are assigned information, specifically cues that tell us how far away
to areas of the raw primal sketch based on the group- each surface is.
ing of the edge-segments, bars, terminations, and Marr’s modular approach to perception means that
blobs. If these place tokens then form a group them- while the full primal sketch is being produced, other
selves, they can be aggregated together to form a new, visual information is being analysed simultaneously.
higher-order place token. Much of this has to do with establishing depth rela-
Imagine looking at a tiger. The raw primal sketch tions, the distance between a surface and the observer,
would contain information about the edge of the and also how far objects extend. We saw in Section 3
tiger’s body, but also about the edges and pattern of its that motion cues and cues from texture can be used to
stripes and the texture of its hair. In the full primal specify the distance to an object, and it is also possible
sketch, place tokens will be produced by the grouping to make use of the disparity in the retinal images of
of the individual hairs into each of the stripes. The the two eyes (known as stereopsis), and shading cues
place tokens for each stripe would then also be that are represented in the primal sketch.
grouped (because they run in a consistent vertical pat- Marr proposed that the information from all these
tern along the tiger) into a higher-order place token, ‘modules’ was combined together to produce the 21/ 2D
meaning that there will be at least two levels of place sketch. It is called the 21/ 2D sketch rather than the 3D
tokens making up the tiger. sketch because the specification of the position and
Various mechanisms exist for grouping the raw pri- depth of surfaces and objects is done in relation to the
mal sketch components into place tokens and for observer. Thus, the description of an object will be
grouping place tokens together. These include cluster- viewer-centred and will not contain any information
ing, in which tokens that are close to one another about the object that is not present in the retinal
are grouped in a way very similar to the Gestalt prin- image. How the viewer-centred 21/ 2D sketch is turned
ciple of proximity, and curvilinear aggregation, in into a fully 3D, object-centred description is one of
which tokens with related alignments are grouped in a the topics dealt with in the next chapter.
similar fashion to the Gestalt principle of good Marr saw the 21/ 2D sketch as consisting of a series of
continuation. primitives that contained vectors (a line depicting
As we saw in Section 2, perceptual grouping is a both size and direction) showing the orientation of
robust, long-established, and powerful effect. Marr each surface. A vector can be seen as a needle, in
saw algorithms expressing laws such as those formu- which the direction the needle is pointing tells us in
lated by the Gestalt approach as being responsible for which direction the surface is facing, and its length
turning the ambiguous raw primal sketch into the full tells us by how much the surface is slanted in relation
primal sketch in which the organization of objects and to the observer. A cube would therefore be repre-
surfaces was specified. sented like the one shown in Figure 3.20. In addition
to the information shown in Figure 3.20, Marr sug-
gested that each vector (or needle) would have a num-
4.3 The 21/ 2D sketch ber associated with it that indicated the distance from
the observer.
In Marr’s theory, the goal of early visual processing is The 21/ 2D sketch therefore provides an unambigu-
the production of a description of the environment in ous description of the size, shape, location, orientation,
86 PART 1 PERCEPTUAL PROCESSES
SUMMARY OF SECTION 4
• Marr proposed a theory of vision that was based on bottom-up processing of information.
• His approach was to see perception as being composed of a series of stages, with each stage generat-
ing an increasingly sophisticated description.
• Marr saw the end point of the perceptual process as object recognition rather than action.
• The first stage involves producing a grey level description based on the activation of retinal cells.
• This description is analysed by blurring it to different degrees. Changes in intensity value that are
present in two or more adjacent levels of blurring are assumed to correspond to the ‘edge’ of an
object (or part of an object).
• The raw primal sketch is generated by assigning one of four primitives (edge-segment, bar, termina-
tion, or blob) to each change in intensity values.
• The full primal sketch is generated by using perceptual organizational principles such as clustering and
similarity to group these primitives together and assign each group a place token.
• Information from different modules (such as stereopsis and motion) are combined with the full primal
sketch to produce the 21/2D sketch. This contains primitives consisting of vectors that reveal the
distance and orientation, in relation to the observer, of the visible surfaces.
5CONSTRUCTIVIST APPROACHES
TO PERCEPTION
The previous sections of this chapter should have already suggested, incomplete. It is necessary to build
given you some idea of how we can see and interpret (or ‘construct’) our perception of the world from
sensory information. The emphasis so far has been on incomplete information. To do this we use what we
‘bottom-up’ processes (see also Activity 3.8). As dis- already know about the world to interpret the incom-
cussed previously, there is also information flowing plete sensory information coming in and ‘make sense’
‘top-down’ from stored knowledge. This makes intui- of it. Thus stored knowledge is used to aid in the rec-
tive sense. To be able to perceive something as ‘a bus’, ognition of objects.
you need to access stored knowledge concerning what Two of the foremost proponents of the constructiv-
the features of a bus actually are (big object with ist approach are Irvin Rock (1977, 1983, 1997) and
wheels, etc.). Richard Gregory (1980). Gregory suggested that indi-
Thus, what you see a stimulus as depends on what viduals attempt to recognize objects by generating a
you know. This notion, that perceiving something series of perceptual hypotheses about what that object
involves using stored knowledge as well as informa- might be. Gregory conceptualized this process as
tion coming in from the senses, is embodied in an being akin to how a scientist might investigate a prob-
approach referred to as the constructivist approach. lem by generating a series of hypotheses and accepting
The approach is described as ‘constructivist’ because the one that is best supported by the data (in percep-
it is based on the idea that the sensory information tion, ‘data’ would be the information flowing ‘up’ from
that forms the basis of perception is, as we have the senses).
88 PART 1 PERCEPTUAL PROCESSES
ACTIVIT Y 3.8
Look back at Activity 3.1. Can you explain any of the be that we also need to look at an explanation based
visual illusions in terms of what you now know on top-down perception.
about the bottom-up approach to perception?
COM M ENT
Gibson would tell us that the Necker cube is a geomet-
ric figure that contains none of the information (partic-
ularly texture gradients) that we would usually use
when perceiving an object. Marr’s theory can help us to
explain Kanizsa’s illusory square, as the four areas of
intensity change corresponding to the missing parts of
the circles would be grouped together to form a square.
(a) (b)
But what about the Müller–Lyer illusion? There are
a number of alternative explanations for this illusion,
one of which is that we group each vertical line with its
FIGU RE 3. 21 The original Müller-Lyer illusion (a),
set of arrowheads to form a single object. This of
and with curved arrowheads (b).
course results in the object with the inward-pointing
arrowheads being larger than the one with the out-
As we saw in Activity 3.1, another explanation of the
ward-pointing arrowheads; basically, due to perceptual
Müller–Lyer illusion is that we make use of top-down
grouping we cannot separate the vertical line from the
information and see the outward-pointing arrow-
overall size of the object. However, as the Müller–Lyer
heads as an indication that the vertical line is nearer to
illusion is reduced if the straight arrowheads are
us than the line with the inward-pointing arrowheads.
replaced with curved lines (see Figure 3.21), it could
level) then the picture may immediately resolve into an figure changes as our eyes (or just our attention) jumps
image of an ocean liner. The sensory information has from corner to corner. These data-supported interpreta-
not changed, but what you know about it has, allowing tions, or hypotheses, tend to overwhelm the conceptual
you to generate a reasonable hypothesis of what the fig- knowledge that we are viewing a flat pattern.
ure represents. Similarly, in the example used in Although the constructivist approach in general,
Activity 3.3 of trying to identify an object by touch and Gregory’s theories in particular, provide an
alone, if you are given some clues about the function of attractive explanatory framework for perception,
the object (i.e. your knowledge related to the object is there are areas of the theory (as there were with
increased), it is likely to be easier to identify it. Gibson’s approach) that are left rather vague. For
The use of knowledge to guide our perceptual hypoth- instance, how do we actually generate hypotheses and
eses may not always lead to a ‘correct’ perception. There how do we know when to stop and decide which is
are some stimuli with which we are so familiar (such as the ‘right’ one? Why does knowledge sometimes but
faces) that there can be a strong bias towards accepting a not always help perception? How can we ‘know’
particular perceptual hypothesis, resulting in a ‘false’ something is wrong and yet still perceive it as wrong
perception. For instance, look at the faces in Figure 3.23. (as with the hollow face)? Although these are difficult
This is the mask of Hor, an Egyptian mummy. The questions to answer, progress is being made in
first view is the mask from the front and the second explaining how human perception may be based, at
two are of the back of the mask. Although the face least in part, on constructivist principles; some of this
viewed from the back is ‘hollow’ it still appears per- work will be discussed below.
ceptually as a normal face. Our knowledge of how a Thus, there appears to be evidence that perceptions
face is supposed to look is (according to Gregory, of the outside world can be ‘constructed’ using infor-
1980) so strong that we cannot accept the hypothesis mation flowing ‘up’ from the senses combined with
that a face could be ‘hollow.’ This effect is interesting in knowledge flowing ‘down’. However, this seems to be
that it provides an example of a perceptual hypothesis in direct contrast to the theories of Gibson and Marr
conflicting with what Gregory terms ‘high-level’
knowledge. You know at a conceptual level that the
mask is hollow, yet you still perceive it as a ‘normal’
face. This, as Gregory suggests, represents a tendency
to go with the most likely hypothesis. The Penrose tri-
angle (Penrose and Penrose, 1958) in Figure 3.24
demonstrates a similar point.
It would be impossible to construct the object in
Figure 3.24 so that the three sides of the triangle were
joined. At one level, we ‘know’ that this must be true. Yet
whichever corner of the triangle we attend to suggests a FIGU RE 3. 24 An impossible triangle. Source: Penrose
particular 3D interpretation. Our interpretation of the and Penrose, 1958
90 PART 1 PERCEPTUAL PROCESSES
discussed earlier, which suggest that there is no need tion, and is there any way in which we can reconcile
to use stored knowledge to interpret the information theories of perception that see knowledge as being
flowing in from the senses. Indeed, the impossible tri- essential with those that see it as unnecessary? The fol-
angle above shows that we do not always make use of lowing section considers how these different theories
knowledge that may be relevant and available. So, just may be reconciled through consideration of the way
how important is knowledge to the process of percep- in which the brain processes sensory information.
SUMMARY OF SECTION 5
• What you see a stimulus as depends on what you know. This means that perception must involve
top-down processing.
• The constructivist approach to perception is based on the idea that sensory data is often incomplete,
so a description can only be constructed by making use of stored knowledge.
• Gregory suggested that sensory data are incomplete and we perceive by generating a series of per-
ceptual hypotheses about what an object might be.
• The use of stored information can lead to perceptual hypotheses that are inaccurate, which is why we
may be fooled by some visual illusions.
Do
cortex
r s al
dorsal–ventral distinction is maintained (Courtney
stre
et al., 1996). It has been suggested that it is in the pre-
am
frontal cortex that meaning is associated with the
Primary
visual information carried by the two streams.
cortex Although describing the two streams as ‘what’ and
Inferotemporal ‘where’ is convenient, there is a large body of work that
cortex am
l s t re suggests that the distinction is not quite that straight-
Ven t ra
forward. For instance, Milner and Goodale (1995)
FIGU RE 3. 25 The dorsal and ventral streams. report a number of studies with a patient, DF, who
suffered severe carbon monoxide poisoning that
Information travelling onward from the primary appeared to prevent her using her ventral system for
visual cortex is still maintained in two distinct streams analysing sensory input. She could not recognize faces
(see Figure 3.25). One stream, leading to the infer- or objects, or even make simple visual discriminations
otemporal cortex, is termed the ventral stream, and such as between a triangle and a circle. She could draw
the other, leading to the parietal cortex, is known as objects from memory but not recognize them once
the dorsal stream (these were described briefly in she had drawn them. DF did, however, appear to have
Chapter 2, Section 5.1). an intact dorsal stream. Although unable to tell if two
discs were of the same or different widths (or even
indicate the widths by adjusting the distance between
her fingers), if she was asked to pick the discs up then
6.2The dorsal and ventral the distance between her index finger and thumb as
streams she went to pick them up was highly correlated with
the width of the discs. In other words, she did not have
The ventral stream projects to regions of the brain that size information available to conscious perception
appear to be involved in pattern discrimination and (via the ventral stream), but it was available to guide
object recognition, whilst the dorsal stream projects to action (via the dorsal stream).
areas of the brain that appear to be specialized for the Norman (2002), following on from similar sugges-
analysis of information about the position and move- tions by Bridgeman (1992) and Neisser (1994), has
ment of objects. Schneider (1967, 1969) carried out drawn on the ongoing debate concerning the charac-
work with hamsters that suggested that there were two teristics of the dorsal and ventral streams and sug-
distinct parts of the visual system, one system con- gested a dual-process approach. In this approach, the
cerned with making pattern discriminations and the two streams are seen as acting synergistically so that
other involved with orientation in space. Schneider the dorsal stream is largely concerned with perception
suggested that one system is concerned with the ques- for action and the ventral stream essentially concerned
tion, ‘What is it?’, whereas the other system is con- with perception for recognition. The dual-process
cerned with the question, ‘Where is it?’. This, and later approach is supported by some of the characteristics of
work (Ungerleider and Mishkin, 1982), led to the ven- the two streams (Norman, 2001, 2002):
tral pathway being labelled a ‘what’ system, and the
dorsal pathway a ‘where’ system. 1. There appears to be evidence (Goodale and
Although the two streams appear to be specialized Milner, 1992; Ungerleider and Mishkin, 1982) to
for processing different kinds of information, there is suggest that the ventral stream is primarily
ample evidence of a huge degree of interconnection concerned with recognition whilst the dorsal
92 PART 1 PERCEPTUAL PROCESSES
stream drives visually-guided behaviour (pointing, ment. It could be, then, that the type of perception
grasping, etc.). discussed by Gibson is principally subserved by the
2. The ventral system is generally better at processing dorsal system, whilst the ventral system is the basis for
fine detail (Baizer et al., 1991) whereas the dorsal the recognition approach favoured by Marr and the
system is better at processing motion (Logothesis, constructivists.
1994). For example, Gibson’s notion of ‘affordance’ empha-
sizes that we might need to detect what things are for
3. The studies on patient DF (Milner and Goodale,
rather than what they actually are. That is, affordances
1995) suggest that the ventral system is
are linked to actions (‘lifting’ or ‘eating’, for example).
knowledge-based and uses stored representations
The dorsal system appears to be ideally suited to pro-
to recognize objects, whilst the dorsal system
viding the sort of information we need to act in the
appears to have only very short-term storage
environment. In addition, if a system is to be used to
available (Bridgeman et al., 1997; Creem and
drive action, it really needs to be fast, as the dorsal
Proffitt, 1998).
stream seems to be.
4. The dorsal system receives information faster than The earlier discussion of Gibson’s ecological
the ventral system (Bullier and Nowak, 1995). approach also stated that Gibson saw no need for
5. A limited amount of psychophysical evidence memory in perception. Certainly, one of the charac-
suggests that we are much more conscious of ventral teristics of the dorsal stream is that it appears to have
than of dorsal stream functioning (Ho, 1998). no more than a very short ‘memory’ (at least for repre-
6. It has been suggested (Goodale and Milner, 1992; sentations of objects). Thus, there appear to be some
Milner and Goodale, 1995) that the ventral system grounds for suggesting that the dorsal stream is
recognizes objects and is thus object-centred. The Gibsonian in operation.
dorsal system is presumed to be used more in In contrast, the ventral stream appears to be ideally
driving some action in relation to an object and suited to the role of recognizing objects. It is special-
thus uses a viewer-centred frame of reference (this ized in analysing the sort of fine detail that Marr saw
distinction arises again in the next chapter). as essential to discriminating between objects, and it
also seems able to draw on our existing knowledge
(top-down information) to assist in identifying them.
In addition, it is slower than the dorsal stream, but
6.3The relationship between then recognizing what an object may be is not neces-
visual pathways and theories sarily an immediate priority. For example, knowing
that an object is moving towards you quickly is ini-
of perception tially more important than knowing what it is.
SUMMARY OF SECTION 6
• There appear to be at least two partially distinct but interconnected streams of information flowing
back from the retina to the primary visual cortex.
• From here, a ventral stream leads to the inferotemporal cortex and a dorsal stream to the parietal
cortex.
• There is evidence that the ventral stream may be involved in perception for recognition and the dor-
sal stream in perception for action.
• Thus the dorsal stream would be better at dealing with the type of perception dealt with by Gibson
and the ventral stream with the type of perception dealt with by Marr and the constructivist approach.
• Enns and Di Lollo’s (2000) re-entrant processing explanation of backward masking was based on a
combination of bottom-up and top-down perception.
7 CONCLUSION
We started this chapter by promising to show you just complexities and of the problems that face any poten-
how complex even the perception of simple objects tial theory of visual perception. You have also seen
can be. We hope you now have some idea of these how rich the field of perception is. There are many
CHAPTER 3 PERCEPTION 97
influential theories that have had a profound impact tory at first glance, it could well be that they are all
on both our understanding of perception and the way describing vital but different aspects of the perceptual
we approach cognitive psychology more generally. For process, which achieve different goals and are dealt
example, Gibson showed us the importance of consid- with by different parts of the brain. So, next time you
ering how we interact with the real world and Marr are hunting in vain for your keys, do not be too hard
demonstrated the advantages of the modular approach on yourself. Remember all the computations, descrip-
to information processing. We have also seen that tions, and hypotheses that your brain is having to pro-
although these different theories may seem contradic- cess in order to perceive the environment around you.
FURTHER READING
The further reading suggestions below are divided into three dedicated to visual perception that explore the area in more
categories: classic texts that provide more information on the depth; and books that cover perception more broadly, includ-
key theories covered in the chapter; contemporary books ing modalities other than visual.
Classic texts
The three theories of perception covered in this chapter were many decades to come. Indeed, Eye and Brain should be read
those of Gibson, Marr, and Gregory. All three have written by every student of cognitive psychology.
books considered to be classic texts in psychology that are well Gibson, J.J. (1986) The Ecological Approach to Visual
worth reading. Marr’s 1982 book does get a little technical but Perception, Hillsdale, NJ, Lawrence Erlbaum Associates, Inc.
also includes an important analysis of previous theories, and Gregory, R.L. (1997) Eye and Brain: The Psychology of
sets out an extremely influential approach for studying cogni- Seeing, Oxford, Oxford University Press.
tion. Gibson’s and Gregory’s books are both very readable. Marr, D. (1982) Vision: A Computational Investigation
Sadly, Richard Gregory passed away in the year this 2nd edi- into the Human Representation and Processing of Visual
tion was written, but his work will remain key reading for Information, New York, W.H. Freeman & Company.
REFERENCES
Aksentijevic, A., Elliott, M.A., and Barber, P.J. (2001) Enns, J.T. and Di Lollo, V. (2000) ‘What’s new in visual
‘Dynamics of perceptual grouping: similarities in the organi- masking?’ Trends in Cognitive Science, vol.4, pp.345–52.
zation of visual and auditory groups’, Visual Cognition, vol.8, Enns, J.T. and Rensick, R.A. (1990) ‘Sensitivity to three-
pp.349–58. dimensional orientation from line drawings’, Psychological
Atherton, M. (2002) ‘The origins of the sensation/percep- Review, vol.98, pp.335–51.
tion distinction’, in Heyer, D. and Mausfeld, R. (eds.) Perception Felleman, D.J. and Van Essen, D.C. (1991) ‘Distributed
and the Physical World: Psychological and Philosophical Issues hierarchical processing in primate visual cortex’, Cerebral
in Perception, Chichester, John Wiley & Sons Ltd. Cortex, vol.1, pp.1–47.
ATSB (2009) Aircraft proximity event, VH-FKU and Fitts, P.M. (1964) ‘Perceptual-motor skills learning’, in
VH-HJH Bankstown Aerodrome, New South Wales. Melton, A.W. (ed.) Categories of Human Learning, New York,
Australian Transport Safety Bureau, Aviation Occurrence Academic Press.
Investigation, AO-2009-054. Gellatly, A.R.H., Pilling, M., Carter, W., and Guest, D.
Baizer, J.S., Ungerleider, L.G., and Desimone, R. (1991) (2010) ‘How does target duration affect object substitution
‘Organization of visual inputs to the inferior temporal and masking?’ Journal of Experimental Psychology: Human
posterior parietal cortex in macaques’, Journal of Neuroscience, Perception and Performance, 36, 1267–79.
vol.11, pp.168–90. Gibson, J.J. (1947) ‘Motion picture testing and research’,
Beck, D.M., Muggleton, N., Walsh, V., and Lavie, N. (2005) AAF Aviation Psychology Research Report No. 7, Washington,
‘Right parietal cortex plays a critical role in change blindness’, DC, Government Printing Office.
Cerebral Cortex, vol.16, no.5, pp.712–717. Gibson, J.J. (1950) The Perception of the Visual World,
Binsted, G. and Carlton, L.G. (2002) ‘When is movement Boston, MA, Houghton Miffin.
controlled by the dorsal stream?’ Behavioral and Brain Gibson, J.J. (1966) The Senses Considered as Perceptual
Sciences, vol.25, pp.97–8. Systems, Boston, MA, Houghton Miffin.
Bridgeman, B. (1992) ‘Conscious vs unconscious process- Gibson, J.J. (1979) The Ecological Approach to Visual
ing: the case of vision’, Theory & Psychology, vol.2, pp.73–88. Perception, Hillsdale, NJ, Lawrence Erlbaum Associates.
Bridgeman, B., Peery, S., and Anand, S. (1997) ‘Interaction Goodale, M.A. and Milner, A.D. (1992) ‘Separate visual
of cognitive and sensorimotor maps of visual space’, Perception pathways for perception and action’, Trends in Neurosciences,
and Psychophysics, vol.59, pp.456–69. vol.15, no.1, pp.20–5.
Bullier, J. and Nowak, L.G. (1995) ‘Parallel versus serial Gregory, R.L. (1980) ‘Perceptions as hypotheses’,
processing: new vistas on the distributed organization of the Philosophical Transactions of the Royal Society of London, B,
visual system’, Current Opinion in Neurobiology, vol.5, vol.290, pp.181–97.
pp.497–503. Ho, C.E. (1998) ‘Letter recognition reveals pathways of
Courtney, S.M., Ungerleider, L.G., Keil, K., and Haxby, J.V. second-order and third-order motion’, Proceedings of the
(1996) ‘Object and spatial visual working memory activate National Academy of Sciences of the United States of America,
separate neural systems in human cortex’, Cerebral Cortex, vol.95, no.1, pp.400–4.
vol.6, pp.39–49. Hupe, J.M., James, A.C., Payne, B.R., Lomber, S.G., Girard,
Creem, S.H. and Proffitt, D.R. (1998) ‘Two memories for geo- P., and Bullier, J. (1998) ‘Cortical feedback improves discrimi-
graphical slant: separation and interdependence of action and nation between figure and ground by V1, V2 and V3 neurons’,
awareness’, Psychonomic Bulletin and Review, vol.5, pp.22–36. Nature, vol.394, pp.784–7.
Di Lollo, V., Bischof, W.F., and Dixon, P. (1993) ‘Stimulus- Kanizsa, G. (1976) ‘Subjective contours’, Scientific
onset asynchrony is not necessary for motion perception or American, vol.234, no.4, pp.48–52.
metacontrast masking’, Psychological Science, vol.4, pp.260–3. Koffka, K. (1935) Principles of Gestalt Psychology, New
Di Lollo, V., Enns, J.T., and Rensink, R.A. (2000) York, Harcourt Brace.
‘Competition for consciousness among visual events: the psy- Kohler, W. (1947) Gestalt Psychology: An Introduction to
chophysics of re-entrant pathways’, Journal of Experimental New Concepts in Modern Psychology, New York, Liveright
Psychology: General, vol.129, pp.481–507. Publishing Corporation.
Enns, J.T. and Di Lollo, V. (1997) ‘Object substitution: a Logothesis, N.K. (1994) ‘Physiological studies of motion
new form of masking in unattended visual locations’, inputs’, in Smith, A.T. (ed.) Visual Detection of Motion,
Psychological Science, vol.8, pp.135–9. London, Academic Press.
CHAPTER 3 PERCEPTION 99
Marr, D. (1982) Vision: A Computational Investigation into Rock, I. (1983) The Logic of Perception, Cambridge, MA,
the Human Representation and Processing of Visual MIT Press.
Information, New York, W.H. Freeman & Company. Rock, I. (1997) Indirect Perception, Cambridge, MA, MIT
Marr, D. and Hildreth, E. (1980) ‘Theory of edge detec- Press.
tion’, Proceedings of the Royal Society of London, B, vol.207, Schneider, G.E. (1967) ‘Contrasting visuomotor functions
pp.187–217. of tectum and cortex in the golden hamster’, Psychologische
Milner, A.D. and Goodale, M.A. (1995) The Visual Brain in Forschung, vol.31, pp.52–62.
Action, Oxford, Oxford University Press. Schneider, G.E. (1969) ‘Two visual systems’, Science,
Milner, A.D. and Goodale, M.D. (1998) ‘The visual brain in vol.163, no.3870, pp.895–902.
action’, Psyche, vol.4, pp.1–14. Sedgwick, H.A. (1973) The Visible Horizon, Unpublished
Neisser, U. (1994) ‘Multiple systems: a new approach to PhD thesis, Cornell University Library.
cognitive theory’, European Journal of Cognitive Psychology, Shapley, R. (1995) ‘Parallel neural pathways and visual
vol.6, no.3, pp.225–41. function’, in Gazzaniga, M.S. (ed.) The Cognitive Neurosciences,
Norman, J. (2001) ‘Ecological psychology and the two vis- Cambridge, MA, MIT Press.
ual systems: not to worry’, Ecological Psychology, vol.13, no.2, Street, R.F. (1931) A Gestalt Completion Test, New York,
pp.135–45. Bureau of Publications, Teachers College, Columbia University.
Norman, J. (2002) ‘Two visual systems and two theories of Ungerleider, L.G. and Mishkin, M. (1982) ‘Two cortical
perception: an attempt to reconcile the constructivist and visual systems’, in Ingle, D.J., Goodale, M.A., and Mansfield,
ecological approaches’, Behavioral and Brain Sciences, vol.25, R.J.W. (eds.) Analysis of Visual Behaviour, Cambridge, MA,
no.1, pp.73–96. MIT Press.
Penrose, L.S. and Penrose, R. (1958) ‘Impossible objects: Wade, N.J. and Bruce, V. (2001) ‘Surveying the scene: 100
a special type of illusion’, British Journal of Psychology, years of British vision’, The British Journal of Psychology, vol.92,
vol.49, p.31. no.1, pp.79–113.
Pilling, M. and Gellatly, A.R.H. (2010) ‘Object substitution Werthiemer, M. (1923) ‘Untersuchungen zur Lehre von der
masking and the object updating hypothesis’, Psychonomic Gestalt, II’, Psychologische Forschung, no.4, pp.301–50.
Bulletin and Review, vol.17, pp.737–42. Translated as ‘Laws of organization in perceptual forms’, in
Rao, S.C., Rainer, G., and Miller, E.K. (1997) ‘Integration of Ellis, W.D. (ed.) (1955) A Source Book of Gestalt Psychology,
what and where in the primate prefrontal cortex’, Science, London, Routledge and Kegan Paul.
vol.276, pp.821–4. Young, M.J., Landey, M.S., and Maloney, L.T. (1993) ‘A
Rock, I. (1977) ‘In defense of unconscious inference’, in perturbation analysis of depth perception from combina-
Epstein, W. (ed.) Stability and Constancy in Visual Perception: tions of texture and motion cues’, Vision Research, vol.33,
Mechanisms and Processes, New York, Wiley. pp.2685–96.
R ECOG N ITION
Graham Pike and Nicola Brace
1 INTRODUCTION
In the last chapter on perception, we explored some of a ‘description’) of the object, based on the
the cognitive processes involved in forming a mental information in the retinal image.
description of the environment based on input from • Second, there must be processes that are able to
the senses. As well as being able to determine the posi- store this description so that we can recognize the
tion and shape of the objects around us, it is also pos- object if we see it again.
sible to recognize what we are seeing. Unless we fully
• Third, there must be processes that somehow
accept Gibson’s concept of affordance (and it’s safe to
compare the description of the object that we can
say that we don’t), there must be another step: another
currently see to the descriptions of objects that we
set of processes that transform the basic descriptions
have stored.
of objects generated by analysing the retinal image
into objects that are familiar to us and that we can rec- • Lastly, it is very likely that we have seen objects from
ognize as specific objects, such as a mobile phone, many different angles, yet are able to recognize
coat, or cow. them regardless of the current angle of view. As we
The same is, of course, true of our other senses; for shall see, the nature of the mechanism that allows us
example, when we listen we may hear music, car to do this is an important and much debated point.
engines, and voices. Again, there must be cognitive
processes that somehow transform the auditory input A basic diagram displaying the recognition process is
of sound waves into what we recognize as an environ- provided in Figure 4.1. In one sense, the process of
ment of voices, music, and cars. recognition is the process of generating and compar-
Let’s stop for a moment and consider the basic steps ing descriptions of objects that are currently in view
that might be involved in the process of visually recog- with descriptions of objects that we have seen previ-
nizing an object: ously. It is worth noting that this is a very simplistic
way of viewing and describing recognition, and in
• First, there must be processes that are able to Section 2 we shall look at some of the problems with
construct an internal representation (referred to as this simplistic approach.
CHAPTER 4 RECOGNITION 101
Viewpoint-dependent
object descriptions
Analysis of
retinal image
Perceptual classification
Store of
object
descriptions
Semantic classification
Naming
SUMMARY OF SECTION 1
• As well as being able to determine the location and shape of an object, or the location and pitch of a
sound, we also have to be able to recognize what they are.
• A basic model of recognition requires that a description from sensory input is generated and com-
pared with descriptions stored in memory.
• Recognition must come after the initial processes of perception and before the stages in which an
object can be first semantically classified and then named.
102 PART 1 PERCEPTUAL PROCESSES
2DIFFERENT T YPES OF
RECOGNITION
As we have stated above, the view that recognition recognize that the object belongs to the category of
involves comparing an object description generated objects known as ‘faces’; we also work out whose face
from the retinal image to descriptions stored in long- it is. In other words, we make a within-category dis-
term memory is very simplistic. In fact there are quite tinction.
different types of recognition, depending on what it is The difference between within- and between-
we are trying to recognize and how we go about trying category recognition is one reason why face recogni-
to recognize it. Throughout this chapter we shall be tion is generally researched as a separate topic from
exploring these different types of recognition and object recognition. In addition, there are some issues
examining some of the issues that suggest the process that are unique to face recognition, such as:
of recognition is far more complex than the simplistic
model presented in Figure 4.1 suggests. • The internal features of a face can move, which
changes the appearance of the face.
• This movement can serve to express emotional and
The end point of Humphreys and Bruce’s (1989) As well as distinguishing between face recognition
model of recognition (Figure 4.2) is the naming and more general object recognition, it is possible to
stage. Naming, of course, is not a necessary compo- identify a number of different types of face recogni-
nent of being able to recognize an object: even if an tion. One such distinction is between recognizing
animal has no capacity for language, it can still familiar and unfamiliar faces. Pike et al. (2000)
recognize objects. But the names we give things do reported that people were often able to identify E-FIT
provide a clue to the fact that there are different types see images even when other participants had rated
of recognition. them as a poor likeness. However, like the E-FIT you
Try Activity 4.1. In completing this, you may have will see in Activity 4.2, these were images of famous
realized that the name you provided for the left image people whose faces would have been familiar to the
was the category to which the object belonged, whilst participants. Considerable evidence suggests we are
the name for the right image corresponded to an indi- not so accurate at recognizing even real faces that are
vidual rather than a category (i.e. you did not name not so familiar to us. For example, many witnesses
the image ‘a face’). express uncertainty when asked to identify the perpe-
Naming reveals that it is possible to recognize trator of a crime from a line-up (Pike et al., 2001).
objects in different ways. When we see objects such as Even when the anxiety of the witness is reduced by
fruit and furniture we tend to concentrate on which using a video identification parade, identification
category they belong to, and when we provide names accuracy is far from perfect (Kemp et al., 2001).
for them, these are usually the name for that category. A second distinction that applies to types of face rec-
Thus, we are making between-category distinctions ognition is that between recognizing whose face you
such as ‘that object is an orange and that one is a table’. are looking at and recognizing what emotion it may be
However, when we see a face we often do more than portraying. You can imagine that the importance of
CHAPTER 4 RECOGNITION 103
ACTIVIT Y 4.1
Figure 4.3 shows two images. See if you can name types of name, but can you describe why these two
them. types of name are so different? (Hint: think about
You probably provided the names ‘apple’ and how many different apples and Sigmund Freuds
‘Sigmund Freud’. These are evidently two different there are.)
FIGU RE 4. 3
ACTIVIT Y 4.2
FIGU RE 4.4
Can you identify the person depicted in the three differences in appearance. In fact, you were probably
images shown in Figure 4.4? able to recognize the E-FIT image of him (right-hand
image), even though this is constructed by combining
COM M ENT
together features from several other faces. So, we
The images are of Paul McCartney and you were
can recognize a face that is familiar to us even when
(probably) able to recognize him from all three
quite large changes have been introduced.
images, even though there are some quite obvious
104 PART 1 PERCEPTUAL PROCESSES
faces in conveying emotional state and in facilitating interact with and investigate the environment. In
social interactions has led us to develop some very examining how Gibson’s idea of active perception
sophisticated cognitive processes for interpreting facial might apply to recognition, we will temporarily switch
expressions. In fact, we are able to judge the emotion modalities from vision to touch. One reason for con-
being displayed on a face with great accuracy (the cog- centrating on touch is that purely passive object recog-
nition involved in perceiving emotion is considered in nition through touch would be almost impossible.
Chapter 19) and are very sensitive to eye movements in Although there may be some objects that you can rec-
those around us. It is tempting to think that we may ognize if they were simply placed on your hand, most
have evolved a specific set of cognitive processes for objects would require exploration. We have evolved
recognizing faces and the emotions they express sophisticated processes for exploring the environment
because of the social importance of this information. and objects using touch in very exact and careful ways.
However, there is evidence (Young et al., 1993) that First, we have tremendous control over our hands,
although we do have specific processes for recognizing so that we can both move our fingers precisely and
emotions, these processes are not involved in recogniz- also apply varying degrees of pressure to objects in a
ing identity. We shall return to the difference between very measured way. This is done by employing a feed-
emotion and identity recognition later in this chapter, back system, whereby information from touch recep-
but logically you can see that you need to be able to tors allows the brain to control the location and
tell whether someone is angry or happy regardless of amount of pressure applied by the fingers. As well as
whether you can recognize them or not. Likewise, you being able to regulate touch precisely, we can also pin-
need to be able to recognize who someone is regardless point the location of our limbs with great accuracy via
of whether they appear happy or angry. receptors inside our muscles and joints. This informa-
The question of whether faces are recognized by the tion about limb location is known as kinesthesis, and
same cognitive processes that are used to recognize it can be combined with information from the touch
other objects has been at the centre of a great deal of receptors to guide our hands and fingers. Of particular
research. Although a definitive answer as to just how importance are the relative positions of your fingers as
different face recognition is from general object recog- they touch the object, their orientation to your hand,
nition has yet to be provided, the two have tended to and the position of your hand in relation to your arm
be treated as different areas of research. Because of and of your arm in relation to your body. The pro-
this, we have divided this chapter into two main areas cesses that allow us to keep track of the relative loca-
of discussion. The first (the rest of Section 2 and tions of all our limbs are known as proprioception.
Section 3) will look at theories of how we recognize So, at every moment that we are touching an
objects, and the second (Sections 4 to 7) will look at object, we know the exact position of our fingers
models of face recognition and examine in more (kinesthesis) and what the object feels like at that
depth the question of whether faces are recognized by point (touch receptor information). The information
special processes. gained from this combination is referred to as haptic
information and it can be used to generate a descrip-
tion of an object.
Lederman and Klatzky (1987) found that there was
2.2Active processing – considerable consistency in the way in which people
recognizing objects by touch used their hands in order to gather haptic informa-
tion. They described how participants tended to use a
One limitation of the basic recognition procedure we series of exploratory procedures when investigating
suggested in Section 1 is that it treats recognition as a an object with their hands. Lederman and Klatzky
passive process. Gibson (1986) stressed that percep- (1990) went on to study these exploratory procedures
tion is an active process and that we are beings who in more depth and described how each particular
CHAPTER 4 RECOGNITION 105
ACTIVIT Y 4. 3
Ask someone to place a variety of objects within make and what each movement tells you about the
easy reach of you (you can do this yourself if you object.
wish). Ask them to choose objects that differ in Table 4.1 gives a list of some of the hand move-
shape, texture, and weight. Close your eyes and ments reported by Lederman and Klatzky (1987),
pick up each object in turn and try to work out along with the information that these exploratory
what it is. As you do this, try to make a mental procedures tend to reveal. Did you find yourself
note of the different movements that your hands using these movements?
TAB LE 4.1 The information revealed by exploratory as an active process. Nor is active perception limited
hand movements to touch. You saw in the last chapter how your inter-
pretation of the impossible triangle (Figure 3.24) kept
Movement Information
changing as you visually explored the object, corner
Enclose object in hand(s) Overall shape by corner.
Following contours with fingers More exact shape
Lateral motion with fingers Texture
Press with fingers Hardness
Static contact with fingers Temperature Recognizing two-
2.3
Unsupported holding Weight dimensional objects
Source: based on Lederman and Klatzky, 1987, Table 1, p.345
Another way of distinguishing between types of rec-
ognition is according to whether the object in ques-
procedure could be used to derive a certain type of tion is three-dimensional (3D), such as the book in
information that was useful for recognizing an object. front of you, or two-dimensional (2D), such as the
For example, if shape was important in recognizing words in front of you. The difference between 2D and
the object people tended to move their fingers around 3D object recognition takes on added significance
the object’s contours, and if texture was important when you consider that the description generated
they would move their fingers across the surface from the retinal image will in essence be 2D, whilst
of the object. most objects tend to be 3D. In fact, much of the early
Although haptic perception can be used to recog- research conducted on recognition processes was
nize objects, visual recognition has the obvious advan- focused on how simple, two-dimensional ‘patterns’
tage that it can be used for distant objects that are out are recognized. Although it can be argued that this
of reach. It also tends to be far quicker and more accu- work tells us little about how complex, three-dimen-
rate in processing information about shape, particu- sional objects are recognized, it does serve to highlight
larly complex 3D shape (Lederman et al., 1993). But some of the problems that are inherent in any approach
visual perception is not so useful when it comes to to object recognition.
judging the weight and texture of an object. By far the simplest model of visual pattern recogni-
So, haptic perception is a very useful source of tion postulates template matching. This is the idea that
information and can be used to recognize certain we have a large number of templates stored in long-
objects. The study of haptic perception also serves to term memory against which we compare the patterns
demonstrate that recognition is not necessarily pas- we come across. For example, a template would exist
sive and that much can be gained from considering it for every number from 0 to 9 and for every letter from
106 PART 1 PERCEPTUAL PROCESSES
R
B
FIGU RE 4. 5 Different alphanumeric characters that
share similar properties.
IF ‘current image’ is NOT equal to ‘stored image’ THEN object = ‘not a coffee mug’
FIGU RE 4.9 A simple program failing to recognize an object from a different viewpoint.
108 PART 1 PERCEPTUAL PROCESSES
The failure of the simple program to deal with a important point and one that is central to the study of
small change in viewpoint is obviously an unaccepta- object recognition.
ble flaw in any system that wishes to interact with its Marr (1982) conceptualized the problem of view-
environment. Instead of being reliant on seeing point as that of turning the viewer-centred description
objects from just a single viewpoint, the process of of the object that was formed in the 2½D sketch
object recognition must somehow be based on (see Chapter 3, Section 4.3) into a 3D object-centred
descriptions of objects that allow recognition to take description that would allow the object to be recognized
place independent of viewpoint. In fact, these pro- despite changes in viewpoint. In the next section
cesses must be tolerant of any naturally occurring we shall look at how Marr suggested this might
change, not just changes in viewpoint. This is a very happen.
SUMMARY OF SECTION 2
• There are different types of recognition, which depend on what is being recognized and how.
• Object recognition tends to be based on making between-category distinctions and face recognition
on making within-category distinctions.
• Face recognition tends to be researched apart from more general object recognition because faces
can convey social and emotional information and their appearance can change.
• Recognition is not entirely a ‘passive’ process and can involve an active exploration of the environ-
ment. This is particularly true of haptic recognition, in which objects are recognized by touch.
• One key problem facing any theory of visual recognition is that the retinal image is essentially 2D, but
objects are 3D.
• Early theories that concentrated on recognizing 2D patterns, such as template matching and feature
recognition theories, are therefore not particularly useful models of human recognition.
• Theories based on abstracting a structural description of an object are better able to cope with 3D
objects.
• As a 3D object can be viewed from many angles, our recognition system must be able to turn an
object description centred on the viewer into one centred on the object.
3RECOGNIZING THREE-
DIMENSIONAL OBJECTS
As we saw in the previous chapter, in the first part vious section, viewer-centred descriptions are of lit-
of Marr’s theory of perception, early visual process- tle use in recognizing real objects that can be seen
ing of the retinal image eventually leads to the gen- from any angle and any distance. The second half of
eration of the 2½D sketch. But the surfaces and Marr’s theory therefore concentrated on recognis-
objects in the 2½D sketch are described in relation ing objects from any angle by working out how to
to the viewpoint of the observer and are therefore turn the 2½D sketch into a 3D object-centred
viewer-centred descriptions. As we saw in the pre- description.
CHAPTER 4 RECOGNITION 109
FIGU RE 4.11 Four generalized cones. Source: Marr, 1982, Figure 3.59, p.224
110 PART 1 PERCEPTUAL PROCESSES
(a)
FIGU RE 4.13 A silhouette (a) and three objects that could cause it (b, c, and d).
CHAPTER 4 RECOGNITION 111
(a) (b)
(c) (d)
(e) (f )
FIGU RE 4.16 Locating the component axes of an object. Source: Marr and Nishihara, 1978, Figure 6
Human
Arm
Forearm
Hand
FIGU RE 4.17 Marr and Nishihara’s hierarchical model of a human body. Source: Marr and Nishihara, 1978, Figure 3
CHAPTER 4 RECOGNITION 113
axis that runs through the centre of the body (a). This the forearm and hand (d). Finally, the axis of the cylin-
3D model also contains the relative length and orien- der used to describe the hand (d) is used as the major
tation of the axes that describe the head, torso, arms, axis in order to describe the five fingers (e). Thus we
and legs (b). However, no details regarding smaller have a 3D model description that can be used to recog-
parts (such as the fingers) are provided. nize an entire human body, as well as any of its parts.
The axis that corresponds to each limb (b) is then Having derived a 3D description of the object, Marr
used as the major axis for a more detailed description and Nishihara (1978) saw the next step in the process
of that limb (c). For example, the axis of the cylinder of recognition as comparing this to a catalogue of 3D
representing the right arm is then used as the major models, formed from the 3D descriptions of all previ-
axis to represent the upper and lower parts of that arm ously seen objects. The catalogue is organized hierar-
(c). The axis of the cylinder used to describe the lower chically according to the amount of detail present in
part of the arm (c) is used as the major axis to describe the model (see Figure 4.18). At the highest level the
Cylinder
Cow
FIGU RE 4.18 3D model catalogue. Source: Marr and Nishihara, 1978, Figure 8
114 PART 1 PERCEPTUAL PROCESSES
catalogue consists of descriptions devoid of any More powerful evidence in support of Marr and
decomposition into components. The next level con- Nishihara’s theory comes from neuropsychological
tains more detail, corresponding to the number and case studies. Warrington and Taylor (1978) reported
basic layout of limbs as in Figure 4.17. At the next level that patients with damage to a particular part of the
even more detail is contained, such as that relating to right hemisphere could recognize objects when they
the angles and lengths of component axes. were presented in a typical view but not when pre-
The 3D model generated of a new object (the target) sented in an unusual view. These patients also found it
is related to the catalogue, starting at the highest level. very difficult to say whether two photographs (pre-
The target is compared to the stored models and the sented simultaneously) were of the same object when
example it best matches is used as the basis for the one image was a typical view of that object and one an
next level of detail. The process stops when a level is unusual view.
reached that corresponds to the level of detail present One explanation for this effect is that the patients
in the target. At this point, assuming the target con- could not transform the two-dimensional representa-
tains sufficient detail, a match should have been found tion of the unusual view of the object into a 3D model
that allows the object to be recognized. description. However, as well as it being difficult to
So, the generation of a 3D model description establish the central axis of an object presented in an
solves several problems inherent to object recogni- unusual view, it is also likely that rotation would cause
tion. As the model is 3D, it allows recognition of some key features of the object to become hidden.
the object from many angles and its hierarchical Humphreys and Riddoch (1984) prepared images of
nature allows recognition of the entire object whilst objects in which either a critical feature was obscured
maintaining more detailed information about the or the central axis had been foreshortened through
components. rotation. These images were presented to patients sim-
ilar to those tested by Warrington and Taylor. The
patients had far more problems recognizing the axis-
foreshortened objects than those with a key feature
Evaluating Marr and
3.2
hidden. The results of these studies do offer some
Nishihara’s theory evidence that axis location may play a central role in
generating a 3D model description of an object.
Although it can be difficult to study the cognition
involved in object recognition, there is evidence for
some of the suggestions made by Marr and Nishihara. 3.3 Biederman’s theory
One of the key predictions of their theory arises
from the fact that they see establishing a central axis as Marr and Nishihara’s work has been extended and
a vital stage in the recognition process. This means adapted in several related theories of object recogni-
that it should be very difficult to recognize an object if tion. The most influential of these was proposed by
it is also difficult to establish the location of its central Biederman in 1987. Biederman’s theory (1987a) was
axis. Some support for this notion comes from a study also based on representing complex objects using a
conducted by Lawson and Humphreys (1996), in series of more simple primitives. Unlike Marr and
which participants had to recognize objects (line Nishihara, Biederman did not restrict these primi-
drawings in this case) that had been rotated. Rotation tives to generalized cones. Instead he proposed that
did not appear to have an effect on recognition unless the basic building blocks for describing an object
the major axis of the object was tilted towards the were a set of basic shapes such as cylinders and
observer. Presumably, the disruption to recognition cubes, known as geons (an abbreviated form of the
was due to the major axis appearing foreshortened phrase ‘geometric ions’). Many of these geons are
and therefore harder to locate. generalized cones, but they also include other
CHAPTER 4 RECOGNITION 115
Geons
1 2 3 4 5
Objects
5 5 4
5
5
3
3 3
2 2 5
2 3
3D shapes that are very useful in representing com- Biederman listed five non-accidental properties:
mon objects. A subset of geons is shown in the top
• Curvilinearity – a curve in the 2D image is
part of Figure 4.19.
produced by a curve on the object.
Biederman suggested that approximately 36 geons
are needed in order to produce descriptions of all • Parallelism – lines that are parallel in the 2D image
common objects. As with Marr and Nishihara’s the- will be parallel on the object.
ory, more complex objects are represented by several • Cotermination – two or more edges that terminate
different components and the division into compo- at the same point in the 2D image will terminate at
nents is based on areas of concavity. the same point on the object.
The principal way in which Biederman’s theory • Symmetry – if the 2D image is symmetrical
diverges from Marr and Nishihara’s approach is the then the object will contain the same axis of
way in which a 3D description is formed from infor- symmetry.
mation in a 2D image – in other words, how the
• Collinearity – a straight line in the 2D image is
information in the primal sketch can be used to gen-
caused by a straight line on the object.
erate a 3D object-centred description. Biederman
proposed that Marr’s contour generators are not Choosing which geon to use in order to represent an
necessary to recover 3D shape, as each geon will object (or part of an object) is then simply a matter of
have a key feature that remains invariant across dif- detecting these non-accidental properties and select-
ferent viewpoints. Thus, all that needs to be done is ing a geon that shares them. For example, the 2D image
to locate these key features in the 2D primal sketch. of a ball will be a circle and will therefore contain no
Each feature can then be matched to a geon so that a parallelism, cotermination, or collinearity, but will
3D structural description of the object is generated. contain curvilinearity and an almost infinite degree of
This description is then matched against those symmetry. The only geon to share these properties is a
stored in memory. sphere, so the 3D shape of the ball is correctly described
Behind the concept of key features that remain by a spherical geon.
invariant across viewpoint is the idea that some regu- Although these assumptions allow apparently
lar aspects of a 3D shape will tend to remain constant ambiguous 2D images to be turned into an accurate
in any 2D image that is formed of that object. 3D description, they can also lead to misinterpreta-
Biederman termed these ‘non-accidental’ properties tion. For example, if you look at the wheel of a
to distinguish them from any regularity that was due bicycle that is directly in front of you so that the
simply to a particular viewpoint. wheel is viewed edge-on, its edges will appear to
116 PART 1 PERCEPTUAL PROCESSES
Apparent
collinearity
Two lines of from seeing
symmetry the wheel
edge-on
Parallelism
The production of an object description that is original experiments and pointed out that although
independent of viewpoint is a crucial stage in the the- visual priming does appear to be mediated by a repre-
ories of both Marr and Nishihara, and Biederman. So sentation of an object’s shape that is independent of its
is there evidence that recognition does involve the position, size, or orientation in depth, it is also the
generation of an object-centred description, rather case that participants form an episodic representation
then relying purely on viewer-centred descriptions? of the specific image originally shown. That both a
To investigate the extent to which recognition is view-independent and a view-dependent representa-
object-centred, Biederman and Gerhardstein (1993) tion seem to be formed by exposure to one image
used a technique known as repetition priming, where obviously poses a challenge to theories of object rec-
the presentation of one stimulus will make recogni- ognition that do not incorporate both forms of repre-
tion of a related stimulus faster and/or more accu- sentation.
rate. The idea behind their experiment was that if an In the end, then, it is unlikely that recognition
object-centred description were being formed, then is completely reliant upon the generation of object-
presenting one particular viewpoint of an object centred descriptions such as those suggested by Marr
should facilitate (or prime) recognition of the same and Nishihara (1978) and by Biederman (1987a), and
object presented in a different view. Their results there may well be tasks and occasions that involve
showed that one viewpoint of an object did prime viewpoint-dependent recognition, as suggested by
recognition of a separate viewpoint, as long as the Tarr (1995).
change in the angle of viewpoint was not more than One task that is hard to incorporate into either
135 degrees. However, even if the viewpoints were Marr and Nishihara’s or Biederman’s theory is that of
less than 135 degrees apart, if one or more geon(s) within-category discrimination. By representing
was hidden between the first and second view, then objects as models consisting of either generalized
the amount of priming was reduced. This result sup- cones or geons, a wealth of information is inevitably
ports both the idea that an object-centred descrip- lost. For example, it is very likely that two collie-
tion is generated (otherwise different viewpoints shaped canines would be represented as identical 3D
should not prime each other), and that this makes models, yet it is possible to tell a border collie from a
use of geons. rough collie and even to tell specific dogs apart.
However, other researchers have reported results It makes sense that there should be more than one
that do not appear consistent with Biederman and way of arriving at such a complex cognitive achieve-
Gerhardstein’s findings. Bulthoff and Edelman (1992) ment as object recognition. In the theories we have
found that participants were generally unable to rec- examined in this section, the process of recognition
ognize complex objects that were presented in a novel has been conceived of as almost wholly passive and
viewpoint, even if the view of the object was one that based on a single retinal ‘snapshot’ or view. As we have
should have allowed the generation of an object- stated previously, there are different types of recogni-
centred description. Biederman and Cooper (2009) tion and different ways of achieving it, including tak-
reflected on the priming work conducted since their ing a more active approach.
SUMMARY OF SECTION 3
• Objects can be recognized from many different angles, suggesting that the process of recognition may
be based on the generation of a 3D object-centred description.
• Marr and Nishihara (1978) suggested a theory of object recognition based on generating 3D models.
This was achieved by: deriving the shape of an object from the 2½D sketch; dividing it into ‘primitives’
using areas of sharp concavity; generating an axis for each of these components; and representing
each component via a generalized cone.
118 PART 1 PERCEPTUAL PROCESSES
• The 3D models were hierarchical in nature and so included both global and detailed information
stored in a hierarchically organized catalogue.
• Biederman (1987) suggested a similar theory based on using the non-accidental properties of an
object to generate a description in terms of a series of basic volumetric forms known as geons.
• Although there is evidence that supports the approach taken by Marr and Nishihara and by Biederman,
there are some forms of recognition that are difficult to explain using their theories.
4 FACE RECOGNITION
The act of recognizing the face of someone familiar is are confronted by a person, you want to know not only
part of everyday life and most of the time it happens that there is a human face in front of you, but whose
very quickly and effortlessly. Faces are arguably our face it is. This requires a much finer level of distinction
favourite visual stimuli and can provide us with a great than simply recognizing a sphere as a sphere; you
deal of very useful information. First and foremost we must be able to tell which specific face is in front of
are very good at determining the identity of a face that you. As we shall see in Sections 4 to 7 of this chapter,
is familiar to us, but faces also provide information the need to recognize individual faces has led to theo-
about gender, age, and cultural background, as well as ries and research concentrating on different issues
the emotional state of a person. Although it was only from that conducted within the area of more general
in the mid-1970s that psychologists acknowledged object recognition.
that faces were a unique visual stimulus, since then an Faces can be categorized at several different levels.
enormous body of research on face recognition has At one level, we decide that the stimulus is a face as
been conducted, meaning that in this chapter we are opposed to some other object. At another level, we
only able to provide you with a snapshot of some of decide that the face is female or male or derive other
this research. semantic information such as ethnic origin. We may
even make attractiveness judgements. Importantly,
we also decide whether the face is familiar or unfa-
miliar. If the face is familiar, there is also the need to
4.1Comparing object and decide to whom the face belongs and it is at this level
face recognition that faces are rather different from other objects. It is
this within-category judgement, which is like recog-
Face recognition is very problematic for the 3D model nizing a specific cat or a specific cup, that sets face
approaches we have looked at so far. If we return to recognition apart from object recognition more gen-
Humphreys and Bruce’s model of object recognition erally, and it is regarded as more visually demanding
shown in Figure 4.2, we can see that theories such as because the differences between faces can be fairly
those of Marr and of Biederman have concentrated on minimal.
the ‘perceptual classification’ stage of the process. Tanaka (2001) has found evidence to liken this
Although this stage may provide information that is level of face recognition to expert recognition – for
useful for navigation and basic interaction with the example, the expertise that certain individuals
objects we find in the environment, more complex acquire through training in bird-watching or x-ray
interaction is often necessary. For example, when you analysis. But whereas only some specifically trained
CHAPTER 4 RECOGNITION 119
people achieve object expertise, face expertise is a those of family and friends) and recognizing a face we
general expertise that we all share and acquire have only seen a few times. Most research on unfa-
without specific training. Whether or not this face miliar face recognition starts with a learning phase,
expertise is the result of an innate processing system where participants are presented with faces unknown
or the expression of a learned skill is a matter of to them that they then ‘learn’, and concludes with a
debate and an issue we will return to in Section 7 test phase in which the participants attempt to recog-
of this chapter. nize those faces they had seen previously from
amongst other faces that they have never seen before.
A large number of face-learning experiments have
been conducted (e.g. Yin, 1969) and these have found
Recognizing familiar and
4.2
that, when given an immediate recognition test, par-
unfamiliar faces ticipants performed extremely well. (For example,
Yin observed that participants correctly recognized
So how good are we at recognizing faces and identi- 93 per cent of the faces previously shown to them).
fying people? You already saw in Activity 4.2 that it However, if the picture of the unfamiliar face shown
was possible to recognize a face that was familiar to in the recognition test depicted a different viewpoint
you (Paul McCartney) despite quite large changes in or expression, then recognition rates dropped (e.g.
appearance. In fact, when you think about it, you are Bruce, 1982), suggesting that what is being tested is
able to recognize your family and friends from any ‘recognition of a specific picture of a face’ rather than
angle, under different lighting conditions, and even ‘face recognition’ as we encounter it in everyday life.
when they age or change their hairstyle, and you are So, whilst we can recognize familiar faces indepen-
still likely to be able to do this in 30 years’ time. dently of viewpoint or expression, the processing of
There is evidence to suggest that we can remember unfamiliar faces is influenced by both viewpoint and
the names and faces of school-friends over long expression. Furthermore, the environmental context
periods of time; recognition tests revealed hardly in which the face is seen also has a larger influence on
any forgetting over a 35-year period (Bahrick et al., the recognition of unfamiliar faces than on the recog-
1975). This is not the case with all the faces we nition of familiar faces (see Memon and Bruce, 1985,
encounter though. Later work by Bahrick investi- for a review). Finally, there is also considerable evi-
gated the ability of college teachers to recognize for- dence from applied research on eyewitness identifica-
mer students taught over a 10-week period (Bahrick, tion decisions and from publicized cases of
1984). The teachers had met these students three to misidentification, such as the one involving Jean
five times a week. Although the level of correct face Charles De Menezes, that suggests unfamiliar face
recognition for those taught recently was reasonably recognition is far, far more error prone than familiar
high at 69 per cent, this dropped as the number of face recognition.
intervening years increased so that after 8 years only In Box 4.1, you will see that research has also shown
26 per cent of the former students were correctly that even when participants do not have to recognize
recognized. an unfamiliar face from memory, they are still prone
What about faces that are not so familiar, for exam- to making errors.
ple ones we’ve only seen once or twice before? How The difference between familiar and unfamiliar
well do we recognize unfamiliar faces? Indeed, that face recognition might be quantitative in nature and
might sound an odd question, as how could it be pos- simply reflect the amount of exposure the partici-
sible to recognize a face you are unfamiliar with? Of pants have had to the faces. However, according to
course, it is impossible to recognize a face you have Megreya and Burton (2006), it is more likely that the
never seen before, but there is a great deal of differ- difference is qualitative in nature. They carried out
ence between recognizing a familiar face (such as six experiments involving face matching tasks
120 PART 1 PERCEPTUAL PROCESSES
Even matching unfamiliar faces that are presented Other studies have demonstrated that we are not
simultaneously (a task that does not test our mem- very good at matching two similar high quality photo-
ory) appears to be surprisingly difficult. In a field graphic images when the face is unfamiliar. Bruce et al.
experiment, Kemp et al. (1997) looked at how well (1999) showed participants a high quality video still of
cashiers could match shoppers to credit cards bear- an unfamiliar young male target that was then pre-
ing their photographs. They found that cashiers sented in a line-up of similar images of nine other
would frequently accept credit cards depicting a young men. Even when told that the target was defi-
photograph of someone who bore a resemblance nitely present in the line-up, participants picked it out
to the shopper (the correct decision rate to reject accurately in only 80 per cent of the trials. If not told
the card was only 36 per cent). Even when the that the target was present, or if the pose of the target
photograph was of someone who bore no particu- was varied between initial presentation and test, then
lar resemblance to the shopper but was of the performance was even worse. In fact, the perfor-
same sex and ethnic background, the correct mance of these participants has been matched or even
decision rate to reject the card was only 66 per cent exceeded by that of an automatic face recognition sys-
(see Activity 4.4). tem tested on the same images (Burton et al., 2001).
ACTIVIT Y 4.4
similar to those described in Box 4.1. They pre- as ‘simple visual patterns’), recognition of familiar
sented the faces in both upright and inverted (upside faces is likely to involve a more specialized and
down) conditions, and found that whilst perfor- robust type of processing.
mance for unfamiliar faces was similar in both con- The next section looks more closely at what recog-
ditions, participants were better with familiar faces nition of familiar faces may entail. We will start our
in upright conditions. This finding was replicated in discussion by considering some of the errors people
a further study (Megreya and Burton, 2007). Their make. These errors provide us with important infor-
conclusion was that unfamiliar faces are not pro- mation about the different systems and processes that
cessed for identity like familiar faces, and whereas may be involved in face recognition. Importantly,
unfamiliar face matching may rely on image-based models of face recognition need to be able to account
or pictorial processes (where the faces are treated for such errors.
SUMMARY OF SECTION 4
• Face recognition is an example of a within-category judgement task.
• Our ability to identify familiar faces is extremely good and relatively unaffected by pose, viewpoint,
or context.
• Recognition of unfamiliar faces is much poorer and is influenced by changes in pose, viewpoint, or
context.
ACTIVIT Y 4. 5
Although we may have face recognition expertise, that you failed to recognize someone you know or
we do make mistakes. Before reading on, reflect for you mistakenly thought you recognized someone
a moment and recall the last time you discovered you didn’t know.
122 PART 1 PERCEPTUAL PROCESSES
TAB LE 4. 2 The main types of everyday errors in face involves a sequence of processes using different types
recognition revealed by Young et al. (1985) of information. Hay and Young (1982), Young et al.
(1985), and then Bruce and Young (1986) refined a
Types of everyday Number of errors
errors cognitive theoretical framework or model of person
recognition involving such a sequence of stages. On
Person misidentified 314
meeting people we encode their faces. This encoded
Person unrecognized 114
information may activate face recognition units
Person seemed familiar only 223
(FRUs) that contain stored information about the
Difficulty in retrieving full
190 faces we are familiar with. If there is a reasonable
details of the person
Decision problems 35 match between what has been encoded and what is
stored in the recognition unit, then the recognition
unit will be activated and allow access to semantic
What do these different categories mean? ‘Person information about the person’s identity, such as their
misidentified’ refers to those occasions when someone occupation, stored in person identity nodes (PINs). It
unfamiliar is misidentified as someone familiar and is only once the PIN for a face has been activated that
‘Person unrecognized’ refers to occasions when some- their name can be generated. A cognitive system is
one familiar was thought to be someone unfamiliar. also involved, as the information provided by the rec-
Both may arise because of poor viewing conditions ognition system must be evaluated. As the diary study
(i.e. it is a bit dark) or because we know the person above indicated, errors in face recognition can arise
only slightly. ‘Person seemed familiar only’ refers to because of decision problems. For example, if we
those occasions when you recognize someone as being know that the person doesn’t live or work nearby, that
familiar but no other information comes to mind knowledge may override what our recognition system
immediately, and ‘Difficulty in retrieving full details of is telling us and hence we may doubt that we have cor-
the person’ refers to occasions when only some seman- rectly identified the person.
tic information is retrieved and not, for example, their So, when might the encoded information activate
name. These errors often occur when the familiar per- FRUs? As mentioned in Section 4, familiar face recog-
son is seen outside the context in which they are usu- nition is extremely good and relatively unaffected by
ally encountered. Finally, ‘Decision problems’ refers to pose, viewpoint, or context, and to achieve this Bruce
those occasions where you think you recognize the and Young suggested that structural codes are formed
person but decide it cannot be them, perhaps because over time. These codes contain the information that
you believe they are currently in another country. allows a face to be recognized despite changes in pose,
These errors demonstrate that it is possible to expression, etc. Importantly, structural codes allow us
retrieve previously learned semantic information to decide whether or not a face is familiar. The first
about a person without recalling their name, but that stage of the model involves the creation of these codes
it is very unlikely that we will recall their name with- resulting in two types of representations that serve
out also retrieving relevant semantic information. different purposes. Viewer-centred descriptions result
However, before we can recall either semantic infor- in viewpoint-specific representations and, as can be
mation or a name, we must realize the face is familiar. seen in Figure 4.22, these are used for expression
analysis and to help make sense of speech. Expression-
independent descriptions result in separate and
more abstract expression-independent representa-
A cognitive model of face
5.2
tions, which are used for recognition. Therefore, a face
recognition needs to be familiar if it is to activate a FRU; if it is
unfamiliar then its representation will be linked to the
These findings on everyday errors are consistent with particular view of the face that is being shown in that
the notion that the recognition of familiar faces particular encounter.
CHAPTER 4 RECOGNITION 123
or
EXPRESSION View-centred
ANALYSIS descriptions
STRUCTURAL
ENCODING
FACIAL Expression-
SPEECH independent
ANALYSIS descriptions
DIRECTED FACE
VISUAL RECOGNITION
PROCESSING UNITS (FRUs)
PERSON
IDENTITY
NODES (PINs)
COGNITIVE
SY STEM
NAME
GENERATION
FIGU RE 4. 22 Bruce and Young’s functional model for face recognition. Source: Bruce and Young, 1986, p.312
The Bruce and Young (1986) functional model for name without also being able to name the occupation,
face recognition is presented in Figure 4.22. As you thus supporting the notion that semantic ‘person
can see, there are separate routes for facial expression identity’ information is retrieved before the person’s
analysis, facial speech analysis, and face recognition; name. Other studies (e.g. Johnston and Bruce, 1990),
and face recognition progresses through a sequence of looking at how quickly we can complete a particular
stages from FRUs to PINs to name generation. task, have shown that faces can be classified as famil-
The notion that different types of information are iar more quickly than they can be classified by occupa-
sequentially accessed is also supported by the results tion, and furthermore that classifications that
of experiments conducted in the laboratory. For require accessing the person’s name take longer than
example, Hay et al. (1991) showed participants 190 classifications involving a person’s occupation or
images of the faces of celebrities (including people other semantic properties. These findings support the
likely to be familiar to the participants and those likely notion that perceptual classification, judging the
to be unfamiliar) and asked them to decide whether or familiarity of a person, takes place before semantic
not each face was familiar and to state the person’s classification and that a person’s name is accessed last.
occupation and name. Participants did not retrieve a They also provide a nice demonstration of how the
124 PART 1 PERCEPTUAL PROCESSES
findings from the laboratory may support those recognition and an extension and implementation of
derived in a more everyday study of face recognition, the Bruce and Young model described above. IAC
such as Young et al.’s (1985) diary study. stands for ‘interactive activation and competition net-
work’. As this model is a computer simulation of face
recognition it has been tested by seeing how compati-
ble it is with the available evidence, and by looking at
5.3A connectionist model of the predictions it generates.
face recognition The model comprises units that are organized into
pools (see Figure 4.23). These pools contain:
The IAC model (e.g. Burton et al., 1990; Burton
and Bruce, 1993) is a connectionist model (recall the • FRUs (face recognition units): For every familiar
discussion of connectionism in Chapter 1) of face person, there is one FRU in the model. These are
WRUs
American Politician
Michael Jesse
Mick British
Jackson Anna Teacher
Ford Jagger
FRUs
NRUs
PINs
SIUs
Singer British
Name:
Name: Mick Jagger
Michael Jackson Teacher
Name:
Jesse Jackson
view-independent and seeing any recognizable specialized for faces, as well as those specialized for
view of a face will activate the appropriate FRU. the recognition of written or spoken names, and
These representations allow perceptual familiarity is judged on this pooled information.
information to be mapped onto stored memories. We mentioned before that IAC stood for ‘interac-
(This is basically what was suggested in the Bruce tive activation and competition network’. The ‘inter-
and Young model.) active activation’ arises from the links between units
• PINs (person identity nodes): This is where a face is in different pools, which are excitatory: the FRU for
classified as belonging to a person, and there is one Mick Jagger’s face excites or activates the PIN for
unit per known person. Mick Jagger, which in turn excites semantic informa-
tion units for the name ‘Mick Jagger’, the occupation
• SIUs (semantic information units): Relevant
‘singer’, and the nationality ‘British’. These excitatory
semantic information is stored here, e.g.
links are bidirectional so that excitation also runs in
occupational category.
the opposite direction from ‘singer’ to Mick Jagger’s
• Lexical output: Units representing output as either PIN and Mick Jagger’s FRU. However, within each
words or a name. pool links between units are inhibitory (these links
are not shown in Figure 4.23), so this is where ‘com-
The IAC model also includes a route based on word petition’ arises. Excitement in the FRU for Mick
recognition. The pool of WRUs (word recognition Jagger will inhibit activity in the other FRUs, just as
units) represents an input lexicon containing both excitement in Mick Jagger’s PIN will inhibit activity
specific names and more general information, such as in the other PINs and excitement in one SIU will
nationality or occupation. Words that are names have inhibit activity in another SIU. But the SIU for Mick
direct links to a pool of NRUs (name recognition Jagger (which might be ‘singer’) will also excite many
units), which are linked to PINs in the same way as other PINs (in this example, those belonging to all
FRUs. The WRUs that do not correspond to names are other singers). This means that activation of PINs will
linked to SIUs. not be limited solely to the specific person in ques-
Figure 4.23 shows how the pools are connected. The tion, but some activation will also occur for anyone
input systems (FRUs and NRUs) join to a common set who is semantically related (e.g. shares the same
of person identity nodes (PINs) and these are linked occupation). Thus, the model incorporates the results
to units containing semantic information (SIUs). Each of experiments that have shown priming effects – that
of the pools is illustrated here with just a few examples you are quicker to recognize Bill Wyman if you have
of the units they might contain. Many SIUs will be already seen Mick Jagger. Generally, the strength of
shared and here many people will be represented with this connectionist model is that it can account for
such information as ‘teacher’ or ‘British’. findings from laboratory studies as well as for the eve-
Recognizing a face is modelled in the following ryday errors described by Young et al. (1985).
way: seeing a face will activate an FRU, which in turn To conclude this section, it is important to highlight
increases activation in the relevant PIN. As PINs are that the Bruce and Young model has been very influ-
linked to SIUs, activation of the PIN will bring about ential and still remains so today, providing a frame-
activation in the relevant SIU. The notion that differ- work for organizing the different elements involved in
ent types of information are sequentially accessed is face recognition. It has been superseded by the IAC
therefore still present in this connectionist model. If a model, which provides more information on how
certain threshold is achieved in the PIN, then this sig- FRUs and PINs actually operate and accounts for the
nals familiarity. An important point to note is that dif- effects of priming. Next we shall consider how well the
ferent types of information come together at the PIN IAC model can account for findings from neuropsy-
stage, including information from recognition systems chological studies.
126 PART 1 PERCEPTUAL PROCESSES
SUMMARY OF SECTION 5
• Everyday errors suggest that recognizing faces involves sequential access to different types of infor-
mation.
• A cognitive model of person recognition involving such an idealized sequence of stages has been
developed (Bruce and Young, 1986).
• IAC is a connectionist model of face recognition that is an extension and implementation of this
cognitive model.
6NEUROPSYCHOLOGICAL
EVIDENCE
Prosopagnosia, the inability to recognize faces whilst 6.1Separate routes for
maintaining the ability to recognize other objects, is
a well-documented phenomenon. However, cases of
identification and emotional
‘pure’ prosopagnosia are exceptionally rare. It is expression
more common to see deficits affecting other visual
categories too. The recognition of all familiar faces is As mentioned in Section 5, models of face recognition
affected, regardless of their semantic categories (so it have proposed a route for face identification that is
is not the case that the failure to recognize a face is independent of emotional expression, and this inde-
restricted to faces of celebrities or politicians). pendence has received support from experimental
However, as recognition from other cues, for exam- work and from neuropsychological research. In many
ple voice, usually remains unaffected, the condition cases of prosopagnosia, the ability to recognize facial
is specific to visual recognition of faces and is not a expressions may be unaffected. Young et al. (1993)
more general impairment of the recognition of per- looked at ex-servicemen with unilateral brain injuries
sonal identity. Also, the ability to distinguish between and tested familiar face recognition, unfamiliar face
faces is often preserved. matching, and analysis of emotional facial expres-
In this section, we shall focus on two key findings sions. Analysis of accuracy data showed evidence of
that have emerged from investigations of prosopag- selective impairments in each of these three abilities.
nosia: first, that identification of expression appears For example, one participant with a right hemisphere
to be independent from face identification; and sec- lesion was selectively impaired in identifying familiar
ond, that face recognition and awareness of face rec- faces, whereas a different participant, also with a
ognition might also be independent of one another. right hemisphere lesion, had problems only with
It is possible that although prosopagnosics are una- matching unfamiliar faces. A number of other partici-
ble to recognize faces consciously or overtly, certain pants with left hemisphere lesions were only impaired
types of non-conscious response may be preserved. on the facial expression tasks. Response latency
We shall examine how the IAC model may account data also supported the notion of a selective deficit
for this. of facial expression processing, but suggested that
CHAPTER 4 RECOGNITION 127
impairments of familiar face recognition and unfamil- processes are mediated and how these processes nor-
iar face matching were not entirely independent from mally become integrated, there is support for
one another. The findings from this study thus provide the involvement of the two major neural pathways (see
strong support for the notion that facial expression Box 4.2).
analysis and face identification seem to proceed inde- A different issue is whether those individuals who
pendently of each other (and also some support for retain covert recognition can be helped to overcome
the notion that the ability to recognize familiar faces their disorder. Could covert recognition be turned
and to match unfamiliar faces may be selectively and into overt recognition? Sergent and Poncet (1990)
independently impaired). were the first to demonstrate such provoked overt
recognition. In their study, PV was shown eight faces
of famous people from the same semantic category
6.2 Covert face recognition and she was unable to identify them. However, when
she was told that they all had the same occupation
Previously, when describing models of face recogni- and she looked at the faces again, she was able to say
tion, we did not draw a distinction between face rec- that they were all politicians, name seven of the peo-
ognition and awareness of recognition. However, ple, and recall biographical information about the
neuropsychological research on prosopagnosia sug- eighth person. This and other later studies (e.g.
gests that the distinction is important. Bauer (1984) Diamond et al., 1994) have shown that provoked
monitored changes in autonomic nervous system overt recognition can occur under certain experi-
activity via changes in skin conductance response mental conditions, and this provides some hope for
(SCR). These changes signal an affective or emotional rehabilitative work.
reaction (you may remember reading in Chapter 2 on Can the IAC model accommodate the pattern of
attention how a closely related response, GSR, was deficits described here? Covert without overt recogni-
measured to look at unconscious processes). Bauer tion is explained in terms of attenuation (or weaken-
showed LF, a participant with prosopagnosia, a face ing) in the connections between the FRUs and
and read out a list of five names, whilst simultaneously PINs. This means that when a face is seen and the FRU
measuring SCR. If LF was asked to pick the correct is activated, the weakened FRU-PIN connection
name he performed no better than expected by strength means that excitation of the corresponding
chance. In other words, LF was overtly unable to PIN is not raised above the threshold for the face to be
recognize familiar people from their faces. However, recognized overtly. However, this weakened activation
LF showed a greater SCR when the correct name was may be sufficient to raise the excitation of the PIN
read aloud compared with the incorrect names. Thus, above its resting level, mediating covert recognition.
LF was showing an affective or emotional response, Provoked overt recognition is explained in the
but this response was not a conscious one. The term following way. Telling PV that the faces are related is
covert recognition is used to describe this non-con- equivalent to strengthening the PIN-SIU connections.
scious recognition or emotional response to the faces. Unlike FRU-PIN connections, PIN-SIU links are
Since Bauer’s work, many studies have investigated assumed to remain intact in instances of prosopagno-
covert recognition and the issue is not whether this sia where covert recognition is observed. Once these
type of face recognition exists but how to interpret it. connections are strengthened, activation is passed
Bauer proposed that separate neural pathways are back from the shared SIUs to the relevant PINs. These
responsible for two independent routes to recognition, then achieve threshold and the faces are recognized
one for conscious overt recognition and one for non- overtly. Simulations with the model confirmed this
conscious covert recognition. Although questions particular prediction – provoked overt recognition
remain over exactly how overt and covert recognition was successfully modelled (Morrison et al., 2001).
128 PART 1 PERCEPTUAL PROCESSES
6.3 Evaluating the IAC model combine the descriptions formed by multiple
encounters with a (familiar) face, so that what is
As a model of face recognition, the IAC model is stored in memory is an abstracted representation of
impressive in that it can account for a wide range of the face. Longmore et al. (2008) have challenged
data from studies on face recognition. Whilst there are such a notion after carrying out six experiments
other models of face recognition, some of these are where participants learned to recognize new faces to
based on a narrower range of evidence; for example, near 100% accuracy (they termed this familiarized
they may have sought only to account for the findings face recognition). Their findings revealed that when
from neuropsychological studies. As we have seen participants learned multiple views of the same face,
here, IAC is compatible with everyday, laboratory, and their performance decreased when shown novel
neuropsychological findings. views of that face, suggesting that the different views
Hole and Bourne (2010) suggest that the weakness of the same face were stored as a collection of sepa-
of IAC is that it says little about what information is rate images rather than as a combined representa-
extracted from the face in the first place to allow it to tion. Therefore, what was stored appeared to be
become familiar. How is a face encoded to allow it to based on view-specific rather than structural codes.
be matched to an internal representation so that FRU We shall consider other findings regarding the infor-
activation then follows? One issue that has been mation that is extracted from a face in the final
raised is whether structural codes are indeed used to section of this chapter.
SUMMARY OF SECTION 6
• Prosopagnosia is the inability to recognize faces, although expressions and other objects may still be
correctly identified.
• Covert face recognition, shown by autonomic responses to faces, may however be spared.
• Overt conscious face recognition and covert non-conscious face recognition are different types of
face recognition that may be mediated by different neural pathways.
• Capgras delusion may be a mirror image of prosopagnosia in terms of which system remains intact
and which system is damaged.
• Provoked overt recognition has been achieved in some studies and has been successfully modelled
using the IAC model.
3. How important are the individual features of the use of a different form of visual information to recog-
face, the relationships between the features, or the nize a face from that used to recognize, for example, a
three-dimensional structure? Do we process the table. Some evidence that this is indeed the case comes
individual facial features or the face as a whole? from studies that have demonstrated that inverting, or
turning upside down, visual stimuli disproportion-
In the previous section, we looked at the syndrome of ately impairs our ability to recognize faces compared
prosopagnosia and found that research implicated sev- with our ability to recognize objects. This is known as
eral neurological pathways. Of particular interest is the inversion effect. Yin (1969) and other studies since
that prosopagnosia can leave object recognition rela- (e.g. Johnston et al., 1992) have shown that inverting a
tively intact and, in turn, face recognition has been photograph of a face disrupts recognition more than
spared in cases where object recognition has been does inverting an image of an object. Yin looked at the
impaired (a double dissociation). Studies using the influence of inversion on faces and other stimulus
technique of functional magnetic resonance imaging material including houses and aeroplanes. Although
(fMRI) have found facial stimuli to activate an area in recognition memory was better for upright faces than
the fusiform gyrus in the posterior temporal lobes for other material, when the stimuli were turned
(especially in the right hemisphere), whilst non-face upside down, recognition for faces was worse than
objects activated a different area. There is also the that for other material. The key question is whether
observation of cells specialized for faces within the this peculiar reversal of recognition accuracy for faces
monkey temporal lobe – these cells respond selectively (from best upright to worst inverted) supports the
to faces of humans and/or monkeys but not to other notion that faces are processed differently from other
stimuli (e.g. geometrical shapes and bananas). There is, stimuli or whether there is an alternative explanation.
therefore, evidence to suggest that the processing of Diamond and Carey (1986) investigated an alterna-
faces is mediated by specific areas of the brain; that tive hypothesis, namely that the effect of inversion on
there is cortical specialization for faces. But does this faces was a result of our perceptual mechanisms
mean that face recognition is unique, that the processes becoming ‘tuned’ to seeing this special type of visual
used for recognizing faces are qualitatively different stimulus in the usual upright orientation. This ‘tuning’
from those used for recognizing other visual stimuli? or expertise would then be ‘lost’ when we see them
There is support for the notion that there is a special inverted. Their research considered whether the inver-
mechanism from birth for processing facial informa- sion effect was indeed specific to human faces or
tion, as newborn babies show a preference for face-like whether it would in fact arise when using any class of
visual patterns. Rather than an innate neural mecha- visual stimulus with which we have a large amount of
nism that processes faces, Johnson and Morton (1991) experience. To investigate this, Diamond and Carey
suggested that there is a mechanism that makes new- selected participants to include both people who were
borns attentive to faces, and this innate attentional bias not interested in dogs and people who were dog
then ensures that any system for learning visual stimuli experts (mainly dog-show judges, breeders/handlers,
receives a lot of face input and learns about the indi- or people with a sustained interest in dogs). These par-
vidual characteristics of faces. Although there is a ticipants were shown photographs of both human
‘kick-start’ mechanism that gives face processing in faces and dogs (body profiles – see Figure 4.25) and
newborns a special status, which serves to guide subse- told to look at each photograph and try to remember
quent learning, soon other processing systems will it. Analysis revealed that whereas all participants rec-
come into play that may or may not be unique to faces. ognized upright faces better than inverted faces, dog
One further reason to think that face recognition is experts also recognized upright dogs better than
a special type of recognition, distinct from other inverted dogs. This finding has been interpreted as
object recognition, is that faces all tend to look alike in supporting the notion that the inversion effect is
that they have similar features in similar positions. acquired as a result of expertise and is not a ‘face-spe-
Given this similarity, it could be that we have to make cific’ effect.
CHAPTER 4 RECOGNITION 131
What changes then in the way we process faces as we share the same basic arrangement or configuration.
acquire this expertise? Diamond and Carey proposed a However, first-order relational properties help us
distinction between first-order and second-order rela- detect that a visual stimulus is a face – a necessary step
tional properties. First-order relational properties refer before identifying the face. Second-order relational
to the spatial relationships among parts of the face; for properties refer to the differences in this basic configu-
example, the eyes are above the nose and the mouth is ration. This refers to the differences in the way the
below the nose. Faces cannot be distinguished accord- features are arranged in relation to each other; for
ing to their first-order relational properties as they all example, wide-set eyes with a low forehead versus
(b) Recognition items: participants were asked to judge which of the stimulus items they
had seen previously
FIGU RE 4. 25 Examples of the dog stimuli used. Source: Diamond and Carey, 1986, p.112
132 PART 1 PERCEPTUAL PROCESSES
narrow-set eyes and a high forehead. Expertise results inverted rather than upright; inversion failed to reduce
in a greater sensitivity to these second-order relational ratings of grotesqueness when the distortions were
properties, as it is these properties that individuate performed on the features. These findings support the
members of the same class, such as human faces. notion that inversion disrupts our processing of spatial
There is support for the notion that inversion influ- relationships between the features.
ences our sensitivity to second-order relational prop- Research like this suggests that our expertise in
erties. For example, Searcy and Bartlett (1996) (upright) face recognition stems from the way in
presented participants with photographs of grotesque- which these upright faces are processed as ‘configura-
looking faces. They created images where they had tions’ rather than as an assemblage of independent
either distorted individual facial features (eyes and features. The term configural processing has been
mouths) or they had distorted the spatial relations used, although this has been interpreted in a number
between the features (see Figure 4.26). They then of ways: to refer to the spatial relationships between
presented these manipulated images in upright and features (i.e. second-order relational properties); to
inverted orientations. Participants rated the grotesque- refer to the way facial features interact with one
ness of the images and results showed that images of another (i.e. the way the shape of the mouth influences
faces with distortions to the spatial relations between how the shape of the nose is perceived); to refer to
the features were rated as less grotesque when presented holistic processing of the face (i.e. the face is perceived
FIGU RE 4. 26 Examples of stimuli used by Searcy and Bartlett (1996): the pair labelled ‘A’ shows a normal image and
one with distorted facial features; the pair labelled ‘B’ shows a normal image and one with spatial distortion. Source:
Searcy and Bartlett, 1986, Figure 1, p.907
CHAPTER 4 RECOGNITION 133
as a whole face pattern and not broken down into sep- Robbins and McKone tested dog experts who they
arate features); or even to refer to the basic arrange- confirmed had good individuation of exemplars of
ment of the facial features (i.e. first-order relational their breed-of-expertise. Their experts included
properties). A considerable amount of research has judges, breeders, and trainers of Labradors and so
been devoted to investigating the relative importance their stimuli were of Labrador Retriever dogs. They
of this type of processing as compared with the pro- compared the performance of these experts with nov-
cessing of the facial features (known as featural pro- ices on a number of tasks, including inversion, and in
cessing or piecemeal processing). Although it is not contrast to Diamond and Carey found no difference
always clear what different researchers mean by the between experts and novices for the dog-inversion
term ‘configural’, there is agreement that configural effect. Their paper not only presented new data but
information plays an important role in the perception also provided a review of behavioural experiments
and representation of upright faces. often used as support for the expertise hypothesis, and
One area of debate centres on the suggestion that they concluded that configural/holistic processing
this reliance on configural processing is the result of does not occur for objects of expertise and is therefore
learning to recognize lots of faces, and hence the result unique to face processing. They claimed that the find-
of expertise. Although this does not rule out input ings of investigations looking at configural processing
from an innate mechanism, which may have ‘kick- support the idea of domain-specificity for faces; in
started’ this learning by biasing attention towards other words that faces are special.
faces, it does not suggest that face perception and rec- In sum, there is physiological and neuropsychologi-
ognition involve unique processes that are qualita- cal evidence supporting the existence of areas special-
tively different from those used to process other types ized for processing faces, and evidence suggesting an
of stimuli. This generic expertise hypothesis has been innate ability to pay attention to faces. Whether or not
criticized by Robbins and McKone (2007), who failed the processes involved in face recognition are unique
to replicate the finding of Diamond and Carey (1986). is a central question under investigation.
SUMMARY OF SECTION 7
• Neuropsychological and physiological evidence suggests that there are specific areas of the brain that
mediate face processing.
• Research on newborn babies suggests an innate ability to attend to faces.
• The inversion effect appears to be linked to our expertise in processing upright faces using configural
information.
• We may develop expertise at distinguishing members of other categories of visual stimuli that also
involves configural processing.
• Most evidence does not suggest that the processes involved in the perception and recognition of
faces are unique.
8 CONCLUSION
In this chapter we have explored different types of rec- allow us to recognize objects and faces. In reading
ognition and looked at some of the mechanisms that about recognition, you may well have got the idea that
134 PART 1 PERCEPTUAL PROCESSES
cognitive psychologists still have a lot to learn about more comprehensive and detailed theory of the cogni-
how object and face recognition may occur. Indeed, tion involved in recognition. Just as there are different
research has yet to clarify the different processes types of recognition, there are also different ways of
involved in recognizing familiar faces as opposed to recognizing faces and objects – for example, visually
unfamiliar faces, or to specify fully the overlap, if any, or by touch – and these different ways may involve dif-
between the processes involved in face identification ferent processes. So, rather than seeing the theories
and those used in object recognition. discussed here as providing a final answer, the best
It is undoubtedly the case that a great deal of way to view them is as taking some of the initial steps
research is still being conducted in order to provide a in this complex but interesting field.
FURTHER READING
Bruce, V., Green, P.R., and Georgeson, M.A. (2003) Visual Hole, G. and Bourne, V. (2010) Face Processing:
Perception: Physiology, Psychology and Ecology, Hove, Psychological, Neuropsychological, and Applied Perspectives,
Psychology Press. This textbook on visual perception by Bruce, Oxford, Oxford University Press. This book by Hole and Bourne
Green, and Georgeson covers both perception and recognition is an excellent text suitable for the student reader, that provides a
and provides a more extensive look at the areas of cognition cov- comprehensive review of different areas of research on face pro-
ered in both this and the preceding chapter. cessing. As well as covering empirical findings from laboratory
Marr, D. (1982) Vision: A Computational Investigation based research, evidence from neuropsychological investigations is
into the Human Representation and Processing of Visual described and relevant applied research is discussed. It also covers
Information, San Francisco, W.H. Freeman & Company. The theories of face perception and recognition that we have not had
critical importance of the work of Marr for theories of percep- time to go into here, most notably Valentine’s multi-dimensional face
tion and recognition is hopefully clear by now. Marr’s seminal space model and the approach to face recognition based on princi-
book, published in 1982, is still widely available and the best way pal component analysis.
of really getting to grips with his research.
REFERENCES
Bahrick, H.P. (1984) ‘Memory for people’, in Harris, J.E. and Conference on Computer Vision, IEEE Computer Society,
Morris, P.E. (eds.) Everyday Memory, Actions and Absent- pp.384–92.
mindedness, Academic Press, London. Biederman, I. and Cooper, E.E. (2009) ‘Translational and
Bahrick, H.P., Bahrick, P.O., and Wittlinger, R.P. (1975) reflectional priming invariance: a retrospective’, Perception,
‘Fifty years of memory for names and faces: a cross-sectional vol.38, pp.809–825.
approach’, Journal of Experimental Psychology: General, Biederman, I. and Gerhardstein, P.C. (1993) ‘Recognizing
vol.104, pp.54–75. depth-rotated objects: evidence and conditions for three-
Bauer, R.M. (1984) ‘Autonomic recognition of names and dimensional viewpoint invariance’, Journal of Experimental
faces in prosopagnosia: a neuropsychological application of the Psychology: Human Perception and Performance, vol.19,
guilty knowledge test’, Neuropsychologia, vol.22, pp.457–69. pp.1162–82.
Biederman, I. (1987a) ‘Recognition by components: a the- Biederman, I., Yue, X., and Davidoff, J. (2009) ‘Rep-
ory of human image understanding’, Psychological Review, resentation of shape in individuals from a culture with mini-
vol.94, pp.115–47. mal exposure to regular, simple artifacts: sensitivity to
Biederman, I. (1987b) ‘Matching image edges to nonaccidental vs. metric properties’, Psychological Science,
object memory’, Proceedings of the First International vol.20, pp.1437–42.
CHAPTER 4 RECOGNITION 135
Bruce, V. (1982) ‘Changing faces: visual and non-visual Humphreys, G.W. and Bruce, V. (1989) Visual Cognition:
coding processes in face recognition’, British Journal of Computational, Experimental and Neuropsychological
Psychology, vol.73, pp.105–16. Perspectives, Hove, Lawrence Erlbaum Associates Ltd.
Bruce, V. and Young, A. (1986) ‘Understanding face recog- Humphreys, G.W. and Riddoch, M.J. (1984) ‘Routes to
nition’, British Journal of Psychology, vol.77, pp.305–27. object constancy: implications from neurological impair-
Bruce, V., Henderson, Z., Greenwood, K., Hancock, P.J.B., ments of object constancy’, Quarterly Journal of Experimental
Burton, A.M., and Miller, P. (1999) ‘Verification of face identi- Psychology, vol.36A, pp.385–415.
ties from images captured on video’, Journal of Experimental Johnson, M.H. and Morton, J. (1991) Biology and Cognitive
Psychology: Applied, vol.5, pp.339–60. Development: The Case of Face Recognition, Oxford, Blackwell.
Bulthoff, H.H. and Edelman, S. (1992) ‘Psychophysical Johnston, A., Hill, H., and Carmen, N. (1992) ‘Recognizing
support for a two-dimensional view interpolation theory of faces: effects of lighting direction, inversion and brightness
object recognition’, Proceedings of the National Academy of reversal’, Perception, vol.21, pp.365–75.
Sciences of the USA, vol.89, pp.60–4. Johnston, R.A. and Bruce, V. (1990) ‘Lost properties?
Burton, A.M. and Bruce, V. (1993) ‘Naming faces and nam- Retrieval differences between name codes and semantic codes
ing names: exploring an interactive activation model of per- for familiar people’, Psychological Research, vol.52, pp.62–7.
son recognition’, Memory, vol.1, pp.457–80. Kemp, R., Pike, G., and Brace, N. (2001) ‘Video-based iden-
Burton, A.M., Bruce, V., and Johnston, R.A. (1990) tification procedures: combining best practice and practical
‘Understanding face recognition with an interactive activation requirements when designing identification systems’,
model’, British Journal of Psychology, vol.81, pp.361–80. Psychology, Public Policy and Law, vol.7, no.4, pp.802–7.
Burton, A.M., Miller, P., Bruce, V., Hancock, P.J.B., and Kemp, R., Towell, N., and Pike, G. (1997) ‘When seeing
Henderson, Z. (2001) ‘Human and automatic face recogni- should not be believing: photographs, credit cards and fraud’,
tion: a comparison across image formats’, Vision Research, Applied Cognitive Psychology, vol.11, no.3, pp.211–22.
vol.41, pp.3185–95. Lawson, R. and Humphreys, G.W. (1996) ‘View-specificity
Diamond, B.J., Valentine, T., Mayes, A.R., and Sandel, M.E. in object processing: evidence from picture matching’, Journal
(1994) ‘Evidence of covert recognition in a prosopagnosic of Experimental Psychology: Human Perception and
patient’, Cortex, vol.28, pp.77–95. Performance, vol.22, pp.395–416.
Diamond, R. and Carey, S. (1986) ‘Why faces are and are Lederman, S.J. and Klatzky, R.L. (1987) ‘Hand movements:
not special: an effect of expertise’, Journal of Experimental a window into haptic object recognition’, Cognitive Psychology,
Psychology: General, vol.115, pp.107–17. vol.19, pp.342–8.
Ellis, H.D. and Lewis, M.B. (2001) ‘Capgras delusion: a Lederman, S.J. and Klatzky, R.L. (1990) ‘Haptic classifica-
window on face recognition’, Trends in Cognitive Sciences, tion of common objects: knowledge-driven exploration’,
vol.5, no.4, pp.149–56. Cognitive Psychology, vol.22, pp.421–59.
Ellis, H.D. and Young, A.W. (1990) ‘Accounting for delu- Lederman, S.J., Klatzky, R.L., and Pawluk, D.T. (1993)
sional misidentifications’, British Journal of Psychiatry, vol.157, ‘Lessons from the study of biological touch for robot haptic
pp.239–48. sensing’, in Nichols, H. (ed.) ‘Advanced tactile sensing for
Gibson, J.J. (1986) The Ecological Approach to Visual robotics’, in World Scientific Series in Robotics and Automated
Perception, Hillsdale, NJ, Lawrence Erlbaum Associates. Systems, vol.5, Singapore, World Scientific Publishing.
Hay, D.C. and Young, A.W. (1982) ‘The human face’, in Longmore, C.A., Liu, C.H., and Young, A.W. (2008)
Ellis, A.W. (ed.) Normality and Pathology in Cognitive ‘Learning faces from photographs’, Journal of Experimental
Functions, London, Academic Press. Psychology: Human Perception and Performance, vol.34,
Hay, D.C., Young, A.W., and Ellis, A.W. (1991) ‘Routes pp.77–100.
through the face recognition system’, Quarterly Journal of Marr, D. (1977) ‘Analysis of occluding contour’, Proceedings
Experimental Psychology, vol.43A, pp.761–91. of the Royal Society of London, Series B, vol.197, pp.441–75.
Hirstein, W. and Ramachandran, V.S. (1997) ‘Capgras syn- Marr, D. (1982) Vision: A Computational Investigation into
drome: a novel probe for understanding the neural represen- the Human Representation and Processing of Visual
tation of identity and familiarity of persons’, Proceedings of the Information, New York, W.H. Freeman and Company.
Royal Society, London, Series B, vol.264, pp.437–44. Marr, D. and Nishihara, H.K. (1978) ‘Representation and
Hole, G. and Bourne, V. (2010) Face Processing: recognition of the spatial organization of three-dimensional
Psychological, Neuropsychological, and Applied Perspectives, shapes’, Proceedings of the Royal Society of London, Series B,
Oxford, Oxford University Press. vol.211, pp.151–80.
136 PART 1 PERCEPTUAL PROCESSES
Megreya, A.M. and Burton, A.M. (2006) ‘Unfamiliar faces Journal of Experimental Psychology: Human Perception and
are not faces: evidence from a matching task’, Memory & Performance, vol.22, pp.904–15.
Cognition, vol.34, pp.865–76. Selfridge, O.G. (1959) ‘Pandemonium: a paradigm for
Megreya, A.M. and Burton, A.M. (2007) ‘Hits and false learning’, in The Mechanisation of Thought Processes, London,
positives in face matching: a familiarity based dissociated’, HMSO.
Perception & Psychophysics, vol.69, pp.1175–84. Sergent, J. and Poncet, M. (1990) ‘From covert to overt
Memon, A. and Bruce, V. (1985) ‘Context effects in epi- recognition of faces in a prosopagnosic patient’, Brain,
sodic studies of verbal and facial memory: a review’, Current vol.113, pp.989–1004.
Psychological Research & Reviews, pp.349–69. Tanaka, J.W. (2001) ‘The entry point of face recognition:
Morrison, D.J., Bruce, V., and Burton, A.M. (2001) evidence for face expertise’, Journal of Experimental Psychology:
‘Understanding provoked overt recognition in prosopagnosia’, General, vol.130, pp.534–43.
Visual Cognition, vol.8, pp.47–65. Tarr, M.J. (1995) ‘Rotating objects to recognize them: a case
Neisser, U. (1967) Cognitive Psychology, New York, study on the role of viewpoint dependency in the recognition
Appleton-Century-Crofts. of three-dimensional objects’, Psychonomic Bulletin and
Pike, G., Brace, N., and Kynan, S. (2001) The Visual Review, vol.2, pp.55–82.
Identification of Suspects: Procedures and Practice: A Publication Warrington, E.K. and Taylor, A.M. (1978) ‘Two categorical
of the Policing and Reducing Crime Unit, London, Home Office stages of object recognition’, Perception, vol.7, pp.695–705.
Research, Development and Statistics Directorate. Yin, R.K. (1969) ‘Looking at upside down faces’, Journal of
Pike, G., Kemp, R., and Brace, N. (2000) ‘The psychology of Experimental Psychology, vol.81, pp.141–5.
human face recognition’, IEE Electronics and Communications: Young, A.W., Hay, D.C., and Ellis, A.W. (1985) ‘The faces
Visual Biometrics, 00/018, pp.12/1–12/6. that launched a thousand slips: everyday difficulties and errors
Robbins, R. and McKone, E. (2007) ‘No face-like process- in recognizing people’, British Journal of Psychology, vol.76,
ing for objects-of-expertise in three behavioural tasks’, pp.495–523.
Cognition, vol.103, pp.34–79. Young, A.W., Newcombe, F., De Haan, E.H.F., Small, M.,
Searcy, J.H. and Bartlett, J.C. (1996) ‘Inversion and process- and Hay, D.C. (1993) ‘Face perception after brain injury’,
ing component and spatial-relational information in faces’, Brain, vol.116, pp.941–59.
CONCEP TS AND
L ANG UAG E
Introduction
5 Concepts
Nick Braisby
6 Language processing
Gareth Gaskell and Helen Brown
7 Language in action
Simon Garrod and Tony Sanford
138 PART 2 CONCEPTS AND L ANGUAGE
INTRODUCTION
In Chapter 1, we saw how cognitive psychology seeks However, both of these theories suffer a number
to explain cognition in terms of information process- of problems. The alternative theories discussed in the
ing by developing and refining accounts that are chapter assume that categorization is knowledge-rich,
expressed in terms of representations, which carry that is, it involves broader knowledge structures – lay
information, and computations, which transform the theories about domains are implicated by the ‘theory’-
representations in various ways. Whereas Part 1 theory of concepts, and beliefs about what constitute
showed how such accounts could be developed to essential properties are implied by psychological
explain perceptual processes, in Part 2 we shall see essentialism.
how successfully this approach can be applied to two As broader knowledge structures get invoked to
related areas of cognition: categorization and language. explain categorization, however, you will see that it
Categorization, our ability to group things together becomes harder to state theories precisely, and the
into discrete categories such as fruit, vegetables, tables, discussion of theories in the chapter reflects this.
and chairs, can be examined in different ways. It can Whereas classical and prototype theories are outlined
be analysed from a perceptual point of view – how can with some precision, so that one can imagine detailed
particular visual or auditory features, for example, accounts of the process of categorization being given,
influence how we categorize the scenes that we ‘theory’-based and essentialist theories are hard to
perceive? – but also from a linguistic viewpoint – how define, and it is unclear whether a detailed information
is our categorization influenced by the information we processing account could be developed at present.
receive via language and also by the words we have Because of the difficulty in developing precise
available? In placing categorization in Part 2, we have accounts of representations of categories and the pro-
chosen to emphasize the link between categorization cesses constituting categorization, researchers have
and language, but in making concepts the topic of the been led to revisit some of the simplifying assump-
first chapter after Part 1 we also hope to draw attention tions previously made in this literature. Perhaps, for
to some of the links between categorization and per- example, there might be different kinds of categoriza-
ception. Indeed, categorization or semantic classifi- tion for different kinds of category, or for different
cation can be seen as the next stage on from perceptual kinds of categorizer. In some sense, researchers are
classification, the focus of Chapter 4. considering again what categorization really is. In the
In Chapter 5, Nick Braisby outlines several different terminology of Marr’s levels that we saw in Chapter 1,
theoretical approaches to categorization. Despite being in spite of its fundamental importance, researchers
a fundamental ability, categorization appears to elude are still seeking agreement over a level 1 account of
a comprehensive treatment. The first two theories categorization – over what categorization achieves
outlined, classical and prototype theories, imply that and why. Only then might we hope to develop precise
concepts, our mental representations of categories, algorithmic, or level 2, accounts.
can be neatly demarcated one from another and each Gareth Gaskell and Helen Brown’s Chapter 6 builds
understood in terms of sets of features. According to on some of the foundations of Chapter 5, but seeks
both theories we place items into a category if they to explain something that superficially appears very
possess a criterial number of these features. Such the- different – how we comprehend both spoken and
ories are knowledge-lean – that is, they assume first written language. Together with Simon Garrod and
that it is possible to demarcate category-relevant Anthony Sanford’s Chapter 7, these chapters on lan-
knowledge, and second that only this knowledge is guage mark a point of departure. The chapters in Part 1,
relevant to determining categorization. and Chapter 5 to some extent, have been concerned
INTRODUCTION 139
with how we perceive and pick up information con- view is that semantic knowledge, for example, is only
cerning our environment, and how we use this infor- called upon late on in processing, and only then to
mation to infer the presence and nature of objects, and adjudicate between interpretations of the incoming
the categories to which they belong. Chapters 6 and 7 input. The top-down (and interactive) view is that
mark a concern with the social world, with how we such knowledge may operate early, and influence
communicate about our world to others, how we make which interpretations are pursued. This important
sense of the interpretations of others, and how others debate, ranging over phenomena such as spoken and
influence our communication. As Gareth Gaskell written word recognition, ambiguity resolution, and
states in opening his chapter, understanding our sentence comprehension, is as important as it is
ability to use language is key to understanding what unresolved.
differentiates humans from other animals, and to This debate is also reflected in Chapter 7, where
understanding human cognition. Simon Garrod and Anthony Sanford broaden the
Chapter 6 draws our attention to many aspects of focus on language to include the comprehension of
language processing that we normally take for granted. whole texts (not just sentences), language production,
In comprehending spoken language, we have to infer and dialogue. The authors begin by considering some
which words are present in a stream of speech, an abil- difficulties for a simple view of language processing in
ity we learn as children. We also have to learn to make which information is processed at one discrete stage,
use of our knowledge of the speech sounds used in and then passed to another, and to another. In the
our particular language(s). These processes are easily simple view, each stage involves interpreting or trans-
taken for granted, and researchers have had to coin lating the output of the previous stage. So, for exam-
new terms and posit new theoretical structures, such ple, in speech comprehension, a phonological stage
as the mental lexicon, in order to make sense of the might be followed by a lexical stage, which might be
comprehension process. Researchers have assumed followed by a syntactic stage, and so on. Each stage
that different kinds of knowledge are brought to bear takes as its input the output of the previous stage,
at different stages of comprehension. Models of the transforms that input in a certain way, and then
process that incorporate new theoretical structures outputs to a subsequent stage. The theme that runs
and different kinds of knowledge have been con- throughout Chapter 7 is that understanding and pro-
structed (e.g. the cohort model) and experiments ducing language involves much more than the simple
conducted to evaluate them. Indeed, and in contrast view assumes – in particular, the authors show how
with Chapter 5, Chapter 6 focuses mainly on process- language processing as a whole involves drawing
ing accounts and how well they explain experimental heavily on general, non-linguistic knowledge. This is
data. Also in contrast with Chapter 5, some of the pro- a significant contrast with Chapter 6, where it was
cessing accounts are sufficiently well specified that assumed that knowledge could be neatly compart-
they have been developed as computational models. mentalized, and that language comprehension requi-
TRACE, for example, is a connectionist model, as is red the use of only particular kinds of knowledge and
IAC (interactive activation and competition), a model only at particular stages.
you encountered in Chapter 4. That researchers have Simon Garrod and Anthony Sanford begin by
been able to develop such models successfully is a showing how the comprehension of texts does not just
testament to how advanced their understanding of rely on consulting the meaning of words in the mental
the cognitive processes of language comprehension is. lexicon and combining these according to linguistic
Nevertheless, running through Chapter 6, and in rules. In various ways, texts require the application of
common with Chapter 5, is a concern with the extent much more than just lexical knowledge – for example,
to which we require general knowledge for processing the authors suggest that the meaning of some words
language, and the time-point at which this knowledge is unlikely to be represented in a ‘lexicon’ but rather
is brought to bear. The bottom-up (and autonomous) is rooted in actual bodily posture and movement. That
140 PART 2 CONCEPTS AND L ANGUAGE
language can involve more complicated processes is how cognitive psychology has been successful in gen-
also demonstrated by a discussion of language pro- erating detailed processing models of language com-
duction. Though there are some similarities to the prehension. Chapters 5 and 7 show a different kind of
discussions in Chapter 6 – production can be seen as success – though researchers have yet to answer some
involving the reverse of comprehension processes – of the basic questions about categorization and lan-
there are also further complexities. Production guage-in-action, the cognitive approach has helped
involves monitoring one’s productions to ensure they them to generate different theoretical frameworks and
are as intended, and also designing one’s productions empirical means of examining them. That is, the suc-
according to the social context. And it is the social cess of the approach can be measured not only in
aspect of language that most clearly comes to the terms of the success of proposed models, but also in
fore in the discussion of dialogue. Dialogue involves terms of the generation of new research questions.
coordination between speakers at a number of levels: Finally, the three chapters in this part reveal a reci-
for example, in taking turns to ask and answer ques- procity between the precision with which theories and
tions, in developing a common understanding, and in models may be specified and the extent to which a
what the authors describe as alignment and routiniza- cognitive process appears to be knowledge-rich; the
tion of representations. extent to which it seems to draw on general knowl-
What do these three chapters reveal about the edge. The more general knowledge a process draws
cognitive approach? Perhaps most notable in these upon, the harder it is for researchers to develop pre-
chapters is the breadth of the cognitive approach. cise models. It appears that precision – one of the hall-
Researchers tackle very diverse questions – from what marks of a scientific account – can be achieved only
knowledge we have of categories to what processes when the knowledge that influences a cognitive pro-
underpin dialogue – but do so from a common cess can be isolated or separated from other kinds of
perspective – that of seeking to posit mental represen- knowledge and demarcated in distinct processing
tations, which carry information, and computational modules. The question as to the modularity of cogni-
processes that transform them. tion, explicitly addressed in Chapter 20 by Martin
The chapters also invite us to think about the Davies and the late Tony Stone, is one to which we
success of the cognitive approach. Chapter 6 shows shall return again and again.
CHAPTER 5
CONCEP TS
Nick Braisby
1 INTRODUCTION
In the UK some years ago a television programme won’t have to think hard to identify the appropriate
required people to guess the identity of unusual antique concept. But how do we achieve this? For, as Figure 5.1
artefacts. Contestants were allowed to hold the objects shows, as did the television programme, categorizing
and discuss their ideas as to what the objects might be, something, finding the right concept, can be difficult.
but the objects were chosen so that it was not at all In fact, as we shall see, even effortless categorizations
obvious what their function was, nor what they were are ultimately difficult to explain. The first step is to
called. In the parlance of cognitive psychology, they work out what concepts are.
were difficult to categorize – objects for which contest-
ants could not readily find an appropriate concept.
You can get a sense of the difficulty faced by these
contestants from Figure 5.1. This shows some obscure
Concepts, categories,
1.1
kitchen utensils. Try to guess what they are – answers and words
are given at the end of the chapter.
Normally we categorize things effortlessly. Try Dictionaries say that the word ‘concept’ has different
looking around you now. Can you see a single object senses. There is a non-technical sense, one that relates
that you can’t label or categorize? My guess is that you loosely to ideas and thoughts. So, for example, we
FIGU RE 5.1 Three (more or less) obscure objects that may be found in the kitchen.
142 PART 2 CONCEPTS AND L ANGUAGE
Even though concepts may be at work almost all of see Newen and Bartels, 2007). Similarly, others have
the time, our focus will be on a restricted range of argued against a strong discursive position, according
behaviours that involve giving fairly explicit and often to which categories are socially constructed (e.g.
linguistic judgements about category membership. Pinker, 1997; Fodor, 1998).
This kind of categorization behaviour has provided So, accepting that judgements of category member-
the primary evidence as to the nature of concepts. ship are the principal indices of categorization, we can
Categorization could be more broadly construed, now turn to some of the techniques psychologists have
however. Potter and Wetherell (1987) and Edwards used to elicit these. One method is the sorting task
and Potter (1992) show how attention to natural dis- (see Coxon, 1999). In this task, participants are shown
course reveals many subtleties in how people choose an array of different items (sometimes words printed
which category words to use, and how they then use on cards) and asked to sort them into groups. Ross
them in particular contexts. This ‘discursive’ approach and Murphy (1999), for example, used this technique
can show how categorization is affected by social influ- to examine how people categorize foods. They found
ences, such as the social status of the people discoursing, that people sometimes put eggs in the same group as
and how using category words serves broader goals bacon and cereal (suggesting a category of breakfast
than merely that of reporting one’s beliefs about cate- foods), whereas at other times they put eggs together
gory membership. Though this line of work reveals with butter and milk (suggesting a category of dairy
important dimensions to our categorization behaviour, products). The groups into which items are catego-
it would be wrong to overplay the significance of such rized are taken to reflect corresponding concepts. The
influences. Indeed, it is precisely because categoriza- fact that eggs are sometimes put into different groups
tion behaviour is systematic that people have posited is consistent with Barsalou’s (1983) findings that
the existence of stable concepts. The focus for cognitive categorization can depend upon people’s goals or
psychologists, therefore, is on categorization processes purposes. So, for example, when asked to say what
in general, i.e. what might be common to different falls into the category ‘things to take with you in case
instances of categorization in different contexts. of fire’ people would mention items that would not
Categorization also need not be so closely tied to normally be found together in the same category (e.g.,
language. Indeed, many researchers attribute concepts loved ones, pets, and family heirlooms).
to non-linguistic animals. Sappington and Goldman If the sorting task seems abstract and artificial, go
(1994) investigated the abilities of Arabian horses into your kitchen and look at how the different foods
to learn to discriminate patterns. They claimed that and gadgets are organized. You will probably find
horses that learned to discriminate triangles from items grouped into categories – herbs and spices in
other shapes had actually acquired a concept – in this one place, fruit in another, vegetables in yet another.
case, the concept of ‘triangularity’ – as opposed to I group foods together even in my supermarket car-
merely having learned the particular triangular pat- rier bags – usually into nothing more complicated
terns to which they had been exposed. Again, though, than frozen, chilled, and room temperature – when
this chapter focuses on what we know of human cog- the person at the checkout gives me enough time to do
nitive achievements, and hence the nature of human so! So, placing members of a category together is really
concepts. an everyday activity that the sorting task taps in a
My bracketing off of these two issues does not solely more measurable and controlled way.
reflect a pragmatic desire to get on with discussing The sorting task and the property-listing technique
the matters of most relevance to cognitive psychology, in Activity 5.1 highlight a third aspect of concepts –
but also the contentious nature of these issues. For they are invoked to explain categorization behaviour.
instance, some cognitive scientists have argued that We behave differently with cats and dogs because cats
the idea that animals might possess concepts is not and dogs belong to different categories, and so our
actually coherent (Chater and Heyes, 1994; though concepts of cats and dogs must differ. The differences
144 PART 2 CONCEPTS AND L ANGUAGE
ACTIVIT Y 5.1
Think of the properties that dogs have. You might property- or attribute-listing technique to investigate
think dogs ‘bark’, ‘have four legs’, ‘run after sticks’, people’s concepts, although they obtain results from
‘pant’, and so on. Now consider the concept of ‘cat’. many participants for each category. They then com-
Take two minutes to write down some of the prop- pare the lists from different people and generate a
erties cats have. Don’t dwell on any particular prop- further list of the most frequently mentioned prop-
erty; just write down whatever comes to mind. If erties. This gives an indication of the information
you get to ten properties, stop. incorporated in people’s concepts, and the frequency
of mention indicates how central each property is to
COM M ENT
the concept.
Simple though this task seems, it gets hard to think of
new properties after a while. Psychologists use this
(and similarities) between cats and dogs are reflected nearly 90 years to decide how the platypus should be
in our concepts, and it is these that are involved in categorized.
producing behaviour. Box 5.1 offers another example where categori-
zation has been more explicitly discussed; legal and
moral cases provide others. In the UK, for example,
the law applies differently to adults and children. So, it
1.3The wider story is important to be able to categorize everyone as either
of concepts a child or an adult. Yet it is too difficult to identify a
precise age for the boundary between children and
Perhaps because concepts are implicated in so much adults, and so parliaments have to decide, arbitrarily,
of our behaviour, their role often goes unnoticed. where it should lie.
However, concepts are sometimes brought explicitly Fascinating though these examples are, the rest of
into focus. Umberto Eco (1999) discusses the example the chapter concentrates on more everyday categori-
of the platypus. In 1798 a stuffed platypus was sent to zations. Researchers have tended to adopt a methodo-
the British Museum. Initially, it was considered so logical strategy of explaining the simpler cases first, in
strange that it was thought to be a hoax, with its beak the hope that explanations can then be developed for
artificially grafted onto its body. For the next 80 years more complex cases. As you will see, even everyday
the question of how the platypus should be categorized categorizations are surprisingly difficult to explain.
was hotly debated. Finally, in 1884, it was declared to
be a type of mammal, called a monotreme, which both
lays eggs and suckles its young, and this categorization 1.4 Concepts and cognition
has stuck (though of course it is possible that even this
categorization might again come into question – see In the last chapter you saw that the word ‘recognition’
Section 2.1.4). labels different kinds of process. The authors focused
This case of scientific ‘discovery’ reminds us that all on what was called perceptual classification and you
of our concepts have a past. Even such basic concepts may have wondered about the subsequent stage
as ‘human’, ‘table’, and ‘food’ have a rich, though per- labelled semantic classification. Well, semantic classi-
haps not fully discoverable, history. But the example of fication is what concepts are for. So, the use of con-
the platypus shows that categorization can be a com- cepts to classify – for example, using the concept of
plex process. Though everyday categorizations seem ‘cat’ to classify or categorize my pet cat Rosie – can be
effortless and routine, it took the best scientific minds viewed as a further kind of recognition.
CHAPTER 5 CONCEPTS 145
Clinicians need to categorize conditions and dis- Psychiatric Association, 1994), which gives criteria
eases in order to treat their patients. Though we for diagnosing different mental illnesses. According
usually call this diagnosis, it is really a form of to the manual, a diagnosis of schizophrenia should
categorization – clinicians consider the various be made on the basis of characteristic symptoms,
properties or symptoms that a patient manifests social or occupational dysfunction, duration, etc.
and attempt to categorize or diagnose the under- Although the manual lists five characteristic symp-
lying condition. For example, diagnosing or catego- toms (e.g. delusions, hallucinations, disorganized
rizing chronic fatigue, or ME, is notoriously difficult. speech, grossly disorganized or catatonic behav-
Macintyre (1998) suggests diagnosis should be iour) it indicates a diagnosis of schizophrenia may be
based on major criteria – chronic unexplained made when only two are present.
fatigue that is debilitating and that is not due to You will see later that both of these kinds of diag-
exertion, nor substantially alleviated by rest. She nosis, which require only a certain number of a
also suggests that at least four out of eight minor longer list of symptoms to be present, relate to a
criteria should be present (e.g. sore throat, mus- particular theoretical approach to concepts. Though
cle pain). our discussion of concepts is rooted in laboratory-
Categorization can also be seen in the Diagnostic based studies, it is just a short step to matters of
and Statistical Manual of Mental Disorders (American practical import.
Concepts can also be seen as the basic units of seman- we would also have to identify which lexical concept is
tic memory. While episodic memory stores memories most appropriate. These and other complexities are
of particular episodes, such as what happened on your developed in Chapter 6.
last birthday, semantic memory is our long-term mem- Concepts also play a role in reasoning. Your list
ory for facts about the world, such as ‘cats are animals’. from Activity 5.1 indicates some of the information in
The episodic-semantic distinction, which you have your concept of ‘cat’. You may have written things like
already encountered in Chapter 2, is discussed in much ‘meows’, ‘likes fish’, ‘mammal’, etc. You might not have
more detail in Chapter 8. For our purposes, we sim- written ‘has a heart’ but this is a property of cats too.
ply note that elements of semantic memory such as Now suppose someone asked you whether Rosie has a
‘cats are animals’ express relationships between con- heart. My guess is that you would say she does. But
cepts (between ‘cat’ and ‘animal’ in this case). this is curious, because I have told you only that Rosie
We have already mentioned the relationship is a cat. How have you managed to draw the inference
between concepts and words, but many researchers that she has a heart? The answer, of course, is that your
assume a more explicit link. It is thought that some concept of ‘cat’ indicates that cats are mammals, and
concepts, called lexical concepts (i.e. concepts for your concept of ‘mammal’ indicates that mammals
which there is a single word), represent our under- have hearts. From these concepts you can infer that
standings of the meanings of words and are stored in cats, like Rosie, have hearts. Such inferences might not
something called the mental lexicon (see Chapter 6). always be valid of course – though I don’t doubt Rosie
For example, our concept of ‘cat’ would represent what has a heart, for all I know, maybe, miraculously, she
we believe the word ‘cat’ means. The process of under- has some complex artificial pump instead. The com-
standing language therefore partly involves retrieving plexities of reasoning, of drawing inferences, are the
lexical concepts from the mental lexicon. Of course, topic of Chapter 12.
this is a complex process; there may be several lexical Because concepts allow us to make inferences, they
concepts corresponding to a single word like ‘cat,’ so simplify the task of remembering information. If you
146 PART 2 CONCEPTS AND L ANGUAGE
want to remember the properties of Rosie, you would because you can draw these inferences simply by
do well simply to remember that she is a cat. If she knowing she is a cat. Suffice it to say that our ability to
were unusual in some way (such as having a piece of store concepts in semantic memory, together with our
her ear missing) you might have to remember that ability to reason and draw inferences, simplifies the
information too. But you do not need to remember task of remembering information. Here concepts,
explicitly that Rosie meows, or that she has a heart, reasoning, and memory all act together.
SUMMARY OF SECTION 1
• Concepts are ideas in the mind that are about categories in the world.
• Words tend to pick out concepts, though the exact relationship between them is complex.
• The principal evidence for concepts comes from categorization behaviour, which involves people
making judgements concerning category membership.
• Concepts play a wide role in cognition.
ACTIVIT Y 5.2
Consider the categories sparrow, gold, chair, intro- Second, are the properties for each category, when
vert, red, and even number. Can you provide defini- taken together, sufficient for membership in the cat-
tions for them? Take a few minutes to list the egory (i.e. must anything that possesses these prop-
properties for each that you think are important for erties necessarily be a member of the category)?
category membership. Don’t worry if you find this
COM M ENT
difficult; just write down what comes to mind. If you
Most people find this kind of activity difficult. In spite
can’t think of anything, pass on to the next category.
of the classical view, it is surprisingly difficult to think of
When you have finished try to answer the following
watertight definitions – you might have succeeded for
questions. First, do you think each of the properties
‘even number’ but perhaps not for the other catego-
is necessary for category membership (i.e. must
ries. We will consider this again later.
every member of the category possess the property)?
The classical view was supported by some early, Rosch’s results for four different categories are shown
empirical investigations (e.g. Hull, 1920; Bruner in Table 5.1. She took these ratings to be indicative
et al., 1956) that showed people categorized instan- of the internal structure of categories, and this con-
ces according to whether they possessed the neces- clusion was supported by other empirical work. For
sary and sufficient conditions of the category. instance, Rips et al. (1973) and Rosch (1975) exam-
However, despite being sporadically defended (e.g. ined the relationship between typicality and the
Sutcliffe, 1993) there have been numerous criticisms, time it takes participants to verify sentences that
and the view has generally fallen into disrepute. The express categorization judgements. The method is
first criticism concerns the phenomenon known as often known as category or sentence verification. For
typicality. example, the sentences might be ‘a robin is a bird’
(typical instance) and ‘a penguin is a bird’ (atypical
2.1.1 Typicality effects instance). Participants were asked to respond either
Since the classical view contends that all members of a ‘Yes’ (meaning they thought the sentence was true) or
category must satisfy the same definition, it follows ‘No’ (meaning they thought it was false) as quickly as
that they should all be equally good members of that possible. The results showed that the more typical the
category. However, psychologists have found systematic instance being considered, the quicker people were
inequalities between category members. Rosch (1973) to verify the sentence (i.e. the sentence ‘a robin is a
elicited participants’ ratings of the typicality or bird’ was verified more quickly than the sentence ‘a
‘goodness-of-exemplar’ (sometimes referred to as penguin is a bird’).
GOE) of particular instances of a category – a method Further support for the idea that categories have
often known as a typicality ratings method. Rosch’s internal structure came from Rosch and Mervis
instructions give a sense of what is involved. (1975). They used a method known as property- or
attribute-listing – the method you tried in Activity 5.1.
Think of dogs. You all have some notion of what a They asked their participants to generate lists of prop-
‘real dog’, a ‘doggy dog’ is. To me a retriever or erties for a series of category instances, e.g. robin and
a German Shepherd is a very doggy dog while a penguin for the category bird. The results showed that
Pekinese is a less doggy dog. Notice that this kind of less typical instances shared properties with fewer
judgement has nothing to do with how well you like category members, while more typical instances
the thing . . . You may prefer to own a Pekinese with- shared properties with many other instances. For
out thinking that it is the breed that best represents example, robins have properties – flying, eating worms,
what people mean by dogginess. (pp.131–2). building nests – that are shared with many other birds.
148 PART 2 CONCEPTS AND L ANGUAGE
ACTIVIT Y 5. 3
Now that you have read Rosch’s instructions, write ratings? Many people feel that their ratings reflect
down the following words on the left-hand side of a how familiar they are with particular instances, or
sheet of paper, putting each word on a new line: how frequently those instances are encountered. You
pineapple, olive, apple, fig, plum, and strawberry. might think that in a society where figs were more
Then, to the right of each word, write down the commonplace than apples, for example, the typicality
number (between 1 and 7) that best reflects how of these items would be reversed. In a series of stud-
well the word fits your idea or image of the category ies, Barsalou (1985) investigated the influences of
FRUIT. A 1 means the object is a very good example familiarity and frequency on typicality. Contrary to
of your idea of what the category is, while a 7 means what one might think, he found that typicality did not
the object fits very poorly with your idea or image correlate with familiarity, and only correlated with
of the category (or is not a member at all). frequency to a limited extent. So, it seems that even if
penguins were much more common than they are
COM M ENT
and we were all much more familiar with them, we
When you have written down your answers, com-
would still think of them as atypical birds!
pare your ratings with those of Rosch shown in the
first column of Table 5.1. How might you explain these
TAB LE 5.1 Rosch’s (1973) typicality ratings for various instances of four categories
Penguins have properties – swimming, not flying – ries have highly typical and atypical members if the
that are shared with relatively few other birds. classical view is correct? And how strongly does such
Using methods such as these, Rosch, Mervis, and evidence count against the classical view?
others provided impressive evidence that categories Though the classical view makes strong claims
have what we might think of as a rich internal struc- about the membership of categories – membership
ture. A definition serves to demarcate members of a should be all-or-none – it says nothing about their
category from non-members, but even things inside internal structure. So, the findings of rich internal
the category are highly structured. Both penguins and structure do not show the classical view to be wrong,
robins would satisfy the definition of a bird, but there unless, of course, internal structure reflects category
are important systematic differences between them membership. If a penguin were not only a less typical
that are reflected in the cognitive processes governing bird than a robin, but also less of a category member
categorization. And this seems contrary to the classi- than a robin, then ratings of typicality might reflect
cal view’s suggestion that all category members must a graded notion of category membership in which
equally satisfy a category’s definition. How can catego- categories have some clear members, some clear
CHAPTER 5 CONCEPTS 149
non-members, and a range of cases in between. Then, these to be items of furniture, others did not, and
category membership, quite palpably, would not be some people changed their judgements across the two
all-or-none. On the other hand, if typicality does not times of testing. McCloskey and Glucksberg thus gave
reflect graded membership, it may be compatible empirical weight to the intuition that many categories
with the classical view. However, typicality effects do have borderline cases.
expose an inadequacy – even if they do not contradict How telling is this evidence? The classical view
its basic tenets, it is not at all obvious how the classical certainly implies that categories should have no bor-
view might explain typicality effects. At the very least, derline cases. However, it is at least possible that some
the classical view would need supplementing. of the instances that appear borderline are not genu-
inely indeterminate, unlike the case of colour catego-
2.1.2 Borderline cases ries. It might be that patterns of disagreement reveal a
If membership in a category is ‘all-or-none’ then there lack of knowledge. For example, you may not know
should be no borderline cases: an item should either whether a tomato is a fruit or a vegetable. Perhaps
satisfy the definition of a category or it should not. sometimes you will say it is a fruit, and other times you
Intuition alone tells us there are items whose category might say it is a vegetable. But if you consult a diction-
membership is unclear. Colour categories, for exam- ary, you will be told that it is a fruit, even though it is
ple, have no obvious boundary. It seems impossible to usually used as a vegetable (e.g. in sauces). So, it is
draw a line on the colour spectrum, say, between red possible that an instance definitely belongs to one or
and orange. For where does a red shade fade into another category (i.e. not a borderline), but uncer-
orange? Rather, in between these two categories, there tainty makes the item appear borderline. Another
seem to be shades that are neither unequivocally red possibility is that inconsistency reflects perspective-
nor unequivocally orange, hence our use of phrases dependence. It might be, for example, that you know
such as ‘a reddy-orange’. that a tomato is technically a fruit, but your catego-
McCloskey and Glucksberg (1978) provided evi- rization judgement is influenced by the fact that it is
dence that confirmed this intuition for a whole range used mostly as a vegetable. So, you might agree, in
of categories. They used a method of asking for cate- a culinary context, that a tomato is a vegetable, but
gorization judgements. They asked their participants disagree in the context of a biology lesson.
to respond either ‘Yes’ or ‘No’ to questions of category Though these remain logical possibilities, it is
membership (such as ‘Is a robin a bird?’). Participants not obvious that McCloskey and Glucksberg’s exam-
were also asked to rate the same instances for typical- ples actually did involve uncertainty or perspective-
ity. McCloskey and Glucksberg then considered the dependence. Though people disagreed about whether
level of agreement that participants showed in their bookends count as furniture, it seems implausible
categorization judgements, both across individuals that they did not have enough information or were
and within the same individuals over two times of adopting different perspectives. So, in the absence
testing. They found that participants readily agreed on of alternative explanations, the compelling evidence
highly typical and atypical items, yet disagreed over for borderline cases seems to undermine the classi-
time and across individuals for some items of inter- cal view.
mediate typicality. For example, people rated ‘chair’ as
a highly typical item of ‘furniture’, and were consistent 2.1.3 Intransitivity of categorization
amongst themselves and over time in judging a chair A further source of difficulties for the classical view
to be an item of furniture. Similarly, with highly atypi- has been the observation of intransitivity in categori-
cal items such as a ceiling they were consistent in zation judgements. Transitivity is observed with many
judging this not to be an example of furniture. With relationships: the relation ‘taller than’ is transitive
items of intermediate typicality, such as bookends, because if ‘A is taller than B’ and ‘B is taller than C’,
they were much less consistent. Some people judged then it simply follows that ‘A is taller than C’. The
150 PART 2 CONCEPTS AND L ANGUAGE
relationship is ‘transitive’ because the last statement various resemblances between members of a family:
follows from the first two. build, features, colour of eyes, gait, temperament, etc.
Is categorization transitive? That is, if As are mem- etc. overlap and criss-cross in the same way. – And
bers of category B, and Bs are members of category C, I shall say: ‘games’ form a family.
does it follow that As are also members of category C? (Wittgenstein, 1953, pp.66–7)
called cats still be cats? What do you think? If you had alternatives. Observations of typicality effects sug-
a pet cat, would it still be a ‘cat’ after this discovery? gested to some that concepts are organized around a
Kripke and Putnam believe that it would – those things measure of the central tendency of a category, other-
we called cats before the discovery are still cats after- wise known as the prototype. Sometimes the proto-
wards (i.e. the robots controlled from Mars are still type may correspond to an actual instance, but in
cats). But since robots aren’t mammals, ‘being a mam- general it is like a ‘best’ category member, formed by
mal’ could not be a defining feature of cats, even though statistically aggregating over examples of the category
we previously thought it was! The conclusion that one encounters. Rosch, for instance, believed that it is
Kripke and Putnam draw is that we might be shown to a feature of the natural world that certain attributes or
be wrong about virtually any property that we happen properties tend to correlate or cluster together, and it
to believe is true (or even defining) of a category. is these natural clusters of correlated attributes that
This is how Pinker puts it: ‘What is the definition of prototypes describe. For example, the prototype for
lion? You might say “a large, ferocious cat that lives in ‘bird’ might describe the cluster of properties such as
Africa.” . . . Suppose scientists discovered that lions having feathers, wings, a beak, and an ability to fly.
weren’t innately ferocious . . . Suppose it turned out These properties cluster together in a way that feath-
that they were not even cats . . . you would probably ers, lips, gills, and an ability to swing through tree
feel that these . . . were still really lions, even if not a branches do not. Whether or not an instance is a cat-
word of the definition survived. Lions just don’t have egory member then depends upon how similar it is
definitions.’ (Pinker, 1997, p.323, original emphasis). to the prototype: an instance falls within the category
There are less fanciful examples that convey the if it achieves a certain criterion of similarity. If an
same point. People thought the platypus (Section 1.3) instance is too dissimilar, if it mismatches on too
bizarrely combined the features of birds (a bill), many properties, then it falls outside the category.
amphibians (swimming), and mammals (fur). Suppose This account is a little like the classical view: both
that some people came to believe, erroneously, that are committed to the idea that similarity explains cat-
the platypus was really a strange kind of bird. What egorization. For classical theory, instances fall within a
Kripke and Putnam argue is that in a case like this, no category if they match each and every element of the
matter how strongly held the belief, it could never be category’s definition, and outside the category if they
definitional for these people that a platypus is a bird. mismatch on any one. The critical difference is that for
If it were, then as soon as it was determined that the prototype theories an instance falls within a category
platypus was a mammal after all, by the very same even if it mismatches on a number of properties.
definition it would no longer be a platypus. The argu- Though it might not seem dramatic, a simple illustra-
ments of Kripke and Putnam hinge on the intuition tion shows how significant a move this really is.
that the platypus will still be a ‘platypus’ no matter Suppose a category is characterized by five properties
what we come to believe, and no matter how wrong (call them A, B, C, D, and E). Now suppose that there
those beliefs ultimately turn out to be. If so, then our is a criterion for membership in the category such that
beliefs about natural categories never really amount to an instance can mismatch on up to, but no more than,
definitions and the classical view must be mistaken. two of these five properties. Then there are a number
of logical possibilities for category membership, as
shown in Table 5.2.
Instance 1 possesses all the characteristic properties
Similarity II: prototype
2.2
of the category. No instance could match on more
theories of concepts properties, and so one could think of this as a highly
typical, perhaps even a prototypical instance. Instance 2
The combined weight of evidence calling into ques- mismatches on one property and so is less typical.
tion the classical view led researchers to consider Instances 3 and 4 mismatch on two properties and are
152 PART 2 CONCEPTS AND L ANGUAGE
TAB LE 5. 2 Different kinds of instances (1 to 4) for a TAB LE 5. 3 Prototype representation for apple
category with five characteristic properties. A tick following Smith et al. (1988)
implies that an instance matches on a particular
property; a cross implies a mismatch Diagnosticity Attribute Value Weight
1 COLOUR red 25
Properties
green 5
Instances A B C D E brown
1 ✓ ✓ ✓ ✓ ✓ ... ...
2 ✓ ✓ ✓ ✓ ✗ .5 SHAPE round 15
3 ✓ ✗ ✓ ✗ ✓ square
4 ✗ ✓ ✗ ✓ ✓ cylindrical 5
... ...
.25 TEXTURE smooth 25
less typical again. What Table 5.2 shows is that this
rough 5
category could not be given a simple definition in
bumpy
terms of the five properties; for each property A to E
... ...
there is an instance of the category that does not pos-
sess that property. Hence, not one of A to E is a neces-
sary property. So, although prototype theories could and weights enter into the computation as well
be thought of as having merely relaxed the classical (though we don’t need to go into detail). Much
view’s criteria for category membership, the upshot is research continues to be devoted to making formal
that prototype theory might be able to explain cate- models of the prototype view and testing these against
gory membership for the many categories that resist empirical data (e.g. Minda and Smith, 2011).
definition. (Note the similarities between Table 5.2 Prototype theories can readily explain the typicality
and the discussion of diagnosis in Box 5.1 – can you effects discovered by Rosch and her co-workers.
see how the criteria proposed for diagnosing schizo-
1. Instances that differ in typicality are assumed to
phrenia and ME treat these as prototype concepts?)
differ in terms of the weighting of values on which
Prototype theories have been formulated in different
they match the concept. For example, in Table 5.3,
ways. One of the earlier formulations was provided by
a difference in typicality between red and brown
Smith et al. (1988), and this captures many of the quali-
apples is reflected in a difference in the weighting
ties found in different versions. Table 5.3 gives their
for red and brown.
illustration of a prototype representation for ‘apple’.
Table 5.3 highlights some of the differences between 2. Sentences such as ‘a robin is a bird’ are likely to be
prototype theories and the classical view. First, there verified more quickly than ‘a penguin is a bird’
are multiple possible values for each attribute, captur- because, for high typicality instances, the criterial
ing the fact that no one value is necessary for category similarity required for verifying the sentence is
membership – apples are typically, but not necessarily, likely to be achieved after matching just a few
red, for example. Second, diagnosticities indicate the properties. This is because most attributes that
extent to which each attribute is important for deciding match will have higher-weighted values, and so any
category membership. Third, the values are weighted criterion for category membership will be reached
and these weights indicate the extent to which each quickly. For low typicality instances like penguin,
value contributes to typicality; the highest weighted many attributes will mismatch or will have low
values are those of the prototype. Categorization weighted values, and so more matches will have
depends upon achieving a criterion similarity with the to be made before the criterion is reached.
representation of the concept, one that depends on 3. Typicality is likely to correlate with how widely
matching properties as before, but now diagnosticities category members share attributes. This follows
CHAPTER 5 CONCEPTS 153
from the fact that the diagnosticities of attributes TAB LE 5.4 Typicality ratings for instances of well-
and weights of values themselves reflect the defined categories (from Armstrong et al., 1983)
statistical distribution of those attributes and
Even Typicality Female Typicality
values. The more widely shared a value is, the number rating rating
greater is its weight. In Table 5.3, for example,
4 1.1 mother 1.7
‘round shape’ receives a high weight indicating
8 1.5 housewife 2.4
that many (many) more apples are round than
10 1.7 princess 3.0
square. Since high typicality instances tend
18 2.6 waitress 3.2
to match on high weighted values, it follows
34 3.4 policewoman 3.9
that they will also possess properties that are
106 3.9 comedienne 4.5
widely shared.
Odd Typicality Plane geometry Typicality
number rating figure rating
However, despite prototype theory being able to
3 1.6 square 1.3
accommodate many of the findings that undermined
7 1.9 triangle 1.5
the classical view, difficulties have emerged.
23 2.4 rectangle 1.9
2.2.1 The meaning of typicality effects 57 2.6 circle 2.1
501 3.5 trapezoid 3.1
Armstrong et al. (1983) considered whether typicality
447 3.7 ellipse 3.4
effects occur for concepts that appear to be defini-
tional. Their examples of definitional concepts included
‘female’, ‘plane geometric figure’, ‘odd number’, and core, while prototype theory explains identification
‘even number’ (as in Activity 5.2). Armstrong et al. procedures. Unfortunately, inasmuch as this proposal
believed that category membership for these concepts involves both theoretical approaches, it appears to
is determined not by similarity to a prototype but by inherit some of the problems faced by each.
a definition: whether a number is even depends on
whether dividing it by 2 yields an integer. Curiously, The context-sensitivity of
2.2.2
sentence but not with others – though both words express what we understand as the meaning of the
were judged to be possible completions of the sen- word ‘red’; the concept ‘car’ is thought to provide the
tences. Roth and Shoben found that when the context meaning of the word ‘car’. But this immediately raises
sentence referred to milking, cows were considered to the question: what kind of concept provides the mean-
be more typical ‘animals’ than horses. However, when ing of the phrase ‘red car’?
the context referred to riding, horses were consid- Researchers have tried to explain the meanings
ered more typical ‘animals’ than cows. (You might of phrases and larger linguistic units in terms of com-
notice similarities with the discussion of priming in plex concepts, i.e. combinations of lexical concepts.
Chapter 2.) The meaning of the phrase ‘red car’ would then be
Medin and Shoben (1988) also found that typicality explained in terms of the combination of the constitu-
judgements change with context. They asked their ent lexical concepts ‘red’ and ‘car’. How could concepts
participants to rate various kinds of spoon for typi- combine to yield the meaning of such a phrase?
cality in the category spoon. Participants rated metal If concepts are structured around prototypes, then
spoons as more typical than wooden spoons, and perhaps they could combine through combining their
small spoons as more typical than large spoons. prototypes. The difficulty, however, is that no one
Therefore, one might expect that small metal spoons really knows how this might be done. Though many
would be most typical of all and that large wooden suggestions have been made, they all appear to fail for
spoons would be least typical, with small wooden and one reason or other. For example, one suggestion has
large metal spoons intermediate. However, while Medin been that the prototype for ‘red car’ is formed from
and Shoben found that small metal spoons were more the prototype for ‘red’ and the prototype for ‘car’ (the
typical than large metal spoons, they found that large prototypical red car would therefore be a prototypical
wooden spoons were more typical than small wooden car that was prototypically red).
spoons. So, the contribution to typicality made by the Though this seems a sensible suggestion, and
values large and small depended on whether one was appears to give the right interpretation for ‘red car’,
thinking about metal spoons or wooden spoons. this could not work in general. Following the same
Prototype theories cannot easily explain such dem- reasoning, the prototypical ‘pet fish’ ought to be a
onstrations of the instability of typicality. First, the prototypical fish that is also prototypically pet-like –
very idea of instability seems to be at odds with Rosch’s perhaps something like a cuddly salmon. The real proto-
claim that prototypes correspond to stable clusters of typical ‘pet fish’ is of course more like a goldfish – neither
correlated properties that reflect the structure of the a prototypical pet nor a prototypical fish. More prob-
natural world. Second, in connection with Table 5.3, lematic still for combining prototypes, the prototypical
Roth and Shoben’s results suggest that the weightings ‘stone lion’ ought to be something like a real lion made
of values and/or diagnosticities of attributes are them- of stone, i.e. an impossible object. How could the pro-
selves changeable. However, it is unclear what mecha- totypes for ‘stone’ (perhaps granite or limestone) and
nism could be responsible for such changes. Third, ‘lion’ (a real lion) combine to give the right interpreta-
Medin and Shoben’s results suggest that the contribu- tion (i.e. a stone statue of a lion)? If you feel that these
tions to typicality of different properties (e.g. size and examples are a little whimsical, take a look at news-
material made from) are mutually dependent. Yet the paper headlines, as these often use phrases with a simi-
representation in Table 5.3 assumes that the attributes lar structure. For example, it is not easy to see how
and values are independent of one another. the meaning of ‘killer firework’ could be explained by
the combination of the constituent prototypes: a proto-
2.2.3 Complex concepts typical killer might be a sadistic criminal, or perhaps
As noted in Section 1.4, it is commonplace to assume a virulent disease; a prototypical firework might be
that concepts express our understandings of the a rocket. How would these prototypes combine to
meanings of words. So, the concept ‘red’ is assumed to yield the required interpretation? Complex concepts
CHAPTER 5 CONCEPTS 155
continue to present real difficulties for most theories of it has proven possible to develop sophisticated mod-
concepts (see Fodor, 1998). els of categorization that have had much success in
accounting for empirical data (see, for example,
Nosofsky, 2011).
That these last two factors were predictors suggests that there is some explanatory principle or theory that
that categorization draws upon deeper, more theoreti- unites the category. They offer the example of some-
cal knowledge than just similarity alone. one at a party who jumps into a swimming pool fully
We now turn to some of the reasons why, in spite of clothed. You might categorize this person as being
these successes, many researchers have become dissat- intoxicated. But a similarity-based view cannot explain
isfied with the notion of similarity. this because your concept of ‘intoxicated’ is unlikely
to include the property ‘jumps into swimming pools
2.4.1 Problems with similarity fully clothed’. So how might we explain the categoriza-
The philosopher Nelson Goodman identified a num- tion? Murphy and Medin argue that categorizing the
ber of problems with similarity; indeed, he described person as ‘intoxicated’ plays a role in explaining their
it as ‘a pretender, an impostor, a quack’ (Goodman, behaviour, that is, in explaining why they jumped into
1972, p.437). One concern is with whether similarity the swimming pool.
genuinely helps us to explain categorization. After all, Might this explanatory basis be found in categori-
in prototype theories saying that an instance is similar zation more generally? If so, then categorizing a robin
to the prototype means that the two share some prop- as a bird ought to provide some kind of explanation
erties in common. But note that this further expli- of the robin’s properties, analogous to the case of
cation removes the notion of similarity: ‘is similar to’ the intoxicated swimmer. Such a categorization does
becomes translated as ‘shares properties with’. So, what appear to provide a (partial) explanation: knowing
explains categorization is not similarity per se but the that a robin is a bird helps explain why it has feath-
sharing of properties. ers and a beak. The explanation is partial, since we
However, a further problem arises since there is no could go on to ask why birds have beaks and feathers,
obvious limit to the number of properties any two but it is an explanation nonetheless. After all, were
objects may share. Murphy and Medin (1985) ask us we to discover that a robin is not a bird, we would
to consider the similarity of plums and lawnmowers. want to know why it has feathers and a beak. With-
‘You might say these have little in common, but of out the categorization we would be in need of an
course both weigh less than 10,000 kg (and less than explanation.
10,001 kg, . . .), both did not exist 10,000,000 years ago We noted in Section 2.2.2 that similarity-based
(and 10,000,001 years ago, . . .), both cannot hear well, approaches cannot easily explain the non-independence
both can be dropped, both take up space, and so on’ of attributes. For Murphy and Medin, relationships
(p.292). It seems that, depending on what counts as between attributes are evidence that our concepts are
a relevant property, plums and lawnmowers could embedded in larger and broader knowledge struc-
either be seen as very dissimilar, or very similar. So, tures. Sometimes these structures have been labelled
for similarity, explicated in terms of shared proper- commonsense theories, sometimes merely background
ties, to provide meaningful explanations of categori- knowledge. But if such knowledge structures are at
zation, we need to know what counts as a property. work in categorization, why might people have previ-
We need some way of declaring ‘lack of hearing abil- ously concluded that concepts are similarity-based?
ity’ as irrelevant in comparing plums and lawnmow- Murphy and Medin speculate that many categoriza-
ers, for example. For Murphy and Medin (1985), tion judgements become automatized, particularly
observations such as these suggest that similarity is when members of the same category have relatively
shorthand for something else that explains why cate- consistent perceptual properties. Under these condi-
gories hang together, or cohere. tions, the role of our underlying theories becomes
obscured, and so we may (erroneously) conclude that
2.4.2 The role of commonsense theories categorization is determined by similarity. However,
In opposition to similarity-based views, Murphy and even in these cases, when novel instances emerge
Medin argued that concepts are explanation-based, (such as robot cats) or where there is disagreement
CHAPTER 5 CONCEPTS 157
(with borderlines perhaps), we turn to our underlying It seems that there are deeper reasons for people’s
theories. categorizations – in the quarter example, perhaps they
What evidence is there that categorization is deter- realized that pizzas can, in principle, be any size,
mined by theories as opposed to similarity? Rips whereas their commonsense theories of coins tell
(1989) asked his participants to consider triads of them they are produced to a regulation standard.
objects. Two objects belonged to distinct categories (e.g.
a pizza and a quarter) and were chosen so that partici- 2.4.3 Difficulties with the theory-theory
pants’ largest estimate of the size of one category (quar- The theory-theory has proved an important and use-
ter) was smaller than their smallest estimate of the other ful way of thinking about concepts. It has, for instance,
(pizza). Rips then asked his participants to consider a reminded researchers of difficulties with the notion of
third object, telling them only that it was of intermedi- similarity, and it has proved to be a useful peg on
ate size (i.e. larger than the largest estimated size of a which to hang a range of disparate findings whose
quarter and smaller than the smallest estimated size of common theme is that categorization is influenced by
a pizza). He asked which of the two other categories this deeper, causal knowledge of categories, as well as by
third object was more likely to belong to, and which of knowledge of their superficial properties.
the two it was most similar to. The two judgements dis- However, there are a number of difficulties with the
sociated: that is, participants judged the object more theory-theory. Some of the findings taken to support
likely to be a pizza, but more similar to a quarter. the theory-theory are really demonstrations that
Rips also found dissociations when participants similarity does not always explain categorization, and
considered, for example, a bird-like creature that came this does not necessarily imply that theories are
(via mutation or maturation) to resemble an insect, what is needed. Moreover, it is not clear what is meant
and other dissociations between categorization and by ‘theory’. Whereas similarity-based views could be
similarity have been demonstrated (e.g. Rips and made relatively precise (see Table 5.3 for instance),
Collins, 1993; Roberson et al., 1999). Kroska and formalizing theory-theories seems much more diffi-
Goldstone (1996) showed their participants scenarios cult. Some researchers have tried to pin down what
that described a putative emotion. Each scenario is meant by a commonsense theory via a compari-
constituted a set of phrases such that one phrase was son with scientific theories (see Gopnik, 1996).
central to one emotion and other phrases were charac- However, other researchers believe such a comparison
teristic of a different emotion. For example, one sce- undermines the idea that commonsense theories are
nario included the phrases ‘Threat of harm or death’, theories at all (see Gellatly, 1997). For example,
‘Being accepted, belonging’, and ‘Experiencing highly Murphy (2000) argues that the background knowl-
pleasurable stimuli or sensations’. The first of these edge that influences concepts is too simplistic and
phrases was considered central to the emotion cate- mundane to be likened to a scientific theory. Indeed,
gory ‘fear’. The remaining two phrases were consid- he eschews the term ‘theory’ in favour of the more
ered characteristic of the emotion category ‘joy’. neutral ‘knowledge’.
Kroska and Goldstone found their participants tended A further difficulty with the theory-theory is that it
to categorize this scenario as an instance of fear (i.e. is hard to imagine how combining theories could
a member of the category ‘fear’) but they also judged explain complex concepts. Scientific theories are
it to be more similar to an instance of joy. That is, notoriously difficult to combine. Indeed, for decades,
judgements of category membership were influenced theoretical physicists have struggled to combine the-
by properties considered central to a category, while ories of electricity, magnetism, and gravity into one
judgements of similarity were influenced by charac- unified theory. So how can theories be combined so
teristic properties. Again, these findings show that effortlessly in understanding phrases like ‘red car’
judgements of category membership can dissociate when they are so difficult to combine in general?
from judgements of similarity. Even if we talk of combining knowledge rather than
158 PART 2 CONCEPTS AND L ANGUAGE
Support for the idea that knowledge of deeper, causal example, it might have skunk-like stripes dyed on its
principles is at work in categorization has come from fur, and have a surgical implant so that it could emit
work looking at children’s categorization. Keil (1989), foul-smelling liquid. Again, younger children seemed
for instance, used both discovery and transformation dominated by appearance-based properties; they
procedures to examine how children weigh appear- judged that the raccoon was now a skunk. The older
ance and theoretical properties. For example, in a children, in contrast, judged that the animal was still
discovery, children might be told of a novel hybrid a raccoon.
animal that looked and behaved just like a zebra. Keil has referred to this age-related change in
However, they would be told also that it had been children’s categorization as the ‘characteristic-to-
discovered that this animal had the insides of a horse defining shift’, since he thought the younger children
and was the offspring of two horses. Younger chil- were influenced by properties (i.e. appearances)
dren (around 4 years of age) tended to judge the that were only characteristic of the category, while
animal to be a zebra, whereas older children (around the older children were beginning to deploy some-
7 years) tended to judge the animal to be a horse. thing like the beginnings of a biological theory and
That is, younger children seemed to be influenced were paying attention to properties that were more
more by the superficial characteristics of the animal defining. However, as Murphy (2000) points out, it
(e.g. appearance), and older children more by its is probably not the case that the younger and older
biologically relevant properties (e.g. lineage). children have qualitatively distinct styles of catego-
Similar results were found using a transformation rization. It is more likely that the younger children
procedure. Children were told of a raccoon that simply do not know enough about biological cate-
underwent a series of transformations so that it gories to work out which properties are character-
ended up looking and behaving like a skunk. For istic and which are defining.
theories, we are still left with the difficult problem of about essential properties. They may also believe that
working out which knowledge gets combined and the the essential properties constrain a category’s more
mechanism by which this is done. superficial properties. For example, the essential
Given these problems, it is ironic that the theory- properties of birds might be thought to involve their
based view is motivated in part by difficulties with the genetic make-up, properties that would constrain
notion of similarity. Arguably, it has supplanted this their appearance and behaviour.
with the equally mysterious notion of a ‘theory’. Essential properties can be characterized as those
properties that if an object did not possess them, it
would not be that object. The essential properties of
2.5 Psychological essentialism birds are properties that all birds necessarily possess;
if something doesn’t possess them, then it isn’t a bird.
Psychological essentialism is one attempt at more Essential properties may seem rather like the defining
precisely formulating the view that categorization is properties of the classical view. However, there is one
influenced by deeper, explanatory principles. Medin critical difference. According to psychological essen-
(1989) and Medin and Ortony (1989) suggested that tialism most people will not know what a category’s
people believe and act as though category members essential properties are, but will still believe that the
have certain essential properties in common. That is, category has some. We might speculate as to what
people categorize things according to their beliefs the essential properties are – perhaps for biological
CHAPTER 5 CONCEPTS 159
categories they would be genetic properties – but, in internal, something hidden and ‘inner’, is causally
general, our beliefs will be vague and may turn out to responsible for category membership.
be incorrect. So psychological essentialism proposes However, psychological essentialism has not gone
that people’s concepts may contain a ‘place-holder’ for unchallenged. Malt (1994) examined the concept of
an essence – and the place-holder may even be empty, water. If people believe H2O to be the essence of water,
reflecting a lack of knowledge as to what the essential then their categorization of liquids as water should be
properties might be. strongly influenced by the proportion of H2O those
Of course not everyone’s place-holder need be liquids contain. However, Malt found that people’s
empty. Indeed, it is usually thought that discovering categorizations were strongly influenced by the source
essential properties is a job for science. A metallurgist of the water, its location, and its function. Indeed,
or chemist, perhaps, might uncover the essential pond water was thought to be ‘water’ but was judged
properties of gold, just as a biologist might for birds. to contain only 78.8 per cent H2O; tears were judged
So, experts may have their place-holders partially or not to be ‘water’ but to contain 88.6 per cent H2O. So
completely filled – they may know (or think they the belief in the presence or absence of H2O was not
know) the essential properties. But these beliefs may the only factor in deciding membership in the cate-
turn out to be in error too, so the place-holder is gory ‘water’.
presumably capable of revision. We can illustrate In Section 2.1.4 we considered the arguments of the
psychological essentialism with the platypus example philosophers Kripke (1972) and Putnam (1975). For
of Section 2.1.4. Soon after its discovery, lay-people example, Putnam argued that even if we discovered
presumably came to believe that the platypus had a that all cats are robots controlled from Mars, they
certain essence, but had no idea what this might be would still be cats. What we didn’t note there is that
(their essence ‘place-holder’ was empty). Experts at they used thought experiments such as this to support
the time might have filled their essence place-holder essentialism. Braisby et al. (1996) subjected these to an
in different ways: some thought the platypus was empirical test. They asked participants to give catego-
essentially an amphibian; others that it was a mam- rization judgements in thought experiments such as
mal. But the contents of these place-holders changed Putnam’s robot cat. In one condition they were told
as more was learned. Finally, the experts settled on the ‘You have a female pet cat named Tibby. For many
view that the platypus was mammalian, and as lay- years people have assumed cats to be mammals.
people adopted this view they filled out their essence However, scientists have recently discovered that they
place-holder accordingly. are all, in fact, robots controlled from Mars. Upon
Psychological essentialism is consistent with much close examination, you discover that Tibby too is a
of the evidence supporting the theory-theory. Much robot, just as the scientists suggest.’ Participants were
evidence supporting psychological essentialism spe- then asked to indicate whether they thought that a
cifically has come from studies of the development of series of statements were true or false. These included
categorization. For instance, Gelman and Wellman statements expressing essentialist intuitions (e.g.
(1991) found that 4- and 5-year-old children believe ‘Tibby is a cat, though we were wrong about her being
the insides of objects to be more important than their a mammal’) and statements that expressed the con-
outsides in determining category membership. For trary intuition (e.g. ‘Tibby is not a cat, though she is a
example, they asked children whether a dog would robot controlled from Mars’). Only about half of the
still be a dog if its outsides were removed, and also if participants thought that the essentialist statements
its insides were removed. Children thought that were true and the contrary ones false. Moreover, many
instances would remain in the category if the outsides participants seemed to give contradictory judgements:
were removed, but not if their insides were removed. they either judged both statements to be true, or
According to Gelman and Wellman, children are judged both to be false. Braisby et al. argued that these
being essentialist since they believe that something findings did not support essentialism, but implied that
160 PART 2 CONCEPTS AND L ANGUAGE
concepts change their content according to context role in the categorization of race and ethnicity, gender,
and perspective (see Braisby and Franks, 1997). Jylkkä mental disorder, personality, and sexual orientation.
et al. (2009) empirically re-examined the Braisby et al. Haslam et al. (2000) developed essentialist belief scales
data and came to a different conclusion from the orig- to examine essentialism thinking in relation to catego-
inal authors. They suggested that people’s intuitions ries, and argued that this centred on two key dimen-
offer support for essentialism. However, their partici- sions: the extent to which a category was seen as a
pants’ responses were actually quite varied, and the natural kind, and the extent to which the category was
greater proportion of responses were not consistent seen as coherent and homogeneous. Haslam et al.
with essentialism. One way of interpreting this debate (2002) have also discovered links between such dimen-
is that both studies suggest essentialism may accu- sions and prejudice, and Haslam and Levy (2006)
rately characterize some people’s categorizations, but revealed a similar structure to people’s thought con-
that an alternative account of concepts is required to cerning homosexuality. However, such studies largely
explain categorization in general. measure people’s beliefs about categories and not
Hampton et al. (2007) re-examined some of the categorization per se. Examining people’s categoriza-
dissociations reported by Rips (1989) and mentioned tion of sexual orientation, Braisby and Hodges (2009)
in Section 2.4.2. They found that when key mani- failed to find signs of essentialism, with participants
pulations were presented as between-subject rather categorizing sexual orientation according to described
than within-subject, the proportions of essentialist behaviour and giving little weight to putative essential
responses fell, and overall the majority of participants properties such as genetics.
adopted responses inconsistent with essentialism. There has also been mixed evidence concerning the
They also found important individual differences, in role that expert opinion plays in categorization. Malt
that some participants consistently gave essentialist (1990) presented people with objects that they were
categorizations, whilst others gave more importance told appeared ‘halfway’ between two categories (e.g. a
to appearance and behaviour. Hampton et al. specu- tree halfway between an oak and a maple) and asked
late whether such individual differences may reflect them to indicate how they would solve the dilemma of
more general and stable cognitive styles. categorizing the object. She offered her participants
While the argument for essentialism was originally three options. They could ‘ask an expert’, ‘call it which-
developed to explain natural concepts (e.g. cat, water), ever you want’, or indicate that they could ‘tell which it
researchers have begun to consider whether the the- is’ if they could only think about it long enough. For
ory applies in other domains also. For example, Bloom pairs of natural categories such as ‘robin-sparrow’ and
(1996) proposed that artefacts such as torches are ‘trout-bass’, 75 per cent of participants suggested they
created with a specific purpose in mind, and that would ask an expert, whereas for pairs of artefact cat-
the creator’s intention constitutes the essence of the egories, such as ‘boat-ship’, 63 per cent of participants
category. However, Malt and Sloman (2007) disputed suggested it was possible to ‘call it whichever you
this account, demonstrating that people often describe want’. This evidence suggests that people may be psy-
artefacts according to their function or use. For exam- chologically essentialist for natural categories, at least
ple, their participants tended to describe a teakettle to some degree, because they recognize that experts
as a watering can if it was used as a watering can, may be in a better position to judge categorization
even though it was created with the intention that it when lay people cannot. However, the data overall are
should heat water. (See also Bloom, 2007, for counter- not conclusive. Braisby (2001) examined the extent
arguments.) to which people modify their categorization judge-
Essentialism has also been applied to social categories. ments for genetically-modified biological categories
For example, Haslam and Whelan (2008) have pro- when told the opinions of experts. For example, his
posed that psychological essentialism plays a central participants might be asked to consider a genetically
CHAPTER 5 CONCEPTS 161
modified salmon, and were told either that expert Braisby and Hanlon found that 89 per cent of field
biologists had judged that it was a salmon or that they dependent participants deferred in their categorization,
had judged that it was not. He found that only around as opposed to just 23 per cent of field independent
half of the participants changed their categorization participants. Such a result appears to support the
judgements to conform to the judgements of the suggestion made by Hampton et al. (see earlier in this
biologists. Moreover, around a quarter of participants section).
would change their categorization judgements to Lastly, it should be noted that much of the evidence
conform to those of shoppers (i.e. a group presumed cited in support of psychological essentialism (e.g.
not to be expert with respect to the category’s essen- Gelman and Wellman, 1991) only indirectly relates to
tial properties). Braisby argued that only around a beliefs in essential properties. Gelman and Wellman,
quarter of participants were modifying their catego- for example, found that children thought that remov-
rization judgements because of the biologists’ exper- ing the outsides from something like a dog did not
tise with the relevant essential properties, and so alter its category membership, but removing its insides
the majority of responses did not provide evidence did. However, for these data to support essentialism, a
for psychological essentialism. Indeed, participants further inference is required, one that relates insides
seemed to base their judgements on non-essential to essences. In a similar vein, Strevens (2000) actually
properties such as appearance and function (as well argues that the notion of essence or essential proper-
as genetic make-up). ties is not required to explain empirical data such as
Braisby and Hanlon (2010) also found that the extent these. Of course, psychological essentialists have
to which people would defer to experts in categori- responded to some of these criticisms, so it seems fair
zation tasks was related to a measure of their cogni- to say that the arguments are not yet settled. However,
tive style. Witkin et al. (1962) coined the term ‘field some of the criticisms of other theories may also apply
dependence’ to refer to a distinction in cognitive style to psychological essentialism – how might it help us
that has been variously labelled as analytic-holistic. understand complex concepts, for example?
SUMMARY OF SECTION 2
• The classical view, that concepts are definitions of categories, is undermined by arguments that many
categories cannot be defined, and cannot readily explain typicality effects, borderline cases, and
intransitivity.
• The prototype view, that categorization is determined by similarity to the prototype, explains most
typicality effects. However, it cannot readily explain the context-sensitivity of typicality, nor how
prototypes might combine in complex concepts. There is a residual question as to whether the exist-
ence of typicality effects implies a prototype organization.
• The theory-based view helps explain the non-independence of attributes in concepts, and dissocia-
tions between categorization and similarity. It also avoids some of the criticisms aimed at similarity.
However, it is not clear how theories might combine in complex concepts, and the notion of a theory
is very under-specified.
• Psychological essentialism apparently explains findings that even young children believe inner, hidden
properties are causally responsible for category membership. However, it is not clear whether the
notion of essence is required to explain data such as these. Moreover, the idea that people categorize
according to essential properties has received mixed empirical support, as has the notion that people
might defer to expert categorizations.
162 PART 2 CONCEPTS AND L ANGUAGE
3 WHERE NEXT?
In this chapter we have canvassed some of the princi- single process. Maybe people categorize items in
pal approaches that have been taken in developing a different ways in different circumstances. Indeed,
theory of concepts. In some respects, it seems as if the discursive psychologists, whose approach we earlier
study of concepts is the study of theories that do not bracketed off, might argue that categorization depends
work for one reason or another. The classical view essentially on context, and that there is nothing com-
falters because we cannot identify necessary and suf- mon to all the cases that we call categorization. Were
ficient conditions of category membership for all but context to have such an unbridled influence we might
a very few concepts. Prototype theory has difficul- expect categorization to appear unsystematic. Yet
ties explaining context-sensitivity and complex con- much of the evidence presented in this chapter points
cepts. Ultimately, both suffer for their use of the notion to the opposite – we have examined a wide range of
of similarity, which seems unable to explain categori- empirical data that are highly robust.
zation fully. Theory-based notions of concepts are One way of reconciling the idea that people cate-
imprecise and cannot obviously explain complex gorize things differently on different occasions with
concepts. Lastly, psychological essentialism has the idea that categorization is nonetheless systematic
received mixed empirical support, and much of the is to suggest that there are (a determinate number of)
empirical evidence only indirectly relates to the notion different kinds of categorization. Moreover, it is
of essences. conceivable that these could be usefully framed by the
However, such a picture of the psychology of con- different theories of concepts. For example, perhaps
cepts is unnecessarily gloomy. Indeed, it turns out that the classical view gives a useful account of categoriza-
we have probably learned more about the phenomena tion in cases where we need to provide or appeal to
of categorization even as various theories have been definitions. In law, for instance, often we need to reach
found wanting. And, of course, adherents of those an agreement or adopt a convention as to whether
theories continue to introduce modifications in order something belongs to a category (e.g. whether a
to explain recalcitrant data. Nonetheless, our discus- 16-year-old is a child or an adult). Similarly, prototype
sion of the different theoretical approaches raises theory may usefully explain categorization in cir-
(at least) two questions. What sense can we make of cumstances where we need to categorize something
so many different theoretical treatments when none is rapidly, or perhaps under uncertainty, maybe when
without problems? And where might researchers next we are in a position to take into account only an
turn their attention if there is, as yet, no common the- object’s superficial properties. Likewise, theory-based
oretical framework? As I shall try to suggest, one way views may describe categorization when we are seek-
of answering these questions is to consider to what ing a more reflective and considered judgement,
extent categorization is a unitary phenomenon. perhaps when we are using categorization in order
to explain something. And essentialism may usefully
explain how we categorize when we wish to be con-
sistent with expertise and a scientific knowledge of
Is all categorization
3.1
the world.
the same? Machery (2005) makes a similar point. In his exam-
ination of complex concepts, he argues that during
Perhaps the different theoretical treatments of con- categorization people employ a range of informa-
cepts reflect the fact that categorization is not one tion, including elements of commonsense theories,
CHAPTER 5 CONCEPTS 163
exemplar-level information, and prototypes. If this is we can label something with a category word yet not
right, then it would be simplistic to expect one of the believe that it belongs to the category – describing
theories we have examined to provide a comprehen- a statue of a lion as a ‘lion’, for example, does not indi-
sive account of concepts and categorization. cate that we think the statue really is a lion. Malt et al.
Speculative though this possibility is, Smith and (1999) showed that the same is true for how we label
Sloman (1994) have provided some empirical evi- containers, such as ‘box’, ‘bottle’, and ‘jar’. They found
dence that there may be some truth to it. They sought that whether an item was called a ‘bottle’ depended
to replicate some of the dissociations between similar- not so much on how similar it was to a prototypical
ity and categorization judgements obtained by Rips bottle, but whether there was something similar that
(1989) and described in Section 2.4.2. Rips found that was also called a ‘bottle’. In this way, for example, a
people judged an object intermediate in size between shampoo container might get called a shampoo ‘bottle’
a quarter and a pizza to be more similar to a quarter, despite bearing little similarity to a prototypical bottle.
but more likely to be a pizza. Smith and Sloman So, whether we apply a category label (e.g. bottle) to an
obtained the same dissociation only when participants object depends in part on how that label has been used
were required to think aloud whilst making their deci- historically and only in part on whether we think that
sions and so articulate reasons for their judgements the object really belongs to the labelled category (i.e.
(that is, they provided a concurrent verbal protocol – on whether the object really is a bottle).
see Chapter 10). Smith and Sloman interpreted this
finding as pointing to two modes of categorization:
a similarity-based mode of categorization and a rule-
based mode. The implication is that people will either
Are all concepts
3.2
focus on similarity or on underlying rules or structure the same?
depending on how the categorization task is presented.
When in similarity-based mode, categorization seems Another possibility that we should consider is the
to conform to similarity-based accounts, such as pro- extent to which different types of concept require a
totype theories. When in rule-based mode, categori- different theoretical treatment. Already you might
zation seems to be more theory- or explanation-based. have noticed how each theory seems to work most
Though this does not show that there are as many convincingly for a slightly different set of examples. In
different ways of categorizing as there are theories Activity 5.2 you tried to define a range of different cat-
of concepts, it does suggest that categorization may egories: sparrow, gold, chair, introvert, red, and even
not be a single process. It is a possibility, therefore, that number. Did you feel then that these categories were
some of the different accounts of concepts may be very different from one another? If so, we can perhaps
implicitly concerned with different kinds of purpose make sense of this intuition.
in categorization, and ultimately with different kinds Some categories like even number seem amenable
of categorization. to definition. For these well-defined categories, the
In a similar vein we can rethink the phenomena classical view appears to give a good explanation of
that are taken as evidence of the nature of concepts. category membership, though it does not obviously
Earlier we noted that concepts and words bear a explain how some even numbers are considered more
complex relationship to one another, but much of the typical than others. Perhaps this would require some-
evidence we have so far reviewed has tended to thing like Armstrong et al.’s dual-process account, and
equate the use of category words with categorization. involve its attendant difficulties (see Section 2.2.1).
However, while our use of category labels is certainly Nonetheless it may be that a modified classical view
influenced by our beliefs about categorization, it is would provide a good explanation of these kinds of
also influenced by language more generally. Indeed, category.
164 PART 2 CONCEPTS AND L ANGUAGE
In a similar vein, prototype theories seem to work occupational groups with correspondingly different
well for fuzzy categories – like red in Activity 5.2 – experience and knowledge of trees: maintenance
categories that seem to have genuine borderline cases. workers, landscapers, and taxonomists. They then
For these similarity to a prototype might provide the asked them to sort the names of 48 different kinds of
best explanation of category membership, since there tree into whatever groups made sense. The taxono-
is no prospect of defining these categories and people mists tended to reproduce a scientific way of sorting
in general do not seem to have relevant commonsense the trees; the maintenance workers produced a similar
theories (e.g. a theory of the deeper causal principles sorting, although they gave more emphasis to superfi-
by which red things come to appear red). Perhaps cial characteristics (such as whether trees were broad-
categories like chair are fuzzy in the same way. leaved). They also tended to include a ‘weed tree’
Theory-based and essentialist approaches are likely group that was not present in the taxonomists’ sorts,
to be most successful for categories for which people and which included trees that cause particular main-
have commonsense theories. Perhaps unsurprisingly, tenance problems. The landscapers didn’t reproduce a
these include many categories for which scientific scientific taxonomy, but justified their sorts in terms
theories have also been developed, e.g. sparrow and of factors such as landscape utility, size, and aesthetic
gold from Activity 5.2. These are categories where it is value. Lynch et al. (2000) also showed how the typical-
relevant to develop a deeper, explanatory knowledge ity ratings of the same kinds of tree expert differed
of the causal principles underlying the category. As from those of novices. Typicality for the expert group
we have seen, however, researchers have extended the reflected similarity to ideals – i.e. trees judged to be
claims of essentialism to include other kinds of cate- best examples of the category were not of average or
gory, such as artefact and social categories, e.g. intro- prototypical height, but of extreme height; in contrast,
vert in Activity 5.2. the ratings of the novices were largely influenced by
While it remains only a possibility that different familiarity.
concepts may require different theoretical treatments, Studies such as these suggest that different people
there is evidence nevertheless that different kinds do not necessarily categorize things in the same way.
of concepts may be realized in the brain in different The goals that a person has as well as the extent of
ways (e.g. Warrington and Shallice, 1984; Strnad et al., their knowledge may influence the way they catego-
2011; though see also Tyler et al., 2003). This evidence rize and, by extension, be reflected in their concepts.
may yet challenge the view that one theory could It is also possible that categorization may differ in
accommodate all kinds of concept. Even if people more fundamental ways for different kinds of person.
were to conclude that different categories require For example, there may be deeper individual differ-
different theoretical treatments, it would still be ences, possibly rooted in cognitive style (see, for
important to find some way of relating the different example, the discussion of essentialism above). There
theories so we could understand in what sense they is also evidence for disruption of semantic processing
were all theories of concepts. in schizophrenia (Chen et al., 1994), and accumu-
lating evidence that categorization is altered in autism
(Coutinho et al., 2010), Alzheimer’s dementia
(Doughty et al., 2009), and schizotypy (Morgan et al.,
Are all categorizers
3.3
2009). Morgan et al.’s results are of special interest
the same? since, in this and similar studies, the sample of (rela-
tively) high schizotypes are drawn from the normal,
Consonant with above considerations, we might healthy population, typically students, and therefore
also consider whether all categorizers are the same. differences among categorizers cannot easily be dis-
Medin et al. (1997) recruited participants from three missed as manifestations of disordered cognition.
CHAPTER 5 CONCEPTS 165
SUMMARY OF SECTION 3
It is possible that the failings of one or all approaches to concepts may be due to any combination of the
following:
• Categorization may not be a single process, and different kinds of categorization may lend themselves
to different theoretical treatments.
• Different types of category have different properties and so may require different theoretical treat-
ments.
• Different groups of people may categorize things in different ways according to their goals and the
nature of their knowledge, and so may fit the claims of different theories.
4 CONCLUSION
Overall, it seems that category knowledge is multi-
layered, encompassing knowledge of the causal prop-
erties relevant to a category, knowledge relevant to
explaining category membership and the properties
of instances, knowledge of function, and knowledge
of superficial properties useful for identification and
judgements about appearance. It also seems that we
are capable of calling on different kinds of category
knowledge on different occasions and for different
purposes. While these observations are not inconsist-
ent with a single theoretical treatment of concepts,
they nonetheless raise the prospect that competing
theories provide good explanations of somewhat dif- FIGU RE 5. 3 Rosie (untroubled).
FURTHER READING
Inevitably in a chapter of this length, I have omitted Laurence, S. and Margolis, E. (eds.) (1999) Concepts: Core
some important issues. Most notably, I have only briefly Readings, Cambridge, MA, MIT Press. Laurence and Margolis’s
touched on the exemplar view of concepts, formal models reader contains an excellent choice of philosophical and psycho-
of categorization, and the literature on category learning, logical papers that together represent most key lines of thought
and have not discussed the issue of basic level concepts. For and argument pertaining to concepts.
these and other important aspects of concepts and catego- Murphy, G.L. (2002) The Big Book of Concepts, Cambridge,
rization, I would strongly recommend Greg Murphy’s MA, MIT Press. Greg Murphy’s book provides a highly readable
excellent book. For a philosophically-inspired selection of and comprehensive view of the psychological literature on con-
psychological and philosophical works, see Laurence and cepts and categorization.
Margolis.
REFERENCES
Allen, S. and Brooks, L. (1991) ‘Specializing the operation of Cognitive Science Society, Austin, TX, Cognitive Science
an explicit rule’, Journal of Experimental Psychology: General, Society.
vol.120, pp.3–19. Braisby, N.R., Franks, B., and Hampton, J.A. (1996)
American Psychiatric Association (1994) Diagnostic ‘Essentialism, word use and concepts’, Cognition, vol.59,
and Statistical Manual of Mental Disorders, 4th edition, pp.247–74.
Washington, DC, American Psychiatric Association. Brooks, L.R., Norman, G., and Allen, S. (1991) ‘Role of spe-
Armstrong, S.L., Gleitman, L., and Gleitman, H. (1983) cific similarity in a medical diagnosis task’, Journal of
‘What some concepts might not be’, Cognition, vol.13, Experimental Psychology: General, vol.120, pp.278–87.
pp.263–308. Bruner, J.S., Goodnow, J.J., and Austin, G.A. (1956) A Study
Barsalou, L.W. (1983) ‘Ad hoc categories’, Memory & of Thinking, New York, John Wiley.
Cognition, vol.11, pp.211–27. Chater, N. and Heyes, C.M. (1994) ‘Animal concepts: con-
Barsalou, L.W. (1985) ‘Ideals, central tendency, and fre- tent and discontent’, Mind & Language, vol.9, pp.209–46.
quency of instantiation as determinants of graded structure Chen, E.Y.H., Wilkins, A.J., and McKenna, P.J. (1994)
in categories’, Journal of Experimental Psychology: Learning, ‘Semantic memory is both impaired and anomalous in schizo-
Memory and Cognition, vol.11, pp.629–54. phrenia’, Psychological Medicine, vol.24, pp.193–202.
Bloom, P. (1996) ‘Intention, history, and artifact concepts’, Coutinho, M.V., Volker, M.A., and Mercado, E. (2010)
Cognition, vol.60, pp.1–29. ‘Atypical categorization in children with high functioning
Bloom, P. (2007) ‘More than words: a reply to Malt and autism spectrum disorder’, Psychonomics Bulletin and Review,
Sloman’, Cognition, vol.105, pp.649–55. vol.17, pp.862–8.
Braisby, N.R. (2001) ‘Deference in categorization: evidence Coxon, A.P.M. (1999) Sorting Data: Collection and Analysis
for essentialism?’ in Moore, J.D. and Stenning, K. (eds.) (Quantitative Applications in the Social Sciences), Thousand
Proceedings of the Twenty-Third Annual Conference of the Oaks, Sage.
Cognitive Science Society, Mahwah, NJ, Lawrence Erlbaum. Doughty, O.J., Lawrence, V.A., Al-Mousawi, A., Ashaye, K.,
Braisby, N.R. and Franks, B. (1997) ‘What does word use and Done, D.J. (2009) ‘Overinclusive thought and loosening of
tell us about conceptual content?’ Psychology of Language and associations are not unique to schizophrenia and are pro-
Communication, vol.1, no.2, pp.5–16. duced in Alzheimer’s dementia’, Cognitive Neuropsychiatry,
Braisby, N. and Hanlon, S. (2010) ‘Categorization, deference vol.14, no.3, pp.149–64.
and cognitive style’, in Ohlsson, S. and Catrambone, R. (eds.) Eco, U. (1999) Kant and the Platypus: Essays on Language
Proceedings of the 32nd Annual Conference of the Cognitive and Cognition, London, Secker & Warburg.
Science Society, Austin, TX, Cognitive Science Society. Edwards, D. and Potter, J. (1992) Discursive Psychology,
Braisby, N. and Hodges, I. (2009) ‘Categorization of sexual London, Sage.
orientation: a test of essentialism’, in Taatgen, N.A. and van Fodor, J.A. (1998) Concepts: Where Cognitive Science Went
Rijn, H. (eds.) Proceedings of the 31st Annual Conference of the Wrong, Oxford, Clarendon Press.
CHAPTER 5 CONCEPTS 167
Gellatly, A.R.H. (1997) ‘Why the young child has neither a gory structure among tree experts and novices’, Memory and
theory of mind nor a theory of anything else’, Human Cognition, vol.28, no.1, pp.41–50.
Development, vol.40, pp.1–19. Machery, E. (2005) ‘Concepts are not a natural kind’,
Gelman, S. and Wellman, H. (1991) ‘Insides and essences: Philosophy of Science, vol.72, pp.444–67.
early understandings of the non-obvious’, Cognition, vol.38, Macintyre, A. (1998) ME: Chronic Fatigue Syndrome, A
pp.213–44. Practical Guide, London, Thorsons.
Goodman, N. (1972) ‘Seven strictures on similarity’, in Malt, B.C. (1990) ‘Features and beliefs in the mental repre-
Goodman, N. (ed.) Problems and Projects, Indianapolis, IN, sentation of categories’, Journal of Memory and Language,
Bobbs-Merrill. vol.29, pp.289–315.
Gopnik, A. (1996) ‘The scientist as child’, Philosophy of Malt, B.C. (1994) ‘Water is not H2O’, Cognitive Psychology,
Science, vol.63, 485–514. vol.27, pp.41–70.
Hahn, U., Prat-Sala, M., Pothos, E.M., and Brumby, D.P. Malt, B.C. and Sloman, S.A. (2007) ‘Category essence or
(2010) ‘Exemplar similarity and rule application’, Cognition, essentially pragmatic? Creator’s intention in naming and
vol.114, pp.1–18. what’s really what’, Cognition, vol.105, pp.615–48.
Hampton, J.A. (1982) ‘A demonstration of intransitivity in Malt, B.C., Sloman, S.A., Gennari, S., Shi, M., and Wang, Y.
natural categories’, Cognition, vol.12, pp.151–64. (1999) ‘Knowing versus naming: similarity and the linguistic
Hampton, J.A. (1998) ‘Similarity-based categorization and categorization of artefacts’, Journal of Memory and Language,
fuzziness of natural categories’, Cognition, vol.65, pp.137–65. vol.40, pp.230–62.
Hampton, J.A., Estes, Z., and Simmons, S. (2007) McCloskey, M. and Glucksberg, S. (1978) ‘Natural catego-
‘Metamorphosis: essence, appearance and behavior in the cat- ries: well-defined or fuzzy sets?’ Memory and Cognition, vol.6,
egorization of natural kinds’, Memory & Cognition, vol.35, pp.462–72.
pp.1785–800. Medin, D.L. (1989) ‘Concepts and conceptual structure’,
Haslam, N. and Levy, S. (2006) ‘Essentialist beliefs about American Psychologist, vol.44, no.12, pp.1469–81.
homosexuality: structure and implications for prejudice’, Medin, D.L. and Ortony, A. (1989) ‘Psychological essential-
Personality and Social Psychology Bulletin, vol.32, pp.471–85. ism’, in Vosniadou, S. and Ortony, A. (eds.) Similarity and
Haslam, N. and Whelan, J. (2008) ‘Human natures: psycho- Analogical Reasoning, Cambridge, CUP.
logical essentialism in thinking about differences between Medin, D.L. and Schaffer, M.M. (1978) ‘Context theory of
people’, Social and Personality Psychology Compass, vol.2/3, classification learning’, Psychological Review, vol.85, no.3,
pp.1297–312. pp.207–38.
Haslam, N., Rothschild, L., and Ernst, D. (2000) ‘Essentialist Medin, D.L. and Shoben, E.J. (1988) ‘Context and structure
beliefs about social categories’, British Journal of Social in conceptual combination’, Cognitive Psychology, vol.20,
Psychology, vol.39, pp.113–27. pp.158–90.
Haslam, N., Rothschild, L., and Ernst, D. (2002) ‘Are essen- Medin, D.L., Lynch, E.B., Coley, J.D., and Atran, S. (1997)
tialist beliefs associated with prejudice?’ British Journal of ‘Categorization and reasoning among tree experts: do all
Social Psychology, vol.41, pp.87–100. roads lead to Rome?’ Cognitive Psychology, vol.32, pp.49–96.
Hull, C.L. (1920) ‘Quantitative aspects of the evolution of Minda, J.P. and Smith, J.D. (2011) ‘Prototype models of cat-
concepts’, Psychological Monographs, vol.28. egorization: basic formulation, predictions, and limitations’, in
Jylkkä, J., Railo, H., and Haukioja, J. (2009) ‘Psychological Pothos, E. and Wills, A. (eds.) Formal Approaches in
essentialism and semantic externalism: evidence for external- Categorization, Cambridge, UK, Cambridge University Press.
ism in lay speakers’ language use’, Philosophical Psychology, Morgan, C.J.A., Bedford, N.J., O’Regan, A., and Rossell,
vol.22, no.1, pp.37–60. S.L. (2009) ‘Is semantic processing impaired in individuals
Keil, F. (1989) Concepts, Kinds and Cognitive Development, with high schizotypy?’ Journal of Nervous & Mental Disease,
Cambridge, MA, MIT Press. vol.197, no.4, pp.232–8.
Kripke, S.A. (1972) ‘Naming and necessity’, in Davidson, D. Murphy, G.L. (2000) ‘Explanatory concepts’, in Keil,
and Harman, G. (eds.) Semantics of Natural Languages, F.C. and Wilson, R.A. (eds.) Explanation and Cognition,
Dordrecht, Reidel. Cambridge, MA, MIT Press.
Kroska, A. and Goldstone, R.L. (1996) ‘Dissociations in the Murphy, G.L. and Medin, D.L. (1985) ‘The role of theories in
similarity and categorization of emotions’, Cognition and conceptual coherence’, Psychological Review, vol.92, pp.289–316.
Emotion, vol.10, no.1, pp.27–45. Newen, A. and Bartels, A. (2007) ‘Animal minds and the
Lynch, E.B., Coley, J.D., and Medin, D.L. (2000) ‘Tall is possession of concepts’, Philosophical Psychology, vol.20, no.3,
typical: central tendency, ideal dimensions and graded cate- pp.283–308.
168 PART 2 CONCEPTS AND L ANGUAGE
Nosofsky, R.M. (2011) ‘The generalised context model: an Roth, E.M. and Shoben, E.J. (1983) ‘The effect of context on
exemplar model of classification’, In Pothos, E. and Wills, A. the structure of categories’, Cognitive Psychology, vol.15,
(eds.) Formal Approaches in Categorization, Cambridge, UK, pp.346–78.
Cambridge University Press. Sappington, B.F. and Goldman, L. (1994) ‘Discrimination
Pinker, S. (1997) How the Mind Works, London, Penguin learning and concept formation in the Arabian horse’, Journal
Books. of Animal Science, vol.72, no.12, pp.3080–7.
Potter, J. and Wetherell, M. (1987) Discourse and Social Smith, E.E. and Sloman, S.A. (1994) ‘Similarity- versus
Psychology, London, Sage. rule-based categorization’, Memory & Cognition, vol.22, no.4,
Putnam, H. (1975) ‘The meaning of “meaning”’, in Putnam, pp.377–86.
H. (ed.) Mind, Language and Reality, Volume 2: Philosophical Smith, E.E., Osherson, D.N., Rips, L.J., and Keane, M.
Papers, Cambridge, CUP. (1988) ‘Combining prototypes: a selective modification
Rips, L.J. (1989) ‘Similarity, typicality and categorization’, in model’, Cognitive Science, vol.12, pp.485–527.
Vosniadou, S. and Ortony, A. (eds.) Similarity and Analogical Strevens, M. (2000) ‘The essentialist aspect of naïve theo-
Reasoning, Cambridge, CUP. ries’, Cognition, vol.74, pp.149–75.
Rips, L.J. and Collins, A. (1993) ‘Categories and resem- Strnad, L., Anzellotti, S., and Caramazza, A. (2011) ‘Formal
blance’, Journal of Experimental Psychology: General, vol.122, models of categorization: insights from cognitive neuro-
pp.468–86. science’, in Pothos, E. and Wills, A. (eds.) Formal Approaches
Rips, L.J., Shoben, E.J., and Smith, E.E. (1973) ‘Semantic in Categorization, Cambridge, UK, Cambridge University
distance and the verification of semantic relations’, Journal of Press.
Verbal Learning and Verbal Behaviour, vol.12, pp.1–20. Sutcliffe, J.P. (1993) ‘In defence of the “classical view”: a
Roberson, D., Davidoff, J., and Braisby, N. (1999) ‘Similarity realist account of class and concept’, in van Mechelen, J.,
and categorization: neuropsychological evidence for a dissocia- Hampton, J.A., Michalski, R., and Theuns, P. (eds.), Categories
tion in explicit categorization tasks’, Cognition, vol.71, pp.1–42. and Concepts: Theoretical Views and Inductive Data Analysis,
Rosch, E.H. (1973) ‘On the internal structure of perceptual London, Academic Press.
and semantic categories’, in Moore, T.E. (ed.) Cognitive Tyler, L.K., Bright, P., Dick, E., Tavares, P., Pilgrim, L.,
Development and the Acquisition of Language, New York, Fletcher, P., Greer, M., and Moss, H. (2003) ‘Do semantic cat-
Academic Press. egories activate distinct cortical regions? Evidence for a dis-
Rosch, E.H. (1975) ‘Cognitive representations of semantic tributed neural semantic system’, Cognitive Neuropsychology,
categories’, Journal of Experimental Psychology: General, vol.20, no.3/4/5/6, pp.541–59.
vol.104, pp.192–233. Warrington, E.K. and Shallice, T. (1984) ‘Category specific
Rosch, E.H. and Mervis, C.B. (1975) ‘Family resemblances: semantic impairments’, Brain, vol.107, pp.829–54.
studies in the internal structure of categories’, Cognitive Witkin, H.A., Dyk, R.B., Faterson, H.F., Goodenough,
Psychology, vol.7, pp.573–605. D.R., and Karp, S.A. (1962) Psychological Differentiation:
Ross, B.H. and Murphy, G.L. (1999) ‘Food for thought: Studies of Development, New York, John Wiley and Sons, Inc.
cross-classification and category organization in a complex Wittgenstein, L. (1953) Philosophical Investigations, Oxford,
real-world domain’, Cognitive Psychology, vol.38, pp.495–553. Basil Blackwell, translated by G.E.M. Anscombe.
L ANG UAG E
PROCESS ING
Gareth Gaskell and Helen Brown
1 INTRODUCTION
What are the qualities of human beings that differenti- abilities has been extensively researched, with numer-
ate us from other species? You can probably think of ous models proposed to explain each aspect of lan-
many characteristics, but pretty high on most people’s guage processing; this chapter provides an overview of
lists would be the ability to produce and understand our current understanding of how language is pro-
language. Linguistic abilities underpin all manner of cessed. As you will see, there often remains considera-
social interactions – from simple acts such as buying a ble disagreement about some quite fundamental
bus ticket or greeting a friend, right up to constructing properties of the language system. Nonetheless, there
and refining political and legal systems. Like many has also been substantial progress in terms of identify-
aspects of cognition, the ability to use language devel- ing some of the features required of the language sys-
ops apparently effortlessly in the early years of life, and tem for it to work the way it does.
can be applied rapidly and automatically. The building blocks of language identified in this
This chapter looks under the surface of the language chapter are discussed in a wider context in Chapter 7,
system, in order to understand the unconscious opera- which examines, for example, questions such as how
tions that take place during language processing. Our speakers interact in conversation. Chapter 7 also cov-
focus is on the basic mechanisms required for language ers language production, whereas the current chapter
understanding. For example, understanding a simple concentrates on language perception. The structure of
spoken sentence involves a whole string of abilities: the this chapter roughly follows the time course of pro-
perceptual system must be able to identify speech cessing in language perception. Section 2 builds on
sounds, locate word boundaries in sentences, recog- some of the ideas about recognition introduced in
nize words, access their meanings, and then integrate Chapter 4, but looks specifically at the processes that
the word meanings into a coherent whole, respecting result in the identification of spoken and written
the grammatical role each word plays. Each of these words. Models of these processes generally assume
170 PART 2 CONCEPTS AND L ANGUAGE
that word recognition involves access to a mental process of sentence comprehension beyond the mental
lexicon – something that was briefly introduced in lexicon. It deals with how listeners use their knowledge
Chapter 5 in the context of lexical concepts – that of the grammar of a language to construct the meaning
stores relevant information relating to the words we of a sentence. In each section some of the influential
know (e.g. what they mean). Section 3 deals with the models of language processing are discussed, along
contents of the mental lexicon and how this informa- with key experimental studies that help us to evaluate
tion might be organized. Finally, Section 4 looks at the and refine these models.
2 WORD RECOGNITION
Adult speakers of English tend to know somewhere evolutionary terms, a new ability. Speech in contrast is
between 50,000 and 100,000 words. Most common something that almost all humans acquire, and has
words are easy to describe and use, suggesting that been around long enough for some aspects of spoken
their meanings are clearly accessible. Less common language to be thought of as innate. Speech is also pri-
words are perhaps represented more vaguely, with mary in the sense that we learn to understand and pro-
some words difficult to define out of context, but none- duce speech before we learn to read and write. For
theless generating a feeling of familiarity. For example, these reasons, we will firstly look at how spoken word
you might be reasonably confident that tarantella is a recognition operates, and then go on to examine the
word and have good knowledge of how it should be visual modality.
pronounced, but you might still be unable to give a
good definition of what it is (a fast whirling dance, 2.1.1 Segmenting the speech stream
once believed to be a cure for a tarantula bite!). Our conscious experience of spoken words is in some
So, quite a lot of information is stored in the mental ways similar to our experience of text on a page: words
lexicon about word meanings and pronunciations. The are perceived as coherent and discrete events, so we
goal of word recognition is to access this information as generally don’t experience any difficulty in finding the
quickly as possible. We shall look at how this process dividing line between two words. However, the truth
occurs in two different sensory modalities: auditory and of the matter is that the speech waveform has no sim-
visual. This may at first seem repetitious, but there are ple equivalent of the white space between printed
some important differences between the two modalities words. Instead, as Activity 6.1 shows, silent gaps are
that, at this level of the language system, lead to quite unreliable as indicators of spoken word boundaries.
different models of recognition processes. Before you Yet somehow the language system must be able to
read through the sections on word recognition, you may divide the speech stream up so that the words con-
wish to remind yourself of the broader issues involved in tained in it can be recognized and understood. How
recognition, as described in Chapter 4. then does this speech segmentation process operate?
Models of segmentation can generally be divided
into two types: (1) pre-lexical models and (2) lexical
2.1 Spoken word recognition models. Pre-lexical models rely on characteristics of
the speech stream that might mark a likely word
Speech is the primary medium of language. Widespread boundary, whereas in lexical models segmentation is
literacy has emerged only in some cultures, and only guided by knowledge of how words sound. The first
in the last century or two, meaning that reading is, in model is pretty straightforward: the only issue at stake
CHAPTER 6 L ANGUAGE PROCESSING 171
ACTIVIT Y 6.1
The waveform in Figure 6.1 depicts a typical sound annotated with surrounding slash marks), so, for
wave that might enter the ear when you hear some- example, /k/ and / / are the first two phonemes in
e
one speak. Try to work out from the sound wave confess. Coarticulation refers to the fact that you
how many words have been spoken, and pencil in a have to prepare for upcoming phonemes well before
mark where you think each word boundary lies. they are produced, and these preparations lead to
changes in the phonemes currently being pro-
COM M ENT
nounced. For example, the /d/ phoneme in ‘do’ and
When you have noted down your estimates, com-
‘dah’ sounds slightly different because of the following
pare them with the actual boundaries marked at the
vowel. In addition, some silent gaps do not mark word
end of the chapter. How did you decide on likely
boundaries: they are just points where the airways
word boundaries, and was this method a useful one?
are closed in the course of uttering a word. For exam-
Most people assume that silent gaps between words
ple, when you say the word ‘spoken’ your lips close
are likely boundary markers, but they can be mislead-
briefly in order to produce the sudden release of air
ing. Some word boundaries do not involve silence
in the phoneme /p/. This results in a short period of
because the surrounding phonemes are coarticu-
silence between the /s/ and the /p/.
lated, meaning that they blend together. A phoneme
is the speech equivalent of a letter (they are normally
is what type of characteristic or cue can be extracted strong (stressed) syllable, followed optionally by one
from the speech waveform as a useful indicator of a or more weak (unstressed) syllables (as you can see
word boundary. We have already seen that silent gaps from Figure 6.2). Strong syllables are reasonably clear
are not sufficient, but nonetheless silence can be use- landmarks in the speech stream, and most words that
ful, particularly if it lasts quite a long time. have a meaning (such as bacon or throw) rather than a
Another important pre-lexical cue comes from the grammatical role (e.g. it, of) begin with a strong sylla-
rhythm of speech. All languages have some unit of ble (Cutler and Carter, 1987). So, a segmentation
temporal regularity, and this provides the basic strategy that predicts a word boundary before each
rhythm when an utterance is produced. In English, strong syllable would seem like a valuable one for
this unit is known as a metrical foot, and consists of a English speakers.
172 PART 2 CONCEPTS AND L ANGUAGE
Rhythms differ from language to language ‘mint’ should be relatively easy. Their prediction turned
out to be correct, suggesting that listeners make use of
the rhythm of English in order to identify likely word
(a) boundaries. In languages where different rhythmic
Pièce de résistance units dominate, such as French (syllables) or Japanese
(sub-syllabic units), similar sensitivities have been
demonstrated (see Cutler and Otake, 2002), suggesting
(b)
that early in life people ‘tune into’ their native language
and optimize their segmentation strategy accordingly.
Shinkansen
These (and other) pre-lexical cues are clearly valua-
ble for identifying likely word boundaries in a sentence
of utterances. However, none of the models that rely on
(c)
pre-lexical cues can claim complete accuracy in bound-
FIGU RE 6 . 2 Examples of language rhythms. In English ary identification. This means that there will be cases
(a) the basic unit of rhythm is the strong syllable (the where a boundary is incorrectly predicted, and other
filled boxes). These stressed syllables are roughly equally cases where a real boundary is missed. For example, a
spaced out in time when you produce a sentence, no word like confess begins with a weak syllable, and so its
matter how many weak syllables (unfilled boxes) there
onset would be missed by a pre-lexical segmentation
are between the strong syllables. Each group of strong
and weak syllables is known as a ‘foot’, so when you say strategy based on strong syllables. It seems that there
the sentence in (a), it may feel like you are speaking more must be some other mechanism available for cases like
quickly towards the end of the sentence because you this. This is where lexical models can offer more
need to fit in more weak syllables to maintain the gaps insight: lexical segmentation models rely on our
between the strong syllables. In French (b), the syllable is knowledge of particular words’ phonological represen-
the unit of rhythm and so all syllables are roughly equally
tation (what they sound like) to guide segmentation.
spaced in time. The rhythmic unit in Japanese (c) can be
even smaller than a syllable. For example, shinkansen The simplest version of this kind of strategy would
(‘bullet train’) contains six units of rhythm (including involve recognizing each word in an utterance sequen-
three single consonants), but only three syllables. tially, and so predicting a new word at the boundary of
the existing word (e.g. Marslen-Wilson and Welsh,
Cutler and Norris (1988) provided evidence sup- 1978). For example, think about how the sentence
porting this idea: they played pairs of nonsense syllables ‘Confess tomorrow or die!’ might be segmented. If you
to listeners and asked them to monitor for any familiar can recognize the first word quickly (before it finishes),
word embedded in the speech (this is known as the then you can use the knowledge that this word ends in
wordspotting task – think trainspotting but duller). For /s/ to predict a word boundary as soon as the /s/ is
example, in the sequence ‘mintayve’, which consists of encountered. You can then start again on word recog-
two strong syllables, there is the embedded word ‘mint’. nition with the speech following the /s/ (tomorrow).
Cutler and Norris argued that for a sequence like this The problem here though is that most words are much
listeners should identify the two strong syllable onsets shorter than confess and tomorrow, and cannot be rec-
(the /m/ and the /t/), and search for any words they ognized within the time-span of their acoustic wave-
know beginning at those points. This segmentation forms, meaning that a lot of backtracking would be
would obscure recognition of the word ‘mint’ because it required to locate word boundaries using this method
spans a hypothesized word boundary (i.e. they would (think about trying to segment the sentence ‘Own up
tend to hear two units: ‘min’ and ‘tayve’). On the other now or die’ using the same strategy).
hand, a sequence like ‘mintesh’ (where the second weak We shall return to this issue in Section 2.1.3, when
syllable contains a reduced ‘uh’ vowel) would tend to be we evaluate the TRACE model of spoken-word recog-
segmented as a single unit, and so spotting the word nition (McClelland and Elman, 1986), which provides
CHAPTER 6 L ANGUAGE PROCESSING 173
The cross-linguistic differences between segmenta- presented with words from the artificial language on
tion mechanisms highlight the fact that the ability to one loudspeaker and jumbled syllables (e.g. pikugo)
segment speech is one that must be learned during on another. The idea was that if the infants found the
the course of language development. French and words from the language familiar, they might spend
English babies aren’t innately specified with different more time listening to the novel sequences (and so
segmentation mechanisms; instead these develop as turn their heads towards the associated loud-
a consequence of exposure to language. Saffran et al. speaker). Using this technique, Saffran et al. (1996)
(1996) provided an impressive demonstration of found that the infants did begin to pick out the words
how statistical information can aid the development from the stream of syllables after just two minutes of
of both segmentation and vocabulary acquisition. the speech. This ability to learn the statistical proper-
They devised an artificial language made up of ties of patterns is quite universal – it operates for
three-syllable words such as dapiku or golatu, and adults and children as well as babies, and works just
then used a computer to synthesize a long continu- as well for non-speech stimuli such as tones or shapes
ous stream of speech containing these ‘words’. Their (Saffran et al., 1999). Therefore, speech segmenta-
intention was to produce a sequence in their artifi- tion may make use of a wide-ranging implicit learning
cial language that contained absolutely no acoustic ability, which may even be shared by other primates,
or rhythmic cues to the location of word bounda- such as tamarin monkeys (Hauser et al., 2001).
ries. If people only make use of acoustic and rhyth- Interestingly, Cunillera et al. (2010) demonstrated
mic segmentation cues then the speech they hear that when adults learned some of the ‘words’ at the
should appear as unsegmented nonsense. However, beginning of the experiment, before exposure to a
if they can make use of statistical information about speech stream containing both the newly learned
co-occurrence of syllables, then they may start to pick words and six additional unlearned words, they
out the words of the language. In other words, they were better at segmenting the unlearned words
might start to notice that the syllables da, pi, and ku compared to when the speech stream did not con-
quite often occur in sequence. tain any previously learned words. This finding sug-
Using what is known as a ‘head-turning’ proce- gests that adults make use of multiple cues, including
dure, 8-month-old infants were tested on their per- lexical knowledge and statistical information, when
ception of this kind of speech. The infants were segmenting speech.
a more powerful lexical-segmentation mechanism. evaluated and re-evaluated against numerous poten-
Although there is plenty of evidence supporting pre- tial candidates in order to determine the identity of
lexical mechanisms it remains likely that lexical com- each word: this is known as parallel activation. A great
petition operates alongside them to provide a more advantage of this method of assessment is that it can
robust system for dividing up the speech stream. lead to determination of a word’s identity well before
the end of the word is heard.
2.1.2 Parallel activation The mechanism sketched above is most clearly
A spoken word typically lasts about half a second. In exemplified by the cohort model of Marslen-Wilson
many ways it might simplify matters if the recognition and colleagues (Marslen-Wilson and Welsh, 1978;
process began only once the whole of a word had been Marslen- Wilson, 1987). This model assumes that as
heard. However, for the language system this would be the beginning of a word is encountered, the word-
valuable time wasted. Instead, speech is continually initial cohort (a set of words that match the speech so
174 PART 2 CONCEPTS AND L ANGUAGE
far) is activated. For example, if the beginning of the would be activated at an earlier point, before the unique-
word were ‘cuh’ (as in confess), then the word-initial ness point had been reached. He found that when some-
cohort would include words like canoe, cocoon, karate, thing like ‘confe . . .’ was used as a prime, responses to
and so on, because these words all match the speech so the target word sin were still facilitated. The same spo-
far. Then, as more of the word is heard, the recognition ken fragment would also facilitate responses to the tar-
process simply becomes one of whittling down the set get wedding, which was semantically related to an
of potential candidates. For example, ‘conf . . .’ would alternative cohort member, confetti. This suggests that
rule out all the words above, but not confess, confetti, the meanings of both confess and confetti are briefly
or confide. At some point in this process (the unique- accessed while the word confess is being heard.
ness point) the candidate set should be reduced to a You might want to reflect on what this result means
single word. According to the cohort model, the rec- in terms of how we recognize spoken words. It sug-
ognition process is then complete. As mentioned gests that when we hear a word, we don’t just activate
above, the recognition point in this kind of model can the meaning of that word; we also activate, very briefly,
be well before the end of the word, meaning that valu- the meanings of other words that begin with the same
able time is saved in interpreting the speaker’s mes- phonemes. Meanings of likely candidates are activated
sage. However, not all words become unique before before the perceptual system can identify the word
the end of the word; for example, ‘cat’ can stand on its being heard, which ensures that the relevant meaning
own as a word, but can also form the first syllable in a has been retrieved by the time the word is identified.
number of longer words, such as caterpillar, cata- Parallel activation of multiple meanings is an impor-
logue, and catch. Thus, even when the entire word has tant property of the language recognition system. The
been heard there will still be a number of active poten- alternative – a serial search, which would be a bit like
tial candidates. In this case, the word cat will only be looking through a dictionary for a word meaning – is
recognized after the listener has heard part of the fol- unlikely to be as efficient (particularly for words near
lowing word and determined that this does not con- the end of the list). However, it is worth questioning
stitute a legal continuation of the word cat. the extent of parallel activation. For example, could it
Nevertheless, even this conception of the process be the case that there is no limit to the number of
doesn’t reflect the full fluency of word recognition. So meanings that can be activated briefly? And can these
far, we haven’t discussed the goal of the recognition pro- multiple meanings be accessed without any interfer-
cess – accessing our stored knowledge about a word. ence between them? Gaskell and Marslen-Wilson
One might assume that this occurs at the recognition (2002) argued that meaning activation is limited, again
point of a word. However, it seems that access to mean- on the basis of cross-modal priming data. They showed
ing can occur substantially earlier. Marslen-Wilson that if many meanings are activated at the same time,
(1987) demonstrated this using cross-modal priming. the resultant priming effect is relatively weak com-
This technique – which is used to examine the extent to pared with the amount of priming found when just one
which the meaning of a spoken word has been or two meanings are compatible with the speech input.
retrieved – involves hearing a spoken prime word, fol- It appears to be the case that activating more than one
lowed swiftly by a visual target word. Participants were meaning can only occur partially, so the gradual reduc-
given the task of deciding whether the target was a word tion of the cohort set of matching words is accompa-
or not as quickly as possible. Semantic similarity nied by a gradual isolation and amplification of the
between a prime–target pair such as ‘confess’ and sin relevant meaning. Nonetheless, an overriding charac-
leads to faster responses to the target (compared with an teristic of the speech perception system is to initially
unrelated control pair, such as ‘tennis’ and sin). This access too much information rather than too little. This
implies that, on reaching the end of the word, the mean- maximizes the chances of having accessed the correct
ing of ‘confess’ has been activated. The question that meaning as soon as enough information has been
Marslen-Wilson addressed was whether the meaning perceived to identify the particular word.
CHAPTER 6 L ANGUAGE PROCESSING 175
2.1.3 Lexical competition activations reflect the degree to which each word
matches the incoming speech.
Marslen-Wilson’s cohort model was important A second mechanism provides a way of selecting
because it incorporated parallel evaluation of multiple between active words. Nodes at the word level in
lexical candidates, and emphasized the swiftness and TRACE are connected by inhibitory links. When any
efficiency of the recognition process. Later models word node becomes activated, it starts to inhibit all
used a slightly different characterization and relied on other word nodes (i.e. by decreasing their activation)
the activation and competition metaphor (introduced with the strength of inhibition depending on the
in Chapter 4 in the discussion of the IAC model of face degree to which that node is activated. This competi-
recognition). In these models, each word in the lexi- tive element tends to amplify differences in word acti-
con is associated with an activation level during word vations, so that it becomes clear which words are
recognition, which reflects the strength of evidence in actually in the speech stream and which are just similar
favour of that particular word. The cohort model in its to the words in the speech stream. So if the spoken
original form (Marslen-Wilson and Welsh, 1978) can word was confess, then the node for confetti would
be thought of as a dichotomous activation model: become strongly activated as well, because all pho-
words are either members of the cohort (equivalent to nemes in the input apart from the final one fit the rep-
an activation level of 1) or they aren’t (activation level resentation of confetti. However, the confess node
0). The advantage of more general models of lexical would be activated to a slightly greater extent because
competition such as TRACE (McClelland and Elman, all phonemes in the input are consistent. Both these
1986) is that they can use continuously varying activa- word nodes would be strongly inhibited by the other,
tion levels to reflect the strengths of hypotheses more but the greater bottom-up support (i.e. greater consist-
generally. This is useful in cases where a number of ency with the incoming signal) for confess would
words are consistent with the speech input so far, but ensure that the confess node would eventually win the
the information in the speech stream matches some competition, remaining activated when the confetti
words better than others. If activation levels are on a node had been strongly inhibited.
continuous scale, then this inequality can be reflected This ‘winner-takes-all’ activation and competition
in the activations assigned to word candidates. approach is common to many models both within lan-
The TRACE model is a connectionist model that guage (we shall see another example in Section 2.2) and
assumes three levels of representation: the phonetic across cognition (e.g. face recognition). These common-
feature level (phonetic features describe the compo- alities across different areas of cognition are valuable, as
nent parts of how a phoneme is articulated, such as lip they provide a way of extracting more general principles
closure or tongue position), the phoneme level, and of cognitive processing from specific examples. In the
the word level (containing a node for each word the case of speech, lexical competition provides a simple
listener knows). The idea of the model is that the mechanism for deciding which words best match the
speech stream is represented as changing patterns of speech input. As we saw in Section 2.1.1, it also provides
activation at the phonetic feature level. These nodes a subsidiary means of segmenting the speech stream
feed into a phoneme recognition level, where a phone- into words. This is because it is not just words that have
mic representation of speech is constructed. A word the same onset, such as confess and confetti, that com-
node has connections from all the phonemes within pete, but also words that simply overlap to some extent,
that word. For example, the confess node would have such as confess and fester (see Figure 6.3). These words
connections feeding into it from the /k/, / /, /n/, /f/,
e have a syllable in common (i.e. the second syllable of
/E/, and /s/ phoneme nodes. If the phoneme nodes for confess and the first syllable of fester). If this syllable is
that word became activated, activation would then perceived, then both of these words will become acti-
spread to the confess word node, resulting in strong acti- vated, but through lexical competition only one will
vation for that word. The net result is that word-node remain active. The segmentation problem can then be
176 PART 2 CONCEPTS AND L ANGUAGE
confess – – tomorrow
+ + + +
– fester –
+ +
FIGU RE 6 . 3 Illustration of lexical competition in the TRACE model. The speech stream activates a set of phonetic
feature nodes (not shown), which then activate the corresponding phoneme nodes. Word nodes at the lexical level
are linked up to the relevant phoneme nodes with positive links (solid lines). In this case, the speech is actually ‘confess
tomorrow’. This sequence actually fits three words completely: confess, fester, and tomorrow. These word nodes have
inhibitory connections between them that vary in strength depending on their degree of overlap. So there is no
inhibitory link between the confess and tomorrow nodes, but the fester node has inhibitory links to both confess and
tomorrow (broken lines). The combined inhibition of the fester node from the other nodes has the effect of
suppressing its activation, leaving only confess and tomorrow as active lexical candidates. The competitive links
between words in TRACE allow word recognition to be carried out, and also provide a mechanism for word
boundary identification (there must be a boundary between the /s/ of confess and the /t/ of tomorrow).
viewed as having been solved implicitly in the activation while listening to a semantically related distractor
of the word nodes. For example, if confess wins the com- word, embedded words only appeared to interfere with
petition then there must be a word boundary at the end picture naming if the embedded word was aligned
of the syllable ‘fess’, but if fester wins the competition with a syllable boundary (e.g. bat in acrobat), not when
then the boundary must be at the start of ‘fess’. the embedded word was misaligned with a syllable
This general version of lexical competition is sup- boundary (e.g. ear in pioneer). As such, it appears that
ported by a wordspotting experiment by McQueen the processes involved in lexical competition interact
et al. (1994). They looked at the time taken to spot a with speech segmentation mechanisms during spoken
word like mess in two different types of embedding word recognition, and that these two processes may be
sequence. In a sequence like ‘duhmess’ the first two syl- carried out in parallel.
lables match a longer word: domestic. If lexical compe-
tition operates for all overlapping words (see Figure
6.3), then the inhibitory link from the domestic node 2.2 Visual word recognition
should make it difficult to spot mess. McQueen et al.
found that detection rates were indeed lower and In this section we focus on the special qualities of
slower in this case compared to a case like ‘nuhmess’, in word recognition in the visual domain, looking at how
which a longer competitor does not exist. Interestingly, the recognition process operates, how visual and audi-
Bowers et al. (2009) found that the degree to which tory processes are linked, and how eye movements are
short embedded words such as mess are activated can linked to the recognition system. Compared to speech,
vary depending on the position of the embedded text might be thought of as an unproblematic medium.
sequence within a longer word. Using a picture-word After all, it is relatively easy to spot where words begin
interference task, in which participants name a picture and end, and text isn’t transient in the way that speech
CHAPTER 6 L ANGUAGE PROCESSING 177
is – if you misperceive a word on the page, you can slim was obscured slightly, so that the ‘s’ letter node was
simply go back to that word and try again. However, only weakly activated by the visual input. In this case,
the availability of textual information also raises spe- the slim word node would still be activated by the three
cific issues that must be addressed by models of visual unambiguous letters, and would in turn increase the
word recognition. For example, because textual infor- activation of the ‘s’ letter node. The result would be cor-
mation is freely available over an extended period of rect recognition of the obscured letter, despite the
time, we need to understand how the recognition sys- weakness of the sensory evidence.
tem determines where the eyes should fixate, and for This kind of top-down influence can be useful in
how long. explaining lexical effects on lower-level processing.
A classic finding in word recognition (known as the
2.2.1 Models of visual word recognition ‘word superiority effect’, or WSE) is that letter detec-
We have already seen how TRACE models spoken tion is easier when the letter forms part of a word (e.g.
word recognition in terms of activation and competi- the letter ‘i’ is easier to detect in slim than in spim).
tion in a multi-level connectionist network. TRACE This can be attributed to the influence of the word
was in fact a variant of an earlier model of visual word node for slim providing a secondary source of activa-
recognition proposed by McClelland and Rumelhart tion for recognition of ‘i’, whereas there is no second-
(1981). The visual model is often known as the IAC ary source for a non-word like spim. So the top-down
(interactive activation and competition) model, and feedback connections in the IAC model provide a neat
shares many properties with the IAC model of face explanation of why we often find lexical influences on
recognition you met in Chapter 4. The model contains recognition of sub-lexical units like letters.
three levels of nodes, representing activation of (1) However, Grainger and Jacobs (1994) demonstrated
visual features, (2) letters, and (3) words. Like TRACE, that a variant of the IAC model could also explain the
it is the inhibitory units within a level that provide a WSE without any top-down feedback. They proposed
competitive activation system. Visual input is repre- that responses to the letter-detection task were based
sented by activation at the featural level, and facilita- on two different levels of representation: a letter-
tory and inhibitory links between levels of detection response could be based on activation of let-
representation allow activation to build up at the ter nodes or word nodes. The idea here was that one of
higher levels. In this way, visual word recognition can the pieces of information about a word stored in the
be modelled as an interactive competition process. mental lexicon is a description of the written form of
An important property of many of these competi- the word. So if a word node reaches a critical level then
tion networks is that as well as allowing activation to the spelling of that word should be activated, triggering
flow up through the system (i.e. from features through a response. The upshot was that the incorporation of a
letters to words), during the course of recognition they second basis for responses using lexical information
also allow activation to flow in the other direction allowed the WSE to be accommodated in a model that
(from words downwards). This is another example of only used bottom-up flow of activation.
the concept of top-down processing that was intro- The experimental finding of WSE remains a robust
duced in Chapter 3. For example, if the word node for and important phenomenon, but the research of
slim became activated, the activation would feed back Grainger and Jacobs shows that there is more than one
through facilitatory links to the constituent letter way of explaining the effect. Whether or not top-down
nodes (i.e. ‘s’, ‘l’, ‘i’, and ‘m’). At first glance, these feed- processing is needed is one of the most contentious
back links appear redundant, because the letter nodes questions in the area of word recognition (both audi-
are going to be activated in any case by bottom-up sen- tory and visual) and other areas of perception, and it
sory information. But their value becomes apparent in remains a hotly debated topic amongst cognitive psy-
cases where the bottom-up information is degraded in chologists (e.g. Norris et al., 2000, and associated
some way. For example, suppose that the first letter of commentaries).
178 PART 2 CONCEPTS AND L ANGUAGE
2.2.2 Mappings between spelling and sound purposes, the critical feature of the model is that it
So far we have treated the question of how words are contains a ‘rule-based’ route to pronunciation via a
recognized separately for spoken and written words. grapheme–phoneme rule system (assembled phonol-
This section looks at how these two modalities inter- ogy; see right-hand side of Figure 6.4), plus a ‘lexical’
act, and what this tells us about the language system. route that requires retrieval of a stored pronunciation
There is an obvious need for interaction in order to (addressed phonology; see left-hand side of Figure 6.4).
spell a word that you have just heard, or to read aloud Looking at the speed with which written words can be
a written sentence. But there are more subtle reasons named often assesses the degree to which these routes
for suspecting that there are links between the orthog- are involved in reading. A typical finding is that regular
raphy of a word (its spelling) and its phonology (its words (e.g. bell) are named faster than irregular words
sound). Some of the data we shall now look at suggest (e.g. pint), but that this advantage is only present for
that visual word recognition relies strongly on spoken low-frequency words (i.e. words that occur relatively
word representations and processes. rarely in the language). This can be explained by dual-
As described in Activity 6.2, reading aloud is often route models in terms of a race between the two routes.
portrayed in terms of two separate mechanisms: assem- Regular words can be named via either the lexical or the
bled and addressed phonology. The separate mecha- rule-based route to pronunciation, whereas irregular
nisms are explicitly represented in dual-route models of words can only make use of the lexical route. On the
reading such as the DRC model of Coltheart et al. whole, naming speeds are faster when two routes are
(2001). DRC (see Figure 6.4) is a complex and powerful available (naming a regular word can be based on the
model, and builds on more than 100 years of theorizing output of whichever route delivers the pronunciation
about multiple routes in reading processes. For current first) than when only one route is available (irregular
ACTIVIT Y 6.2
Think about what processes might operate when rules for ‘e’ and ‘ll’. This works well for words such as
you read aloud the following words: bell, stick, pint, bell and stick, because they follow these conversion
yacht, colonel. How does a reader convert the rules (i.e. they are regular items), and also for non-
orthographic (or written) form to a phonological words like dobe and leck. But what about pint, yacht,
one in order to pronounce the words, and where is and colonel? A simple sounding out of these irregular
the phonological information stored? Would the words would lead to the wrong pronunciation (e.g.
same processes operate when you read the follow- pint might be pronounced to rhyme with hint), sug-
ing non-words: dobe, leck, brane, noyz? gesting that an alternative mechanism is available. This
is often known as addressed phonology, and (like
COM M ENT
whole-word methods of teaching reading) it relies on
Researchers often refer to two different ways of
some kind of stored pronunciation of the whole
reading words aloud (what we could call ‘retrieving
word in the mental lexicon. Brane and noyz are unu-
their phonology’). The division is much like the divi-
sual because their pronunciation coincides with the
sion between phonics and whole-word methods of
pronunciations of real words (i.e. brain and noise).
teaching children to read. Assembled phonology (like
These pseudohomophones (non-words that can be
phonics) means generating a pronunciation based on
pronounced to sound like words) are generally only
a set of mappings between letters and sounds for
found in rock lyrics and some rather fiendish language
your language. For example, the ‘b’ in bell corresponds
experiments (see below).
to the /b/ phoneme, and there are similar conversion
CHAPTER 6 L ANGUAGE PROCESSING 179
two words rhymed or not. They found that participants about how the word sounds or about how the word is
were able to answer this question faster when the two spelled. More importantly, this appears to be the case
words were spelled in a similar way (e.g. tie/pie) com- regardless of whether the word is presented in a spoken
pared to when the two words were spelled differently or a written form.
(e.g. tie/guy). More recent studies have provided evi-
dence suggesting that the activation of orthographic 2.2.3 Eye movements in reading
information during spoken word recognition occurs Speech perception is a relatively passive process, in that
automatically. Chéreau et al. (2007), for example, found the listener doesn’t need to perform any overt action in
that spoken target words were processed faster when order to listen to a conversation. Reading a book or
they overlapped with the spoken prime in both phonol- newspaper, however, is more active, because the reader
ogy and orthography (e.g. dream/gleam) compared to controls the speed of uptake of information and must
when the prime and target overlapped only in phonol- direct their eyes in order to take in new information.
ogy (e.g. scheme/gleam), and that this was the case even Eye movements turn out to be enormously useful in
when the gap between hearing the prime and target was revealing how the language system operates.
reduced to 20 ms. This finding demonstrates that even Eye movements may feel quite smooth and contin-
when participants have little time to process a spoken uous introspectively, but they really consist of saccades
word, orthographic information is still activated and (jerky movements) followed by fixations (more-or-
affects processing of the spoken item. It seems, there- less stationary periods) during which visual informa-
fore, that all forms of information are used when faced tion is processed. Eye-tracking techniques can
with the task of recognizing a word, be it information monitor the movements of the eyes during reading
red) is directed at the eye from a given angle, the FIGU RE 6 . 5 Example of typical eye movements
angle of the reflection can be used to determine the during reading.
orientation of the eye, and consequently the direc-
tion of gaze. Precise measurements can be made if spoken language. Here, the participant is presented
the eye-tracking system combines measurements with a spoken sentence in the context of some visual
from more than one surface within the eye. scene, and the eye movements of the listener are
In studies of reading, the position of the head is monitored. For example, if a participant is sitting in
often fixed using a chinrest and headrest and the front of a table with some candy and a candle on it,
participant is presented with text on a computer and is asked to pick up the candy, it is revealing to find
screen. Given that the head position is fixed and the out at what point people look at the candle, and cor-
distance from the screen is known, the reader’s relate this with the amount of speech information
gaze location relative to the text can be calculated they have received at that point (Tanenhaus et al.,
from the gaze-angle measurements. This results in a 1995). In this kind of situation (see Section 4.4 for
set of timed fixations to the text, as illustrated in another example of this method), the participant
Figure 6.5. needs to be able to move their head freely. To allow
It is clear how eye-tracking studies would be ben- for this, a slightly different type of tracker is used,
eficial for understanding how we read. However, a consisting of an eye tracker mounted on the head
less obvious use of eye tracking is in the study of plus a second system for determining head position.
CHAPTER 6 L ANGUAGE PROCESSING 181
and relate them to the location of the reader’s gaze (see fact that fixations work best if they are near the middle
Box 6.2). Figure 6.5 illustrates the fixations involved in of the word makes sense, given that visual acuity is best
the processing of a typical sentence. Each numbered in the foveal (central) region of the retina (try fixating
circle corresponds to the gaze location for a single on the edge of this page and reading the text!). The
fixation. Fixations typically last about 200 ms, but slight but consistent bias in favour of left of centre is
their durations are strongly dependent on the linguis- more intriguing. Shillcock et al. (2000) argued that this
tic processing involved. For example, fixation dura- bias reflects a balancing of the informativeness of the
tion is strongly dependent on the frequency of a word’s parts of the word to the left and right of the fixation
usage in the language (Rayner and Duffy, 1986). This, point. The OVP should be left of centre for longer
along with many other effects, suggests that fixations words because there is greater redundancy towards the
are a measure of some kind of processing difficulty, end of most of these words. For the word cognition, for
and so they can reveal influential variables in reading. example, it would be easier to guess what the word is
As Figure 6.5 illustrates, our eyes don’t simply move from the first five letters (cogni) than the last five
from one word to the next as reading proceeds. Some (ition). Shillcock et al. also found that for some shorter
words are skipped altogether, whereas others require words such as it, the theoretical OVP was outside the
multiple fixations. In a significant proportion of cases, word, either to the left or the right, perhaps explaining
readers perform regressive saccades (i.e. they move why shorter words are often not fixated when reading.
backwards through the text), as marked by the grey cir- How much textual information can be utilized
cle in Figure 6.5. Short function words (grammatical when a reader makes a fixation? The foveal region of
words like we and on) are much more likely to be the retina has the greatest acuity, but it spans a limited
skipped than content words (words that convey mean- angle. It is possible that information can also be gained
ing, like sentence and look), and regressions can often from the parafoveal region, which is wider but has
tell us about cases where a word has been misinter- reduced acuity. Rayner and colleagues have carried
preted due to some ambiguity (Starr and Rayner, 2001). out a number of ingenious experiments aimed at
Eye-movement data are also valuable in terms of assessing the perceptual span of readers. In one exper-
understanding where we fixate within a word. O’Regan iment they applied a moving window to text shown on
and Jacobs (1992) showed that words are identified a computer screen so that only a certain number of
most quickly if they are fixated at a point in the word letters to the left and right of the current fixation point
known as the optimal viewing position OVP. The OVP could be read (see Figure 6.6). Whenever the partici-
is generally near the middle of a word but can be pant shifted their gaze, the window shifted accord-
slightly left of centre in the case of longer words. The ingly. They found that if the window is small, reading
FIGU RE 6 .6 Example stimuli in a moving window experiment (e.g. McConkie and Rayner, 1975). The numbers in
parentheses are the window sizes in characters. In a typical experiment the participant sits in front of a computer
screen, with an eye-tracking system monitoring their gaze. Wherever the participant directs their gaze along a line of
xs, the computer displays around that point small ‘windows’ of unobscured text. All text outside this window is
obscured by xs (in some experiments the gaps between words were preserved). The asterisk below each example
marks the fixation point, and would not be seen by a participant (participants can fixate where they like). In this case
the sentence is ‘Where we look when reading a sentence depends on many different factors’.
182 PART 2 CONCEPTS AND L ANGUAGE
is a slow and painful process, but for larger windows 15 characters to the right of fixation and 3 characters
participants are barely aware of the text beyond the to the left. The asymmetry is due to the left-to-right
window that is masked. nature of reading in English – there is more useful
The idea behind this technique is that the experi- information to be gained in text following the fixation
menter can gradually increase the window size until a position than the text preceding the fixation (which
point is reached at which reading speed and compre- has normally already been read). In a right-to-left lan-
hension are normal. At this point one can be confident guage like Hebrew the asymmetry is swapped, show-
that the text beyond the window range is not used for ing that the perceptual span in reading is shaped by
normal reading. The results suggest that the percep- the requirements of the written language.
tual span for English readers is quite limited: about
SUMMARY OF SECTION 2
• In speech, finding out where words begin and end is a non-trivial problem. Models of word segmenta-
tion rely on either features of the speech stream or knowledge about how words sound.
• Word recognition relies on parallel assessment of multiple options, and competition between word
candidates.
• Models of word recognition differ in the extent to which top-down processing is required.
• Visual word recognition relies to a considerable extent on speech codes, whilst spoken word recog-
nition relies to some extent on written codes.
• Studying eye movements during reading reveals what aspects of visual word recognition cause
difficulties.
cumbersome units, and a lexicon based on morphemes morphemes, such as disenchantment, is essentially the
would be more economical (fewer entries) and more same process as recognizing a single-morpheme word,
flexible. such as cat. The opposite extreme – often known as the
Most people are aware that words can be divided up affix-stripping or decompositional approach (Taft and
into meaningful units, and that these units follow Forster, 1975) – is that words are chopped up into
some grammatical rules. For example, we know that morphemes as they are perceived, and the morpheme
plurals in English are generally derived by adding an is the basic unit of representation in the lexicon.
‘s’ to the singular form, as in cats or dogs. In its spoken One way of looking at whether the lexicon is organ-
form, the rule is slightly more complex: speakers add ized in terms of morphemes is to test whether we can
on /s/, /z/, or /iz/, depending on the final phoneme of add morphemes onto unknown words. A classic dem-
the singular form (think about how you would say the onstration of this kind of generalization is Berko’s
plural forms cats, dogs, and pieces). This kind of rela- ‘wug test’ (1958), in which children were encouraged
tively minor modification of a word (for example, to generate the plural form of novel words. For exam-
marking pluralization or tense) is known as an inflec- ple, a child might see a drawing of a toy and be told
tional change, and is covered by a branch of morphol- that it was a wug. The child would then see two of
ogy known as inflectional morphology. More major these toys and be prompted to say what they were.
modifications are possible as well, in which the gram- Children found it easy to generate the correct inflected
matical class of a word may change. For example, the form (wugs), suggesting that they had learned some
suffix -ness can change an adjective to a noun (as in kind of pluralization rule, and that the ‘s’ can operate
happiness or weakness). Similarly, the suffix -ly can as an independent morpheme. The pluralization suffix
change an adjective into an adverb. These modifica- is a particularly common one, but other morphemes
tions form part of derivational morphology. such as -ment, as in government, or en-, as in enact, are
The examples of morphological change given above more rare. This factor may affect the way different
are particularly straightforward. All involve regular morphemes are represented in the lexicon. It may be
changes in which the meaning of the word is predict- that common morphemes such as the plural mor-
able from the meanings of the morphemes. But things pheme are stored as separate units, but less common
are not always so simple. For example, according to units have no separate representation.
the regular pluralization rule, the plural form of mouse Marslen-Wilson et al. (1994) used the priming meth-
should be mouses not mice. Mice is an example of an odology to examine whether morphemic units exist in
irregular plural form, and similar irregularities exist in the mental lexicon. Their reasoning was that if words
many types of morphological change. Similarly, the are broken down into morphemes then we should be
meanings of the morphemes making up a word may able to get strong priming effects between words con-
not always determine the meaning of the whole word. taining the same morpheme. They found that priming
It’s easy to spot the relationship in meaning between of this type depended on some shared meaning between
govern and government but not between depart and the two words. So hearing cruelty resulted in faster pro-
department, yet both pairs have (at least supposedly) cessing of cruel because they have similar meanings, but
the same morphological relationship. hearing casualty did not prime responses to casual, pre-
The descriptions given here are linguistic ones, but sumably because there was no clear link between the
do they have any relevance to cognitive psychology? meanings of the two words. However, more recent
In other words, do the regularities that exist between studies have shown that when the prime is presented
families of words have any effect on the organization for only a very short duration (typically around
of the mental lexicon? It is quite possible that our rec- 40–50 ms), and participants are not aware of having
ognition system is set up to recognize words, regard- seen the prime word, processing of the target word is
less of their sub-structure. This full-listing approach speeded up even when there is no semantic link
would mean that recognizing a word made up of many between the prime and target (Rastle et al., 2004).
184 PART 2 CONCEPTS AND L ANGUAGE
Taken together, these results suggest that at an early sent semantic relationships between words. Collins
stage of processing words are automatically decom- and Loftus’s original model in 1975 used different
posed into their constituent morphemes irrespective of kinds of links for different kinds of semantic relation-
the meanings of the words, but that meaning may play ship. For example, the network could encode the fact
a role during later processing stages. Thus, it seems that that a canary is a bird by linking the nodes for canary
extreme positions such as full-listing or full decompo- and bird with an ‘is a’ link, or that a canary has wings
sition are untenable. Perhaps it may instead make more using a ‘has’ connection. Other models didn’t use
sense to have a pragmatic view of morphological pro- labelled links but simply connected together words
cessing, in which morphological decomposition only that were similar in meaning. The application to word
occurs if there is some clear benefit to be had. Different recognition would be that once a word has been recog-
morphemes within a language may be treated in differ- nized (for example by activating the correct node in
ent ways, and there may also be differences between the IAC model), activation would spread to the seman-
languages in terms of the extent to which the mental tic network and then along links to related words, thus
lexicon relies on morphemes. generating a set of known facts about that word and
activating a set of semantically related words.
The alternative featural theory of semantic represen-
3.2 Accessing word meanings tation assumes that word meanings are represented as
a set of semantic features or properties (a bit like some
Chapter 5 introduced you to the notion of lexical of the theories of concepts explored in Chapter 5). The
concepts – a class of concepts specific to words. In this idea here is that the mental lexicon contains a large set
section we shall relate the ideas underlying concepts of features, and that each word representation consists
and categories to the operation of the semantic system. of a subset of these features. For example, the features
We shall examine the kinds of information that become relevant for the word canary might include (‘has wings’,
available once a word has been recognized, and also ‘can fly’, ‘is a bird’, and so on). The feature model has
look at the problem of how to select the appropriate also been incorporated into connectionist models of
meaning in cases where a word is ambiguous. recognition, allowing the linkage of recognition mod-
els and semantic representations. In this case, the acti-
3.2.1 Semantic representations vation of a written or spoken representation would
Once a word has been recognized the relevant infor- lead to a pattern of activation on a set of semantic
mation about that word must be accessed, so that the nodes, with each node representing a semantic feature
word, and ultimately the sentence, can be understood. (e.g. Masson, 1995).
Most models of language perception start to get slightly These two approaches are highly underspecified,
hazy at this point, because while word forms are quite and could potentially accommodate many different
concrete and easy to define, their meanings are rather patterns of data. Despite this, you might find it useful
less tangible and may vary quite strongly from person when you read through the experimental findings
to person. listed below to think about how the findings might be
Two theories of how word meanings might be repre- accommodated by featural and spreading activation
sented have gained popularity since the 1970s, both of theories. Most studies of semantic representations of
which have links to the kinds of ideas discussed in words have addressed what kinds of information can
Section 2.2 with respect to interactive activation mod- be accessed and when. Clearly, all kinds of information
els. Spreading activation models (e.g. Collins and about a word could be stored in the mental lexicon, but
Loftus, 1975) assume that words can be represented by the information required to understand a sentence
units or nodes, as in the TRACE and IAC models of must be readily available in a fraction of a second, and
word recognition. The difference here is that links this time constraint may have some consequences for
between nodes in spreading activation networks repre- what types of information are stored.
CHAPTER 6 L ANGUAGE PROCESSING 185
The most popular tool for investigating the types of semantic priming effects were robust, with perhaps
semantic information stored in the mental lexicon is the strongest evidence for links in the lexicon between
semantic priming. For example, an experiment might members of the same category (e.g. horse–pig) and
use pairs of semantically related words, such as bread instrument–action pairs such as broom and sweep.
and butter, with participants asked to perform some Kellenbach et al. (2000) looked at whether words
kind of speeded task such as lexical decision (is it a might be linked in terms of the visual or perceptual
word or not?) or naming (say the word aloud) to the properties of the objects they represented. For exam-
second item of the pair. In this case, the assumption is ple, button and coin both refer to flat, round objects.
that if responses are facilitated (i.e. quicker) when there This kind of priming had been observed weakly in
is a semantic relationship between the words, then that some studies but not others. However, Kellenbach et al.
semantic relationship must be represented in the men- (2000) used two measures of priming: the first was the
tal lexicon; in a spreading activation model there might standard reaction time test, and the second was based
be a link between the words, whilst in a featural model on brain activity using the ERP technique (see Box 6.3
the words might share a number of semantic features. in Section 3.2.2). They found no effect in the reaction
So what kinds of relationship between words can sup- time test, but nonetheless a robust effect on the brain
port semantic priming? Perhaps the most robust effect response to the target word, suggesting that even in
involves pairs of associated words (words that seem to this case, where the semantic link was too subtle to be
go together naturally). Association strength is often detected by conventional techniques, a priming rela-
measured by asking people to say or write down the tionship still existed. So it seems that the semantic
word that first comes into their heads when they read a information that becomes available when a word is
target word. So if you were asked to provide an associate perceived is far from minimal. Instead, many different
for the word cheddar you would probably say cheese. aspects of meaning are accessed. Current research says
According to the University of South Florida norms little about how these different aspects of meaning are
(Nelson et al., 1998), that’s what more than 90 per cent of organized and accessed, but even at this stage it seems
respondents say (curiously, a further 3 per cent of their that associative, pure semantic, and perceptual knowl-
respondents said Swiss!). In any case, the fact that pre- edge might be accessed in different ways.
senting one word results in facilitated processing of an
associated word suggests that associative links between 3.2.2 Semantic ambiguity
words are represented in the lexicon in some way. In many cases, the operation of activating a word’s
The problem with this conclusion is that the types meaning in the mental lexicon is made more difficult
of relationship found for associated word pairs are because the word is ambiguous in some way. For
quite variable, ranging from near synonyms (words example, what does the word bank mean to you? You
that have very similar meanings, such as portion and may immediately think of a high-street bank, but then
part), to antonyms (words that have opposite mean- later realize that bank could mean the side of a river as
ings, such as gain and lose), to words that just crop up well. This is because bank is a homonym: a word that
in the same context (e.g. law and break). For this rea- has multiple unrelated meanings. There are also more
son, researchers have often tried to look for semantic subtle possibilities: the first meaning of bank is most
priming in cases where words have only weak associa- commonly applied to the place you keep your money.
tions but still retain some specific semantic link (e.g. But a blood bank, while clearly related, is a somewhat
horse and sheep). The data here are less clear, which different concept, as is the bank at a casino. So bank is
suggests that non-associative links might be weaker in a polysemous word, as well as a homonym, because it
some way, or rely on a different mechanism compared has multiple related senses. Further ambiguity is
with associative links. Nonetheless, Lucas (2000) caused by the fact that bank could be a verb (transitive
reviewed a large set of semantic priming experiments or intransitive) or a noun, but we shall leave this syn-
and reached the conclusion that non-associative tactic ambiguity to the next section. Homonyms are
186 PART 2 CONCEPTS AND L ANGUAGE
The ERP method relies on the fact that brain activity with the word spoon might be small in the sentence
creates an electromagnetic field that can be meas- ‘James ate the cereal with a dessert spoon’, but large
ured by a set of electrodes placed on the scalp. in the sentence ‘James caught the salmon using a fish-
Typically, the recording of activity is synchronized ing spoon’. This sensitivity to semantic congruency
with the presentation of a stimulus, and many record- makes the ERP technique an excellent one for exam-
ings using different stimuli must be averaged to gen- ining issues such as lexical ambiguity resolution.
erate an interpretable waveform. The resultant ERP Van Petten and Kutas (1987) compared ERP and
waveform often contains a set of characteristic peaks standard priming methods of assessing the effects of
at different delays. sentential context on meaning activation for ambig-
A negative peak occurring roughly 400 ms after uous words such as bank. They showed that even
the stimulus has been presented (known as the when standard priming techniques detected no
N400) has been identified with the integration of influence of sentential context, the ERP waveforms
semantic information into sentential context. A typi- for the ambiguous words were subtly different, sug-
cal finding is that the size of the N400 peak associated gesting that sentential context was influencing the
with a word in sentential context is inversely related processing of these words, and strengthening the
to how easily that word fits into the context (Kutas case for an interactive account of lexical ambiguity
and Hillyard, 1980). So the N400 peak associated resolution.
thankfully reasonably rare (roughly 7 per cent of com- Using cross-modal semantic priming, Swinney
mon English words according to Rodd et al., 2002), (1979) found evidence for autonomous activation of
but the vast majority of words have multiple senses, ambiguous word meanings. In his experiment, partici-
which means that we really need to deal with ambigu- pants heard homonyms like ‘bugs’ embedded in senten-
ity effectively if we are going to understand language. tial contexts, and were asked to make a lexical decision
Normally, the sentential context of an ambiguous on a visual target related to one of the meanings of the
word will provide some valuable clues to allow the rel- prime or an unrelated control word (see Figure 6.7).
evant meaning of the word to be selected. So the ques- Swinney found that whether or not the sentence
tion that researchers have focused on is how sentential context was biased towards one meaning of the homo-
context influences meaning selection in cases of ambi- nym, both related targets were primed. This implies
guity. Two opposing views have emerged since the that both meanings of the ambiguous word were
1980s (you may note similarities between the debate accessed, despite the fact that in the biased condition
here and the debate on top-down and bottom-up pro- only one meaning was compatible with the sentential
cessing discussed in Section 2.2). According to the context. When the experiment was repeated with the
autonomous view, all meanings of an ambiguous word targets presented roughly one second later, only the
are first accessed and then the contextually compatible contextually appropriate meaning appeared to be acti-
meaning is selected from these alternatives. The inter- vated. So Swinney’s data suggested that there is a short
active view has a stronger role for sentential context, window of up to a second in which the meanings of
in that it may in some cases rule out inappropriate ambiguous words are accessed without regard to sen-
meanings before they are fully accessed. So these two tential context, supporting the autonomous model.
viewpoints differ in terms of whether there is a short Variants of Swinney’s experiment have been run
period of time in which meanings of words are many times, and once again there is some inconsist-
accessed regardless of sentential context. ency in the pattern of priming. In some cases it seems
CHAPTER 6 L ANGUAGE PROCESSING 187
UNBIASED CONTEXT
Hear: ‘Rumour had it that, for years, the government building had been plagued with problems.
The man was not surprised when he found several bugs in the corner of his room’
BIASED CONTEXT
Hear: ‘Rumour had it that, for years, the government building had been plagued with
problems. The man was not surprised when he found several spiders, roaches and other bugs in
the corner of his room’
FIGU RE 6 .7 Example trial in Swinney’s (1979) priming experiment. In the unbiased context, both meanings of bugs
are plausible (relating to insects and relating to spying). The activation of each meaning is assessed using the reaction
time to a related word (ant or spy), compared with a control unrelated word (sew). In the biased context, only the
insect meaning is plausible by the time the homonym is heard.
that only one meaning is activated if the homonym more priming for the contextually appropriate mean-
has one particularly common meaning and the sen- ing than the inappropriate one. Therefore it seems that
tential context is strongly constraining towards that at least some interactive processing is likely in access-
meaning (Tabossi and Zardon, 1993). Lucas (1999) ing word meanings, although sentential context may
has also shown that studies demonstrating exhaustive only rule out inappropriate meanings in specific
access of ambiguous word meanings often still show circumstances.
SUMMARY OF SECTION 3
• The mental lexicon stores the meanings of words. Although the subject is contentious, it seems that
some words are broken down into smaller units called morphemes.
• A wide variety of information about the meaning of a word becomes available when a word is recog-
nized, including associative knowledge, pure semantic information, and perceptual features.
• For words with more than one meaning, the sentential context of the meaning can help select the
relevant meaning. This process is to some extent interactive.
4 SENTENCE COMPREHENSION
So far, language perception has largely been described was a little more productivity involved. That is, people
in terms of recognition processes. Up to the level of can recognize and make use of novel morphological
the lexicon, the job of the perceptual system is simply variants of familiar morphemes. So, for example, even
to allow recognition of familiar sequences (words or if the word polysemous was new to you when it was
morphemes) and retrieve stored knowledge relating mentioned in the previous section, you would proba-
to these items. When we discussed morphology, there bly find it quite easy to define its morphological
188 PART 2 CONCEPTS AND L ANGUAGE
relative, polysemy. However, when we get to the level intended. You might think of this process in terms of
of the sentence, the character of language perception building up a mental model of the information being
changes abruptly. Sentences are almost always new, in communicated (see Chapter 12 on reasoning). Accor-
that the same permutation of words has often never dingly, the listener or reader takes each word and
been encountered before. If perception at this level deduces its grammatical or syntactic role in the cur-
were still simply a recognition process, then we would rent sentence. Termed parsing, this process is the focus
completely fail to understand all but the most simple of the final section in this chapter.
or common sentences. The solution to this problem is
to treat sentence-processing not as a pure recognition
process but as a constructive process. When we read or 4.1 Syntax
hear a sentence, we take the individual components –
the words – and combine them to produce something Before embarking on a review of the models and data
that may be quite novel to us, but hopefully bears relevant to sentence processing, it is worth having a
some relationship to the message the speaker or writer quick look at linguistic views of language structure.
ACTIVIT Y 6. 3
Please read the following passages and sentences familiar as the opening line of the Star Trek series. You
and think about whether they seem grammatical to might be tempted to mark this down as being less
you. Give each one a rating from 1 to 10, where grammatical because it contains a famous example of
grammatical-sounding passages get high marks. a split infinitive: ‘to boldly go’. However, this kind of
(most likely mistaken) grammatical rule is not what
1 The most beautiful thing we can experience is the
cognitive psychologists are typically interested in; we
mysterious. It is the source of all true art and all
do not wish to dictate what the best or most eloquent
science. He to whom this emotion is a stranger,
way of speaking is, we simply wish to understand how
who can no longer pause to wonder and stand
people really speak. In these terms splitting the infini-
rapt in awe, is as good as dead: his eyes are closed.
tive is a perfectly acceptable and grammatical form of
2 Her five-year mission: to explore strange, new
language. Sentence 3 is not grammatical by most defi-
worlds; to seek out new life and new civilizations;
nitions, but if a two-year-old said it to you, you would
to boldly go where no man has gone before.
understand what they meant quite easily. Sentence 4 is
3 Please cup, gimme cup.
in some ways the opposite of Sentence 3, in that it
4 Colourless green ideas sleep furiously.
seems grammatical, yet meaningless. It was made
5 In become words sentence the rather have
famous by Noam Chomsky as an example of how syn-
jumbled this.
tax and semantics can be dissociable. Finally, Sentence
5 is clearly ungrammatical and pretty hard to extract
COM M ENT
any meaning from. After a while you may be able to
People have quite reliable intuitions about the gram-
work out that the sentence is a scrambled version of
maticality of sentences, despite often being unable to
‘The words in this sentence have become rather jum-
define exactly what makes a sentence grammatical.
bled’. It demonstrates just how important it is for us to
You probably gave the first two passages fairly high
have some mutually agreed conventions for word
ratings. Passage 1 is a quotation from Albert Einstein,
order, and this is precisely what syntax is!
and applies quite well to the study of syntax: mysteri-
ous but potentially very revealing! Passage 2 may be
CHAPTER 6 L ANGUAGE PROCESSING 189
Sentence
NP
The constraints of our vocal and auditory systems dic- out, because they would not form a grammatically
tate that words are uttered one by one in a serial fash- coherent sentence in their alternative roles, but in many
ion. However, according to many syntactic theories, cases full sentences can be interpreted in different
this serial transmission obscures what is actually a grammatically well-formed ways. Altmann (1998) gives
hierarchical structure. Figure 6.8 illustrates the kind of the example of the sentence ‘Time flies like an arrow’,
syntactic structure that might be assigned to a simple which has more than 50 grammatically permissible
sentence like ‘The girl spotted the yacht’. interpretations. For example, time appears to be acting
In this hierarchical analysis, each word is assigned a as a noun but it could also be used as a verb, as in to
syntactic role in the sentence. The broken lines mark ‘time an egg’. Similarly, flies is most obviously a verb, but
the links between each word and its role. These con- it could act as a plural noun – someone could time
stituents are then grouped into phrases according to some flies! Semantically, such an interpretation may
phrase structure rules, which are grammatical rules make little sense, but it could still be grammatical – just
of English that indicate how phrases can combine. At like Chomsky’s famous example (Sentence 4 in Activity
the highest level the phrases combine to form a sen- 6.3). In these cases we need to make use of more than
tence. The analysis of sentences using phrase struc- just syntactic knowledge to resolve the ambiguity. The
ture grammar offers a purely linguistic description, next section discusses how different models of parsing
but we can see how it might apply to human language cope with ambiguities of this type. All models assume
processing. On the perceptual side, we might think that we need to make use of multiple sources of infor-
parsing should involve taking each word in a sentence, mation, but they differ in terms of the priority of the
fleshing out its grammatical role and building a phrase different information types.
structure tree that fits the sentence. This would not in
itself recover the meaning of the sentence, but it would
assist in this process by facilitating the thematic role 4.2 Models of parsing
assignment for the sentence (i.e. identifying the fact
that the girl is the doer, that spotting is the activity she We found in Section 2.1 that the language system
is doing, and that the yacht is what she is doing it to!). makes good use of the short time it takes to say a word.
Parsing is made more difficult by the fact that, as As speech enters the perceptual system, the cohort of
mentioned earlier, many words can be used in different potential candidates is whittled down, ensuring mini-
grammatical roles. For example, the word spotted is mal delay in retrieving a word’s meaning. One can ask
used as a verb in Figure 6.8, but can be used as an adjec- the same question at the sentence level: does parsing
tive, as in a spotted dress. Equally, the noun yacht can be assign a syntactic structure only at major syntactic
used as a verb, as in to yacht around the world. In the boundaries (or even at the end of a sentence), or does
example sentence these alternative roles can be ruled it do so incrementally, refining the set of plausible
190 PART 2 CONCEPTS AND L ANGUAGE
syntactic structures every time a new word is recog- cases where the parse chosen at a point of ambiguity is
nized? It will not surprise you to learn that current incorrect (so the listener is ‘led down the garden
models of sentence processing assume that parsing is path’). Later in the sentence this incorrect selection
incremental, and again this makes sense in terms will become clear, causing some backtracking as an
of maximizing the availability of information for alternative interpretation is attempted. The idea of
responding to the sentence. There are numerous dem- pursuing some hypothesis and then reaching a dead-
onstrations of incremental processing, employing a end requiring re-analysis fits in with people’s intui-
wide range of methods – an early example is the study tions about how they interpret some sentences. A
of Tyler and Marslen-Wilson (1977). They made use famous example of ‘garden pathing’ is the sentence:
of ambiguous phrases such as landing planes. With a ‘The horse raced past the barn fell’ (Bever, 1970). As
preceding context such as ‘If you walk too near the you read this sentence, you may have had problems
runway, . . .’ the natural interpretation of landing is as integrating the final word. Some people think that
an adjective (e.g. ‘landing planes are dangerous’ would maybe there is an ‘and’ missing between barn and fell,
be a suitable continuation), whereas following ‘If or that there is a comma missing between past and the.
you’ve been trained as a pilot, . . .’ the interpretation is But there is an alternative interpretation, which is a
more likely to be as a verb (e.g. ‘landing planes is reduced version of ‘The horse that was raced past the
easy’). Tyler and Marslen-Wilson wanted to know barn fell’. According to the garden path model, this
whether listeners showed a contextual bias in their alternative is not chosen when the word raced is first
parsing of the ambiguous phrase. If parsing is delayed perceived, leading to trouble with interpretation later
until a syntactic boundary is reached, then there in the sentence.
should have been no effect of preceding context on The garden path model makes use of a set of guid-
listeners’ expectations about whether the word fol- ing principles that specify which parse should be
lowing landing planes was either is or are. They gauged selected in the case of syntactic ambiguities, and these
listeners’ expectations by presenting spoken frag- principles involve only syntactic information. The
ments such as ‘If you’ve been trained as a pilot, land- details of these principles are not essential – it is more
ing planes . . .’ to participants and asking them to important to keep in mind that the garden path model
name a visual target word (either is or are in this case). assumes a serial parser that maintains only one poten-
They found that the speed of a naming response tial parse of a sentence at a time, and has an autono-
depended on the preceding context of the ambiguous mous component in that the initial evaluation of a
phrase. Appropriate continuations were named word’s role in a sentence is based only on syntactic fac-
quickly, compared with inappropriate ones. This is tors. In direct contrast, constraint-based models (e.g.
incompatible with the ‘delayed parsing’ hypothesis, MacDonald et al., 1994) assume that parsing is parallel
because such a model predicts no effect of appropri- and interactive. So rather than maintaining a single
ateness. Instead it fits in with the idea that a plausible syntactic analysis, these models allow more than one
parse of a sentence is built up incrementally, and this potential parse of a sentence to be evaluated at the
influences expectations about upcoming words. same time (just as the cohort model of word recogni-
One of the most influential models of parsing, often tion evaluates numerous candidates for word identifi-
known as the garden path model (Frazier, 1979), cation). Constraint-based models are thought of as
assumes that parsing is incremental, so each word is interactive because they eliminate the autonomous
allocated a syntactic role as soon as it is perceived. In stage of parsing assumed by the garden path model.
cases where more than one syntactic structure is com- Instead other factors, such as frequency and semantic
patible with the sentence so far, the parser makes a plausibility, can influence parsing immediately.
decision about which alternative to pursue based on MacDonald et al.’s model also increases the involve-
syntactic information alone. The ‘garden path’ element ment of the lexicon in the parsing process, by assum-
comes in because the model predicts that there will be ing that some information about how a word can
CHAPTER 6 L ANGUAGE PROCESSING 191
combine with other words is stored in the lexicon. By interpretation. So if the sentence continuation is in
this kind of account, parsing becomes a bit like fitting fact a reduced relative structure, the Frazier model
the pieces of a jigsaw together. Each piece contains predicts a garden path effect when the true structure
information about a word, including the kinds of syn- of the sentence becomes clear. So when a reader
tactic context the word could fit into, and parsing encounters ‘The defendant examined by the lawyer
involves fitting all the pieces together so that the words turned out to be unreliable’ they should show evi-
form a coherent sentence. dence of processing difficulty. This is exactly what
The two models described here are by no means the Ferreira and Clifton found, using the eye-tracking
only models of parsing that researchers currently con- methodology – people tended to fixate on the region
sider, but they do mark out the kinds of properties that just after the ambiguity, suggesting that they were
generate debate in this area, and they highlight the having trouble incorporating the new information
kinds of questions that we need to investigate through into their initially selected parse of the sentence.
experimentation. First and foremost among these, we The critical question here was whether the meaning
need to try to address the question of whether parsing of the word preceding the ambiguous verb could affect
is autonomous, or whether it makes use of non- the garden path effect. So Ferreira and Clifton com-
syntactic sources of information stored in the lexicon. pared sentences like the one above to sentences like
‘The evidence examined by the lawyer turned out to
be unreliable’. In this case evidence is inanimate, which
4.3 Is parsing autonomous? reduces the plausibility of the main verb interpreta-
tion (i.e. it seems unlikely that the evidence would
As we have seen, the garden path model makes the examine anything). Despite the semantic bias towards
strong prediction that the initial syntactic analysis of a the alternative reading, the garden path effect
word is unaffected by factors such as the meaning of remained (i.e. fixation times remained long). On the
the preceding context or the meaning of the words. In surface, this seems like sound support for the auton-
essence, the model puts all aspects of semantics aside omy assumed by the garden path model.
until a word has been assigned a syntactic role. Initial However, Trueswell et al. (1994) noticed that some
data on the resolution of syntactic ambiguity showed of the contexts used by Ferreira and Clifton were less
garden path effects fully consistent with the autono- constraining than the example above. It is difficult to
mous approach of Frazier’s model. In addition, some imagine a situation in which evidence could examine
experiments designed specifically to look for semantic something, but Trueswell et al. argued that this was
influences on syntactic ambiguity resolution found not the case for about half the materials used in the
none. Ferreira and Clifton (1986) investigated how original experiment (e.g. ‘the car towed . . .’ where car
readers interpret verbs in phrases such as ‘The defend- is inanimate, but still quite a plausible candidate for
ant examined . . .’. Before you read on, think about something that tows). They ran another eye-tracking
how you might continue this sentence fragment. experiment using a similar design but with more con-
There are two common roles that ‘examined’ can play straining semantic contexts, and found that these
in this context. It could simply be the main verb of the contexts could lessen or even eliminate the garden
sentence, as in ‘The defendant examined his hands’. path effect. The results of this and other similar stud-
But it could also form part of what is known as a ies are important because they show that, in some cir-
reduced relative clause. A relative clause might be cumstances, the parsing system can be strongly
‘The defendant that was examined by the lawyer . . .’, affected by the semantic plausibility of the various
and the reduced form would simply be the same but parses of the system. The garden path model could
with ‘that was’ eliminated. The garden path model perhaps be saved if it is assumed that the autonomous
states that the preferred structure when examined is parsing component lasts only a short time, and that
encountered is the more straightforward main verb other factors come into play soon afterwards, but this
192 PART 2 CONCEPTS AND L ANGUAGE
greatly weakens the predictive power of the model, different sentences, and apply this knowledge in cases
because it becomes harder to distinguish from models of ambiguity.
that allow semantic factors to play a stronger role. Perhaps the most striking example of a contextual
However, it is worth remembering that Frazier’s syn- influence on syntactic processing is based on the use of
tactic constraints are not rendered immaterial by the visual information. Tanenhaus et al. (1995) wanted to
finding that parsing is influenced by semantic plausi- know whether the visual context of a sentence would
bility. Instead, syntactic constraints appear to operate affect the interpretation of syntactic ambiguities. In
in combination with other constraints, with the ulti- order to test this, they sat participants at a table on
mate goal being to weigh up the likelihood of different which some objects like apples and towels were placed
parses of a sentence in cases of ambiguity. and gave them instructions to move the objects, such
as ‘Put the apple on the towel in the box’. The partici-
pants wore head-mounted eye trackers so that the
4.4 Constraints on parsing experimenters could monitor eye movements as the
sentences were heard (see Box 6.2 in Section 2.2.3).
It seems that the parsing system can be influenced by The sentences had a temporary syntactic ambiguity,
quite a number of different factors when it encounters which in the case of the example here involves the
an ambiguity. When a sentence is spoken, there is often phrase ‘on the towel’. We know from studies like
useful information in the rhythm of the sentence. Think Ferreira and Clifton (1986) that when people hear ‘Put
about how you might say the sentence ‘Jane hit the man the apple on the towel . . .’ they tend to interpret ‘on the
with the hammer’ in the cases where (a) the man has a towel’ as the desired destination of the apple. But the
hammer, or (b) Jane has a hammer. One way to distin- continuation ‘. . . in the box’ should force a reassess-
guish between these two possibilities is by changing ment of the sentence (i.e. the sentence is a reduced
your speech rate mid-sentence, so that different sets of form of ‘Put the apple that’s on the towel in the box’).
words are grouped together. Of course these changes We have seen that various sentential factors such as
will be exaggerated when the speaker is aware of the semantic plausibility can reduce or eliminate this gar-
potential ambiguity, but even in normal speech, the den path effect, but what about external, environmen-
speaker can reduce ambiguity with changes in pitch and tal context? Tanenhaus et al. (1995) gave the
timing, and the listener can make use of this informa- participants instructions in two types of external con-
tion (Warren, 1996). At a very different level, informa- text (see Figure 6.9). In one case (see Figure 6.9(a)),
tion about how often words are used in different there was an apple on a towel, another towel, and a
syntactic structures can also influence the parsing pro- box. This context supports the initial interpretation of
cess. This factor can be seen at work in the earlier exam- ‘on the towel’ as referring to the destination, so people
ple from Bever (1970), ‘The horse raced past the barn tended to look at the apple and then at the empty
fell’. One of the reasons this sentence causes so many towel, and only looked at the true intended destination
problems is because the verb race is rarely used as a past once the disambiguating speech (‘in the box’) was
participle (i.e. as in ‘the horse that was raced . . .’). Not heard. However, when the scene also included a sec-
all verbs have this strong bias; for example released has ond apple on a napkin (see Figure 6.9(b)), participants’
the opposite bias – it is more likely to be used as a past eye movements were quite different. Now when they
participle (e.g. ‘The hostage was released’) than as a past heard ‘on the towel’, they rarely looked at the empty
tense of a main verb (e.g. ‘The government released a towel, because they interpreted ‘on the towel’ as distin-
press statement’). Trueswell (1996) showed that this guishing information between the two apples (one was
lexical frequency factor also influences the way in on a towel and one on a napkin). In other words, the
which sentences are parsed. People seem to be able to environmental situation provided a source of informa-
keep track of the ways in which words are used in tion that could eliminate the garden path effect.
CHAPTER 6 L ANGUAGE PROCESSING 193
A B
+ +
C
D
A
(a) (b)
FIGU RE 6 .9 Two visual contexts from Tanenhaus et al. (1995) showing the typical sequence of eye movements in
response to the ambiguous instruction ‘Put the apple on the towel in the box’. Eye fixations began at the central cross,
and continued in the sequence indicated by the capital letters. Source: based on Tanenhaus et al., 1995, Figures 1 and 2
SUMMARY OF SECTION 4
• Understanding a sentence requires a parsing process in which each word is assigned a grammatical
role.
• The garden path model assumes that the parser operates autonomously, without any influence of
non-syntactic factors.
• Recent studies of syntactic ambiguity resolution suggest that a variety of different constraints can
influence parsing, including even the environment of the listener.
5 CONCLUSION
This chapter has provided a brief account of some of sub-systems. So reading a word engages processes and
the main components of the language system, particu- representations related to speech perception, and the
larly with reference to recognizing words and under- way in which you process a spoken sentence can be
standing sentences. We have seen that many of the influenced by the real world context in which you hear
processes involved can be modelled in terms of com- it. This interconnectedness may well reflect two aspects
petition between multiple candidates, implying that of language processing: the complexity of language, and
the language system is busy evaluating countless the speed with which we need to communicate. In
hypotheses about an utterance at numerous levels at terms of language development, it makes a lot of sense
any moment in time. Thankfully we remain blissfully to reuse existing mechanisms when we are trying to add
unaware of these operations, with only a pretty terse a new mechanism such as the mechanism for reading.
‘executive summary’ of the process available to con- In terms of adult language processing, it makes sense to
scious awareness. call on as much useful information as possible to mini-
Another recurring theme has involved the extent to mize the time it takes to comprehend a sentence.
which components of the system operate indepen-
dently of each other. There is a long way to go in this Answer to Activity 6.1
debate, but the current state of play seems to be one The approximate word boundary positions are marked
in which there is a surprising level of linkage between in Figure 6.10, along with the words themselves. Some
194 PART 2 CONCEPTS AND L ANGUAGE
gaps in the speech (low amplitude signal) are aligned periods of silence are poor indicators of word bounda-
with word boundaries (e.g. between quite and care- ries, meaning that we have to find better ways to seg-
fully, marked with a tick), whereas others are not (e.g. ment speech.
within spoken, marked with a cross). In general, short
FURTHER READING
Altmann, G.T.M. (2001) ‘The language machine: psycho- as additional topics such as first and second language acquisition
linguistics in review’, British Journal of Psychology, vol.92, and language production that are not covered in this chapter.
pp.129–70. A comprehensive review of the field of psycholin- McQueen, J. (1996) ‘Word spotting’, Language and
guistics. Cognitive Processes, vol.11, no.6, pp.695–9. A very accessible
Harley, T. (2008) The Psychology of Language: From Data to overview of the wordspotting task, highlighting key studies that
Theory, Hove, Psychology Press. An up-to-date and readable have used this task, as well as discussing the advantages and limita-
overview of language processing. Topics covered include spoken tions of using wordspotting to study speech segmentation and
and visual word recognition and sentence comprehension, as well lexical access.
REFERENCES
Altmann, G.T.M. (1998) ‘Ambiguity in sentence processing’, Chéreau, C., Gaskell, M.G., and Dumay, N. (2007) ‘Reading
Trends in Cognitive Sciences, vol.2, no.4, pp.146–52. spoken words: orthographic effects in auditory priming’,
Berko, J. (1958) ‘The child’s learning of English morphol- Cognition, vol.102, pp.341–60.
ogy’, Word, vol.14, no.2, pp.150–77. Collins, A.M. and Loftus, E.F. (1975) ‘A spreading-activa-
Bever, T.G. (1970) ‘The cognitive basis for linguistic struc- tion theory of semantic processing’, Psychological Review,
tures’, in Hayes, J. (ed.) Cognition and the Development of vol.82, no.6, pp.407–28.
Language, New York, Wiley. Coltheart, M., Rastle, K., Perry, C., Langdon, R., and Ziegler,
Bowers, J.S., Davis, C.J., Mattys, S.L., Damian, M.F., and J. (2001) ‘DRC: a dual route cascaded model of visual word rec-
Hanley, D. (2009) ‘The activation of embedded words in spo- ognition and reading aloud’, Psychological Review, vol.108, no.1,
ken word identification is robust but constrained: evidence pp.204–56.
from the picture-word interference paradigm’, Journal of Cunillera, T., Càmara, E., Laine, M., and Rodríguez-Fornells,
Experimental Psychology: Human Perception and Performance, A. (2010) ‘Words as anchors: known words facilitate statistical
vol.35, no.5, pp.1585–97. learning’, Experimental Psychology, vol.57, no.2, pp.134–41.
CHAPTER 6 L ANGUAGE PROCESSING 195
Cutler, A. and Carter, D.M. (1987) ‘The predominance of Marslen-Wilson, W.D. and Welsh, A. (1978) ‘Processing
strong initial syllables in the English vocabulary’, Computer interactions and lexical access during word recognition in con-
Speech and Language, vol.2, no.2, pp.133–42. tinuous speech’, Cognitive Psychology, vol.10, no.1, pp.29–63.
Cutler, A. and Norris, D. (1988) ‘The role of strong syllables Marslen-Wilson, W.D., Tyler, L.K., Waksler, R., and Older,
in segmentation for lexical access’, Journal of Experimental L. (1994) ‘Morphology and meaning in the English mental
Psychology, Human Perception and Performance, vol.14, no.1, lexicon’, Psychological Review, vol.101, no.1, pp.3–33.
pp.113–21. Masson, M.E.J. (1995) ‘A distributed memory model of
Cutler, A. and Otake, T. (2002) ‘Rhythmic categories in semantic priming’, Journal of Experimental Psychology:
spoken-word recognition’, Journal of Memory and Language, Learning, Memory and Cognition, vol.21, no.1, pp.3–23.
vol.46, no.2, pp.296–322. McClelland, J.L. and Elman, J.L. (1986) ‘The TRACE model
Ferreira, F. and Clifton, C. (1986) ‘The independence of of speech perception’, Cognitive Psychology, vol.18, no.1, pp.1–86.
syntactic processing’, Journal of Memory and Language, vol.25, McClelland, J.L. and Rumelhart, D.E. (1981) ‘An interactive
no.3, pp.348–68. activation model of context effects in letter perception. Part 1:
Frazier, L. (1979) On Comprehending Sentences: Syntactic an account of basic findings’, Psychological Review, vol.88,
Parsing Strategies, Bloomington, IN, Indiana University no.3, pp.375–407.
Linguistics Club. McConkie, G.W. and Rayner, K. (1975) ‘The span of the
Gaskell, M.G. and Marslen-Wilson, W.D. (2002) effective stimulus during a fixation in reading’, Perception and
‘Representation and competition in the perception of spoken Psychophysics, vol.17, no.6, pp.578–86.
words’, Cognitive Psychology, vol.45, no.2, pp.220–66. McQueen, J.M., Norris, D., and Cutler, A. (1994)
Glushko, R.J. (1979) ‘The organization and activation of ‘Competition in spoken word recognition – spotting words in
orthographic knowledge in reading aloud’, Journal of other words’, Journal of Experimental Psychology: Learning,
Experimental Psychology: Human Perception and Performance, Memory and Cognition, vol.20, no.3, pp.621–38.
vol.5, no.4, pp.674–91. Nelson, D.L., McEvoy, C.L., and Schreiber, T.A. (1998) The
Grainger, J. and Jacobs, A.M. (1994) ‘A dual read-out model University of South Florida Word Association, Rhyme, and
of word context effects in letter perception – further investiga- Word Fragment Norm [online]. Available from http://w3.usf.
tions of the word superiority effect’, Journal of Experimental edu/FreeAssociation (accessed 19 January 2004).
Psychology: Human Perception and Performance, vol.20, no.6, Norris, D., McQueen, J.M., and Cutler, A. (2000) ‘Merging
pp.1158–76. information in speech recognition: feedback is never neces-
Hauser, M.D., Newport, E.L., and Aslin, R.N. (2001) sary’, Behavioral and Brain Sciences, vol.23, no.3, pp.299–370.
‘Segmentation of the speech stream in a non-human primate: O’Regan, J.K. and Jacobs, A.M. (1992) ‘Optimal viewing
statistical learning in cotton-top tamarins’, Cognition, vol.78, position effect in word recognition – a challenge to current
no.3, B53–B64. theory’, Journal of Experimental Psychology: Human Perception
Kellenbach, M.L., Wijers, A.A., and Mulder, G. (2000) and Performance, vol.18, no.1, pp.185–97.
‘Visual semantic features are activated during the processing Rastle, K., Davis, M.H., and New, B. (2004) ‘The broth in my
of concrete words: event-related potential evidence for per- brother’s brothel: morpho-orthographic segmentation in vis-
ceptual semantic priming’, Cognitive Brain Research, vol.10, ual word recognition’, Psychonomic Bulletin & Review, vol.11,
no.1–2, pp.67–75. no.6, pp.1090–8.
Kutas, M. and Hillyard, S.A. (1980) ‘Reading senseless sen- Rayner, K. and Duffy, S.A. (1986) ‘Lexical complexity and
tences: brain potentials reflect semantic incongruity’, Science, fixation times in reading – effects of word-frequency, verb
vol.207, no.4427, pp.203–5. complexity, and lexical ambiguity’, Memory and Cognition,
Lucas, M. (1999) ‘Context effects in lexical access: a meta- vol.14, no.3, pp.191–201.
analysis’, Memory and Cognition, vol.27, no.3, pp.385–98. Rodd, J., Gaskell, G., and Marslen-Wilson, W. (2002) ‘Making
Lucas, M. (2000) ‘Semantic priming without association: a sense of semantic ambiguity: semantic competition in lexical
meta-analytic review’, Psychonomic Bulletin and Review, vol.7, access’, Journal of Memory and Language, vol.46, no.2, pp.245–66.
no.4, pp.618–30. Saffran, J.R., Aslin, R.N., and Newport, E.L. (1996)
MacDonald, M.C., Pearlmutter, N.J., and Seidenberg, M.S. ‘Statistical learning by 8-month-old infants’, Science, vol.274,
(1994) ‘Lexical nature of syntactic ambiguity resolution’, no.5294, pp.1926–8.
Psychological Review, vol.101, no.4, pp.676–703. Saffran, J.R., Johnson, E.K., Aslin, R.N., and Newport, E.L.
Marslen-Wilson, W.D. (1987) ‘Functional parallelism in (1999) ‘Statistical learning of tone sequences by human infants
spoken word recognition’, Cognition, vol.25, no.1, pp.71–102. and adults’, Cognition, vol.70, no.1, pp.27–52.
196 PART 2 CONCEPTS AND L ANGUAGE
Seidenberg, M.S. and McClelland, J.L. (1989) ‘A distrib- Tanenhaus, M.K., Spivey-Knowlton, M.J., Eberhard, K.M.,
uted, developmental model of word recognition and naming’, and Sedivy, J.C. (1995) ‘Integration of visual and linguistic
Psychological Review, vol.96, no.3, pp.523–68. information in spoken language comprehension’, Science,
Seidenberg, M.S. and Tanenhaus, M.K. (1979) ‘Orthographic vol.268, no.5217, pp.1632–4.
effects on rhyme monitoring’, Journal of Experimental Trueswell, J.C. (1996) ‘The role of lexical frequency in syn-
Psychology: Human Learning and Memory, vol.5, pp.546–54. tactic ambiguity resolution’, Journal of Memory and Language,
Shillcock, R., Ellison, T.M., and Monaghan, P. (2000) ‘Eye- vol.35, no.4, pp.566–85.
fixation behavior, lexical storage, and visual word recognition Trueswell, J.C., Tanenhaus, M.K., and Garnsey, S.M. (1994)
in a split processing model’, Psychological Review, vol.107, ‘Semantic influences on parsing – use of thematic role infor-
no.4, pp.824–51. mation in syntactic ambiguity resolution’, Journal of Memory
Starr, M. and Rayner, K. (2001) ‘Eye movements during read- and Language, vol.33, no.3, pp.285–318.
ing: some current controversies’, Trends in Cognitive Sciences, Tyler, L.K. and Marslen-Wilson, W.D. (1977) ‘The on-line
vol.5, no.4, pp.156–63. effects of semantic context on syntactic processing’, Journal of
Swinney, D.A. (1979) ‘Lexical access during sentence com- Verbal Learning and Verbal Behavior, vol.16, no.6, pp.683–92.
prehension: (re)consideration of context effects’, Journal of Van Orden, G.C. (1987) ‘A rows is a rose – spelling, sound,
Verbal Learning and Verbal Behavior, vol.18, no.5, pp.645–59. and reading’, Memory and Cognition, vol.15, no.3, pp.181–98.
Tabossi, P. and Zardon, F. (1993) ‘Processing ambiguous Van Petten, C. and Kutas, M. (1987) ‘Ambiguous words in
words in context’, Journal of Memory and Language, vol.32, context – an event-related potential analysis of the time course
no.3, pp.359–72. of meaning activation’, Journal of Memory and Language,
Taft, M. and Forster, K.I. (1975) ‘Lexical storage and vol.26, no.2, pp.188–208.
retrieval of prefixed words’, Journal of Verbal Learning and Warren, P. (1996) ‘Prosody and parsing: an introduction’,
Verbal Behavior, vol.14, no.6, pp.638–47. Language and Cognitive Processes, vol.11, no.1–2, pp.1–16.
L ANG UAG E
IN AC TION
Simon Garrod and Tony Sanford
1 INTRODUCTION
In the previous chapter we saw how language compre- Most often it is through monologue, in which there is no
hension can be viewed as a translation process. The interaction between the writer and the reader, as when
process starts with patterns of sounds or letters and you write an essay or read a newspaper article. But
then translates them into increasingly large and more increasingly even written communication is becoming
abstract units – words, phrases, and sentences – until interactive. Consider, for instance, exchanging text mes-
the reader or listener eventually arrives at the mean- sages with a friend or taking part in a live ‘chat’ conversa-
ing. However, this view of language processing does tion on your computer. Whether it is through speech or
not take into account how language is used in every- writing, communication is perhaps the most important
day settings and how this affects processing. Here we social, cultural, and cognitive activity that we engage in,
go beyond the model of the previous chapter to look at so understanding how we use language to communicate
language in action and how language comprehension is central to the study of human cognition.
and language production reflect the different circum- Although it can easily be argued that spoken lan-
stances under which the language is being used. guage and in particular dialogue is the more natural
Language is used primarily for verbal communica- form of language use, we begin this chapter with a
tion and most often through speech rather than writing. look at research on written language, and only then
From the moment you get up in the morning until you proceed to dialogue. This sequence reflects the history
finally fall asleep at night you will be speaking to some- of experimental research on the psychology of lan-
one or other almost every minute of the day. guage. Much more research has been done on written
Furthermore, when you do this you are nearly always language comprehension than on dialogue, and the
engaging in a dialogue, in which one or more people findings of this research illustrate important features
interact directly with you and with each other. Of course, of language in action that take us beyond the simple
you can also use written language to communicate. translation metaphor discussed above.
198 PART 2 CONCEPTS AND L ANGUAGE
One way in which written language comprehension than it seemed in the previous chapter. The precise
takes us beyond the translation metaphor is that it interpretation of any real piece of language calls upon a
requires the integration of information across different wide range of different sources of information, includ-
sentences in a text. As we see below, a key aspect of this ing our knowledge of the situation under discussion.
integration is that it depends upon access to non-lin- We begin by defining what is meant by text and
guistic background knowledge. To this extent language then consider what this means for text processing.
processing in this broader sense is less ‘encapsulated’
lend the money, his being hard up in (2’”) is taken as Discourse-as-Product view (the coherence is in the
an obstacle to Bill lending the money. text alone) with Discourse-as-Process, where the
So, collections of sentences become texts through coherence comes from mental processes called upon
the links that bind them together into a coherent to interpret the text. The second view leads us natu-
structure. Some of the links are explicitly signalled rally to psychological investigations of interpretation,
through cohesion markers, such as pronouns or sen- and how the mind adds to what is in the text.
tence connectives like but, therefore, and however,
whereas other links depend upon inferring the logical
or psychological relationships between the events por-
trayed. Besides reference, there are many other sources
2.1Processes underlying text
of linkage. For instance, in narrative text there have to interpretation
be temporal links that order the events in the story. In
simple cases these are signalled with explicit temporal Much research on language comprehension is con-
expressions as in the following short passage: cerned with how the comprehension process operates
in real time: when each of the sub-operations occur
(3) Yesterday Mary visited (e1) her grandmother.
that eventually lead to a coherent understanding of
Later, she stopped (e2) at a shop to buy some flowers.
the text. Here we shall concentrate on just four issues,
(e1 and e2 denote events)
each of which concerns the establishment of coher-
Here the events are explicitly ordered through the tem- ence, and extracting the meaning of discourse beyond
poral cohesion device later. So event e1 precedes event just the meaning of the words it contains.
e2. But again, ordering often comes from establishing a
coherent chain of events. For instance, in the following 2.1.1 Anaphora resolution
variant the ‘visiting’ and the ‘stopping at the shop’ are As we have already seen, anaphora is crucial to text
interpreted as occurring in the opposite order: cohesion. So it is not surprising that how we resolve
anaphors during comprehension is one of the most-
(4) Yesterday Mary visited (e2) her grandmother. She
studied components of text comprehension
stopped (e1) at a shop to buy some flowers. She then
(Garnham, 2001). When reading a text, it is important
went and presented them to her as a gift for her eight-
to keep track of who is doing what and when. For
ieth birthday.
instance, given the passage in Box 7.1, we need to
So temporal cohesion, like referential cohesion, often know what John did and what William did.
depends upon the coherence of the passage as a whole. Right until the last sentence, every time we encoun-
Examples like those above where there is no explicit ter he, we interpret it as standing for John (it is an
marker to indicate how the sentences relate to each anaphor for John). He does not stand for Mary because
other show that the coherence of a discourse is in the Mary is female, and he specifies a singular and male
mind of the reader. In all of the examples above the antecedent. There is no ambiguity, and we might sup-
reader uses general knowledge to make a coherent pose that the language processor checks to see what he
connection. Brown and Yule (1983) contrast the stands for as soon as he is encountered. John is the
We shall use this example to discuss a number of had, he was going to buy some new CDs. On the way to
processing issues throughout this chapter. the shop, he bumped into William. He found out William
John went to the shops with Mary. She went off to buy hadn’t had any lunch that day. John lent William some
clothes, and he went to the bank. With the money he money because he was hard up.
200 PART 2 CONCEPTS AND L ANGUAGE
main character in the story, being mentioned often, does (causing longer initial fixations, or causing an
and so even when a new male individual turns up, increase in regressive eye-movements), then one can
there is a preference to equate he with John. conclude that the word’s meaning is being used at that
In the last sentence of the text in Box 7.1, something point.
different happens. Here he stands for William. The Traxler and Pickering (1996) compared how people
new pronoun assignment works because the reader read materials like (5) and (6) below:
can use his or her knowledge to disambiguate the pro-
(5) That’s the pistol with which the man shot the
noun. As we saw earlier, the reader can assume that
gangster yesterday afternoon.
people who have money are in a position to lend, and
people who are hard up need money. So, putting these (6) That’s the garage with which the man shot the
facts together with what the text says enables the pro- gangster yesterday afternoon.
cessor to resolve he as referring to William.
In this hypothetical analysis, we can see several The word shot fits sentence (5) in meaning, but not
potential sources of information that the comprehen- sentence (6). Participants read sentences of this type
sion system might use to resolve pronoun-based (pro- while having their eye-movements monitored. Traxler
nominal) anaphora: and Pickering found that the very first fixations on the
word shot were longer in the implausible cases, like
• Gender cues in the pronouns. Apart from gender
(6), than in the plausible cases, like (5). So, the mean-
marking (he versus she), we also have animacy
ing of shot must have been accessed, and incorporated
marking (he, she vs it) and reflexivity (he versus
into the meaning of the sentences as a whole, as soon
himself, she versus herself).
as the word was fixated. Results such as these are con-
• Main character versus secondary character (or sistent with what is called incremental interpretation,
continued reference to one character). a view of discourse comprehension that says each
• General knowledge, e.g. people with X can give X, word is interpreted and incorporated into the mean-
while people without can’t. People without X might ing of the sentence as soon as it is encountered. See
want X, etc. These properties form a very large set Chapter 6 for related work that investigates accessing
of general knowledge beliefs. word meaning.
These are just some of the cues that are known to sup- 2.1.3 Non-literal meaning
port anaphora resolution. A full discussion of anaph- The immediacy of processing observed in the studies
ora from a psychological standpoint is given in above is consistent with what one might term the ‘stand-
Garnham (2001). ard view’ of text understanding. In this view, as words
are encountered, their meanings are retrieved from
2.1.2 When word-meaning is used long-term (semantic) memory. As the sentence unfolds,
The text in Box 7.1 illustrates other problems that psy- the syntactic structure is derived, and the meanings of
cholinguists have worked on intensively. One is the the words are then combined to give a sentence mean-
question of when word meaning enters into the compre- ing. However, there are several problems with this view.
hension process. A useful technique for studying when One is the problem of non-literal meaning. Consider the
meaning may be accessed is to track a person’s eye- sentence, John asked the man if he could tell him the time.
movements during reading, as described in Chapter 6. Although Can you tell me the time? is a literal question
A good way of investigating when word meaning is (to which the answer is ‘yes’ or ‘no’), the interpretation
accessed is to insert into the text a word that is not given is as a request (Tell me what the time is, please).
appropriate, or anomalous, and see if it disturbs the pat- These are known as indirect speech acts. How do people
tern of eye-movements as soon as it is encountered. If it get the correct interpretation? The standard account
CHAPTER 7 L ANGUAGE IN ACTION 201
(Searle, 1980) has the following steps (Glucksberg and think of your own examples of such things, and they
Keysar, 1990): provide a challenge for any view that says sentence
meaning is based on the literal meanings of words.
• Derive a literal interpretation.
• Assess that interpretation against the context of the 2.1.4 Inferences
utterance. We have seen that general knowledge is needed to
• If (and only if) literal meaning is a poor fit, derive understand texts. The processes that give rise to coher-
a non-literal interpretation. ence are known as inference-making. In psycholinguis-
tics, a distinction has been drawn between necessary
This suggests that indirect speech acts should take inferences and elaborative inferences. Here is a case
longer to process than direct speech acts (e.g. questions where a necessary inference allows interpretation:
that are in fact questions and not indirect requests).
Certainly for some cases the model is wrong, because (10) Mary got some picnic things out of the car. The
the indirect cases are processed just as quickly as the beer was warm.
direct cases (e.g. Gibbs, 1983). Now look at the follow- (11) Mary got some beer out of the car. The beer was
ing sentence from Box 7.1: On the way to the shop, he warm.
bumped into William. This is interpreted as John meet-
ing William, probably unexpectedly, and not actually The inference in (10) is that the beer is part of the pic-
colliding with him. It requires non-literal interpreta- nic things, and so came out of the car. Haviland and
tion. Now according to the model above, a statement Clark (1974) were the first to show that such inferences
will only get a non-literal interpretation if it is needed. take time. Using self-paced reading, they showed that
Glucksberg et al. (1982) showed that non-literal inter- the reading time for the second sentence was longer by
pretations may be given when they are not needed, some 100 ms for example (10), where beer hadn’t been
suggesting that they are automatically derived. They mentioned before, than for (11), where it had. The
asked participants to decide whether statements were extra time is the time to form the inference beer is part
literally true, for instance, Some desks are junkyards. of the picnic things, which forms a link, or bridge, and is
What they showed was that the time to answer ‘no’ was sometimes called a bridging inference. Unless the infer-
longer in such cases than in the case of literally false ence had been drawn, there would be no way in which
statements with no metaphoric interpretation, such as the two sentences could be sensibly connected – it
Some desks are roads. They suggest that this is because would not be a coherent discourse. That is why such
the non-literal meaning is highly available from mem- inferences are called necessary.
ory, and so it intrudes in the ‘true’ judgement, leading Elaborative inferences refer to inferences that are
to longer times to decide that it is not literally true. not strictly necessary. Consider (12) below:
It might be thought that such cases are rare, but
(12) Unable to control his rage, the angry husband
they are not. In particular, Lakoff (1987) has provided
threw the valuable porcelain vase at the wall.
numerous examples of metaphors used in everyday
language. Here are a few: Did you make the inference that the vase broke? It is
certainly a plausible inference, as are several others,
(7) When John heard about his wife, he exploded. like he was having a row with his wife, for instance.
(8) When it came to chemistry, Fred was a little rusty. Such inferences are not necessary for understanding
(9) It is morally right to fight poverty. the sentence. In fact they are defeasible (can be can-
celled). For instance, if you read He missed and the
Thinking about the literal meaning of these sentences vase landed on the sofa you would have to cancel your
quickly shows that they are metaphorical. It is easy to inference that the vase broke. Research into whether
202 PART 2 CONCEPTS AND L ANGUAGE
elaborative inferences are made has been carried out (15) The court case was going badly for the defend-
by using a variety of priming techniques, such as ant. He could see that the judge had no time for him.
showing the word ‘broke’ after (12). If it is primed in a
lexical decision task, then that would suggest that the Encountering the judge for the first time causes no dif-
inference had been made. The evidence suggests that ficulty, taking no more time to process than if the
elaborative inferences are not made routinely judge had been mentioned explicitly (see Sanford and
(McKoon and Ratcliff, 1992), but it remains to be Garrod, 1998, for further details). These examples
shown exactly what the conditions are under which show how language accesses information in memory
they are and are not made. that represents situations and settings, containing
information about what to expect to be present at a
2.1.5 Relating language to knowledge court case, for instance. Precisely how situational
Almost all of the processes discussed above show how information is represented has been a considerable
world-knowledge is needed to interpret the signifi- area of enquiry. Recently, one intriguing idea is that
cance of what is being said in a text. This leads to a understanding relies on representations that are liter-
variety of questions concerning the text-knowledge ally of how our bodies interact with the world. This is
interface. One very important concept is that under- quickly becoming a key issue in how understanding
standing depends upon the reader setting up a mental works, and what meaning really is.
model of what the text is depicting. Look at texts (13)
and (14): 2.1.6 Knowledge, meaning, and embodiment
In the traditional view of language processing, con-
(13) Harry put the wallpaper on the table. Then he
cepts are treated in an abstract way. Indeed, the mean-
sat his cup on it.
ings of words are commonly thought of as being
(14) Harry put the wallpaper on the wall. Then he sat represented as mental lists or networks of attributes
his cup on it. (see Section 3 on the mental lexicon in Chapter 6).
According to this view, language conveys meaning by
Example (14) sounds odd because when wallpaper is using abstract words, combined by syntactic rules
on the wall it is in a vertical plane and would not sup- (e.g. Fodor, 2000; Kintsch, 1988; Pinker, 1994).
port a cup. If you noticed this, which you will have, However, an alternative view has been emerging, in
then this means you produced a mental model of what which meaning is rooted in perception and bodily
the first sentence meant in relation to the real world, action – literally, in how we interact with the world.
and when you integrated the second sentence, there One motivation behind this embodiment view of
was a problem. Approaches to language understand- meaning comes from what has been called the symbol
ing all include some reference to how world-knowl- grounding problem. Harnad (1990) illustrates the
edge is involved in interpretation (e.g. Kintsch, 1988; problem nicely:
Sanford and Garrod, 1998). Here we want to empha-
size that it is very important for readers to have the Suppose a person P lands at an airport in a country
right mental model if they are to understand the dis- where they do not speak the language. P has a dic-
course. Sanford and Garrod (1981, 1998) believe that tionary written solely in that language. P sees a sign
much of our knowledge is organized in situation-spe- at the airport written in the local script, and looks up
cific packages. For instance, if one reads about buying the sign in the dictionary to see what it means. The
something in a shop, the important aspects of what first part of the sign has an entry described in terms
this entails become available as part of one’s mental of more of the same script, so P has to look up what
representation of what the text is about. This means, the first part of that description means, in the same
for instance, that the writer can refer to things that dictionary. No matter how many times P does this,
have not been explicitly mentioned before, as in (15): the meaning of the original will not be found! The
CHAPTER 7 L ANGUAGE IN ACTION 203
dictionary does not, on its own, contain the meaning Kaschak (2002) and colleagues suggests that the direc-
of the expressions on the sign. tion of real movement underpins the comprehension of
transfer and movement sentences. Glenberg and
So, according to Harnad (see also Searle, 1980) sym- Kaschak (2002) compared people’s responses to two
bols can only have meaning by being related to things types of sentence, examples of which included impera-
in the world, and not to other symbols and words. tive, and physical and abstract transfer sentences:
Consider the words left and right. Definitions for these
TOWARD SENTENCES
in dictionaries make interesting reading. One element
with left, for instance, is that it is the opposite of right. Open the drawer (IMPERATIVE)
Without some means of interpreting that statement, it Courtney handed you the notebook (TRANSFER:
simply doesn’t make sense. Typically in dictionaries, DOUBLE OBJECT)
there is reference to the outside world. So, left is Liz told you a story (ABSTRACT TRANSFER)
defined as ‘that side in which a person has normally
the weaker and less skilled hand’, and right as ‘that side AWAY SENTENCES
in which a person has normally the stronger and more Close the drawer (IMPERATIVE)
skilled hand’. Unless one knows about people, and You handed Courtney the notebook (TRANSFER:
which side (regardless of name) is normally stronger, DOUBLE OBJECT)
the definitions are vacuous. So, the meanings of words You told Liz a story (ABSTRACT TRANSFER)
have to be grounded in the world. Activity 7.1 consid-
ers another case, the verb trudge. Physical towards sentences require a movement
The view that cognitive activities such as under- towards the body to be executed, while away sentences
standing the meaning of something are bound up with require a movement away. Participants were presented
representations of actual interactions with the world is with sentences of these two types, along with non-
part of the issue of embodied cognition. It is a short sense sentences like Boil the air. The task was to judge
step from words to sentences. Sentences suffer from whether each sentence was sensible. They did this for
the symbol grounding problem if they are not con- each sentence by pressing a button that was on the far
nected to perception and action. For instance, in order end of a box (away from the body), or near to the
to understand the unconventional use of the word body. For half of the participants, ‘Yes’ was the near
elbow in verb form (e.g. John elbowed the pencil to button, while for the other half, it was far. At the outset
Mary), we have to make use of the range of actions of of each trial, the response finger rested on a centre
which the elbow is capable. button, so that to respond participants actually had to
Is there any experimental evidence for bodily move either towards themselves or away.
involvement in the understanding of entire sentences The prediction was that when ‘away’ sentences were
depicting simple actions? Recent work by Glenberg and comprehended, part of the understanding involves a
ACTIVIT Y 7.1
Try to write down a definition of trudge before in (human) movement. This is obvious with waltz
moving on. too. So, one way of trying to get around the symbol
Try to write down a definition of waltz. grounding problem is to assume that meanings
A word-description of trudge is virtually impossi- relate to representations of our physical interac-
ble, as well as meaningless. This is because trudge tions with the world.
defines a set of motion attributes that are embodied
204 PART 2 CONCEPTS AND L ANGUAGE
1300
1700 1700
FIGU RE 7.1 Results of the experiment by Glenberg and Kasheck. Source: Glenberg and Kaschack (2002)
simulation of transferring the object (concrete or questionnaire in Activity 7.2. (Do this now before
abstract) away from the body, so responses that are reading on.)
physically ‘away’ should be made more rapidly than The failure to use the full meaning of a word is a
responses that are ‘towards’ movements. The opposite demonstration of shallow processing: not shallow in
should apply to ‘towards’ sentences. The results in the sense of being sensory rather than to do with
Figure 7.1 show that in the yes-is-near condition, meaning, but rather in the sense of dealing only super-
away sentences took longer to process than towards, ficially with meaning. This can easily be seen with
while the opposite was true for towards sentences. contrasts between different versions of the Moses illu-
Although the effects appear weaker for the imperative sion. For example, if Adam is substituted for Moses,
sentences, the difference from the other conditions then everyone spots that he didn’t put any animals on
was not reliable. Glenberg and Kasheck take these the Ark (Van Oostendorp and De Mul, 1990). It is
results as supporting their view that the simple under- argued that this is because Moses is more similar in
standing of transfer sentences is rooted in the actions ‘meaning’ to Noah than Adam is (according to partici-
underlying the transfers themselves. pants’ ratings). So, it is not that people don’t process
the meanings of words in anomalies; rather, they do
not process them very deeply. (See Barton and Sanford
2.2 Special topics (1993) for further evidence, using the anomaly After
an aircrash, where should the survivors be buried?)
Before moving on to language production and dia- In Chapter 6 and in Section 2.1.2 of this chapter, we
logue, we shall focus on two relatively new, emerging, saw evidence suggesting that word meaning is
and important issues: shallow processing and per- retrieved immediately when a word is read. Are the
spective in communication. findings with anomalies inconsistent with the incre-
mental interpretation hypothesis? No. First, if a word
Incomplete processing and selective
2.2.1
is a really poor fit in meaning, it is noticed; it is just
processing when it is a close (but wrong) fit that there are prob-
Just how completely do we utilize the meanings of lems. So, meanings may be used immediately, but only
words in establishing sentence meaning? Just how part of the full meaning may be used. For this reason,
much detail goes into the representations of discourse it may be best to say that readers immediately initiate
we end up with after reading? Quickly complete the meaning retrieval, but that this may be incomplete.
CHAPTER 7 L ANGUAGE IN ACTION 205
ACTIVIT Y 7.2
Underspecification and depth of processing Can a man marry his widow’s sister? The answer
Complete the following questionnaire as quickly as has to be ‘no’, because a person who has a widow is
possible (all questions apply to what is true in the dead.
United Kingdom). Anomalies such as these show that word mean-
ings are not necessarily fully analysed and/or inte-
a. Can a 16-year-old girl marry without her parents’
grated into the mental representation of a
permission?
discourse (which of these alternatives holds is an
b. Can a man marry his natural sister? empirical issue). There are many such cases (see
c. Can a person marry their first cousin? Sanford and Sturt, 2002), the best known being
d. Can a man marry his widow’s sister? the so-called Moses illusion (Erickson and
e. Can a woman marry her uncle? Matteson, 1981):
It is perhaps even more interesting that the extent to the part of the sentence on which focus or emphasis is
which meaning is processed depends upon the syntac- put affects the depth of semantic processing. A cleft
tic construction of sentences. Baker and Wagner sentence has a structure like It was John who opened
(1987) presented participants with sentences like (16) the door, with it was being one half of the cleft. Using
and (17), and asked them to say whether the state- It was. . . clearly indicates that the sentence answers
ments were true or not. Try the first one for yourself: the question Who opened the door? Using standard
Moses illusion sentences, Bredart and Modolo (1988)
(16) The liver, which is an organ found only in showed that in (19), detection of the anomaly was
humans, is often damaged by heavy drinking. much better than with (18):
(17) The liver, which is often damaged by heavy
drinking, is an organ found only in humans. (18) Moses put two of each kind of animal on the
Ark. (True or False?)
Participants spotted that sentences like (16) were false (19) It was Moses who put two of each kind of animal
about 69 per cent of the time; here, the statement ‘an on the Ark. (True or False?)
organ found only in humans’, which is of course false, is
in the subordinate position. In (17), where it is in the So, the focused elements of a sentence appear to expe-
main clause, errors were spotted 80 per cent of the rience deeper processing than the non-focused ele-
time. So, putting information in a subordinate clause ments. These simple observations open the way to
makes it less detectable than if it is in the main clause. developing processing theories in a new direction, by
Practically, if you want someone not to scrutinize showing how the forms of sentences control the
what you are saying, put the bit that you want them to amount of processing effort afforded the retrieval of
miss in a subordinate position! meaning from words. There are many other situations
Subordination is an example of how syntax controls in which shallow processing may occur, and establish-
the extent of processing. There is also evidence that ing these will enable us to give more sophisticated
206 PART 2 CONCEPTS AND L ANGUAGE
accounts of language comprehension. Papers by below, bad thing is acceptable, whereas in the second,
Ferreira et al. (2002) and Sanford and Sturt (2002) good thing is (although both depict the same amount
illustrate the scale of the problem. of fat):
1900
Healthy Unhealthy
1800
1700
RT (ms)
1600
1500
1400
1300
5% fat 25% fat 95% fat free 75% fat free
Quantified fat statements
FIGU RE 7. 2 Effect of quantified fat statement upon acceptance of healthy/unhealthy continuation. Source: Sanford
et al. (2002)
knowledge. Sanford et al. (2002) suggested that the Perspective effects like this are subtle, but influence
fat-free formulation effectively stops people from uti- how we think of things. With risks, for instance, com-
lizing the kind of knowledge they would use with the pare the following formulations:
percentage-fat formulation. Other formulations, such
• Side-effects, including headaches, occur rarely.
as less than 10% fat, have not been investigated at the
time of writing. • Side-effects, including headaches, occur
These are very clear effects of perspective: in the occasionally.
case of percentage fat-free, the perspective is on the Although rarely and occasionally both denote head-
amount of non-fat (or healthy) ingredient, whereas in aches occurring a small proportion of the time, you
the case of percentage fat, the perspective is on the could fit the continuation which is a good thing to the
amount of fat. Although these two formulations actu- first sentence, and which is a bad thing to the second
ally depict the same amount of fat, they lead to quite one. They point to different perspectives, so that the
different mental operations during understanding. same chance of a side-effect can sound good or bad.
SUMMARY OF SECTION 2
In the first part of the chapter we have seen various examples of how we use language affecting how we
interpret the meaning of what is written. Because language is such an important tool for communication
it is not surprising that language use has such an impact on our judgements about things, such as how
risky they are, as well as our ability to understand and solve basic problems.
In the second part of the chapter we will again look at language in action, but in the context of speech
and dialogue. Again, we shall find that language and the circumstances of language usage can play an
important role in activities not normally associated with language processing, such as group decision
making.
208 PART 2 CONCEPTS AND L ANGUAGE
TAB LE 7.1 Sample speech errors (from Bock and Huitema, 1999)
1. Word anticipation bury me right with him bury him right with him
2. Sound anticipation the lush list the lust list
evidence brought to bear on evidence brought to bear on
3. Word perseveration
representational theories representational evidence
4. Sound perseveration President Bush’s budget President Bush’s boodget
5. Word exchange the head of a pin the pin of a head
6. Sound exchange occipital activity accipital octivity
7. Stranding exchange the dome doesn’t have any windows the window doesn’t have any domes
8. Phrase exchange the death of his son from leukaemia the death of leukaemia from his son
9. Semantically related word-substitution I like berries with my cereal I like berries with my fruit
10. Phonologically related word-substitution part of a community part of a committee
11. Sound substitution the disparity the disparigy
12. Word blend it really stood/stuck out it really stook out
13. Phrase blend at large/on the loose at the loose
Table 7.1. The speaker had intended to say The dome the message in a pre-linguistic form. Then, there are
doesn’t have any windows, but the plural ‘windows’ two distinct processing systems, the first concerned
was placed in the part of the sentence where the singu- with formulating the grammatical aspects of the
lar word ‘dome’ should have been and vice versa. What utterance and the second concerned with converting
came out was not The windows doesn’t have any dome this into the appropriate sequence of sounds (the
but rather The window doesn’t have any domes. Hence, phonological component). There are many reasons
the assignment of the number feature on the words for making this split. First, speech errors are predom-
window and dome (i.e. whether they were marked as inately either lexical errors or errors involving pho-
singular or plural) seems to involve a separate stage in nemes. In fact, the first six kinds of error in Table 7.1,
the process from the choice of word and placement of anticipation, preservation, and exchange, can either
that word in the sentence. Another such example of be lexical (e.g. 1, 3, 5) or phonological (e.g. 2, 4, 6),
stranding is when the speaker intended to say If that but rarely involve other units of speech. In other
was done to me and it came out as If I was done to that words, even though morphemes (i.e. meaningful bits
and not If me was done to that. In this case it is the of words like the meaning and the -ful in meaningful)
grammatical case marking of the pronoun (i.e. I for are more prevalent than words, there are very few
subject of the verb was done and me for object) that is morphemic errors. Similarly, errors involving the
assigned separately after the pronoun has been put more common phonetic features (i.e. sound segments
into that position in the sentence. So the examples out of which the phonemes are made) are much rarer
indicate that speech errors are more subtle than they than errors involving phonemes. This suggests that
seemed at first. Also, they tell us something about the two main processes either arrange words (gram-
what sorts of operations go together in producing an matical encoding) or arrange phonemes (phonologi-
utterance. cal encoding). Another piece of evidence relates to
On the basis of such patterns of errors the overall the earlier point about lexical exchanges in which
organization of the language production system is nouns exchange with nouns and verbs with verbs. If
commonly viewed as in Figure 7.3 (see Bock, 1996 grammatical and phonological encoding occurred
and Levelt, 1989 for a full account). It has three main together we would expect phonological exchanges to
processes. First, there is the process of formulating occur within words of the same grammatical class.
210 PART 2 CONCEPTS AND L ANGUAGE
Try repeating the words below quickly. Start by You should notice that you will start to make
repeating pod-cab etc. and then after a while have a errors that involve substituting the speech sounds
go with moss-knife etc. If possible record your rep- from one word into the next. Typically, the errors
etitions on tape and then examine them for differ- will be anticipations where you might say nuss for
ent kinds of phonological speech error. noose, anticipating the following muff. This exercise
illustrates how phonemes can be substituted in
POD CAB CORD PUB . . .
adjacent words during normal speech.
MOSS KNIFE NOOSE MUFF . . .
CHAPTER 7 L ANGUAGE IN ACTION 211
3.1.3 Message selection and audience design was a barrier obscuring your view of your companion,
In looking at the language production process we have then they would have no basis for establishing what it
adopted a similar model to that assumed in the work was you intended to speak about in saying ‘It’s great,
on language comprehension discussed earlier in isn’t it?’ Even if the barrier were a one-way mirror
Chapter 6. Basically, production when viewed as an allowing you to see them but not allowing them to see
isolated process is seen as a kind of translation from you or what you were looking at, the statement would
an idea via intermediate levels to a sequence of articu- be infelicitous.
lated sounds. But of course when we use language to This might seem to be a rather special and compli-
communicate, the speaker has to make a number of cated example, but audience design enters into almost
more complicated general decisions about how to for- everything we say. Take for example an experiment by
mulate what he or she wants to say in such a way that Isaacs and Clark (1987). They used a situation called the
it will make sense for that particular listener. This gen- referential communication task shown in Box 7.3
eral topic is what has been called audience design. (Krauss and Weinheimer, 1967). However, in their case
Audience design is an interesting part of the pro- the director (see Box 7.3) had to indicate to the matcher
duction process because it requires the speaker to draw which picture he or she was looking at from a set of
complicated inferences about what the listener knows. pictures of buildings in New York City. In effect, the
These inferences are more complicated than you might director had to describe the picture unambiguously to
imagine because they usually involve establishing what the matcher. Now the twist in the experiment was that
is called common ground. Technically common the communicating pairs were chosen such that either
ground relates to the knowledge that the speaker and one or both or neither were New Yorkers. In other
listener share and that they both know that they share words, the common ground between the different pairs
(Clark, 1996). Common ground is important because could be quite different and the question was whether
it affects how you should formulate your utterance in or not the directors would alter the design of their
such a way that you can be sure it will be understood as descriptions according to their assessment of common
you intended it to be. For example, say you are going ground. It turned out that everyone was extremely good
around an art gallery with a companion and you turn at the task and almost immediately established whether
to gaze at a painting that you really like. You might say they were both New Yorkers, only one was a New
to them, ‘It’s great, isn’t it?’ Now, under certain circum- Yorker, or neither were. In fact 85 per cent of pairs
stances that would be a perfectly felicitous statement knew into which category they both fell after only
and convey to your companion that you really liked describing two of the cards. But perhaps more interest-
that particular painting. However, under other circum- ing was how the speakers then adapted their descrip-
stances it would be totally uninformative for them. It tions according to whom it was that they were speaking
all depends on what you know that they know at that to. New Yorkers speaking to New Yorkers would typi-
time, and what you know that they know that you cally just name the building in the picture (e.g. ‘Chrysler
know, and so on. For instance, if you can see from the building’) whereas New Yorkers speaking to non-New
corner of your eye that they are looking at the same Yorkers would describe the picture itself (e.g. ‘Well, it
painting and that they can see that you are also looking has three buildings in it, a tall one and two short ones’)
at that painting, then the statement is quite clear. Both and so design their utterances according to what they
of you take the thing that is really great to be the paint- knew was the common ground.
ing that you both know that you are both looking at. This experiment illustrates nicely how language
However, on other occasions the statement may not be production in a real context involves much more than
felicitous. Anything that blocks establishing common just translating ideas into sounds. It also requires a
ground could lead to misunderstanding. For instance, complex assessment of what the listener knows at the
if you were standing looking at the painting but there time, even including what is in common ground
212 PART 2 CONCEPTS AND L ANGUAGE
BOX 7.3 The referential communication task (from Glucksberg and Danks, 1975)
In this task there is a director (speaker) and a pile and puts it onto their stake. With this task it is
matcher (listener) who are separated by a thin par- possible both to analyse what the communicators
tition. The director picks wooden blocks impaled say to each other, and to establish how accurately
on a stake and has to communicate to the matcher they can communicate the patterns by comparing
the nonsense pattern shown on the block (see the the order of items that the director started out with
right side of Figure 7.4 for examples). The matcher to the order of items that the matcher ended up
then chooses the appropriate block from his or her with. You could try it out with your friends.
Speaker Listener
FIGU RE 7.4 The referential communication task. Source: Glucksberg and Danks, 1975
between the speaker and listener. However, there is for a referent for a description, listeners are just as
controversy over the extent to which speakers always likely to initially look at things that are not part of the
take common ground into account. For example, common ground as things that are. In other words,
Horton and Keysar (1996) found that speakers under listeners also do not seem to always take advantage of
time pressure did not produce descriptions that took common ground.
advantage of what they knew about the listener’s view Nevertheless, Horton and Keysar (1996) found that
of the relevant scene. In other words, the descriptions with less time pressure speakers often did take account
were formulated with respect to the speaker’s current of common ground in formulating their utterances, and
knowledge of the scene rather than with respect to the Keysar et al. (1998) argued that listeners at a later mon-
speaker and listener’s common ground. Similarly, itoring stage take account of common ground in com-
Keysar et al. (1998) found that in visually searching prehension (see also Brennan and Clark, 1996; Schober
CHAPTER 7 L ANGUAGE IN ACTION 213
and Brennan, 2003). For a more detailed review of this Evidence for this kind of ‘inner-loop’ monitoring
controversy see Garrod and Pickering (2007). comes from a variety of sources. The most colourful
So all in all it seems that audience design, and the evidence is from a speech error elicitation experiment
extent to which the audience as comprehender is sen- by Motley et al. (1982). They used a device for produc-
sitive to design, is a complicated issue. In the absence ing speech errors that was a bit like the tongue-twister
of time pressure both language producers and lan- elicitation procedure described in Box 7.2. Participants
guage comprehenders are able to take into account had to repeat context sequences that were likely to
their common ground in processing an utterance. produce errors in subsequent critical items, such as
However, when under time pressure this kind of com- the pair ‘barn door’, which might be mispronounced
plex assessment of listener by speaker and vice versa is as ‘darn bore’. However, they also included critical
one of the first parts of the process to suffer. Below we pairs of items that if mispronounced would lead to a
consider how this separation of processes in produc- taboo word (e.g. ‘tool kits’ as ‘cool ???’). The crucial
tion may depend upon the distinction between initial question was whether speakers were as likely to come
formulation of an utterance and subsequent monitor- up with the taboo forms as they were to come up with
ing and correction of that utterance. non-taboo forms. Motley et al. found that the taboo
errors were much less likely to occur than non-taboo
3.1.4 Self-monitoring errors. They argued that the taboo errors must have
An important part of the process of speech produc- been filtered out before the utterance had been articu-
tion is being able to monitor and correct what you are lated. Now, it is difficult to understand how such a pre-
saying (Hartsuiker and Westerberg, 2000). We know articulatory filtering could occur without some form
that speakers are always doing this because natural of ‘inner-loop’ monitoring; that is, monitoring based
speech is full of minor hesitations and dysfluencies in on something available before the speaker has had a
which the speaker briefly stops and corrects or repairs chance to listen to what they are saying.
their utterance. Another kind of evidence comes from examining
There is a real issue as to how this monitoring pro- the temporal characteristics of speech errors and their
cess operates. In its most straightforward form moni- corrections. The crucial measure is the time between
toring can work by the speaker listening to and producing the incorrect word and producing the
comprehending their own output. Then, as soon as they repair (e.g. the time between saying ‘the left . . .’ and
encounter something that does not match what they ‘going from left . . .’ in utterance 6 in the example in
had originally intended to say, they can stop the speech, Section 3.2.1). Hartsuiker and Kolk (2001) argued
reformulate the utterance, and continue with the that any error correction time interval of less than
repaired fragment. For example, take turn 6 in the dia- 150 ms could not reflect the outer-loop monitoring
logue extract shown in Section 3.2.1. Here the speaker process, because this would not allow sufficient time
starts out saying ‘The left . . .’ but then realizes that he to comprehend the output, reformulate it, and then
intended to be more explicit. So he stops and restarts restart the utterance. Looking at several collections of
his utterance with the repair ‘going from left to right in such errors they found a high preponderance of these
the second box’. It is straightforward to assume the short latency restarts. In fact, their results suggested
existence of such an ‘outer-loop’ monitoring process that the majority of speech repairs were based on
because we know that we can perfectly well understand ‘inner-loop’ as opposed to ‘outer-loop’ monitoring.
what we are saying to someone else. More controversial An additional interesting feature of these two kinds of
is the idea that monitoring can also operate at earlier monitoring is that whereas outer-loop monitoring
stages in the production process. For instance, that it appears to tax attention, ‘inner-loop’ monitoring does
can operate at the level of the message formulator, or not. This explains why when people speak under time
later at the stage of phonological encoding. pressure they tend to produce fewer overt speech
214 PART 2 CONCEPTS AND L ANGUAGE
repairs than when they speak more slowly, and the 3.2 The challenge of dialogue
overt repairs tend to involve short latency restarts. It
is assumed that with high time pressure, monitoring
So far we have only considered language production
and repair shift even more in favour of the low atten-
as if it were a process completely isolated from com-
tion ‘inner-loop’ route. This is also one reason why
prehension. However, language processing most often
Keysar et al. (1998) argued that audience design might
occurs in the context of a dialogue where each partici-
only influence production at a later stage on the basis
pant both produces and comprehends more or less at
of self-monitoring. The idea was that such monitoring
the same time. How does this kind of interaction affect
would be associated with the outer loop and so be less
the production and comprehension process?
effective when speaking under time pressure.
First, we take a look at what sort of thing goes on in
A similar distinction between ‘inner-loop’ and
dialogue and how the language itself is different in
‘outer-loop’ monitoring is made for monitoring of
dialogue from monologue. This then leads to a more
physical movements, such as when grasping some-
general discussion about how dialogue and mono-
thing or when picking something up (see Blakemore
logue involve different kinds of processing, and in
et al., 2002). Again, it seems that the inner loop equiv-
turn how this influences the nature of production and
alent for motor control is not accessible to conscious-
comprehension in a dialogue setting. Finally, we con-
ness and does not tax attention to the same degree that
sider a recent model of language processing in dia-
the outer loop system does.
logue that takes these differences into account.
3.1.5 Summary
In this section we looked at two special topics in lan- 3.2.1 What is dialogue?
guage production that are outside the basic produc- The following example comes from a transcript of two
tion processes discussed earlier in Sections 3.1.1 and players in a cooperative maze game. One player, A, is
3.1.2. The first of these special topics, audience design, trying to describe his position to his partner, B, who is
was about ways in which the speaker attempts to take viewing the same maze on a computer screen in
into account the listener during production. As we another room (see Garrod and Anderson, 1987). The
saw, there is some controversy over the degree to position being described in all the utterances shown
which audience design, at least in relation to taking in bold is illustrated schematically in Figure 7.5.
into account the common ground, is an obligatory 1—–B: Tell me where you are?
part of the normal language production process. 2—–A: Ehm . . . oh God. (laughs)
Whereas Clark and colleagues have argued that speak- 3—–B: (laughs)
4—–A: Right: two along from the bottom, one up.
ers aid their listeners by taking account of common
5—–B: Two along from the bottom, which side?
ground when formulating their utterances, others 6—–A: The left: going from left to right in the second box.
have argued that common ground is only taken into 7—–B: You’re in the second box.
account on the basis of an optional outer-loop moni- 8—–A: One up. (1 sec.) I take it we’ve got identical mazes?
9—–B: Yeah, well: right, starting from the left, you’re one
toring and repair process.
along.
The second special topic we looked at was the 10—-A: Uh-huh.
mechanisms of self-monitoring in speech. The impor- 11—-B: and one up?
tant issue here is whether such monitoring can only 12—-A: Yeah, and I’m trying to get to . . . etc.
occur on the basis of a speaker listening to himself or At first glance the language looks disorganized. Strictly
herself – outer-loop monitoring – or whether it also speaking many of the utterances are not grammatical
proceeds on the basis of pre-articulatory monitoring sentences – only one of the first six contains a verb.
– inner-loop monitoring. Evidence from the time There are occasions when production of the same sen-
course of self-repair strongly indicates the prevalence tence is shared between the speakers, as in utterances
of pre-articulatory inner-loop monitoring. (7–8).
CHAPTER 7 L ANGUAGE IN ACTION 215
being said does not lead to a full understanding when come to a mutually satisfactory interpretation of what
you cannot interact directly with the speaker. is being said and it greatly simplifies the basic pro-
The third way that dialogue involves coordinated cesses of production and comprehension during dia-
processing relates to the general problem of ambiguity logue.
discussed in Chapter 6. In the extract shown above,
the participants spend all the time trying to work out 3.2.3 A model of dialogue processing
a mutually acceptable and unambiguous description The interactive alignment account starts with the sim-
for A’s location on the maze. As we shall see below, ple observation that dialogue participants alternate
this is achieved through a process of coordinating out- between speaking and comprehending. Furthermore,
puts with inputs: speakers always attempt to generate the representations that are used for comprehension
utterances that correspond semantically to the utter- (whether they be syntactic, lexical, or at the level of
ances that they have recently had to comprehend. articulation) will activate or prime matching repre-
Consider for example utterances 4 and 5 above, in sentations in production.
which B echoes the description ‘Two along from the If we assume that representations active during com-
bottom . . .’ As a result of such output-input coordina- prehension remain active during subsequent produc-
tion, the same expression comes to take on the same tion, then there will always be a tendency for
precise meaning within any stretch of dialogue. interlocutors to coordinate outputs (productions) with
Finally, dialogue participants try to establish a inputs (what has just been understood). Put two such
coordinated conception of their topic. In the case of systems together in a dialogue and the overall system
the maze game illustrated above, this amounts to con- will only be completely stable if the two adopt aligned
verging on a common spatial concept of the maze’s linguistic representations at every level (see Garrod and
configuration. Thus some people playing this game Pickering, 2004). Pickering and Garrod (2004) go on to
will refer to their locations by reference to right-turn argue that this kind of interactive alignment of repre-
indicators, upside-down T shapes, or Ls on their sides. sentations supports mutual understanding because
These speakers, unlike the pair responsible for the dia- alignment does not just occur within independent lev-
logue illustrated above, conceive of the maze as a con- els of the system, but also serves to link those levels with
glomeration of patterns or shapes, each with a different each other. In other words, the automatic alignment of
name. Conversational partners often establish quite representations at all levels will tend to establish a kind
idiosyncratic conceptions of the topic (as with the use of common ground between the two communicators,
of right-turn indicator or upside-down T shapes) but in which aids mutual understanding.
well-managed dialogues they always align on the same First we look at the evidence for representational
idiosyncratic conception. Again, this process supports alignment during dialogue and consider how it may
consensus, which is the fundamental goal of dialogue. support the interpretation process. Then we go into a
One of the reasons why dialogue presents such a little more detail on one consequence of representa-
challenge to processing accounts is that these interac- tional alignment in relation to language processing,
tive characteristics are difficult to reconcile with the which is what has been called routinization.
standard view of communication as a one-way process
of information transfer. And it is just such a view that 3.2.4 Evidence for interactive alignment
underpins much of the work in psycholinguistics Dialogue transcripts are full of repeated linguistic ele-
(such as the work described in Chapter 6). Here we ments and structures indicating alignment at various
argue that a more useful processing framework for levels (Aijmer, 1996). Alignment of lexical processing
dialogue may be based on the notion of interactive during dialogue was specifically demonstrated by
alignment. According to this account, dialogue par- Garrod and Anderson (1987), as in the example dia-
ticipants come to align their linguistic representations logue in Section 3.2.1, and by Clark and colleagues
at many levels. The alignment process helps them to (Brennan and Clark, 1996; Wilkes-Gibbs and Clark,
CHAPTER 7 L ANGUAGE IN ACTION 217
1992). These latter studies show that interlocutors tend in a dialogue setting. The representations called upon
to develop the same set of expressions to refer to par- in production are already in some sense available to the
ticular objects, and that the expressions become shorter speaker from his or her comprehension of the prior
and more similar on repetition with the same interlocu- dialogue. Apart from helping the interlocutors to come
tor but are modified if the interlocutor changes. to a truly aligned interpretation of what the dialogue is
Levelt and Kelter (1982) found that speakers tended about, it also simplifies the production and compre-
to reply to ‘What time do you close?’ or ‘At what time hension processes themselves. One of the ways in
do you close?’ (in Dutch) with a congruent answer which this may happen is through what has been called
(e.g. ‘Five o’clock’ or ‘At five o’clock’). This alignment routinization.
may be syntactic (repetition of phrasal categories) or
lexical (repetition of at). Branigan et al. (2000) found 3.2.5 Routinization in dialogue processing
clear evidence for syntactic alignment in dialogue. The process of alignment means that interlocutors
Participants took it in turns to describe pictures to draw upon representations that have been developed
each other (and to find the appropriate picture in an during the dialogue. Thus it is not always necessary to
array). One speaker was actually a confederate of the construct representations that are used in production
experimenter and produced scripted responses, such or comprehension from scratch. One particularly
as ‘the cowboy offering the banana to the robber’ or important implication is that interlocutors develop
‘the cowboy offering the robber the banana’. The syn- and use routines (set expressions) during a particular
tactic structure of the confederate’s description influ- interaction.
enced the syntactic structure of the experimental A routine is an expression that is ‘fixed’ to a rela-
subject’s description and it did so much more strongly tively great extent. First, the expression has a much
than in a comparable non-dialogue situation. For higher frequency than the frequency of its component
instance, if the participant had just heard ‘the cowboy words would lead us to expect. Second, it has a par-
offering the robber the banana’, they would describe ticular analysis at each level of linguistic representa-
the next picture as ‘the clown handing the dancer the tion. Thus, it has a particular meaning, a particular
balloon’, whereas if they had just heard ‘the cowboy syntactic analysis, a particular pragmatic use, and
offering the banana to the robber’, they would describe often particular phonological characteristics (e.g. a
it as ‘the clown handing the balloon to the dancer’. fixed intonation). Extreme examples of routines
Alignment also occurs at the level of articulation. It include repetitive conversational patterns such as How
has long been known that as speakers repeat expres- do you do? and Thank you very much. Routines are
sions, articulation becomes increasingly reduced (i.e. highly frequent in dialogue. It has been estimated that
the expressions are shortened and become more diffi- up to 70 per cent of words in a standard dialogue
cult to recognize when heard in isolation; Fowler and occur as part of recurrent word combinations.
Housum, 1987). However, Bard et al. (2000) found However, different expressions can be routines to dif-
that reduction was just as extreme when the repetition ferent degrees, so actual estimates of their frequency
was by a different speaker in the dialogue as it was are somewhat arbitrary. Some routines are idioms, but
when the repetition was by the original speaker. In not all (e.g. I love you is a routine with a literal inter-
other words, whatever is happening to the speaker’s pretation in the best relationships).
articulatory representations is also happening to their Most discussion of routines focuses on phrases
interlocutor’s. So the two representations are becom- whose status as a routine is pretty stable. However,
ing aligned. There is also evidence that interlocutors Pickering and Garrod (2005) also claim that routines
align accent and speech rate (Giles et al., 1992; Giles are set up ‘on the fly’ during dialogue as a result of the
and Powesland, 1975). interactive alignment process. They call this routiniza-
Taken together these findings indicate that some- tion and it represents one of the rather special features
thing rather special happens when we process language of language processing in a dialogue as opposed to a
218 PART 2 CONCEPTS AND L ANGUAGE
monologue setting. For more details on the routiniza- what kind of communication process operates within
tion process during dialogue see Pickering and Garrod a group and how that might affect the way in which
(2005). people are influenced by other members of the group
in coming to a decision.
Imagine that you are a member of a committee dis-
cussing some particular issue at your work. Sometimes
3.3The monologue dialogue you are aware of being highly engaged in discussion
with just one or two other members of the committee;
distinction and group it is like a two-party dialogue. At other times you just
decision making sit back and listen to what the most vociferous mem-
ber of that committee is saying. Now, afterwards you
The first part of this chapter concentrated exclusively happen to bump into someone who had been there
on comprehension of written language or monologue and to your surprise you discover that what you
comprehension. The second half has concentrated on thought was the crucial decision is not quite the same
language production and production and comprehen- as what they thought was crucial. Typically people’s
sion during dialogue. In describing language produc- views about such things vary quite a lot. The question
tion we first treated it as an isolated process. In other is what affects those views and how does that relate to
words, we only considered production in terms of the the communication process during the meeting itself.
production of monologue. In the later sections of the Are you going to agree more with the people that you
chapter we have seen that language processing in dia- had the interactive discussion with at the meeting, or
logue may be rather different from language process- are you going to be influenced most by the vociferous
ing in monologue. First, it depends upon coordinated and dominant member of the group?
processes of production and comprehension, as in The monologue and dialogue models of communi-
answering a question. Second, it seems to involve cation bear differently on this question. According to
direct participation from both interlocutors in creat- the information transfer or monologue account, a
ing a common understanding of the message. Hence, group discussion can be thought of as a process in
overhearers cannot fully understand what is being which there are a series of monologues in which the
said in dialogue. Finally, both production and com- current speaker broadcasts information to the rest of
prehension may be governed by an interactive align- the group. Hence, you should tend to be influenced
ment process that leads to routinization. most by the person who says the most. Who you speak
We opened the chapter by contrasting language use to next in the discussion should have no special influ-
in the contexts of monologue and dialogue. But what ence on your views. The interactive alignment or dia-
are the consequences of this distinction beyond lan- logue account makes a very different prediction. The
guage processing itself? One interesting consequence people who should have most influence on your views
relates to group decision making. Communication is are those with whom you directly interacted, and
crucial to group decision making, whether it involves there should be no particular reason why you should
a family deciding to move to a larger house, a parlia- be influenced by the dominant speaker.
ment deciding on new legislation, or a jury coming to Fay et al. (2000) report a study that shows that both
a verdict. It is crucial because there is no other way in of these views are correct, but which applies depends
which a group can come to a consensus, and group on the size of the group holding the discussion. To test
decision, at least in its purest form, depends upon this they had two sizes of groups of students imagine
consensus. Remember that one of the main distinc- that they were a university disciplinary committee who
tions between dialogue and monologue is the way in had to sit down and decide as a group what to do about
which dialogue promotes consensus whereas mono- a complex case of student plagiarism. First, each mem-
logue does not. So it is an interesting question as to ber of the group read a one-page description of the
CHAPTER 7 L ANGUAGE IN ACTION 219
case, and then before discussing it they each had to had been influenced either by their high interaction
rank 14 relevant issues in terms of how important they partners or by the dominant speakers in the discus-
felt they were to this case. The issues ranged from sion. The results were clear and quite striking. It turned
clearly relevant ones, such as the severity of the plagia- out that in small group meetings with five members,
rism, to more ambiguous issues, such as the universi- people were only especially influenced by their high
ty’s responsibility to the student. The groups then interaction partners. There was no additional influence
discussed the case for about 20 minutes and after the coming from dominant speakers. This is exactly what
discussion each person again ranked the issues, but is predicted by the alignment account, because (1)
now in terms of how important they thought they had interactants automatically align with each other, and
been to the group as a whole. By comparing the agree- (2) an overhearer or side participant is not going to be
ment in the ranking scores between each member of influenced by others’ interactions even when they
the group after the meeting (after accounting for their involve the dominant speaker. However, in larger
pre-meeting agreements), it is possible to determine groups of ten exactly the opposite pattern emerged.
who has the strongest influence on whom with respect People in the larger groups were all influenced by the
to the 14 key issues. Fay et al. then used the transcrip- dominant speaker and there was absolutely no effect of
tions of the discussions to establish (1) which members interaction (see Figure 7.6). This was as predicted by
of the groups had served as high interaction partners the monologue or information broadcast account.
for each group member and which had served as low Additional analysis of the meeting transcripts also sup-
interaction partners, and (2) which members of each ported the idea that in the small groups the utterances
group had been dominant speakers as opposed to non- and turn pattern was just like that in two-party conver-
dominant speakers. For (1) they defined a high inter- sation. The utterances were shorter, there were many
action partner as a person who was most likely to more interruptions, and the pattern of speaker turns
speak either immediately before or immediately after tended to conform to an ABABA pattern with the same
each member of the group. They were then able to two speakers taking alternate turns for extended peri-
examine the degree to which everyone in the groups ods of discussion.
Baseline Baseline
High interaction High interaction
Low interaction Low interaction
1.2 1.2
1.0 1.0
0.8 0.8
Corrected r´
Corrected r´
0.6 0.6
0.4 0.4
0.2 0.2
0 0
Group 5 Group 10 Group 5 Group 10
(a) (b)
FIGURE 7.6 Correlation between ranking of issues before and after discussion for groups of five and ten discussants.
(a) shows correlation between discussants and high and low interaction participants, and (b) shows correlation between
the group and dominant speakers and between the group and non-dominant speakers. Source: Fay et al., 2000
220 PART 2 CONCEPTS AND L ANGUAGE
4 CONCLUSIONS
We began this chapter by arguing that the simple 15 years, it is natural to ask where this research might be
translation account of language processing, whether headed. Of the many possible future directions, we con-
in terms of comprehension or production, could not centrate here on one, which concerns developing a more
capture everything that happens when we use our lan- unified approach to considering the production and
guage to communicate. Language in action involves comprehension of language. As we pointed out in both
access to general knowledge, inference beyond what is Sections 2 and 3, psychologists traditionally study the
actually said, and, in the case of dialogue, coordinated processes of language production and comprehension
action. Without these additional processes communi- in the context of isolated acts of production and com-
cation fails. In fact, it is generally thought that much of prehension. Yet, as we have argued toward the end of
the individual differences in reading ability that you Section 3, language in action typically requires the inter-
encounter in the school classroom or university lec- weaving of the two. The work on dialogue discussed
ture hall come from differences in readers’ abilities to here also suggests that processes of production and
access the appropriate knowledge, and hence their comprehension might be strongly interwoven. In other
ability to integrate information in the texts they are words, acts of production may call upon comprehension
reading (see Garrod and Daneman, 2003). processes and acts of comprehension may call upon pro-
In Section 2 we considered these additional processes duction processes. To a certain extent this is already
in relation to text comprehension. We concentrated on accepted for acts of production, because it is generally
the three basic issues that figure in most accounts of assumed that we use the comprehension system to mon-
comprehension beyond the word: anaphora resolution, itor speech production both during outer- and inner-
non-literal meaning, and text inference. We then went loop monitoring. But what about the use of production
on to discuss in more detail some of the hot topics in the processes during acts of comprehension? A recent pro-
area. So we looked at the argument for embodied repre- posal is that speech comprehension in naturalistic situa-
sentations of meaning, the problem of partial or incom- tions calls upon the production system to support
plete processing of text, and the way in which perspective predictions about upcoming material (Pickering and
affects interpretation. In all these cases, language com- Garrod, 2007). This proposal is based first on growing
prehension involved more than just the translation of evidence that prediction can play an important role in
sounds or written symbols into meanings. sentence and discourse comprehension, with predic-
In Section 3 we turned our attention to language pro- tions operating at all levels including phonemes, words,
duction and dialogue. Language production when grammar, and meaning. Secondly, there is increasing
viewed as an isolated process seems to involve the same evidence for the involvement of production processes
sort of translation processes assumed for comprehen- (e.g. sub-threshold activation of speech motor pro-
sion in Chapter 6. However, when production and grams) during speech comprehension.
comprehension are considered in the context of dia- A recent neuroimaging study produced intriguing
logue the processes take on a different character. The evidence for such interweaving in relation to predic-
important thing in dialogue processing is how produc- tions during naturalistic story understanding. Stevens
tion and comprehension processes become coupled to et al. (2010) recorded BOLD activity (i.e. changes in
each other to produce aligned linguistic representations blood oxygenation across the brain) as a participant
at every level. In turn the contrast between language told an impromptu story in an fMRI scanner, and they
processing in monologue and dialogue has interesting recorded the story. Subsequently, they played back the
consequences for such apparently non-cognitive activi- recording to another group of participants while they
ties as group interaction and decision making. were also being scanned. Stevens et al. then looked for
Having covered some of the ways in which research regions in the brain in which the narrator’s brain
on language in action has developed over the last activity correlated with that of the listeners. The results
CHAPTER 7 L ANGUAGE IN ACTION 221
were very striking. First, they discovered that the because speakers need to prepare what they are saying
speaker’s brain activity in a wide range of brain areas and produce it before the listener hears it. More inter-
strongly correlated over time with that of the listeners, estingly, they also found the opposite pattern in which
and this appeared both in traditional language pro- activity in the listeners’ brains predicted subsequent
cessing areas and in areas not normally associated activity in the speaker’s brain. In other words, listen-
with language processing (e.g. medio-frontal cortex). ers’ brains were often anticipating what was about to
Second, they shifted the time series of brain activity happen in a speaker’s brain. Of particular interest was
between speaker and listener so that either the speak- the further finding that the degree to which a listener’s
er’s BOLD activity in each region preceded that of the brain activity predicted the speaker’s brain activity
listener or vice versa. This meant that they could correlated highly with the quality of that listener’s
determine the extent to which speaker brain activity understanding of the story as measured by analysis of
predicted subsequent listener brain activity in any their subsequent recall of the story.
region and the extent to which listener brain activity This kind of research linking neural activity in
predicted subsequent speaker brain activity in any speakers and listeners over time is very much in its
region. Interestingly, they found evidence for both. infancy. However, it points to exciting new develop-
Not surprisingly, activity in the speaker’s brain often ments in the integrated study of production and com-
predicted subsequent activity in the listeners’ brains, prehension processes when language is truly in action.
FURTHER READING
Fischer, M.H. and Zwaan, R.A. (2008) ‘Embodied language: a cusses such issues as dialogue as an instance of joint action and the
review of the role of the motor system in language compre- nature of common ground.
hension’, The Quarterly Journal of Experimental Psychology, Pickering, M.J. and Garrod, S. (2004) ‘Toward a mechanis-
vol.61, pp.825–50. This paper gives an up-to-date review of tic psychology of dialogue’, Brain and Behavioral Sciences,
research on embodiment of meaning, which builds on the discus- vol.27, pp.169–226. This extended article gives a much more
sion in Section 2. detailed account of interactive alignment in dialogue. The edition
Clark, H.H. (1996) Using Language, Cambridge, Cambridge also includes a range of commentaries on the article (and
University Press. This book gives a much more extensive account responses), which you may find helpful in understanding and evalu-
of the special characteristics of language use in dialogue. It dis- ating the theory.
REFERENCES
Aijmer, K. (1996) Conversational Routines in English: Blakemore, S-J., Wolpert, D.M., and Frith, C.D. (2002)
Convention and Creativity, London and New York, Longman. ‘Abnormalities in the awareness of action’, Trends in Cognitive
Baker, L. and Wagner, J.L. (1987) ‘Evaluating information Science, vol.6, pp.237–42.
for truthfulness: the effects of logical subordination’, Memory Bock, K. (1995) ‘Sentence production: from mind to mouth’,
& Cognition, vol.15, pp.247–55. in Miller, J.L. and Eimas, P.D. (eds.) Handbook of Perception
Bard, E.G., Anderson, A.H., Sotillo, C., Aylett, M., Doherty- and Cognition: Speech, Language, and Communication,
Sneddon, G. and Newlands, A. (2000) ‘Controlling the intelli- Orlando, FL, Academic Press.
gibility of referring expressions in dialogue’, Journal of Memory Bock, K. (1996) ‘Language production: methods and method-
and Language, vol.42, pp.1–22. ologies’, Psychonomic Bulletin & Review, vol.3, no.4, pp.395–421.
Barton, S. and Sanford, A.J. (1993) ‘A case-study of prag- Bock, K. and Huitema, J. (1999) ‘Language production’, in
matic anomaly-detection: relevance-driven cohesion patterns’, Garrod, S. and Pickering, M. (eds.) Language Processing, Hove,
Memory and Cognition, vol.21, pp.477–87. Psychology Press.
222 PART 2 CONCEPTS AND L ANGUAGE
Branigan, H.P., Pickering, M.J., and Cleland, A.A. (2000) Glenberg, A.M. and Kaschak, M.P. (2002) ‘Grounding lan-
‘Syntactic coordination in dialogue’, Cognition, vol.75, no.2, guage in action’, Psychonomic Bulletin and Review, vol.9,
B13–B25. pp.558–65.
Bredart, S. and Modolo, K. (1988) ‘Moses strikes again: Glucksberg, S. and Danks, J.H. (1975) Experimental
focalization effects on a semantic illusion’, Acta Psychologica, Psycholinguistics: An Introduction, Hillsdale, NJ, LEA.
vol.67, pp.135–44. Glucksberg, S. and Keysar, B. (1990) ‘Understanding meta-
Brennan, S.E. and Clark, H.H. (1996) ‘Conceptual pacts and phorical comparisons: beyond similarity’, Psychological
lexical choice in conversation’, Journal of Experimental Psychology: Review, vol.97, no.1, pp.3–18.
Learning, Memory and Cognition, vol.22, pp.1482–93. Glucksberg, S., Gildea, P., and Bookin, H. (1982) ‘On
Brown, G. and Yule, G. (1983) Discourse Analysis, understanding nonliteral speech: can people ignore meta-
Cambridge, Cambridge University Press. phors?’ Journal of Verbal Learning and Verbal Behavior, vol.21,
Clark, H.H. (1996) Using Language, Cambridge, Cambridge pp.85–98.
University Press. Halliday, M.A.K. and Hasan, R. (1976) Cohesion in English,
Erickson, T.A. and Matteson, M.E. (1981) ‘From words to London, Longman.
meaning: a semantic illusion’, Journal of Verbal Learning and Harnad, S. (1990) ‘The symbol grounding problem’, Physica
Verbal Behavior, vol.20, pp.540–52. D, vol.42, pp.335–46.
Fay, N., Garrod, S., and Carletta, J. (2000) ‘Group discussion Hartsuiker, R.J. and Kolk, H.H.J. (2001) ‘Error monitoring
as interactive dialogue or as serial monologue: the influence of in speech production: a computational test of perceptual loop
group size’, Psychological Science, vol.11, no.6, pp.481–6. theory’, Cognitive Psychology, vol.42, pp.113–57.
Ferreira, F., Ferraro, V., and Bailey, K.G.D. (2002) ‘Good- Hartsuiker, R.J. and Westerberg, C. (2000) ‘Persistence of
enough representations in language comprehension’, Current word order in written and spoken sentence production’,
Directions in Psychological Science, vol.11, pp.11–15. Cognition, vol.75, B72–B39.
Fodor, J. (2000) The Mind Doesn’t Work That Way, Haviland, S.E. and Clark, H.H. (1974) ‘What’s new? Acquiring
Cambridge, MA, MIT Press. new information as a process in comprehension’, Journal of
Fowler, C. and Housum, J. (1987) ‘Talker’s signalling of Verbal Learning and Verbal Behavior, vol.13, pp.512–21.
“new” and “old” words in speech and listener’s perception and Horton, W.S. and Keysar, B. (1996) ‘When do speakers take
use of the distinction’, Journal of Memory and Language, into account common ground?’ Cognition, vol.59, pp.91–117.
vol.26, pp.489–504. Isaacs, E.A. and Clark, H.H. (1987) ‘References in conver-
Garnham, A. (2001) Mental Models and the Interpretation sation between experts and novices’, Journal of Experimental
of Anaphora, Hove, Psychology Press. Psychology: General, vol.116, pp.26–37.
Garrod, S. and Anderson, A. (1987) ‘Saying what you mean Keysar, B., Barr, D.J., Balin, J.A. and Paek, T.S. (1998)
in dialogue: a study in conceptual and semantic co-ordination’, ‘Definite reference and mutual knowledge: process models of
Cognition, vol.27, pp.181–218. common ground in comprehension’, Journal of Memory and
Garrod, S. and Daneman, M. (2003) ‘Reading, the psychol- Language, vol.39, pp.1–20.
ogy of ’, in Nadel, L. (ed.) Encyclopedia of Cognitive Science, Kintsch, W. (1988) ‘The role of knowledge in discourse com-
London, Nature Publishing Group, Macmillan. prehension: a construction-integration model’, Psychological
Garrod, S. and Pickering, M.J. (2004) ‘Why is conversation Review, vol.65, pp.163–82.
so easy?’ Trends in Cognitive Sciences, vol.8, pp.8–11. Krauss, R.M. and Weinheimer, S. (1967) ‘Concurrent feed-
Garrod, S. and Pickering, M.J. (2007) ‘Alignment in dia- back, confirmation and the encoding of referents in verbal
logue’, in Gaskell, G. (ed.) Oxford Handbook of Psycholinguistics, communications; effects of referent similarity and communi-
Oxford, OUP. cation mode on verbal encoding’, Journal of Personality and
Gibbs, R. (1983) ‘Do people always process the literal mean- Social Psychology, vol.4, pp.343–6.
ing of indirect requests?’ Journal of Experimental Psychology: Lakoff, G. (1987) Women, Fire and Dangerous Things,
Learning, Memory, and Cognition, vol.9, pp.524–33. Chicago, University of Chicago Press.
Giles, H. and Powesland, P.F. (1975) Speech Styles and Levelt, W.J.M. (1989) Speaking: From Intention to Articulation,
Social Evaluation, New York, Academic Press. Cambridge, MIT Press.
Giles, H., Coupland, N., and Coupland, J. (1992) Levelt, W.J.M. and Kelter, S. (1982) ‘Surface form and
‘Accommodation theory: communication, context and conse- memory in question answering’, Cognitive Psychology, vol.14,
quences’, in Giles, H., Coupland, J., and Coupland, N. (eds.) pp.78–106.
Contexts of Accommodation, Cambridge, Cambridge University Levin, I.P. and Gaeth, G.J. (1988) ‘How consumers are
Press. affected by the framing of attribute information before and
CHAPTER 7 L ANGUAGE IN ACTION 223
after consuming the product’, Journal of Consumer Research, Sanford, A.J., Fay, N., Stewart, A.J., and Moxey, L.M. (2002)
vol.15, pp.374–8. ‘Perspective in statements of quantity, with implications for
McKoon, G. and Ratcliff, R. (1992) ‘Inference during read- consumer psychology’, Psychological Science, vol.13, pp.130–4.
ing’, Psychological Review, vol.99, pp.440–66. Schegloff, E.A. and Sacks, H. (1973) ‘Opening up closings’,
Motley, M.T., Camden, C.T., and Baars, B.J. (1982) Semiotica, vol.8, pp.289–327.
‘Covert formulation and editing of anomalies in speech pro- Schober, M.F. and Brennan, S.E. (2003) ‘Processes of inter-
duction: evidence from experimentally elicited slips of the active spoken discourse: the role of the partner’, in Graesser,
tongue’, Journal of Verbal Learning and Memory, vol.21, A.C., Gernsbacher, M.A., and Goldman, S.R. (eds.) Handbook
pp.578–94. of Discourse Processes, Hillsdale, NJ, Erlbaum.
Pickering, M.J. and Garrod, S. (2004) ‘Toward a mechanis- Schober, M.F. and Clark, H.H. (1989) ‘Understanding by
tic psychology of dialogue’, Behavioral and Brain Sciences, addressees and over-hearers’, Cognitive Psychology, vol.21,
vol.27, pp.169–90. pp.211–32.
Pickering, M.J. and Garrod, S. (2005) ‘Establishing and Searle, J.R. (1980) ‘Minds, brains and programs’, Behavioral
using routines during dialogue: implications for psychology and Brain Sciences, vol.3, pp.417–24.
and linguistics’, in Cutler, A. (ed.) Twenty-first Century Stevens, G.J., Silbert, L.J., and Hasson, U. (2010, in press)
Psycholinguistics: Four Cornerstones, Hillsdale, NJ, Erlbaum. ‘Speaker-listener neural coupling underlies successful commu-
Pickering, M.J. and Garrod, S. (2007) ‘Do people use lan- nication’, Proceedings of the National Academy of Sciences.
guage production to make predictions during comprehen- Traxler, M.J. and Pickering, M.J. (1996) ‘Plausibility and the
sion?’ Trends in Cognitive Sciences, vol.11, no.3, pp.105–110. processing of unbounded dependencies: an eye-tracking study’,
Pinker, S. (1994) The Language Instinct, New York, Harper- Journal of Memory and Language, vol.35, pp.454–75.
Collins. Van Oostendorp, H. and De Mul, S. (1990) ‘Moses beats
Sanford, A.J. and Garrod, S.C. (1981) Understanding Adam: a semantic relatedness effect on a semantic illusion’,
Written Language, Chichester, John Wiley & Sons. Acta Psychologica, vol.74, pp.35–46.
Sanford, A.J. and Garrod, S. (1998) ‘The role of scenario Wilkes-Gibbs, D. and Clark, H.H. (1992) ‘Coordinating
mapping in text comprehension’, Discourse Processes, vol.26, beliefs in conversation’, Journal of Memory and Language,
pp.159–90. vol.31, pp.183–94.
Sanford, A.J. and Sturt, P. (2002) ‘Depth of processing in Wilshire, C.E. (1999) ‘The “tongue twister” paradigm as a
language comprehension: not noticing the evidence’, Trends in technique for studying phonological encoding’, Language and
Cognitive Sciences, vol.6, no.9, pp.382–6. Speech, vol.42, no.1, pp.57–82.
MEMORY
Introduction
9 Working memory
Graham J. Hitch
226 PART 3 MEMORY
INTRODUCTION
In Part 3 you will find two chapters dedicated to the One reason that these questions can be so hard to
topic of memory. Of course, you will have noticed that answer is introduced at the start of Chapter 8. It is that
all the previous chapters have already included explicit the functions of memory in normal everyday cogni-
references to and implicit assumptions regarding tion are so vast and diverse, and for the most part so
memory processes and/or memory stores. In the reliable and smooth running, that – as with the pro-
chapters of Part 1, the activation and utilization of cesses of vision – they are really quite hard to think
stored knowledge was frequently invoked in trying to about. It is perhaps on account of this that one theme
comprehend the processes of attention, perception, running throughout the chapter involves the impor-
and recognition. Similarly in Part 2, stored informa- tance of neuropsychological observations and studies
tion (e.g. the mental lexicon) was seen to be essential in understanding the cognitive psychology of mem-
to understanding categorization, language, and the ory. Of course, it is the case that any memory impair-
construction of successful discourse. The fact is that ment will itself be open to a variety of interpretations.
memory of one sort or another is integral to every Despite this, however, you will see in Chapter 8 that
form of cognition. However, the chapters in Part 3, neuropsychological data have played an important
and also Chapter 17 in Part 6, differ from the other part in the development of theories about the nature
chapters in that they take memory as their focus of of memory.
interest rather than as an important incidental to In Chapter 9, ‘Working memory’, the focus of inter-
some other major topic. est narrows further to take in just the memory stores
In Chapter 8, ‘Long-term memory: encoding to and/or processes involved simply in maintaining
retrieval’, the concern is to understand how informa- whatever information an individual has in mind, or in
tion gets into and is recovered from memory. More executing whatever tasks they are engaged upon at a
than that, the emphasis is on understanding how dif- particular moment. Although there are necessarily
ferent types of encoding and retrieval operations considerable areas of overlap between the two chap-
determine what gets remembered and in what form. ters, the altered focus of interest results in a definite
The quality of memory, it turns out, results from inter- difference in emphasis. Where Chapter 8 dealt with
actions between encoding processes, the kinds of cog- issues concerning how information comes to be stored
nitive representations that are constructed, and the and retrieved (or not), the emphasis in Chapter 9 is
types of retrieval operations that act upon those repre- more on the way in which available information is
sentations in fulfilling whatever goals a person is made use of. You will soon find, however, that while
intent upon. One theme of the chapter is the sheer dif- the focus of interest in Chapter 9 may seem rather nar-
ficulty of knowing how best to conceptualize memory. rower, working memory turns out to be an extensive
A major distinction is seen between the noun memory topic in its own right.
and the verbs memorizing and remembering or recol- As the chapter explains, the notion of working
lecting. That is, on the one hand, memory can be con- memory elaborates and extends upon the older and
ceived as a set of stores and, on the other, memory can simpler idea of a short-term memory store. Working
be thought of as a set of systems or processes. As you memory is conceived as a workspace with a limited
will see there are arguments and data that favour and capacity. But just as in Chapter 8 it proved necessary
count against both conceptualizations. Whichever to postulate a variety of different kinds of memory, so
conceptualization one opts for, there is then the prob- it turns out that working memory itself fractionates
lem of deciding how many stores or how many pro- into a number of component parts. Evidence for these
cesses to postulate. separate components comes from studies employing
INTRODUCTION 227
various techniques for selectively interfering with cog- a topic that is further expanded upon in Chapters 19
nitive performance. Once again neuropsychological and 20.
data bear strongly upon the issues, and evidence is One final theme to be found in Chapter 9 is that of
also adduced from studies employing neuroimaging individual differences. As described in Chapter 1, cog-
techniques. nitive psychology as a whole tends to play down indi-
The history of the idea of working memory pro- vidual differences in favour of an emphasis on what it
vides a good illustration of a point discussed in is that people have cognitively in common. This is
Chapter 1. You will see how the range of application of similar to the way in which anatomists emphasize the
the theory of working memory has been extended as considerable similarities in people’s bodies ahead of
the theory has developed, and how with this extension their individual variations. But psychology, to an even
researchers have become more confident of their the- greater degree than anatomy, cannot afford to overlook
ory. Chapter 9 also provides a discussion of the impor- individuality for long. In Chapter 9 you will see how
tance of computer modelling in the development and cognitive psychologists can make use of individual dif-
testing of cognitive theories, and introduces some ferences to test their theories, and also utilize their
illustrative examples. This chapter, therefore, previews theories to explain individual differences in cognition.
This page intentionally left blank
CHAPTER 8
LONG -TER M
MEMORY
Encoding to retrieval
Andrew Rutherford, Gerasimos Markopoulos, Davide Bruno, and
Mirjam Brady-Van den Bos
1 INTRODUCTION
Everyone appreciates how useful it is to have a good types of cars, dogs, or sporting events, or make a cup
memory. However, fewer people appreciate that hav- of tea or coffee. Given the essential role of memory in
ing a good memory is not just useful – it is vital to the our lives, it is not surprising that memory has been an
way we live our lives. Quite literally, our memory con- active area of research in psychology since its first sci-
tains everything we know. Yet, despite the vast amount entific investigation by the German philosopher
of information stored, memory almost always pro- Hermann Ebbinghaus in the 1880s.
vides accurate and rapid access to the pertinent infor- This chapter focuses on long-term memory, par-
mation we require. It is memory that tells us who we ticularly episodic memory, although there is also
are and what we have done, it is memory that provides some mention of semantic and implicit memory.
us with the words and grammar required to construct Episodic memory is a record of the episodes that con-
comprehensible sentences, and it is memory that stitute our lives. Episodic memory provides a descrip-
holds the information that lets us recognize different tion of what you have experienced (and thought)
230 PART 3 MEMORY
throughout your life. How these memories contribute then observing what can be remembered. Different
to your understanding of yourself is considered in manipulations can be applied at the encoding, storage,
Chapter 17. This chapter presents accounts of how and retrieval stages, depending on the purpose of the
episodic memory operates and some pertinent experi- study. However, irrespective of whether encoding,
mental evidence. Researchers interested in normal storage, or retrieval is of interest, all stages will have
memory usually examine people with normal memo- been involved when information is remembered.
ries, but they also examine people with abnormal There are two major theoretical approaches appar-
memory resulting from physical damage to the brain. ent in memory research and in contemporary cogni-
This may seem a peculiar way of finding out about tive psychology generally: the processing approach
normal memory, but an accurate account of normal and the systems approach (e.g. Foster and Jelic, 1999;
memory operation should also explain why and how Surprenant and Neath, 2009). As the names suggest,
its manner of operation changes when damage is sus- the processing approach emphasizes psychological
tained. More formally, it can be said that data from processing, while the systems approach emphasizes
neuropsychological studies provide useful constraints structures or systems, usually with distinct brain loca-
on psychological accounts of normal memory. Of tions. It will be apparent from the accounts presented
course, such studies also provide beneficial insight in the following sections that while most researchers
into the memory problems experienced by brain- adopt a processing approach, they also are influenced
damaged people. by the systems approach, and the two approaches cer-
Logically, memory involves three stages, encoding, tainly are not incompatible. Nevertheless, in some sec-
storage, and retrieval (getting information in, holding tions, especially Section 3, where memory stores and
it, and then getting it back out). Typically, psycholo- systems are considered, both approaches compete to
gists examine memory by presenting material and provide the superior theoretical account.
SUMMARY OF SECTION 1
• Our long-term memory contains all that we know and all that makes us who we are.
• Our memory operation is usually very efficient.
• Episodic memory is the record of our life experiences.
• Neuropsychological findings can constrain psychological accounts of normal memory.
• Memory involves three logical stages: encoding, storage, and retrieval.
• The processing and systems approaches are the major theoretical perspectives in memory research.
2 ENCODING
Encoding describes the way in which objects and processes can produce memory representations of
events in the world come to be represented in mem- objects and events that differ from those arising from
ory. Our normal perception of objects and events perceptual processes alone.
requires considerable encoding, but further encoding
CHAPTER 8 LONG-TERM MEMORY 231
2.1 Levels of processing are not items specially constructed for storage, but are
simply the traces of the processing operations left in
the cognitive system. The greater the depth of pro-
Craik and Lockhart’s (1972) levels of processing (LOP)
cessing applied to an item, the more elaborate, longer
article exerted a large influence on memory research.
lasting, and stronger are the memory traces produced,
Previously, accounts of memory performance were
and so the more likely it is that the item will be remem-
based on a fairly rigid memory systems viewpoint
bered (see Box 8.1).
encapsulated by Atkinson and Shiffrin’s (1968) ‘multi-
Of course, processing need not continue through all
store’ memory model (see Chapter 9). This proposed
levels. It may stop at any point when attention is
separate sensory registers for each sense modality,
diverted elsewhere, or, at any given level, the process-
along with a short-term memory store and a long-
ing already engaged may simply repeat rather than
term memory store. Craik and Lockhart considered
proceed through further levels. An example of repeti-
the multi-store model, but contrary to its proposals,
tive processing is verbally rehearsing a telephone num-
they argued that the major determinant of an item’s
ber to keep it ‘in mind’ before calling the number.
memorability was the LOP it received at encoding,
Craik and Lockhart labelled this Type I processing,
and not the store in which it was held or how long it
while Type II processing was the label applied to pro-
was held in this store (e.g. Baddeley et al., 2009). Craik
cessing that proceeded through further levels. (NB
and Lockhart presumed that processing followed a
This is wholly different to the use of the terms Type 1
fixed sequence of levels, from early perceptual pro-
and Type 2 processing in relation to reasoning – see
cesses through pattern recognition to the extraction of
Chapter 12.)
meaning. According to Craik and Lockhart, memories
BOX 8.1 RESEARCH STUDY Levels of processing (LOP) and memory performance
Craik and Tulving (1975, Experiment 1) presented phonetic perceptual processing must also be
subjects with a question followed by a word. engaged to answer question 2. Questions 3 and 4
Subjects had to answer ‘yes’ or ‘no’ to the question, both required semantically oriented processing, but
and then later their recognition memory for the more elaborative semantic processing was required
words was tested (see Table 8.1). to answer question 4 than question 3. As predicted,
As the words were presented visually, visual pro- subjects’ recognition memory performance in-
cesses were always engaged. Graphemic perceptual creased with deeper LOP.
processing alone was required for question 1, but
Proportion correctly recognized (%)
100
TAB LE 8 .1
80
Question Yes No 60
Although the LOP framework provided a different assumption of a fixed sequence of processing levels
perspective on the nature of memory and had sub- from perception to semantic elaboration. Although
stantial empirical support, there are problems with the this view is in keeping with the serial processing per-
account (e.g. Baddeley, 1978). Obtaining a valid meas- spective of the 1970s, there is greater appreciation now
ure of processing depth that is independent of the of how much parallel processing underlies cognition.
amount remembered is a particular problem. Without There are also memory phenomena for which the
this, processing level can be defined only in a circular LOP framework offers no explanation. For example,
fashion – deeper levels of processing improve memory Glenberg et al. (1977) and Rundus (1977) presented
performance, so any improved memory performance numbers for subjects to remember, but to stop them
can be taken to indicate a deeper level of processing rehearsing the numbers they had to rehearse words
and any lack of memory performance improvement for various durations. In these circumstances, it was
can be interpreted as a failure to deepen the LOP at expected that the words would be maintenance
encoding. The consequence of such a circular defini- rehearsed. However, subjects were asked to free recall
tion is that LOP predictions cannot be refuted and so the words at test, rather than the numbers. As
cannot be tested properly. Another problem is the predicted by Craik and Lockhart’s LOP account,
Subjects were presented with nouns they had to Phonetically non-distinct processing (P–ND) of
process in a semantically distinct (S–D) fashion by nouns was obtained by having subjects maintain the
providing a descriptor (e.g. an adjective) that would conventional pronunciation.
be used infrequently to modify the noun (e.g. thin The results showed that there was very little
house). Semantically non-distinct processing (S– difference in recognition performance after
ND) was fostered by having subjects provide a fre- semantic distinctive, semantic non-distinctive, and
quently used descriptor to modify the noun (e.g. phonetic distinctive processing, but there was a
large house). Phonetically distinct processing (P–D) significant drop after phonetic non-distinctive pro-
was achieved by presenting subjects with nouns pro- cessing. Therefore, semantic processing enhances
nounced differently to the way their spelling sug- memory performance, but distinctive processing,
gests, but subjects had to pronounce the words in even with phonetic processing, can lift memory
line with their spelling (e.g. the usually silent ‘b’ in performance to the level observed with semantic
comb had to be pronounced at the end of the word). processing.
Mean number of words recognized
24
22
20
18
16
14
12
10
8
6
4
2
0
P-ND P-D S-ND S-D
Type of processing at encoding
BOX 8.3 RESEARCH STUDY Item-specific and relational processing, free recall and
recognition
Hunt and Einstein (1981, Experiment 1) presented were tested. However, prior to these tests, sub-
subjects with either a categorized list of 36 words jects were required either to sort the words into
(six words from each of six categories) or 36 unre- specified categories (a relational processing task) or
lated words. Subjects were assumed to process the to rate the pleasantness of the words (an item-
categorized words spontaneously in a relational specific processing task). Subjects read a short story
fashion, while subjects receiving the unrelated for one minute before trying to free recall the 36
words were assumed to process them spontane- words. Recognition was tested after free recall.
ously in an item-specific fashion. For both catego- Table 8.2 below presents the average free recall and
rized and unrelated lists, free recall and recognition recognition scores.
TAB LE 8 . 2
1Correct free recall as a proportion of total number of items presented (i.e. 36).
2AG scores – a non-parametric measure of recognition sensitivity.
BOX 8.4 RESEARCH STUDY Self memory bias created through ownership
Van den Bos et al. (2010) created a self memory bias self cue – that is, when the self is involved in encod-
via ownership. Subjects had to imagine they and a fic- ing, material is encoded such that it is easily retrieved
tive other student, ‘John’, had won a basket of super- in great detail, making self referential encoding a
market shopping items. Two baskets were shown on very effective encoding technique.
a monitor and subjects were told which was theirs.
Shopping items were then shown on the monitor and
subjects had to put these into their own or John’s
0.6
basket on the basis of the colour border around the 0.5
Hit rate
item. This basic sorting task did not require subjects 0.4
to engage in elaboration or self evaluation. 0.3
0.2
Performance on a remember (R)-know (K) rec- 0.1
ognition task (see Section 4.4) was better for self 0
Self-R Other-R Self-K Other-K
owned than for other owned items but only with R
responses. This suggests elaboration of item repre- FIGU RE 8 .4 Hit rate as a function of ownership and
sentations occurs spontaneously when perceiving a response type.
recall and recognition, is linking information to the review of the self reference effect.)
self. (See Box 8.4 and Symons and Johnson, 1997, for a
SUMMARY OF SECTION 2
• The levels of processing (LOP) framework was a counter to the multi-store memory model.
• The levels of processing framework asserted that memorability was due to the level of processing
engaged at encoding – not the store in which an item was held.
• Distinctive (item-specific) processing can benefit memory independently of the level of processing.
• Relational and item-specific are two important types of processing.
• Item-specific processing enhances the operation and coherence of the cognitive processes carrying
mental representations, and benefits processing fluency.
• Relational processing establishes connections between item representations.
• The self reference effect (SRE) refers to superior recall or recognition following self referencing than
following other types of encoding.
• The SRE is apparent in remember (R) but not in know (K) responding.
the processes that operate when memory representa- Declarative and non-
3.1
tions are active, such as the processes that generate the
image of your favourite item of clothing. The memory declarative memory systems
systems perspective is that memory stores and mem-
ory processing are localized in the same part of the An influential memory systems perspective was pre-
brain. This view receives some support from research sented by Squire (e.g. Cohen and Squire, 1980; Squire,
on connectionist systems, where representation and 2007). Squire’s main focus was the amnesic syndrome
processing are intimately related. (see Box 8.5), but his memory systems perspective
Neuropsychological and neuroimaging data have also addressed and was soon applied to normal mem-
exerted greater influence on theoretical accounts of ory. The amnesic syndrome is a gross memory impair-
memory systems than on theoretical accounts of ment due to an organic cause.
memory encoding or memory retrieval. However, However, amnesics also exhibit normal or close to
there also has been considerable theoretical and normal learning on tasks such as priming and psycho-
empirical dispute about memory systems accounts. motor skills (for a brief review see Eysenck and Keane,
2010; for a more detailed account see Spiers et al., However, so little is known about consciousness and
2001). Squire argued that the tasks on which amnesics its relationship with representational format that
exhibited their gross impairment depended upon one equating declarative memory with conscious access
particular neurologically-based memory system, should be appreciated as a change in the nature of the
whereas those tasks amnesics still could perform classification rather than an expression of any under-
relied upon a different neurologically-based memory standing. Declarative memory would operate if you
system. Initially, Squire applied a distinction between were asked ‘What is the capital of Scotland?’ The name
declarative and procedural knowledge drawn by the of the city, ‘Edinburgh’, should enter consciousness
philosopher Ryle (1949). Squire later modified his and you would be able to state ‘The capital of Scotland
classificatory scheme (e.g. Squire, 1987; Squire, 1992) is Edinburgh’. Similarly, if asked ‘Was this picture pre-
to distinguish between a single declarative memory sented before?’, a memory of the previous presentation
system and a heterogeneous group of non-declarative of the particular picture should enter consciousness
memory systems (see Figure 8.7). and, again, it would be possible to state ‘This picture
Declarative memory refers to memory for facts. was presented before’. In contrast, non-declarative
Initially, Squire described declarative memory as memory refers to a group of behaviours that are
being memory for certain process outputs, but later affected by stored information (i.e. memory), but
the key feature of the declarative memory system was there is no conscious awareness of the information
described as being conscious awareness of the infor- retrieved (cf. implicit memory). Unfortunately, while
mation retrieved (cf. explicit memory). A declarative these descriptions may be consistent with experience,
format provides an explicit representation of informa- they provide no explanation of how and why these
tion, which presumably benefits conscious access. conscious and unconscious experiences arise.
238 PART 3 MEMORY
LTM
Declarative Non-declarative
Emotional Skeletal
responses musculature
FIGU RE 8 .7 Declarative and non-declarative memory systems and the brain regions with which they are associated.
Adapted from Squire (2007). NB Medial temporal lobe structures emerge as elaborations of the medial edge of the
temporal cortex.
TAB LE 8 . 3 Schacter and Tulving’s systems and sub- was drawn between semantic and episodic memory
systems of human learning and memory (Schacter and (Tulving, 1972). Squire’s main claim is simply that
Tulving, 1994; Schacter et al., 2000)
declarative memory output enters consciousness.
System Other labels Sub- Retrieval
Schacter and Tulving agree, but they also attribute a
systems type separate and unique character to the type of con-
sciousness supported by episodic memory.
Primary Working Visual Explicit
memory memory Auditory The multiple memory systems perspective, particu-
Semantic General Spatial Implicit larly the semantic and episodic distinction, has received
Factual Relational far greater criticism than Squire’s account of declarative
Knowledge and non-declarative memory systems (e.g. McKoon
Episodic Personal Explicit et al., 1986; Neely, 1989; Roediger et al., 1999; Toth and
Autobiographical Hunt, 1999; Surprenant and Neath, 2009; Shanks, 1997).
Events However, a benefit of this has been greater theoretical
Perceptual Non-declarative Visual word Implicit development of the multiple memory systems account.
representation form For example, Roediger (e.g. Roediger et al., 1990;
Auditory
Roediger et al., 1999) criticized the multiple memory
word form
systems perspective for failing to define the criteria by
Structural
description which systems should be classified and distinguished.
Procedural Non-declarative Motor skills Implicit Clearly, it is essential to know exactly what a memory
Cognitive system is (and isn’t) when it is presented as an explana-
skills tion of memory phenomena. A theoretical account of
Simple what constitutes a memory system is vital because it
conditioning defines (i.e. constrains) what is and what isn’t a memory
Simple system and so distinguishes its predictions from other
associative
learning theoretical accounts. Roediger et al. (1999) attribute the
proliferation of inconsistent memory system models to
this failure. Crowder (1993) states that a memory system
system. Both Squire and Schacter and Tulving present must involve more than just the identification of the
procedural memory systems, but while Schacter and brain structure(s) carrying out the cognitive operations
Tulving accommodate simple conditioning (i.e. classi- for a specific task. As all cognitive processes have a neu-
cal but not operant conditioning) and simple associa- ral basis, simply defining a memory system as the brain
tive learning within the procedural memory system, structure(s) that carry out the cognitive operations for a
Squire attributes associative learning (i.e. classical and specific task does no more than state where in the brain
operant conditioning) to a separate non-declarative these processes run and is as compatible with the pro-
memory system. Comparing non-declarative memory cessing perspective as it is with the multiple memory
systems also reveals that Schacter and Tulving omit systems perspective. However, if more and more mem-
any mention of operant conditioning and non-associ- ory systems are postulated, then more and more brain
ative learning. locations will be running different cognitive processes.
The same quick glance also suggests agreement The processing perspective tends not to identify pro-
between Squire’s declarative (facts and events) mem- cesses with brain locations, but many processes running
ory system and Schacter and Tulving’s semantic (facts) in different parts of the brain is the default processing
and episodic (events) memory systems. However, perspective. Therefore, as more and more memory sys-
Squire presents a single declarative memory system tems are postulated, so the difference between multiple
responsible for the retrieval of both facts and events, memory systems and processing perspectives dimin-
whereas the first multiple memory systems distinction ishes.
240 PART 3 MEMORY
In response to these and related criticisms, Schacter semantic information. Given the continual sharing
and Tulving (e.g. Schacter and Tulving, 1994; Schacter and blending of semantic and episodic information
et al., 2000) presented the following three criteria to required, a single system rather than two separate sys-
define a memory system: tems seems a more attractive and likely design. To
address some of these criticisms, Tulving (1984) pro-
• Class inclusion operations – different memory
posed that the easy influence of semantic information
systems operate on different kinds of information
on episodic memory was due to episodic memory
from different classes or domains.
being a recent evolutionary development arising out
• Properties and relations – separate memory of, but embedded within, semantic memory. Unfor-
systems are defined differently with respect to a set tunately, however, exactly how this enabled access and
of properties and relations, such as their influence was not explained.
information class or domain (see above), system The memory systems perspective and the distinction
function and rules of system operation, and neural between semantic and episodic memory was adopted
substrates. readily by neuropsychologists. Neuropsychological data
• Convergent dissociations – memory systems should obtained from amnesic patients already had influenced
exhibit multiple and consistent dissociations, e.g. views about short-term and long-term memory (e.g.
between two specific tasks, between sets of similar Baddeley and Warrington, 1970) and it also exerted a
tasks, between patients with and without specific strong influence on the semantic-episodic memory dis-
brain damage, or when the different memory tinction.
systems have different physiological characteristics. The amnesic syndrome includes a retrograde com-
ponent extending back months or even years from the
Nevertheless, Roediger et al. (1999) considered these amnesia-inducing trauma, but amnesics typically
definitions to be inadequate, and by way of illustration retain normal memory for events that occurred prior
they made the point that these criteria would draw an to this period (see Box 8.5). As the brain damage caus-
untenable distinction between a recall memory sys- ing the amnesic trauma does not affect access to these
tem and a recognition memory system. A theoreti- long established memories, it suggests the damaged
cally complete specification of what constitutes a neural substrate is not the memory store. This, along
memory system remains elusive. with the apparent inability to form new memories,
implies the amnesic syndrome is due to problems with
The semantic–episodic distinction:
3.3.1
one or more of the processes that encode or retrieve
cognitive/neuropsychological evidence these new memories.
The semantic and episodic distinction is a useful Tulving (1983) argued that the amnesic syndrome
descriptive heuristic, but many psychologists remain is due to a severe deficit in episodic memory com-
sceptical about the multiple memory systems perspec- bined with an intact semantic memory. The retention
tive, and many doubt the specific distinction between of amnesics’ intellect and language skills demonstrates
semantic and episodic memory systems (e.g. Baddeley, a substantial part of their semantic memory operates
1984). As all memories are encountered first through normally. Nevertheless, some studies indicated amne-
experience, it seems the first destination of all encoded sics’ semantic and episodic memory were equally
information must be episodic memory. Therefore, for impaired in acquiring new information, and the
semantic memory to develop there must be a well- apparently normal operation of semantic memory
worn route from episodic to semantic memory (see arose from the use of semantic information acquired
Box 8.6). However, most, if not all, of our episodic prior to the amnesic trauma (e.g. Cermak and
memories are understood in semantic terms. O’Connor, 1983; Gabrieli et al., 1988; Grossman,
Anderson and Ross (1980) demonstrated that epi- 1987). These findings appeared to contradict the view
sodic memory information affects the retrieval of that the amnesic syndrome was due to a severe deficit
CHAPTER 8 LONG-TERM MEMORY 241
Consistent with episodic memory being the first while the associated contexts, without the benefit
destination of all encoded information is a concep- of such repetition, will become inaccessible or will
tion of semantic memory as an abstraction of epi- fade from memory (e.g. Baddeley, 2002). A num-
sodic experience. Common aspects of episodes ber of possible cognitive and biologically oriented
are, by definition, experienced repeatedly. In con- systems have been described that, consistent with
trast, there is an inconsistent association between this perspective, utilize information retrieved
the common aspects of the episodes and the vari- (repeatedly) from episodic memory to construct
ous contexts in which they occur. As a result, the semantic memory representations (e.g. Hintzman,
common aspects of the episodes will be well 1986; McClelland et al., 1995; Rolls and Kesner,
learned and will be easily and speedily retrieved, 2006).
in episodic memory combined with an intact seman- exhibited severely impaired episodic memory, but was
tic memory. able to perform normally on less demanding semantic
However, Spiers et al. (2001) examined 147 cases of memory tasks. Although PS did show performance
amnesia where hippocampus or fornix had been dam- impairment when the semantic task retrieval demands
aged. All cases exhibited episodic memory impair- increased, these findings are generally consistent with
ment, but most semantic memory problems were mild. Vargha-Khadem et al.’s (1997) suggestion that episodic
Moreover, Vargha-Khadem et al. (1997) described the memory relies upon the hippocampus, while semantic
cases of three patients, two of whom had sustained memory depends upon the entorhinal, perirhinal, and
bilateral hippocampal damage at a very young age – parahippocampal cortices, which are adjacent and
Beth at birth and Jon at 4 years old. Both exhibited input to (as well as receive output from) the hippocam-
extremely poor episodic memory, but they attended pus (also see Section 4.4 and Figure 8.14). As all of
normal schools and their language development, liter- these structures are not only linked and adjacent, but
acy levels, and factual knowledge were within the nor- occupy a relatively small area in the medial temporal
mal range. (Beth and Jon’s condition is known as lobe (MTL), it is likely that most amnesics (e.g. those
developmental amnesia or early onset amnesia.) A few studied by Cermak and O’Connor, Gabrieli, and
years later, Baddeley et al. (2001) reported the results of Grossman) will have suffered damage to both hip-
a number of assessments carried out with Jon between pocampus and adjacent areas, with the result that both
the ages of 19–22. Jon’s level of intelligence was above semantic and episodic memory will be impaired. These
average (WAIS-R full scale IQ = 114) and again, he findings are consistent with a distinction between
exhibited normal performance in tests of language and semantic and episodic long-term memory systems, but
general knowledge. However, as before, he showed the data from Beth, Jon, and PS also suggest that
impaired recall and appeared to lack the normal expe- semantic memory may arise without episodic memory
rience associated with episodic memory. Indeed, a (cf. Tulving, 1984, and Box 8.6).
subsequent study by Brandt et al. (2006) suggested that
much of Jon’s recall of episodic information was based The semantic–episodic distinction:
3.3.2
these new techniques revealed was that a large num- ations (Henke et al., 2003). Findings of this sort have
ber of different regions of prefrontal cortex (PFC) maintained the debate about hippocampal involve-
were involved in semantic and episodic memory tasks. ment in semantic memory retrieval.
PFC involvement in memory has been attributed to However, in a functional magnetic resonance imag-
executive control of memory processing (e.g. Cabeza ing (fMRI) study, Hoscheidt et al. (2010) matched epi-
and Nyberg, 2000), which is consistent with the prob- sodic and semantic tasks in terms of spatial content
lem solving activities (selecting, planning, organizing, and observed hippocampal activation not only when
and monitoring) underlying memory operation sug- episodic memories were retrieved, but also when
gested by Norman and Bobrow’s account of memory semantic memories with spatial content were
encoding and retrieval (Norman and Bobrow, 1979; retrieved. They concluded that the hippocampus was
Norman, 1982; see Section 4.2). involved in the retrieval of spatial information irre-
Functional neuroimaging research has observed spective of its semantic or episodic designation, and
activation in PFC and MTL as well as cerebellar so sharp dissociations between semantic and episodic
regions during episodic memory encoding (e.g. memory systems must be overly simplistic. Prince
Cabeza and Nyberg, 2000), while activation is et al. (2007) employed fMRI to investigate the rela-
observed in PFC and MTL as well as lateral parietal, tionship between episodic encoding and semantic
anterior cingulate, occipital, and cerebellar regions retrieval. Using word stimuli, activation in left hip-
during episodic memory retrieval (e.g. Cabeza and pocampus (and thalamus) was associated only with
Nyberg, 2000). More recently, functional neuroimag- episodic encoding, and activation in a posterior lateral
ing research has started to identify the types of pro- region of the left temporal lobe was associated only
cessing implemented by specific areas of the with retrieval from semantic memory. In the left infe-
hippocampal formation (e.g. Carr et al., 2010). rior PFC, a dorsal posterior region was active during
Neuroimaging (and neuropsychological) research retrieval from semantic memory, a mid-region was
suggests that semantic memory is a collection of func- active during retrieval from semantic memory and
tionally and anatomically distinct systems. In these episodic encoding, and a ventral anterior region was
systems, information about each semantic attribute is active during episodic encoding, but only when there
usually linked to a sensorimotor modality (e.g. vision) was a high level of retrieval from semantic memory.
and sometimes an even more specific property within Prince et al. suggest that these data indicate a unique
that modality (e.g. colour; see Thompson-Schill et al., role for the hippocampus in episodic encoding, and
2006 and Patterson et al., 2007 for neuroscience orien- that the inferior PFC may have a complex role in the
tated reviews of semantic memory). Nevertheless, interaction between episodic encoding and semantic
there are inconsistencies between the neuroimaging memory retrieval. Nevertheless, debate continues as
data, usually obtained from normal subjects, and the to whether the amnesic syndrome is best described in
data obtained from the neuropsychological study of terms of a single damaged declarative memory system,
amnesic patients (e.g. Ryan et al., 2008). For example, or a damaged episodic memory system and an intact
there is currently an absence of neuroimaging evi- semantic memory system (e.g. Bayley and Squire,
dence supporting the special role of the entorhinal, 2005; Burianova and Grady, 2007; O’Kane et al., 2004;
perirhinal, and parahippocampal cortices in the Rajah and McIntosh, 2005; Squire et al., 2004).
development of semantic memory. Moreover, hip- A constant theme of recent research on semantic
pocampal activation has been associated with the and episodic memory is the issue of system interde-
retrieval of a number of different kinds of well-estab- pendencies (even within semantic memory) with a
lished semantic information, such as category exem- strong emphasis on semantic and episodic memory
plars (Ryan et al., 2008), spatial relations between systems operating in concert to support normal mem-
objects (Ryan et al., 2010), famous faces (Bernard ory function (e.g. Baddeley et al., 2009; Eysenck and
et al., 2004; Leveroni et al., 2000), historical events Keane, 2010). Greenberg and Verfaellie (2010)
(Maguire and Mummery, 1999), and semantic associ- reviewed neuropsychological studies and concluded
CHAPTER 8 LONG-TERM MEMORY 243
that semantic and episodic memory can influence each issues also raise questions about exactly what consti-
other at encoding and retrieval, and so theories should tutes a system, exactly what benefits accrue from the
accommodate the interdependencies between the two theoretically loaded notion of separate systems, and
types of memory. Indeed, the extent of these interde- whether this is preferable to a process-orientated con-
pendencies has led researchers to suggest that a clear- ception (e.g. Roediger et al., 1999). It seems that a theo-
cut distinction between semantic and episodic memory retical interpretation of memory in terms of semantic
systems is too simplistic (e.g. Hoscheidt et al., 2010; and episodic systems still merits caution.
Prince et al., 2007; Rajah and McIntosh, 2005). These
SUMMARY OF SECTION 3
• Non-active memory representations are held in a memory store.
• The memory systems perspective regards memory storage and processing as occurring within a
system localized within the brain.
• Declarative and non-declarative memory systems and multiple memory systems have been
proposed.
• The multiple memory systems perspective advocates a large number of memory systems and
sub-systems, including episodic and semantic memory.
• A theoretically sufficient definition of what constitutes a system remains elusive.
• Debate continues as to which theoretical approach (processing or systems) or which memory
systems perspective provides the best theoretical account of the data.
• Neuropsychological and neuroimaging evidence exert a strong influence on theory development in
this area of research.
• If the multiple memory systems perspective is adopted, then substantial interaction between seman-
tic and episodic memory systems must be accommodated.
4 RETRIEVAL
Retrieval is the label given to the way memory infor- the role of cues in memory retrieval. They suggested
mation is obtained for use. Retrieval involves finding, that specific retrieval cues facilitate recall only if they
activating, and sometimes further processing perti- and their relation to the target item are stored along
nent memory representations. with the target item. In their study, subjects were pre-
sented with target words written in capitals. Also pre-
sented with each target word were zero, one, or two
4.1Encoding specificity and weakly associated words written in lowercase (e.g.
MUTTON, fat, leg; CITY, dirty, village). Subjects were
transfer appropriate told that the words in lowercase might help them
processing remember the capitalized target words and to try and
think about how the lowercase words were related to
Tulving and Osler (1968; see also Tulving, 1983) intro- the target words. Tulving and Osler found a single
duced the encoding specificity hypothesis to explain weak associated aided recall of the target word,
244 PART 3 MEMORY
provided the weak associate had been presented at overlap between the processes engaged at encoding
learning. Neither one nor two weak associates aided and retrieval and predicts best memory performance
recall if they had not been presented at learning – will be observed when the processes engaged at
recall was not assisted by the provision of these cues at encoding transfer appropriately to retrieval (see
test alone. Successful retrieval of the target item Box 8.7). However, Craik (2002) noted that although
increased with the overlap between the information Morris et al.’s (1977) data reveal the interaction
stored in memory and the information employed at between encoding and retrieval predicted by TAP, best
retrieval (Tulving, 1979). memory performance was observed when semantic
The transfer appropriate processing (TAP) hypoth- processing was employed at both encoding and
esis also emphasizes the overlap between encoding retrieval. So, while the encoding–retrieval processing
and retrieval, but Morris et al. (1977; see also Bransford match is important, it may not be the main reason for
et al., 1979) presented TAP to assert the role of the memory performance observed (see Section 4.2).
retrieval processing, which had been ignored in Craik Encoding specificity deals with information and
and Lockhart’s (1972) LOP account. TAP refers to the TAP deals with processing, but these distinctions may
Morris et al. (1977, Experiment 2) presented sub- When rhyme (phonetic) processing was employed
jects with a list of words (e.g. CAT, TABLE). All sub- at encoding, memory performance was best when
jects received two types of orienting question: rhyme (phonetic) processing was employed at test.
‘Does the word rhyme with hat? Does the word Similarly, when semant ic processing was employed
rhyme with label?’, which require phonetic process- at encoding, memory performance was best when
ing to answer, or ‘Is it an animal? Do you sit at it?’, semantic processing was employed at test. So, as
which require semantic processing to answer. TAP predicts, memory performance is best when
Subjects then split into immediate test and test after the encoding processes transfer appropriately to
24 hour groups. For each test group, half of the sub- retrieval.
jects were asked to recognize which of a set of
words rhymed with any of the words presented
originally (e.g. which of these words rhyme with
those presented originally: FIRE, MAT, STAIR, 0.5
Adjusted proportion correct
as a function of orienting task and recognition task FIGU RE 8 . 8 Adjusted proportion of items correctly
for the 24 hour delay test group, and Figure 8.9 pre- recognized as a function of encoding task and test
sents a schematic of the TAP experimental design. type after 24 hours.
CHAPTER 8 LONG-TERM MEMORY 245
Condition A
P items: Phonemic
recognition test Study-test match
S items: Standard
recognition test Study-test match
(semantic)
FIGU RE 8 .9 A schematic depiction of the TAP experimental design. Source: based on Morris et al., 1977
be different sides of the same coin. Both accounts Surprenant and Neath (2009) consider the ‘relative
emphasize the relationship between encoding and distinctiveness’ of a target item at retrieval to be a
retrieval, and the benefit to memory performance principle of memory (e.g. a single long word in a list of
when encoding conditions are repeated at retrieval. As short words).
information at encoding and at retrieval is manifest by In a classic article, Norman and Bobrow (1979) sug-
cognitive processes, it may be more a matter of expres- gested that entities may be encoded with varying degrees
sion rather than psychological substance whether of specificity depending on a number of factors, such as
information or processes are repeated. task demands. Similarly, successful memory retrieval is
determined by two factors: constructability – the extent
to which pertinent descriptions of memory targets can
be constructed – and discriminability – the extent to
4.2The diagnostic value of which target memory records can be discriminated
retrieval cues from all other records in memory. Therefore, successful
memory retrieval requires the construction of unique
Nairne (2002) argued that contrary to encoding speci- memory records that can be discriminated from all
ficity and TAP accounts, the match between the cues other records in memory. Unfortunately, however, even
employed at retrieval and the information represented when a unique memory record is constructed, it may
in memory may not be the key factor determining not remain unique after further items and events are
successful memory retrieval. Instead, Nairne argued encoded.
that successful memory retrieval is determined by the Table 8.4 presents the four retrieval aspects or sub-
diagnostic value of the retrieval cues employed – diag- processes described by Norman and Bobrow (1979;
nostically valuable cues distinguish target memory Norman, 1982, added a fourth in an updated account).
records from all other records in memory. Indeed, The particular circumstances and constraints under
246 PART 3 MEMORY
TAB LE 8 .4 Four retrieval sub-processes with outlines generally observed when semantic encoding and
of their inputs and outputs retrieval are employed. It is worth noting that Norman
and Bobrow’s account reveals that a substantial part of
Sub-process Input to Output from
sub-process sub-process what is classed as memory retrieval might be charac-
terized better as problem solving (see Chapter 10).
Retrieval (Partial) Target
specification perceptual description* The retrieval specification, evaluation, and failure
descriptions diagnosis sub-processes all involve some form of
(Partial) Verification problem solving, assessment, or decision making with
description(s) of criteria* regard to the information to be input or output, and
purposes/needs
only the matching sub-process, which attempts to fit
Matching Target Memory records
the target description to the memory records, can be
descriptions
regarded as a pure memory process.
Evaluation Memory records Success or
failure:*
Verification if success
criteria terminate Accounts of recognition
4.3
if failure diagnose
Failure diagnosis Information from Revised retrieval memory
evaluation specification
process The single process signal detection
4.3.1
model of recognition
* – may require memory retrieval
Source: Modified from Norman, 1982 Signal detection theory (e.g. Swets, 1959; Green and
Swets, 1966; Macmillan and Creelman, 2005; Wickens,
which retrieval occurs are likely to influence the four 2002) applied to memory provides the basis for the
sub-processes differently (e.g. time-limited recogni- single process account of recognition memory perfor-
tion is likely to employ restricted retrieval specifica- mance (e.g. Ratcliffe et al., 1992). Originally, signal
tions and evaluations, and abandon failure diagnosis). detection theory (SDT) was a theory about how sen-
Norman and Bobrow’s notions of target descriptions sory and perceptual detection decisions were made –
(i.e. memory probes), continuous cycles of retrieval only later was it applied to recognition decisions (e.g.
specification, and matching, evaluation, and failure Banks, 1970; Lockhart and Murdock, 1970; Parks,
diagnosis (frequently based on partial information) 1966).
running until retrieval succeeds or memory retrieval The single process signal detection (SPSD) model
is terminated, were used and developed in many for- of recognition assumes that all of the events or items
mal and informal memory models (e.g. Eich, 1985; to be discriminated differ only in terms of the ampli-
Gillund and Shiffrin, 1984; Hintzman, 1988; tude of a unidimensional quantitative measure. A
Humphreys et al., 1989; Morton et al., 1985; Murdock, great deal of recognition memory research labels this
1993) and are now part of the general vocabulary of measure familiarity, but to avoid confusion here,
memory operation. strength of evidence will be used.
Norman and Bobrow (1979) suggested that seman- When applied to recognition memory, the SPSD
tic encoding provides a very rich encoding ‘vocabu- model assumes that some retrieval process interro-
lary’ in comparison with other coding schemes (e.g. gates the memory representation and outputs a
there are a limited number of different phonemes, but strength of evidence signal. Target events or items pre-
the range of semantic elements and their combination sented and encoded in an experiment will provide
is limited only by imagination). The greater distinc- greater strength of evidence signals than other entities
tiveness (diagnostic value) available from such coding in memory that were not presented and encoded in
could explain why superior memory performance is the experiment. In principle, the process outputting
CHAPTER 8 LONG-TERM MEMORY 247
the strength of evidence signal could assess and pro- of evidence signals above the response criterion elicit
vide strength of evidence signals for all items in mem- ‘recognized’ responses and all items returning strength
ory. However, the recognition test only requires of evidence signals below the response criterion elicit
discrimination between items previously presented ‘not recognized’ responses. Applying some mathemat-
(i.e. targets) and items not presented previously (i.e. ics relating the underlying target and distractor
distractors), so the strength of evidence signals for strength of evidence distributions, the proportion of
only these items need be considered. The SPSD model correctly identified targets (i.e. hits) and the propor-
assumes that if strength of evidence signals for all tar- tion of falsely recognized distractors (i.e. false alarms)
gets and distractors were obtained and the frequency provides subjects’ responses in SDT terms. For exam-
of these strength of evidence signals were plotted, then ple, the ability to discriminate between the distribu-
two distributions would be observed. Target items tions of targets and distractors – as assessed by the
would be distributed higher (more to the right) on the distance between two equivalent points on the target
strength of evidence axis than the distractor items that and distractor distributions (e.g. the apex of each dis-
were not encoded previously in the experiment (see tribution) – is termed d´ (‘dee prime’), while the loca-
Figure 8.10). tion of the response criterion (measured as a positive
When the x-axis represents ‘strength of evidence’, it or negative distance from the point of intersection of
is assumed that subjects are not aware of the strength the two distributions) is termed C (‘see’). It is assumed
of evidence signal distributions depicted in Figure that d´ is fixed but subjects can change C. (In Figure
8.10. (Log likelihood recognition decision models do 8.10, the response criterion, C, is set at the point of
assume that subjects have some knowledge of these intersection of the two distributions – the optimum
distributions, e.g. Shiffrin and Steyvers, 1997; point for maximizing HR and minimizing FAR.) A
McClelland and Chappel, 1998.) For each target or useful way of depicting both SDT expectations and
distractor item presented for recognition, the retrieval subjects’ actual responses is to plot HR against FAR
process outputs a strength of evidence signal and sub- for different response criteria. Usually, different
jects have to make a recognition decision about each response criteria are obtained by asking subjects to
item based on each strength of evidence signal. rate their confidence that each memory probe is a tar-
Consequently, strength of evidence SPSD models get. This form of plot is known as a receiver operating
assume that subjects make their recognition decisions characteristic (ROC) curve. A ROC curve that is sym-
depending on whether the item’s strength of evidence metrical along the minor diagonal (from top left cor-
signal is greater than a (response) criterion they set. ner to bottom right corner) is predicted by the classic
All items returning (via the retrieval process) strength single process SDT account (see Figure 8.11). The left-
most point on the ROC curve reflects the HR and FAR
C for the strictest criterion location (i.e. greatest confi-
Respond ‘new’ Respond ‘old’ dence that the test item is a target). The sensitivity to
targets and distractors is the same for each point on
Distractor Target the ROC curve (an alternative name for a ROC curve
CRR HR
distribution distribution
is isosensitivity curve). Greater sensitivity is indicated
by curves that fall towards the upper left region of the
graph, where the hit rate is greater and the false alarm
MR FAR rate is lower. More liberal response criteria are indi-
Strength of evidence cated by points toward the right-hand ends of the
ROCs, where both hit and false alarm rates are greater.
FIGU RE 8 .10 Signal detection model for recognition.
HR = hit rate, FAR = false alarm rate, MR = miss rate, Unfortunately, however, the empirical data from
CRR = correct rejection rate, C = old/new criterion. recognition experiments most frequently provide
Source: Bruno et al., 2009 asymmetrical ROCs. SPSD model accounts attribute
248 PART 3 MEMORY
Yonelinas (1994) argues that asymmetric curvilin- However, discriminating between the different ROC
ear recognition ROC curves are due to some items curves predicted by SPSD and DPSD models can be a
being recognized on the basis of recollective retrieval difficult task (e.g. Mickes et al., 2010).
and some items being recognized on the basis of The DPSD recognition account and Hunt and
familiarity-based retrieval. In a number of studies, Einstein’s (1981) experimental results offer an expla-
Yonelinas (1994, 1997, 2001) obtained data that fit his nation for the findings obtained by Glenberg et al.
DPSD model predictions closely (see Box 8.8). (1977) and Rundus (1977) reported in Section 2.1.
Yonelinas (1997) proposed that recognition mem- pairs correctly was to access information in the
ory for single items (e.g. words) is based upon two memory about the association between the items
independent processes: a familiarity-based retrieval presented at recognition, and only recollection pro-
process well described by an equal variance signal vides this. If Yonelinas’s claims are correct and rec-
detection model, and a recollective retrieval pro- ollection is a threshold process, then pair recognition
cess described by a threshold model. Signal detec- should generate linear ROCs (asymmetric along the
tion models generate curvilinear ROCs, while minor diagonal), while item recognition should gen-
threshold models generate linear ROCs. erate curvilinear ROCs (symmetric along the minor
Yonelinas provided further support for the DPSD diagonal).
account by comparing item recognition (e.g. single Yonelinas (1997, Experiment 1) asked 20 subjects
words and pictures) with pair recognition. All of the to engage in a mixed memory test where half of the
individual items presented for pair recognition had test trials required single item recognition and half
been presented before, but while some pairings required pair recognition. When presented in the
were identical to what had been shown before, the form of ROCs, as shown in Figure 8.12, the recogni-
other item pairings were new. Therefore, in con- tion data were consistent with Yonelinas’s theoreti-
trast to item recognition, where brand new items cal predictions.
were presented, the only way to recognize item
Items Pairs
1 1
0.8 0.8
0.6 0.6
Hit
Hit
0.4 0.4
0.2 0.2
Observed
Model generated
0 0
0 0.2 0.4 0.6 0.8 1 0 0.2 0.4 0.6 0.8 1
FA FA
FIGU RE 8 .12 Recognition ROC curves for single items and item pairs. Source: Yonelinas (1997)
250 PART 3 MEMORY
Free recall derives greatest benefit from relational pro- (1985) but explored in greater detail by Gardiner and
cessing, but little benefit from maintenance rehearsal associates (e.g. Gardiner, 1988; Gardiner and Java,
(i.e. item-specific processing), which promotes inte- 1990; Gardiner et al., 1998, 2002; Gardiner and
gration. In contrast, familiarity-based recognition Richardson-Klavehn, 2000), reflects the different phe-
depends upon the degree of integration. Therefore, a nomenological experiences resulting from recollec-
high degree of item-specific processing (maintenance tive and familiarity-based retrieval. Subjects are
rehearsal) will benefit recognition to a greater extent instructed to report a remember experience when
than free recall. This illustrates that a full explanation they have a conscious recollection of the item appear-
of the effect on memory performance of different ing in the study. Subjects are instructed to report a
forms of encoding requires consideration of the rela- know experience when they just know that the item
tions between memory encoding, memory represen- appeared but have no conscious recollection of its
tation, and memory tests. This is the point made in occurrence (see Figure 8.13). Recollective retrieval is
Section 1 – whether interest is in encoding, storage, or assumed to provide the qualitative information neces-
retrieval, all stages of memory are involved when sary for remembering, while familiarity-based
information is remembered. retrieval provides a quantitative ‘feeling’ about the
item, sometimes expressed as a sense of familiarity,
but usually as a feeling of knowing the item was pre-
sented before.
Remembering and
4.4
Donaldson (1996; see also Dunn, 2004, 2008)
knowing argues that rather than reflecting qualitatively differ-
ent memory retrieval processes and memory informa-
Yonelinas (2001) suggests that the distinction between tion, remember and know responses simply reflect
remembering and knowing, first proposed by Tulving decisions based on different response criteria applied
1-Step 2-Step
Next item
presented
FIGU RE 8 .13 A schematic outline of the recognition one- and two-step remember (R)-know (K) paradigms. In
one-step paradigms, subjects immediately provide R or K responses to recognized items, or they respond that the
items are New. In two-step paradigms, subjects initially provide a standard yes–no recognition response and only
when they respond yes are they required to provide a R or K response. (See Bruno and Rutherford, 2010, for the
effects of including a Guess response option.)
CHAPTER 8 LONG-TERM MEMORY 251
to the strength of evidence axis: a response criterion then based upon this signal. This is an active area of
high on the strength of evidence axis is used to iden- research and debate, that eventually should provide a
tify remember items, while another response criterion much greater understanding of recognition memory
lower on the strength of evidence axis is used to iden- (e.g. Mickes et al., 2009; Parks and Yonelinas, 2007;
tify know items. If this account is accurate, then Parks and Yonelinas, 2008; Slotnick, 2010; Wais et al.,
remember and know responses simply represent dif- 2008).
ferent levels on the single, strength of evidence dimen- Although the remember-know task is a popular
sion, and so only a single decision process operating method for separating recollective and familiarity-
on a single type of information is required. However, based retrieval processes, its effective use requires
if remember and know responses tap into distinct rec- some care (e.g. Geraci et al., 2009; McCabe and Geraci,
ollection and familiarity-based retrieval processes, 2009; Mulligan et al., 2010; Parks, 2007; Yonelinas and
then two types of information and so two types of Jacoby, 1996). However, Yonelinas’s DPSD account
decision process will be required (e.g. Murdock, 2006; does not depend upon supporting evidence from
Reder et al., 2000; Yonelinas, 2001). remember-know task performance, or the analysis of
Wixted (e.g. Wixted and Stretch, 2004; Wixted and ROC curves, as one of its strengths is the variety of
Mickes, 2010) presents a modified version of evidence converging in its support (e.g. Vanna et al.,
Yonelinas’s DPSD model. This assumes separate 2009). In particular, a consistent line of theorizing
sources of recollective and familiarity-based informa- (e.g. Aggleton and Brown, 1999; Eichenbaum et al.,
tion (also see Rotello et al., 2004), but regards recollec- 2007) and a large and increasing body of neuroimag-
tion as outputting a single continuous quantitative ing research has linked distinct brain regions with rec-
signal that is combined with the output from the ollective (remember) and familiarity-based (know)
familiarity-based retrieval process to provide a single retrieval processing, and led Diana et al. (2007) and
continuous quantitative strength of evidence signal. Ranganath (2010) to develop a ‘binding of item and
All recognition and remember and know decisions are context’ (BIC) model (see Figure 8.14).
Hippocampus
(binding of items & contexts)
Entorhinal cortex
FIGU RE 8 .14 The ‘binding of item and context’ (BIC) model. Arrows represent anatomical connections. Source:
adapted from Diana et al., 2007 and Ranganath, 2010
252 PART 3 MEMORY
According to the BIC model, item-specific (who and the parahippocampal cortex processes the rela-
and what) information and relational (where) infor- tional (where) information. Via the entorhinal cortex,
mation from the neocortex is sent via different ana- these two structures output to the hippocampus,
tomical routes to the MTL. The MTL perirhinal cortex which binds together item and context information.
processes the item-specific (who/what) information
SUMMARY OF SECTION 4
• Retrieval involves finding, activating, and sometimes further processing pertinent memory
representations.
• Both encoding specificity and TAP emphasize the encoding-retrieval relationship, with performance
enhanced by increasing overlap of information (encoding specificity) or processing (TAP) at encoding
and retrieval.
• The relative distinctiveness of a target item in memory and prior retrieval practice are important
determinants of memory performance.
• Research is examining dual process accounts of recognition, which assume recollective and
familiarity-based retrieval processes.
• Recognized (and recalled) items may provide a remember response (you consciously remember the
item’s presentation) or a know response (you know the item appeared but you have no conscious
recollection of its presentation).
• Remember experiences and know experiences seem to be based on recollective and familiarity-
based retrieval processes, respectively.
• Recollection decision processes assess qualitative information and employ a threshold process.
• Familiarity-based decision processes assess a continuous quantitative unidimensional signal and
employ a modifiable SDT response criterion.
• A strength of the DPSD view of recollective and familiarity-based retrieval processing is the variety
of evidence converging in its support.
5 IMPLICIT MEMORY
When free recall, cued recall, and recognition mem- Several terms have been used to identify the type of
ory tests are employed, it is clear to subjects that they memory test. These include: explicit versus implicit
need to remember past events and so these are known (Schacter and Tulving, 1994); direct versus indirect
as explicit memory tests. However, there are also (Johnson and Hasher, 1987); and intentional versus
implicit memory tests. According to Schacter (1987), incidental (Jacoby, 1984). As the intentionality aspect
implicit memory manifests when test performance is of implicit memory is less contested than the aware-
influenced by previous experience without the subject ness aspect (e.g. Butler and Berry, 2001; Richardson-
intentionally remembering past events or being aware Klavehn, 2010), Jacoby’s terminology will be applied,
of their relevance. In other words, implicit memory is with explicit memory tests labelled as intentional tests
supposed to be both unintentional and unconscious. and implicit memory tests labelled as incidental tests.
CHAPTER 8 LONG-TERM MEMORY 253
When “implicit memory” is used, it refers only to incidental test. Such tests usually require subjects to
memory performance on incidental tests. Applying resolve displays that are perceptually impoverished
terminology that distinguishes between test types but (McDermott and Roediger, 1996) due to a short or an
avoids theoretical assumptions about the underlying incomplete stimulus presentation. Examples include
memory organization is sensible when much of the word-fragment completion (see Box 8.9) and anagram
research in this area addresses whether a processing or solution (e.g. Srinivas and Roediger, 1990), but also
systems approach is most appropriate (see Section 5.3). lexical decision – whether letter strings are real words
(e.g. Duchek and Neely, 1989). Conceptual incidental
tests require subjects to employ semantic knowledge
to answer questions or respond to a cue (McDermott
5.1Perceptual and conceptual and Roediger, 1996). Examples include: word associa-
incidental tests tion (Shimamura and Squire, 1984); category exemplar
generation (e.g. Srinivas and Roediger, 1990); and
Roediger and McDermott (1993) list a variety of tests answering general knowledge questions (e.g. Blaxton,
used to investigate perceptual and conceptual implicit 1989). In all cases, implicit memory is demonstrated
memory. The word fragment task employed by Tulving when test performance is better when test items were
et al. (1982) (see Box 8.9) is an example of a perceptual presented previously than when they were not.
Tulving et al. (1982) asked subjects to learn 96 words had been presented previously, more of the
words. Later they received a recognition test with corresponding word fragments were completed,
24 of the presented words (targets) and 24 similar even though subjects had no appreciation that they
distractors (i.e. words not presented before), and a were using memory.
word fragment completion test with 24 word frag- Figure 8.15 shows the probability of a correct
ments based on 24 presented words and 24 word response as a function of test type (word fragment
fragments based on words not shown before (e.g. or recognition) after 1 hour and after 7 days. Unlike
present the word fragment F_ O _ _ A _ L – subjects intentional recognition, there was no significant
complete the fragment by placing O, T, B, and L in decline in incidental word fragment completion
the empty letter slots to provide the word between the two test delays.
FOOTBALL). Seven days later, subjects received
another recognition and word fragment completion
test for the 48 words remaining. Critically, prior to
Probability of a correct response
Intentionality and
5.2 retrieval conditions completed a word fragment test,
and so it is impossible to claim that any differences
awareness observed are due only to the different retrieval instruc-
tions rather than the different cues provided at test.
Implicit memory has been defined as memory Another requirement for the retrieval intentional-
retrieval without intention or awareness (Schacter, ity criterion is the identification of a variable that dis-
1987). However, it is not clear to what extent the inci- sociates performance across the two tests. In the
dental tests described so far satisfy both aspects of this Tulving et al. (1982) study, a dissociation between
definition. intentional and incidental retrieval was observed: per-
formance on the recognition test but not the word
5.2.1 The retrieval intentionality criterion fragment completion test declined over time. If this
One of the major advances in implicit memory research dissociation across time had not been observed, then
occurred with the development of the retrieval inten- two interpretations would have been possible: i) there
tionality criterion (Schacter et al., 1989) to address the is no difference between intentional and incidental
issue of contamination from explicit memory (see retrieval processes, or ii) there is no difference in per-
Figure 8.16). The criterion distinguishes between formance between the intentional and incidental
intention to retrieve and awareness of retrieval. It also retrieval process tests because incidental test subjects
requires the same cues to be provided at retrieval for actually employed intentional retrieval strategies.
intentional and incidental tests, so the only difference However, the observed dissociation between inten-
between tests is the task instructions that manipulate tional and incidental test performance indicates that
retrieval intention. Consider the study by Tulving et al. subjects in the word fragment condition did not use
(1982; see Box 8.9). A problem with this study is the intentional retrieval strategies to complete the task. If
test and retrieval instructions are confounded – sub- intentional retrieval strategies had been used to com-
jects in the intentional retrieval conditions completed plete both types of test, then there would be no basis
a recognition test, but subjects in the incidental for different memory performance across the two test
Experimental manipulations at
Requirement 2: study (e.g. divided attention) affect
performance on these tests differentially
types – performance on the intentional recognition psychological experience of memory use as different
test and performance on the supposedly incidental, tasks are done (Schacter, 1987). However, it does not
but actually intentional, word fragment test would provide an explanation in terms of the cognitive pro-
decline similarly over time. cesses involved. So far, most research has focused on
transfer appropriate processing or memory systems
The issue of awareness in implicit
5.2.2
accounts to explain these phenomena.
memory
Functional dissociations have a key theoretical role in 5.3.1 TAP account
cognitive psychology (e.g. Dunn and Kirsner, 1988; Roediger and associates (e.g. Roediger et al., 1989)
Richardson-Klavehn and Bjork, 1988) and for implicit have been the strongest advocates of Morris et al.’s
memory research in particular (see Section 5.3 and (1977) TAP account as an explanation of performance
Richardson-Klavehn et al., 2009). However, in implicit differences on incidental and intentional memory
memory research, dissociations also play a vital meth- tests. They argue that the match between the type of
odological role in establishing the absence of explicit processing (perceptual or conceptual) engaged at
contamination in incidental memory tests (following encoding and when stimuli are tested is key, rather
the logic of the retrieval intentionality criterion just than differences between memory store retrieval char-
described). Many studies using incidental tests have acteristics. TAP predicts perceptual incidental tests
employed LOP manipulations. Although LOP effects will benefit most from encoding that engages similar
are observed frequently with intentional memory tests perceptual processes. Likewise, performance on con-
(e.g. Craik and Tulving, 1975; see Box 8.1), they are ceptual incidental tests will benefit more from encod-
observed rarely with incidental tests (e.g. Graf and ing that engages similar conceptual processes. Indeed,
Mandler, 1984). Richardson-Klavehn and Gardiner perceptual manipulations at encoding have been
(1996) investigated the effects of intentionality and shown to influence perceptual incidental memory test
awareness on retrieval using a LOP manipulation at performance, but not conceptual intentional memory
encoding as an indicator of intentionality or explicit test performance (see Roediger and McDermott,
contamination. Awareness was measured item by item 1993, for a review). Moreover, Blaxton (1989) demon-
(for discussion of other measures see Butler and Berry, strated that generating words from a cue at study led
2001 and Richardson-Klavehn et al., 1996). Their data to more conceptual priming than reading words, a
and a number of other studies (e.g. Richardson- finding consistent with the TAP account, as word gen-
Klavehn, 2010) demonstrate that conscious awareness eration is assumed to involve conceptual processing
of retrieval does not equate with intentional retrieval. (cf. Mulligan, 2002; see Section 5.3.3). However, as the
A dissociation between awareness and intentionality TAP account was examined, discrepant findings
has also been demonstrated in studies of conceptual began to emerge. For example, Hunt et al. (1990)
implicit memory (e.g. Mulligan, 2002). Neuroimaging noted that orthographic distinctiveness (a perceptual
data also strongly indicate that awareness and retrieval factor) affected both (perceptual) incidental memory
intention are dissociable (e.g. Schott et al., 2005). test performance and free recall.
Further evidence against the TAP account comes
from studies of amnesic patients. Vaidya et al. (1995)
found no difference between amnesics and controls in
Accounts of implicit
5.3
either a perceptual incidental memory test or a con-
memory ceptual incidental memory test. However, amnesics’
performance on intentional, perceptual, and concep-
The distinction between incidental and intentional tual memory tests was as poor as expected. Similar
memory tasks provides a description of a person’s findings were reported by Cermak et al. (1995). The
256 PART 3 MEMORY
TAP account of implicit memory attributes amnesics’ obtains a large number of dissociations by assuming
ability to perform on conceptual incidental memory the noise variance associated with incidental tests is
tests on a par with normal controls to their retained larger than the noise variance associated with inten-
perceptual processing capability, while their poor tional retrieval tests. However, this model seems una-
memory performance is attributed to impaired con- ble to account for the complex pattern of intentional
ceptual processing. However, the ability of amnesics to and incidental memory test dissociations (Richardson-
perform on conceptual incidental memory tests on a Klavehn, 2010; Richardson-Klavehn et al., 1999; see
par with normal controls contradicts this account. also Section 5.3.3).
Moreover, the fact that amnesics exhibited their usual
poor memory performance on intentional perceptual 5.3.3 Components of processing account
and conceptual memory tests suggests that the dis- To deal with the problems associated with the TAP
tinction between intentional and incidental memory interpretation of implicit memory, Roediger and asso-
tests is more critical than the distinction between per- ciates modified their account and relabelled it compo-
ceptual and conceptual processing. nents of processing (e.g. Roediger et al., 1999). This
view considers performance on different memory
5.3.2 Memory systems accounts tests to involve different sets of processes. The sets of
The multiple memory systems and declarative and processes elicited by different memory tests may over-
non-declarative memory systems perspectives have lap, but some different process components will be
been applied to account for the differences between elicited by any two tests that dissociate. However, the
intentional and incidental memory test performance. components of processing (COP) account has been
In both cases, the differences are attributed to different criticized for being circular – it is assumed that prim-
memory systems being tested (see Figure 8.7 and ing occurs when there is appropriate transfer of pro-
Table 8.3). Squire (1992, 2007) simply attributes per- cessing, but the mark of appropriate transfer of
formance on intentional memory tests to the declara- processing is considered to be priming (see Section
tive memory system and performance on incidental 2.1 for a similar criticism of LOP). Greater detail on
memory tests to the non-declarative memory system. the mechanisms operating in these circumstances is
The multiple memory systems perspective attributes necessary to avoid this circularity, and indeed, this is
performance on perceptual incidental memory tests one of the requirements McDermott and Roediger
to the (unspecified) nature of the visual word form (1996) place on the components of processing account.
sub-system of the perceptual representation system, Mulligan (2002) presented data suggesting that a full
while picture priming is attributed to the (unspeci- components of processing account required a distinc-
fied) nature of the structural description sub-system tion between item-specific and relational processing
of the perceptual representation system (e.g. Schacter (see Section 2.2). He employed a number of different
et al., 2000). Within this perspective, Gabrieli (1999) generation encoding tasks where subjects were pre-
attributes performance on conceptual incidental sented with cues and then had to generate responses,
memory tests to yet another memory system – the and assumed the generated responses would be
conceptual representation system (cf. perceptual rep- encoded as stimulus items. Generation tasks were
resentation system; see Table 8.3). employed at encoding because they have been shown
In contrast to the memory systems perspectives, to produce opposite effects on intentional and inci-
some researchers argue that the operation of a single dental memory tests (Jacoby, 1983). A semantic gen-
memory system explains both incidental and inten- eration encoding task, where subjects generated a
tional memory performance. Berry et al. (2008) con- word based on a semantic cue (e.g. ‘Lightning often
structed a SDT-based computational model that occurs with t_____’: the response item generated is
CHAPTER 8 LONG-TERM MEMORY 257
expected to be ‘thunder’), benefited both intentional involves both item-specific and relational processing,
retrieval and incidental conceptual retrieval – consist- while a non-semantic generation task affects only cat-
ent with the COP account. However, perceptual gen- egory-cued recall due to the item-specific processing
eration encoding tasks (where subjects filled in the involved (and the lack of relational processing).
first two missing letters of each word) benefited inten- Richardson-Klavehn (2010) reviewed a number of
tional but not incidental conceptual retrieval, which is studies presenting functional neuroimaging data and
at odds with the COP account. Mulligan resolved this formulated an integrative theoretical framework of
discrepancy by demonstrating that semantic genera- retrieval based on the components of processing
tion tasks at encoding require both item-specific and account. The framework extends Moscovitch’s (1992)
relational processing, while non-semantic generation account by postulating that all retrieval processes
tasks involve mainly item-specific processing. At the occur automatically and that different forms of mem-
retrieval stage, category-cued recall (an intentional ory arise from the way control processes (attention
conceptual test) benefits from both relational and and working memory) interact with retrieval pro-
item-specific processing, because the task requires the cesses. One advantage of this account is its integration
production of words that were on the study list and of diverse data patterns (behavioural and neurologi-
belong to the category, while the conceptual incidental cal) and existing theories of cognitive function from
test (i.e. category exemplar production) only benefits different research topics (e.g. working memory, atten-
from relational processing, as the task does not require tional processes), making it both plausible and empir-
discrimination between studied and not studied ically testable. Nevertheless, more research is required
exemplars. Consequently, a semantic generation to assess the framework assumptions.
encoding task affects both retrieval modes, as it
SUMMARY OF SECTION 5
• Implicit retrieval was defined initially as unintentional and unconscious, but there is strong evidence
that intentionality and awareness are dissociable.
• Perceptual incidental memory tests include: word fragment completion, word stem completion,
word identification, anagram solution, and lexical decision.
• Conceptual incidental memory tests include: word association, category instance generation, and
answering general knowledge questions.
• Amnesics exhibit normal memory performance on incidental memory tests.
• The multiple memory systems perspective and Squire’s declarative and procedural memory systems
attribute the differences between intentional and incidental memory test performance to different
memory systems.
• The TAP account attributes the differences between intentional and incidental memory test perfor-
mance to perceptual incidental tests benefiting most from perceptual encoding at presentation, while
conceptual incidental tests and intentional memory tests benefit from conceptual encoding at pres-
entation.
• The components of processing account can accommodate a large variety of different findings, but it
suffers from circularity problems. However, these problems may be overcome by developing more
specific models and predictions.
258 PART 3 MEMORY
6 CONCLUSIONS
The systems and processes approaches are the two pre- processes perspective (conducted primarily by cogni-
vailing perspectives in cognitive psychology. Craik and tive psychologists) progresses, the distinction between
Lockhart’s LOP article stimulated a great deal of these two approaches appears to be diminishing.
research on memory encoding processes and did much There is greater appreciation of the need to give
to establish the processing approach as a theoretical account of the nature of processing within systems,
perspective in psychology. LOP research demonstrated and greater appreciation of the biological basis of sys-
the key role of encoding processing, but subsequent tems (e.g. Squire, 2007) and how this can affect the
research by Mandler, Tulving, and Morris, Bransford, nature of processing within systems.
and Franks emphasized the role of retrieval processing A great deal of recent research activity has focused
and demonstrated that memory performance depends on retrieval operations. Yonelinas’s DPSD model
upon the interaction between encoding, representa- prompted considerable research activity across cogni-
tion, and retrieval. Since the original LOP article, there tive psychology, neuropsychology, and neuroimaging
has been a substantial change in the conception of the research. Neuropsychological and neuroimaging
nature of mental processing. Rather than being con- research has provided almost consistent support for
ceived only in terms of semantic degree or extent, pro- Yonelinas’s DPSD model, but opinion is still divided in
cessing is now conceived more broadly, with a range of cognitive psychology, where the nature of the recollec-
processing modes available to subjects, some of which tive retrieval process is a major point of contention.
may engage “deep”, but not semantic, processing. An Despite early consideration and rejection of DPSD
appreciation that information can be encoded with ref- models in favour of continuous detection models,
erence to oneself is one example of this new conception only now are threshold detection models, their pre-
of mental processing. This sort of encoding is extremely dictions, and the criteria by which they should be
effective, probably due to the ‘self ’ acting as a superor- judged being examined with appropriate scrutiny (e.g.
dinate schema that influences encoding and retrieval Algarabel and Pitarque, 2007; Broder and Schutz,
operations (e.g. Van den Bos et al., 2010). 2009; Macho, 2004; Martin et al., 2011; Meiser et al.,
Around the same time as Craik and Lockhart’s lev- 2008). Although many matters concerning DPSD and
els of processing article, Tulving provided a descrip- SPSD models remain to be resolved, DPSD models
tion of separate semantic and episodic memory seem to provide greater contact with other theoretical
systems, but it was not until the 1980s that memory accounts and issues. Yonelinas’s account of recollec-
systems research began to exert substantial theoretical tion – a threshold retrieval process that outputs
influence. This influence seems to have arisen as a qualitatively different types of information – offers a
consequence of a number of related factors, including route to explain people’s phenomenological experi-
a renaissance in connectionist research, cognitive ence of the remember component of recognition. In
neuropsychological investigation of abnormal mem- contrast, SPSD models retrieval processes output only
ory as a consequence of brain damage, and develop- a unidimensional quantitative (i.e. continuous) meas-
ments in neuroimaging techniques. Memory systems ure, and so are unable to provide convincing accounts
research has benefited from the theoretical constraints of how qualitatively different memory information is
imposed by neuropsychological findings and the the- retrieved, even when they are augmented by further
oretical criticism provided by cognitive psychologists. formal memory model assumptions (e.g. SAM:
As research from a memory systems perspective (con- Gillund and Shiffrin, 1984; Minerva 2: Hintzman,
ducted primarily by neuropsychologists and neuroim- 1988). Links between free recall and recognition are
aging researchers) and research from a memory often mentioned (e.g. Mandler, 1980) but, as SPSD
CHAPTER 8 LONG-TERM MEMORY 259
models find free recall problematic, again such links ality criterion research can be seen in recent theoretical
seem more likely to be established by DPSD than accounts, which incorporate a number of related
SPSD models (e.g. Brainerd and Reyna, 2010). aspects of memory, such as item-specific and rela-
Important theoretical and methodological progress tional processing, in the interpretation of the data.
in the study of implicit memory has been provided by An aim of this chapter was to present an overview
the retrieval intentionality criterion. As this distin- of research in the psychology of memory that not only
guishes between retrieval intention and retrieval reflects theoretical influence and change, but also
awareness, it immediately revealed that previous demonstrates the exciting advances in understanding
implicit memory definitions were too simplistic. The that these new theoretical perspectives have provided.
theoretical perspective provided by the retrieval inten- Memory research continues to be one of the most
tionality criterion also led to modified study designs, active research areas in psychology, where important
which provided more consistent data that was more theoretical and methodological developments are
easily interpretable within existing theoretical frame- leading to a more accurate appreciation of memory
works. The benefits of applying the retrieval intention- operation.
FURTHER READING
Baddeley, A., Eysenck, M.W., and Anderson, M.C. (2009) dissociations of consciousness’, in Underwood, G. (ed.)
Memory, Hove, Psychology Press. This is an up-to-date, schol- Implicit Cognition, Oxford, Oxford University Press. This chap-
arly, and accessible account of memory research. ter provides a good and clear discussion of intention and aware-
Sedikides, C. and Spencer, S.J. (2007) The Self, New York, ness issues, as well as various methods of measuring awareness.
Psychology Press. A book that presents an up-to-date, scholarly, Richardson-Klavehn, A. and Bjork, R.A. (2002) ‘Memory:
and accessible account of research on the self. long term’, in Encyclopedia of Cognitive Science, vol. 2
Richardson-Klavehn, A., Gardiner, J.M., and Java, R.I. (pp.1096–105). The authors present a brief overview of LTM and
(1996) ‘Memory: task dissociations, process dissociations and also describe the concept of resonance.
REFERENCES
Aggleton, J.P. and Brown, M.W. (1999) ‘Episodic memory, Spence, J. (eds.) The Psychology of Learning and Motivation,
amnesia and the hippocampal–anterior thalamic axis’, vol.2, New York, Academic Press.
Behavioural and Brain Sciences, vol.22, pp.425–44. Baddeley, A.D. (1978) ‘The trouble with levels: a re-exami-
Algarabel, S. and Pitarque, A. (2007) ‘Context, remember- nation of Craik and Lockhart’s framework for memory
know recognition judgements, and ROC parameters’, Memory, research’, Psychological Review, vol.85, pp.139–52.
vol.15, pp.477–94. Baddeley, A.D. (1984) ‘Neuropsychological evidence and
Anderson, J.R. and Ross, B.H. (1980) ‘Evidence against a the semantic/episodic distinction [commentary]’, Behavioral
semantic–episodic distinction’, Journal of Experimental and Brain Sciences, vol.7, pp.238–9.
Psychology: Human Learning and Memory, vol.6, pp.441–65. Baddeley, A.D. (2002) ‘The concept of episodic memory’ in
Atkinson, R.C. and Juola, J.F. (1973) ‘Factors influencing Baddeley, A., Conway, M., and Aggleton, J. (eds.) Episodic
speed and accuracy of word recognition’, in Kornblum, S. (ed.) Memory: New Directions in Research, Oxford, Oxford
Attention and Performance IV, New York, Academic Press. University Press.
Atkinson, R.C. and Juola, J.F. (1974) ‘Search and decision Baddeley, A.D. and Warrington, E.K. (1970) ‘Amnesia and
processes in recognition memory’, in Kroutz, D.H., Atkinson the distinction between long- and short-term memory’,
R.C., and Suppes, P. (eds.) Contemporary Developments in Journal of Verbal Learning and Verbal Behavior, vol.9,
Mathematical Psychology, San Francisco, Freeman. pp.176–89.
Atkinson, R.C. and Shiffrin, R. (1968) ‘Human memory: a Baddeley, A., Eysenck, M.W., and Anderson, M.C. (2009)
proposed system and its control processes’, in Spence, K. and Memory, Hove, Psychology Press.
260 PART 3 MEMORY
Baddeley, A.D., Vargha-Khadem, F., and Mishkin, M. Butler, L.T. and Berry, D.C. (2001) ‘Implicit memory:
(2001) ‘Preserved recognition in a case of developmental intention and awareness revisited’, Trends in Cognitive Sciences,
amnesia: implications for the acquisition of semantic mem- vol.5, pp.192–7.
ory’, Journal of Cognitive Neuroscience, vol.13, pp.357–69. Cabeza, R. and Nyberg, L. (2000) ‘Imaging cognition ii: an
Banks, W.P. (1970) ‘Signal detection theory and human empirical review of 275 PET and fMRI studies’, Journal of
memory’, Psychological Bulletin, vol.74, pp.81–99. Cognitive Neuroscience, vol.12, pp.1–47.
Bayley, P.J. and Squire, L.R. (2005) ‘Failure to acquire new Carr, V., Rissman, J., and Wagner, A. (2010) ‘Imaging the
semantic knowledge in patients with large medial temporal human medial temporal lobe with high-resolution fMRI’,
lobe lesions’, Hippocampus, vol.15, pp.273–80. Neuron, vol.65, pp.298–308.
Bernard, F., Bullmore, E., Graham, K., Thompson, S., Cermak, L.S. and O’Connor, M. (1983) ‘The anterograde
Hodges, J., and Fletcher, P. (2004) ‘The hippocampal region and retrograde retrieval ability of a patient with amnesia due
involved in successful recognition of both remote and recent to encephalitis’, Neuropsychologia, vol.21, pp.213–34.
famous faces’, Neuroimage, vol.22, pp.1704–14. Cermak, L.S., Verfaelie, M., and Chase, K.A. (1995)
Berry, C.J., Shanks, D.R., and Henson, R.N.A. (2008) ‘A sin- ‘Implicit and explicit memory in amnesia: an analysis of data-
gle system account of the relationship between priming, rec- driven and conceptually driven processes’, Neuropsychology,
ognition and fluency’, Journal of Experimental Psychology: vol.9, pp.281–90.
Human Learning and Memory, vol.34, pp.97–111. Cohen, N.J. and Squire, L.S. (1980) ‘Preserved learning and
Blaxton, T.A. (1989) ‘Investigating dissociations among retention of pattern-analysing skill in amnesia: dissociation of
memory measures: support for a transfer-appropriate process- knowing how and knowing that’, Science, vol.210, pp.207–10.
ing framework’, Journal of Experimental Psychology: Learning, Craik, F.I.M. (1977) ‘“A level of analysis” view of memory’, in
Memory and Cognition, vol.15, pp.657–68. Pliner, P., Krames, L., and Allaway, T.M. (eds.) Communication
Bower, G.H. (1972) ‘Mental imagery and associative learn- and Affect: Vol 2. Language and Thought, New York, Academic
ing’, in Gregg, L.W. (ed.) Cognition in Learning and Memory, Press.
New York, Wiley. Craik, F.I.M. (2002) ‘Levels of processing: past, present . . .
Brainerd, C.J. and Reyna, V.F. (2010) ‘Recollective and non- and future?’ Memory, vol.10, pp.305–18.
recollective recall’, Journal of Memory and Language, vol.63, Craik, F.I.M. and Lockhart, R.S. (1972) ‘Levels of process-
pp.425–45. ing: a framework for memory research’, Journal of Verbal
Brandt, K.R., Gardiner, J.M., Vargha-Khadem, F., Baddeley, Learning and Verbal Behavior, vol.11, pp.671–84.
A.D., and Mishkin, M. (2006) ‘Using semantic memory to Craik, F.I.M. and Tulving, E. (1975) ‘Depth of processing
boost “episodic” recall in a case of developmental amnesia’, and the retention of words in episodic memory’, Journal of
Neuroreport, vol.17, pp.1057–60. Experimental Psychology: General, vol.104, pp.268–94.
Bransford, J.D., Franks, J.J., Morris, C.D., and Stein, B.S. Crowder, R. (1993) ‘Systems and principles in memory
(1979) ‘Some general constraints on learning and memory theory: another critique of pure memory’, in Collins, A.F.,
research’, in Cermak, L.S. and Craik, F.I.M. (eds.) Levels of Gathercole, S.E., Conway, M.A., and Morris, P.E. (eds.)
Processing in Human Memory, Hillsdale, NJ, LEA. Theories of Memory, Hove, LEA.
Bröder, A. and Schütz, J. (2009) ‘Recognition ROCs are Diana, R.A., Yonelinas, A.P., and Ranganath, C. (2007)
curvilinear – or are they? On premature arguments against the ‘Imaging recollection and familiarity in the medial temporal
two high threshold models of recognition’, Journal of lobe: a three component model’, Trends in Cognitive Sciences,
Experimental Psychology: Learning, Memory and Cognition, vol.11, pp.379–86.
vol.35, pp.587–606. Donaldson, W. (1996) ‘The role of decision processes in
Bruno, D. and Rutherford, A. (2010) ‘How many response remembering and knowing’, Memory and Cognition, vol.24,
options? A study of remember–know testing procedures’, Acta pp.523–33.
Psychologica, vol.134, pp.125–9. Duchek, J.M. and Neely, J.H. (1989) ‘A dissociative word-
Bruno, D., Higham, P.A., and Perfect, T.J. (2009) ‘Global frequency X levels-of-processing interaction in episodic rec-
subjective memorability and the strength-based mirror effect ognition and lexical decision tasks’, Memory and Cognition,
in recognition memory’, Memory and Cognition, vol.37, vol.17, pp.148–62.
pp.807–18. Dunn, J.C. (2004) ‘Remember-Know: a matter of confi-
Burianova, H. and Grady, C.L. (2007) ‘Common and dence’, Psychological Review, vol.111, pp.524–42.
unique neural activations in autobiographical, episodic, and Dunn, J.C. (2008) ‘The dimensionality of the remember-
semantic retrieval’, Journal of Cognitive Neuroscience, vol.19, know task: a state-trace analysis’, Psychological Review, vol.115,
pp.1520–34. pp.426–46.
CHAPTER 8 LONG-TERM MEMORY 261
Dunn, J.C. and Kirsner, K. (1988) ‘Discovering functionally Green, D.M. and Swets, J.A. (1966) Signal Detection Theory
independent mental processes: the principle of reversed asso- and Psychophysics, New York, Wiley.
ciation’, Psychological Review, vol.95, pp.91–101. Greenberg, D.L. and Verfaellie, M. (2010) ‘Interdependence
Eich, J.M. (1985) ‘Levels of processing, encoding specificity, of episodic and semantic memory: evidence from neuropsy-
elaboration and CHARM’, Psychological Review, vol.92, chology’, Journal of the International Neuropsychological
pp.1–38. Society, vol.16, pp.1–6.
Eichenbaum, H., Yonelinas, A.P., and Ranganath, C. (2007) Grossman, M. (1987) ‘Lexical acquisition in alcoholic
‘The medial temporal lobe and recognition memory’, Annual Korsakoff psychosis’, Cortex, vol.23, pp.631–44.
Review of Neuroscience, vol.30, pp.123–52. Henke, K., Mondadori, C., Treyer, V., Nitsch, R., Buck, A.,
Eysenck, M.W. and Eysenck, M.C. (1980) ‘Effects of pro- and Hock, C. (2003) ‘Nonconscious formation and reactiva-
cessing depth, distinctiveness and word frequency on reten- tion of semantic associations by way of the medial temporal
tion’, British Journal of Psychology, vol.71, pp.263–74. lobe’, Neuropsychologia, vol.41, pp.863–76.
Eysenck, M.W. and Keane, M.T. (2010) Cognitive Hintzman, D.L. (1986) ‘Schema abstraction in a multiple-
Psychology: A Student’s Handbook, Hove, Psychology Press. trace memory model’, Psychological Review, vol.93, pp.411–28.
Foster, J.K. and Jelic, M. (1999) Memory: Systems, Process or Hintzman, D.L. (1988) ‘Judgements of frequency and rec-
Function?, Oxford, Oxford University Press. ognition in a multiple-trace memory model’, Psychological
Gabrieli, J.D.E. (1999) ‘The architecture of human mem- Review, vol.95, pp.528–51.
ory’, in Foster, J.K. and Jelic, M. (eds.) Memory: Systems, Hoscheidt, S.M., Nadel, L., Payne, J., and Ryan, L. (2010)
Process or Function?, Oxford, Oxford University Press. ‘Hippocampal activation during retrieval of spatial context
Gabrieli, J.D.E., Cohen, N.J., and Corkin, S. (1988) ‘The from episodic and semantic memory’, Behavioural Brain
impaired learning of semantic knowledge following bilateral Research, vol.212, pp.121–32.
medial-temporal lobe resection’, Brain, vol.7, pp.157–77. Humphreys, M.S., Bain, J.D., and Pike, R. (1989) ‘Different
Gardiner, J.M. (1988) ‘Functional aspects of recollective ways to cue a coherent memory system: a theory for episodic,
experience’, Memory and Cognition, vol.16, pp.309–13. semantic and procedural tasks’, Psychological Review, vol.96,
Gardiner, J.M. and Java, R.I. (1990) ‘Recollective experi- pp.208–33.
ence in word and nonword recognition’, Memory and Hunt, R.R. and Einstein, G.O. (1981) ‘Relational and item-
Cognition, vol.18, pp.23–30. specific information in memory’, Journal of Verbal Learning
Gardiner, J.M. and Richardson-Klavehn, A. (2000) and Verbal Behavior, vol.20, pp.497–514.
‘Remembering and knowing’, in Tulving, E. and Craik, F.I.M. Hunt, R.R. and McDaniel, M.A. (1993) ‘The enigma of
(eds.) The Oxford Handbook of Memory, Oxford, Oxford organization and distinctiveness’, Journal of Memory and
University Press. Language, vol.32, pp.421–45.
Gardiner, J.M., Ramponi, C., and Richardson-Klavehn, A. Hunt, R.R., Humphrey, N., and Toth, J.P. (1990) ‘Perceptual
(1998) ‘Experiences of remembering, knowing and guessing’, identification, fragment completion and free recall: concepts
Consciousness and Cognition, vol.7, pp.1–26. and data’, Journal of Experimental Psychology: Learning,
Gardiner, J.M., Ramponi, C., and Richardson-Klavehn, A. Memory and Cognition, vol.16, pp.282–90.
(2002) ‘Recognition memory and decision processes: a meta- Jacoby, L.L. (1983) ‘Remembering the data: analyzing inter-
analysis of remember, know and guess responses’, Memory, active processes in reading’, Journal of Verbal Learning and
vol.10, pp.83–98. Verbal Behavior, vol.22, pp.485–508.
Geraci, L., McCabe, D.P., and Guillory, J.J. (2009) ‘On inter- Jacoby, L.L. (1984) ‘Incidental versus intentional retrieval:
preting the relationship between remember–know judgments remembering and awareness as separate issues’, in Squire, L.R.
and confidence: the role of instructions’, Consciousness and and Butters, N. (eds.) Neuropsychology of Memory, New York,
Cognition, vol.18, pp.701–09. Guildford Press.
Gillund, G. and Shiffrin, R.M. (1984) ‘A retrieval model for Jacoby, L.L. and Dallas, M. (1981) ‘On the relationship
both recognition and recall’, Psychological Review, vol.91, between autobiographical memory and perceptual learning’,
pp.1–67. Journal of Experimental Psychology: General, vol.3, pp.306–40.
Glenberg, A.M., Smith, S.M., and Green, C. (1977) ‘Type 1 Johnson, M.K. and Hasher, L. (1987) ‘Human learning and
rehearsal: maintenance and more’, Journal of Verbal Learning memory’, Annual Review of Psychology, vol.38, pp.631–68.
and Verbal Behavior, vol.16, pp.339–52. Koffka, K. (1935) Principles of Gestalt Psychology, New
Graf, P. and Mandler, G. (1984) ‘Activation makes words York, Harcourt Brace.
more accessible, but not necessarily more retrievable’, Journal Leveroni, C., Seidenberg, M., Mayer, A., Mead, L., Binder,
of Verbal Learning and Verbal Behavior, vol.23, pp.553–68. J., and Rao, S. (2000) ‘Neural systems underlying the
262 PART 3 MEMORY
recognition of familiar and newly learned faces’, Journal of failures of connectionist models of learning and memory’,
Neuroscience, vol.20, pp.878–86. Psychological Review, vol.102, pp.419–57.
Lockhart, R.S. and Murdock, B.B. (1970) ‘Memory and the McDermott, K.B. and Roediger, H.L. (1996) ‘Exact and
theory of signal detection’, Psychological Bulletin, vol.74, conceptual repetition dissociate conceptual memory tests:
pp.100–09. problems for transfer appropriate processing theory’, Canadian
Lockhart, R.S., Craik, F.I.M., and Jacoby, L.L. (1976) ‘Depth Journal of Experimental Psychology, vol.50, pp.57–71.
of processing, recognition and recall’, in Brown, J. (ed.) Recall McKoon, G., Ratcliff, R., and Dell, G.S. (1986) ‘A critical
and Recognition, London, Wiley. examination of the semantic/episodic distinction’, Journal of
Macho, S. (2004) ‘Modeling associative recognition: a com- Experimental Psychology: Learning, Memory and Cognition,
parison of two-high-threshold, two-high-threshold signal vol.12, pp.295–306.
detection, and mixture distribution models’, Journal of Meiser, T., Sattler, C., and Weisser, K. (2008) ‘Binding of
Experimental Psychology: Learning, Memory & Cognition, multidimensional context information as a distinctive charac-
vol.30, pp.83–97. teristic of Remember judgments’, Journal of Experimental
Macmillan, N.A. and Creelman, C.D. (2005) Detection Psychology: Learning Memory & Cognition, vol.34, pp.32–49.
Theory: A User’s Guide, Mahwah, NJ, Erlbaum. Mickes, L., Johnson, E.M., and Wixted, J. (2010)
Maguire, E. and Mummery, C. (1999) ‘Differential modula- ‘Continuous recollection versus unitized familiarity in associ-
tion of a common memory retrieval network revealed ative recognition’, Journal of Experimental Psychology:
by positron emission tomography’, Hippocampus, vol.9, Learning, Memory and Cognition, vol.36, pp.843–63.
pp.54–61. Mickes, L., Wais, P.E., and Wixted, J. (2009) ‘Recollection is
Mandler, G. (1979) ‘Organization and repetition: organiza- a continuous process: implications for dual-process theories of
tional principles with special reference to rote learning’, in recognition memory’, Psychological Science, vol.20, pp.509–15.
Nilsson, L-G. (ed.) Perspectives on Memory Research, Hillsdale, Mickes, L., Wixted, J., and Wais, P.E. (2007) ‘A direct test of
NJ, LEA. the unequal-variance signal-detection model of recognition
Mandler, G. (1980) ‘Recognizing: the judgement of previ- memory’, Psychonomic Bulletin & Review, vol.14, pp.858–65.
ous occurrence’, Psychological Review, vol.87, pp.252–71. Milner, B. (1966) ‘Amnesia following operation on the tem-
Mandler, G. (2008) ‘Familiarity breeds attempts: a critical poral lobes’, in Whitty, C.W.M. and Zangwill, O.L. (eds.)
review of dual-process theories of recognition’, Perspectives on Amnesia, London, Butterworths.
Psychological Science, vol.3, pp.390–9. Morris, C.D., Bransford, J.D., and Franks, J.J. (1977) ‘Levels
Markopoulos, G., Rutherford, A., Cairns, C., and Green, J. of processing versus transfer appropriate processing’, Journal
(2010) ‘Encoding instructions and stimulus presentation in of Verbal Learning and Verbal Behavior, vol.16, pp.519–33.
local environmental context-dependent memory studies’, Morton, J., Hammersley, R.H., and Bekerian, D.A. (1985)
Memory, vol.18, pp.610–24. ‘Headed records: a model for memory and its failures’,
Martin, C.D., Baudouin, J.Y., Franck, N., Guillaume, F., Cognition, vol.20, pp.1–23.
Guillem, F., Huron, C., and Tiberghien, G. (2011) ‘Comparison Moscovitch, M. (1992) ‘Memory and working-with-mem-
of RK and confidence judgement ROCs in recognition mem- ory – a component process model based on modules and cen-
ory’, Journal of Cognitive Psychology, vol.23, pp.171–84. tral systems’, Journal of Cognitive Neuroscience, vol.4, pp.257–67.
Matzen, L.E. and Benjamin, A.S. (2009) ‘Remembering Mulligan, N.W. (2002) ‘The effects of generation on con-
words not presented in sentences: how study context changes ceptual implicit memory’, Journal of Memory and Language,
patterns of false memories’, Memory and Cognition, vol.37, vol.47, pp.327–42.
pp.52–64. Mulligan, N.W., Besken, M., and Peterson, D. (2010)
McCabe, D.P. and Geraci, L. (2009) ‘The influence of instruc- ‘Remember-Know and source memory instructions can qualita-
tions and terminology on the accuracy of remember–know tively change old-new recognition accuracy: the modality-match
judgments’, Consciousness and Cognition, vol.18, pp.401–13. effect in recognition memory’, Journal of Experimental
McClelland, J.L. and Chappel, M. (1998) ‘Familiarity Psychology: Learning, Memory and Cognition, vol.36, pp.558–66.
breeds differentiation: a subjective likelihood approach to the Murdock, B.B., Jr. (1993) ‘Todam 2 – a model for the stor-
effects of experience in recognition memory’, Psychological age and retrieval of item, associative, and serial-order infor-
Review, vol.105, pp.724–60. mation’, Psychological Review, vol.100, pp.183–203.
McClelland, J.L., McNaughton, B.L., and O’Reilly, R.C. Murdock, B. (2006) ‘Decision-making models of remem-
(1995) ‘Why there are complimentary learning systems in the ber-know judgments: comment on Rotello, Macmillan and
hippocampus and neocortex: insights from the successes and Reeder (2004)’, Psychological Review, vol.113, pp.648–55.
CHAPTER 8 LONG-TERM MEMORY 263
Nairne, J.S. (2002) ‘The myth of the encoding-retrieval recognition paradigm’, Journal of Experimental Psychology:
match’, Memory, vol.10, pp.389–95. Learning, Memory and Cognition, vol.26, pp.294–320.
Neely, J.H. (1989) ‘Experimental dissociations and the Richardson-Klavehn, A. (2010) ‘Priming, automatic recol-
semantic/episodic memory distinction’, in Roediger, H.L. and lection, and control of retrieval: toward an integrative retrieval
Craik, F.I.M. (eds.) Varieties of Memory and Consciousness: architecture’, in Mace, J.H. (ed.) The Act of Remembering:
Essays in Honor of Endel Tulving, Hillsdale, NJ, LEA. Toward an Understanding of How We Recall the Past, New
Norman, D.A. (1982) Learning and Memory, San Francisco, York, Wiley-Blackwell.
Freeman. Richardson-Klavehn, A. and Bjork, R.A. (1988) ‘Measures
Norman, D.A. and Bobrow, D.G. (1979) ‘Descriptions: an of memory’, Annual Review of Psychology, vol.39, pp.475–543.
intermediate stage in memory retrieval’, Cognitive Psychology, Richardson-Klavehn, A. and Gardiner, J.M. (1996) ‘Cross-
vol.11, pp.107–23. modality priming in stem completion reflects conscious
O’Kane, G., Kensinger, E.A., and Corkin, S. (2004) ‘Evidence memory but not voluntary memory’, Psychonomic Bulletin and
for semantic learning in profound amnesia: an investigation Review, vol.3, pp.238–44.
with patient H.M.’, Hippocampus, vol.14, pp.417–25. Richardson-Klavehn, A., Bergström, Z.M., Magno, E.,
Parkin, A. (1993) Human Memory, Oxford, Blackwell. Markopoulos, G., Sweeney-Reed, C.M., and Wimber, M. (2009)
Parks, C.M. (2007) ‘The role of noncriterial recollection in ‘On the intimate relationship between neurobiology and func-
estimating recollection and familiarity’, Journal of Memory tion in the theoretical analysis of human learning and memory’,
and Language, vol.57, pp.81–100. in Rösler, F., Ranganath, C., Röder, B., and Kluwe, R.H. (eds.)
Parks, C.M. and Yonelinas, A.P. (2007) ‘Moving beyond Neuroimaging of Human Memory: Linking Cognitive Processes to
pure signal-detection models: comment on Wixted’, Neural Systems, New York, Oxford University Press.
Psychological Review, vol.114, pp.188–202. Richardson-Klavehn, A., Clarke, A.J.B., and Gardiner, J.M.
Parks, C.M. and Yonelinas, A.P. (2008) ‘Theories of recog- (1999) ‘Conjoint dissociations reveal involuntary “perceptual”
nition memory’, in Byrne, J.H. (chief ed.) Learning and priming from generating at study’, Consciousness and
Memory: A Comprehensive Reference, vol.2, Roediger, H. (ed.) Cognition, vol.8, pp.271–84.
Cognitive Psychology of Learning, Oxford, UK, Elsevier. Richardson-Klavehn, A., Gardiner, J.M., and Java, R.I.
Parks, T.E. (1966) ‘Signal-detectability theory of recogni- (1996) ‘Memory: task dissociations, process dissociations and
tion-memory performance’, Psychological Review, vol.73, dissociations of consciousness’, in Underwood, G. (ed).
pp.44–58. Implicit Cognition, Oxford, Oxford University Press.
Patterson, K., Nestor, P.J., and Rogers, T.T. (2007) ‘Where Roediger, H.L. and McDermott, K.B. (1993) ‘Implicit
do you know what you know? The representation of semantic memory in normal human subjects’, in Boller, F. and Grafman,
knowledge in the human brain’, Nature Reviews Neuroscience, J. (eds.) Handbook of Neuropsychology, vol.8, Amsterdam,
vol.8, pp.976–9. Elsevier.
Prince, S.E., Tsukiura, T., and Cabeza, R. (2007) Roediger, H.L., Buckner, R.L., and McDermott, K.B. (1999)
‘Distinguishing the neural correlates of episodic memory ‘Components of processing’, in Foster, J.K. and Jelic, M. (eds.)
encoding and semantic memory retrieval’, Psychological Memory: Systems, Process or Function?, Oxford, Oxford
Science, vol.18, pp.144–51. University Press.
Rajah, M.N. and McIntosh, A.R. (2005) ‘Overlap in the Roediger, H.L., Rajaram, S., and Srinivas, K. (1990)
functional neural systems involved in semantic and episodic ‘Specifying criteria for postulating memory systems’, in
memory retrieval’, Journal of Cognitive Neuroscience, vol.17, Diamond, A. (ed.) The Development and Neural Bases of Higher
pp.470–82. Cognitive Functions, New York, New York Academy of Sciences.
Ranganath, C. (2010) ‘Binding items and contexts: the cog- Roediger, H.L., Weldon, M.S., and Challis, B.H. (1989)
nitive neuroscience of episodic memory’, Current Directions in ‘Explaining dissociations between implicit and explicit meas-
Psychological Science, vol.19, pp.131–37. ures of retention: a processing account’, in Roediger, H.L. and
Ratcliffe, R., Sheu, C-F., and Gronlund, S.D. (1992) ‘Testing Craik, F.I.M. (eds.) Varieties of Memory and Consciousness:
global memory models using ROC curves’, Psychological Essays in Honour of Endel Tulving, Hillsdale, NJ, LEA.
Review, vol.99, pp.518–35. Rolls, E.T. and Kesner, R.P. (2006) ‘A computational theory
Reder, L.M., Nhouyvanisvong, A., Schunn, C.D., Ayers, of hippocampal function and empirical tests of the theory’,
M.S., Angstadt, P., and Hiraki, K. (2000) ‘A mechanistic Progress in Neurobiology, vol.79, pp.1–48.
account of the mirror effect for word frequency: a computa- Rotello, C.M., Macmillan, N.A., and Reeder, J.A (2004)
tional model of remember-know judgments in a continuous ‘Sum-difference theory of remembering and knowing: a
264 PART 3 MEMORY
Tulving, E. (1985) ‘Memory and consciousness’, Canadian Wais, P.E., Mickes, L., and Wixted, J.T. (2008) ‘Remember/
Psychology, vol.26, pp.1–12. know judgments probe degrees of recollection’, Journal of
Tulving, E. and Osler, S. (1968) ‘Effectiveness of retrieval Cognitive Neuroscience, vol.20, pp.400–5.
cues in memory for words’, Journal of Experimental Psychology, Wickens, T.D. (2002) Elementary Signal Detection Theory,
vol.77, pp.593–601. Oxford, Oxford University Press.
Tulving, E., Schacter, D.L., and Stark, H.A. (1982) ‘Priming Wixted, J.T. and Mickes, L. (2010) ‘A continuous dual-pro-
effects in word-fragment completion are independent of rec- cess model of remember/know judgments’, Psychological
ognition memory’, Journal of Experimental Psychology: Review, vol.117, pp.1025–54.
Learning, Memory and Cognition, vol.8, pp.336–42. Wixted, J.T. and Stretch, V. (2004) ‘In defense of the signal
Vaidya, C.J., Gabrieli, J.D.E, Keane, M.M., and Monti, L.A. detection interpretation of remember/know judgments’,
(1995) ‘Perceptual and conceptual memory processes in Psychonomic Bulletin and Review, vol.11, pp.616–41.
global amnesia’, Neuropsychology, vol.10, pp.529–37. Yonelinas, A.P. (1994) ‘Receiver operating characteristics in
Van den Bos, M., Cunningham, S.J., Conway, M.A., and recognition memory: evidence for a dual-process model’,
Turk, D.J. (2010) ‘Mine to remember: the impact of ownership Journal of Experimental Psychology: Learning, Memory and
on recollective experience’, The Quarterly Journal of Exper- Cognition, vol.20, pp.1341–54.
imental Psychology, vol.63, pp.1065–71. Yonelinas, A.P. (1997) ‘Recognition memory ROCs for
Vanna, S.D., Tsivilis, D., Denby, C.E., Quamme, J.R., item and associative memory: evidence for a dual-process
Yonelinas, A.P., Aggleton, J.P., Montaldi, D., and Mayes, A.R. signal detection model’, Memory and Cognition, vol.25,
(2009) ‘Impaired recollection but spared familiarity in patients pp.747–63.
with extended hippocampal system damage revealed by 3 con- Yonelinas, A.P. (2001) ‘Consciousness, control and confi-
vergent methods’, Proceedings of the National Academy of dence: the 3 Cs of recognition memory’, Journal of Experimental
Sciences, vol.106, pp.5442–7. Psychology: General, vol.130, pp.361–79.
Vargha-Khadem, F., Gadian, G.D., Watkins, K.E., Connelly, Yonelinas, A.P. (2002) ‘Components of episodic memory:
A., and van Paesschen, W. (1997) ‘Differential effects of early the contribution of recollection and familiarity’, in Baddeley,
hippocampal pathology on episodic and semantic memory’, A., Conway, M., and Aggleton, J. (eds.) Episodic Memory: New
Science, vol.277, pp.376–80. Directions in Research, Oxford, Oxford University Press.
Verfaillie, M., Koseff, P., and Alexander, M.P. (2000) Yonelinas, A.P. and Jacoby, L.L. (1996) ‘Noncriterial recol-
‘Acquisition of novel semantic information in amnesia: effects lection: familiarity as automatic irrelevant recollection’,
of lesion location’, Neuropsychologia, vol.38, pp.484–92. Consciousness and Cognition, vol.5, pp.131–41.
WOR K ING
MEMORY
Graham J. Hitch
1 INTRODUCTION
Working memory (WM) refers to a central feature of differences, normal and abnormal development, neu-
cognition, namely our ability to process and maintain ropsychology, and neuroimaging. We go on to focus in
temporary information in a wide range of everyday more detail on the particular topic of phonological
activities such as planning, learning, reasoning, prob- working memory and vocabulary acquisition, where
lem solving, and following instructions. This chapter the convergence of different kinds of evidence is par-
begins by introducing the concept of working memory ticularly striking. Finally, we take a short look at recent
in the context of the distinction between short-term developments in computational modelling that make
memory (STM) and long-term memory (LTM). theories of some aspects of working memory more
Having done this, we are in a position to consider the explicit and more precise. Overall, we shall see that the
structure of working memory, that is, the unchanging multi-component view of working memory provides a
features that account for its operation in different useful framework for explaining known facts and
activities. We shall see that – in common with many guiding further research, and can be used productively
other aspects of the cognitive system – identifying to address a range of practical problems.
structure is no trivial task. The discussion is organized
around the multi-component model of working mem-
ory (Baddeley and Hitch, 1974; Baddeley, 1986), trac-
ing some of the developments in this model in the light
Human memory as a
1.1
of new evidence and noting alternative accounts where multifaceted system
appropriate. The material covered has been chosen to
illustrate the increasing diversity of phenomena that When someone tells us they have a poor memory,
are seen as relating to working memory and includes they may be referring to any of a range of specific
evidence from laboratory experiments, individual problems. For example, they may have difficulties in
CHAPTER 9 WORKING MEMORY 267
Response output
FIGU RE 9.1 The modal model of memory, redrawn from Atkinson and Shiffrin (1971). Note how information has to
pass through the short-term store in order to access the long-term store. Note also that the sensory stores are not
discussed in the text. They are very short-lived and are specific to the various sensory pathways that feed information
into the short-term store. Source: Atkinson and Shiffrin, 1971
So compelling was all this evidence at the time that assumption that STM behaves as some form of work-
several two-store models of memory were proposed. ing memory. You can gain some insight into the plau-
Reflecting this unanimity, their common features sibility of supposing that these activities require
were referred to as the ‘modal’ model (Murdock, keeping track of temporary information within a
1967). The main assumptions of this model were (1) stream of ongoing mental operations by trying one for
that STM is a limited-capacity store subject to rapid yourself (see Box 9.1 on the comprehension of garden-
forgetting, (2) that control processes, such as sub- path sentences).
vocal rehearsal, can be used to maintain information Although the modal model captured some impor-
in STM, and (3) that information in STM is gradually tant insights, the consensus it reflected turned out to be
transferred to LTM. Atkinson and Shiffrin (1971) pro- fleeting. One concern was whether the various strands
vide the best known example of this type of account of evidence for distinguishing STM and LTM con-
(see Figure 9.1). verged on a coherent account. For example, different
You will see from the diagram that Atkinson and ways of estimating the capacity of the short-term store
Shiffrin (1971) labelled their short-term store as a gave quite different answers and reasons for this were
working memory that serves other functions besides unclear. A consequence of this particular challenge
acting as a temporary store. These functions include was a resurgence of interest in general principles of
the regulation of control processes such as rehearsal remembering as in the ‘levels of processing’ theoretical
and retrieving information from LTM. Note that con- framework of Craik and Lockhart (1972). Another
trol processes are volitional and are conceptually dif- concern was whether it is appropriate to assume that
ferent from involuntary, automatic processes (such as STM behaves as a working memory. One difficulty for
becoming alert to the sound of one’s own name whilst this position arose from intriguing neuropsychological
attending to something else). At about the same time evidence from a patient known in the literature as KF
that the Atkinson and Shiffrin model was enjoying its (Shallice and Warrington, 1970). KF sustained brain
popularity, numerous other authors argued that the damage from an accident and his auditory digit span
transient storage provided by STM was crucial for cog- was reduced to two items, which is way below the nor-
nitive activities such as sentence comprehension and mal range of about seven identified by Miller (1956).
problem solving. In other words, there was a general However, despite having such a low memory span,
CHAPTER 9 WORKING MEMORY 269
Garden-path sentences are sentences that lead the support their view with evidence that individuals
comprehender ‘up the garden path’ towards an with low working memory capacity are less able to
incorrect interpretation, as in We painted the wall maintain multiple interpretations than individuals
with cracks (see Chapter 6). It is the ambiguity of with high working memory capacity. However, an
such sentences that makes them difficult. One alternative theory is that comprehension draws on
explanation assumes that multiple interpretations more specialized resources than working memory
of ambiguous sentences are held in working mem- (e.g. Caplan and Waters, 1999).
ory (Just and Carpenter, 1992). Just and Carpenter
KF performed normally on tests of long-term learning effect of performing an irrelevant STM task at the same
and memory; he possessed normal intelligence and had time as reasoning, comprehending language, or learning
no major difficulties in understanding spoken language new information. For example, in one experiment peo-
(Shallice and Warrington, 1970). In general terms KF’s ple carried out a verbal reasoning task while remember-
pattern of memory performance was consistent with ing sequences of random digits (see Box 9.2 for an
the modal model as it could be explained in terms of outline of the experimental procedure). Reasoning was
selective damage to STM while LTM was intact. impaired when the STM load was increased by making
Moreover, the fact that damage to part of the brain the digit sequences longer. Similar results were obtained
could have this effect suggested a separate neuroana- when the cognitive task was either comprehending
tomical localization of STM. However, the absence of a prose or learning a list of words for free recall. Baddeley
general impairment in KF’s learning, comprehension, and Hitch (1974) drew two main conclusions from these
and reasoning presents obvious difficulties for the idea observations. First, the finding that an irrelevant STM
that STM acts as a general-purpose working memory task interferes with a range of cognitive tasks is consist-
necessary for supporting a range of cognitive activities. ent with the idea of a common working memory system
that combines temporary information storage with
ongoing mental operations. Second, while working
memory overlaps with STM, the two concepts are not
Working memory as
1.3
the same. Thus, even when the irrelevant digit load
more than STM approached memory span and therefore ‘filled’ STM
storage capacity, there was no catastrophic breakdown
Given theoretical difficulties such as that presented by in any of the cognitive tasks. This suggests that working
KF, Baddeley and Hitch (1974) made an empirical memory includes an additional resource not shared
investigation of whether STM does indeed act as a with STM. Baddeley and Hitch (1974) tentatively identi-
working memory. One technique they used was the fied this as a ‘central executive’ responsible for the atten-
dual-task paradigm in which participants performed a tional control and coordination of mental operations.
STM task and a separate cognitive task at the same Further evidence for a distinction between STM and
time. The logic of this paradigm is that two tasks will working memory came from studies of individual dif-
mutually interfere if they require access to a common ferences. The logic behind this approach is that if two
resource and their combined demands exceed its capac- tasks involve similar underlying psychological pro-
ity. Moreover, the effect of loading STM on cognition cesses, then a person who performs well on one should
provides an experimental simulation of the depleted do well on the other. In statistical terms, the two abili-
STM of neurological patients like KF. In a series of ties should be positively correlated. In an influential
experiments, Baddeley and Hitch (1974) studied the study, Daneman and Carpenter (1980) argued that
270 PART 3 MEMORY
BOX 9.2 RESEARCH STUDY Studying the effect of an irrelevant memory load on
verbal reasoning
The verbal reasoning task used by Baddeley and sequence of six random digits is close to the span of
Hitch (1974) involved deciding whether a sentence immediate memory, whereas the counting sequence
gave a true or a false description of the order of a is stored in long-term memory. Repeating random
letter pair. Examples are: A precedes B – AB (true), digits slowed solution times in the reasoning task
and B does not follow A – AB (false). Varying the verb, relative to a control condition, but the counting task
the grammar, the letter order, and the truth-value had very little effect. Furthermore, the interference
of the answer gave a total of 32 problems of varying produced by random digits was greater for the
difficulty. Each problem was shown individually, per- more difficult versions of the reasoning task.
formance being measured by the speed and accu- The conclusion Baddeley and Hitch (1974) drew
racy of pressing ‘true’ and ‘false’ response keys. was that reasoning and short-term retention com-
One experiment involved a comparison between pete for a limited-capacity ‘workspace’ that can be
the effect on reasoning of concurrently repeating a flexibly allocated either to the storage demands of
sequence of six random digits and counting repeat- the memory load or the processing demands of the
edly from one to six. The rationale was that a reasoning task.
standard measures of STM, such as word span and Aptitude Test (SAT) scores (see Table 9.1). It turned out
digit span, tax storage capacity but do not assess the that reading span was a good predictor of all three
capacity to combine storage with ongoing processing measures of reading comprehension and a much better
operations. In order to provide a better assessment of predictor than word span. Daneman and Carpenter
the latter, and therefore of working memory capacity, went on to show that a listening span measure gave
Daneman and Carpenter devised a novel reading span similar results, showing that the correlation is not spe-
task. In this task, participants were required to read cific to reading. They interpreted their findings as
aloud a set of unrelated sentences and immediately showing that working memory capacity is an important
afterwards to recall the last word of each sentence. source of individual differences in language compre-
Box 9.3 gives further information about the procedure. hension, the key characteristic of working memory
To assess reading span, Daneman and Carpenter being its function of combining temporary storage and
(1980) prepared sets of two, three, four, five, and six information processing, in line with the approach taken
sentences. Participants were presented with progres- by Baddeley and Hitch (1974).
sively larger sets until they failed at a particular level. A criticism made of Daneman and Carpenter was
An individual’s reading span was measured as the big- that their correlations might be an artefact of similari-
gest set size at which he or she could achieve correct ties in processing operations in the various tasks they
recall. Thus, reading span reflects how many items a used. Thus, reading span, listening span, and language
person can remember at the same time as reading sen- comprehension all involve language processing,
tences, in contrast to their STM span, which reflects whereas word span does not. The potential force of
how many items they can remember when there is no this criticism is substantial and called into question
requirement for simultaneous processing. whether Daneman and Carpenter’s results have any-
Daneman and Carpenter (1980) compared reading thing to do with working memory as a general-pur-
span with STM span for words as predictors of reading pose resource. To address it, other investigators looked
comprehension skills in a group of college students. at patterns of correlation using different measures of
Reading comprehension was measured in three ways: working memory span to which the criticism does not
fact questions, pronoun questions, and verbal Scholastic apply. For example, Turner and Engle (1989) devised
CHAPTER 9 WORKING MEMORY 271
The materials for Daneman and Carpenter’s (1980) time and read it aloud at their own pace, starting at
reading span task were a set of unrelated sentences, set-size two. The second card was presented as
each of which was typed on a separate card. The soon as the first was read. A blank card signalled
two examples they gave are: recall of the final word on each card in their order of
occurrence (i.e. anger, lake in the above example of
Card 1: When at last his eyes opened there was no
set-size two). Three trials were given at each set-
gleam of triumph, no shade of anger.
size, and set-size was increased until all three trials
Card 2: The taxi turned up Michigan Avenue where at a particular level were failed. At this point testing
they had a clear view of the lake. was ended. Reading span was taken as the level at
Cards were arranged in sets of two, three, four, five, which the participant was correct on two out of
and six sentences, there being three instances of three sets. As with memory span, there are many
each set-size. Participants were shown one card at a variants on this basic procedure.
TAB LE 9.1 Correlations between spans and various was accurate. Turner and Engle (1989) found that
measures of reading comprehension operation span was a superior predictor of reading
comprehension than standard STM span, despite
Reading comprehension measure
involving dissimilar processing operations. Their
Fact Pronoun Verbal SAT results therefore support the idea of a general working
questions questions
memory system underpinning the ability to combine
Reading span .72 .90 .59 information processing with temporary storage in a
Word span .37 .33 .35 range of different activities. Indeed, reading span, lis-
tening span, operation span, and tasks like them are
Source: Daneman and Carpenter, 1980, Experiment 1
often referred to by the generic term working memory
span. Subsequent work has expanded the picture by
an operation span task in which participants solved a showing that individual differences in working mem-
series of arithmetical calculations. A single word was ory span predict performance in a range of tasks such
presented after each calculation, and after completing as following directions (Engle et al., 1991), are closely
each set of calculations, all the words had to be related to fluid intelligence (Engle et al., 1999b), and
recalled. Operation span was measured as the maxi- can be used as longitudinal predictors of children’s
mum number of calculations for which this final recall scholastic development (Hitch et al., 2001).
SUMMARY OF SECTION 1
• Human memory is not a unitary system and appears instead to be multifaceted.
• An important distinction has been made between STM and LTM.
• Atkinson and Shiffrin (1971) suggested that STM acts as a working memory responsible for a variety
of control processes.
• Baddeley and Hitch (1974) explored and expanded this idea and concluded that STM is better
regarded as a component of working memory.
• Converging evidence that working memory differs from STM comes from studies of individual differ-
ences in tasks such as reading span and operation span.
272 PART 3 MEMORY
more difficult than combining a visuo-spatial and a limit where performance breaks down. The observa-
verbal task. This observation suggests that there are tion of a double dissociation of neuropsychological
separate resources specialized for dealing with verbal impairment is strong evidence for separate verbal and
and visuo-spatial information. Nevertheless, as there visuo-spatial stores.
is some mutual interference when a visuo-spatial and Dual-task methods have proved to be a highly pro-
a verbal task are combined, the data are also consistent ductive way of investigating the nature of the visuo-
with the involvement of a common resource. One way spatial sketchpad. In one highly cited study, Baddeley
of accounting for these observations is to assume that and Lieberman (1980) found that the ability to use a
the central executive controls visual and verbal tasks mental imagery mnemonic to remember verbal mate-
and that there is a separate sub-system for storing rials was disrupted by a concurrent spatial, non-visual
visuo-spatial information, analogous to the phono- task (tracking a moving loudspeaker while blindfold)
logical loop. This tripartite model, in which the extra but not by a concurrent visual, non-spatial task
sub-system is referred to as the visuo-spatial sketch- (detecting changes in the brightness of a blank field).
pad, was developed further by Baddeley (1983; 1986) This pattern was not observed when participants used
and is illustrated in Figure 9.2. rote rehearsal rather than imagery, suggesting it was
Neuropsychological patients can show selective not a function of the relative difficulties of the inter-
impairments in either visuo-spatial or verbal working fering tasks. Baddeley and Lieberman (1980) explained
memory. For example, de Renzi and Nichelli (1975) their results in terms of the fact that the imagery mne-
found Corsi span and auditory digit span could be monic they studied was spatial rather than visual.
independently impaired in patients with different Subsequent research has largely borne out the idea
types of lesion. Corsi span is a test of visuo-spatial STM that the visuo-spatial sketchpad has separate spatial
that uses an apparatus in which a set of nine identical and visual components (Klauer and Zhao, 2004; Logie,
cubes is placed at haphazard locations on a horizontal 1995).
board. The experimenter points to a selection of cubes An interesting example of a predominantly visual
one by one and the task is to reproduce the sequence imagery task is provided by the work of Hitch et al.
immediately afterwards by pointing. As in digit span, (1995). Participants were first shown two line draw-
sequence length is progressively increased to find the ings, one after the other, and were then asked to super-
impose them using mental imagery and identify the
Visuo-spatial novel figure thus revealed. For instance, in one trial the
sketchpad
first drawing showed two ice cream cones placed apart
from one another horizontally. The second drawing
showed a line shaped as an inverted U with ends where
the tops of the cones had appeared just previously.
When mentally superimposed, the two drawings com-
bined to reveal a skipping rope with the cones as the
Central
executive handles. Hitch et al. (1995) found that identifying the
novel figure was more accurate when both drawings
consisted of a black figure on a white ground than
when one was white on black, providing clear evidence
that the images preserved information about visual
appearance. It is interesting to note in passing that if
Articulatory you were able to ‘see’ the skipping rope in your mind’s
loop
eye in the above example, you achieved this using con-
FIGU RE 9. 2 The structure of working memory. Source: ceptually-driven images rather than the perceptually-
based on Baddeley, 1983 driven images studied by Hitch et al. (1995). This is an
274 PART 3 MEMORY
important distinction as the characteristics of these of the capacity of working memory in terms of chunks,
two types of image are not necessarily the same (see for where each chunk is a unit corresponding to a familiar
example Farah, 1984). subgroup of items, then we can understand these
In reviewing visuo-spatial working memory, Logie results in terms of experts being able to encode famil-
(1995) suggested that the spatial and visual sub- iar stimuli as larger chunks when presented with plau-
systems comprise a spatial movement system that can sible arrangements. Interestingly, Cowan (1988; 2005)
be used to refresh the contents of the visual store, by maintains the assumption that working memory
analogy with the role of articulatory rehearsal in the involves a limited capacity attentional system (see also
phonological loop. Smyth and Waller (1998) asked Engle et al., 1999a). The idea of specialized buffer
rock climbers to imagine tackling familiar routes stores has also been challenged by the work of Jones
while performing a variety of secondary tasks designed (see Section 2.3.4). In the remainder of this chapter we
to disrupt their ability to use visual, spatial, or kinaes- stay within the Baddeley and Hitch (1974) framework
thetic information and obtained results implicating all for the purpose of organizing the discussion, raising
three dimensions of representation. However, we are problems for it where appropriate. We begin with the
still some way from understanding how these differ- relatively well-specified concept of the phonological
ent types of information combine together. loop, before moving on to the central executive, the
In conclusion, the work of Baddeley and Hitch most important but least understood aspect of work-
(1974) led to a tripartite model of working memory ing memory.
that was subsequently developed by Baddeley (1986).
This model appears to have been the first substantive
account of working memory and has been influential
within the field. However, an increasing number of
Phonological working
2.2
alternative accounts has emerged subsequently, many memory
of which are described in a landmark volume edited by
Miyake and Shah (1999). Several theoretical issues One reason the phonological loop is relatively well
divide these approaches. One of the main ones con- specified is the existence of a cluster of interrelated
cerns the relationship between working memory and experimental manipulations that affect its operation.
LTM. Baddeley and Hitch (1974) assumed separate We have already encountered one of these, namely
systems. However, a number of authors take a different the phonemic similarity of items presented in tests of
view, maintaining that working memory corresponds immediate recall (see Section 1.2). A second variable
to the currently activated sub-region of LTM (e.g. was the word length of the items. In an important
Ericsson and Kintsch, 1995; Cowan, 1988; 2005). Part series of experiments, Baddeley et al. (1975) showed
of the motivation for this alternative approach comes that the limit on STM span for verbal stimuli was not
from evidence that extensive knowledge of a specific simply a fixed number of items or chunks, as Miller
domain is associated with a dramatic increase in work- (1956) had claimed, and in particular was higher for
ing memory capacity for information from that shorter words (e.g. harm, wit) than for longer words
domain. For example, chess experts display superior (e.g. university, hippopotamus). Box 9.4 describes one
working memory skills when reproducing an arrange- of their procedures and its results. One of many inter-
ment of chess pieces on a board when the arrangement esting observations was a systematic relationship
is plausible in the context of a game. However, with a between how many words could be recalled and the
random arrangement of pieces experts perform no time it took to say them out loud. Thus, people could
better than non-experts, suggesting that the underly- recall the number of words that could be spoken in
ing capacity of working memory is the same in both about two seconds. This is consistent with the idea of
groups and that experts benefit from their greater a rehearsal loop in which rehearsing items sequen-
familiarity with patterns taken from games. If we think tially refreshes their decaying memory traces. Longer
CHAPTER 9 WORKING MEMORY 275
In one of their experiments, Baddeley et al. (1975) has a time-based capacity such that people can
constructed five pools of 10 words of one, two, recall as many words as they can say aloud in about
three, four, or five syllables. The pools were two seconds. Individual differences paint a corre-
matched for semantic category and familiarity. To sponding picture in that the faster a person can say
illustrate, the one-syllable pool included stoat, a list of words out loud (that is, the faster they can
mumps, school, Greece, and corresponding items in rehearse), the more effective they prove in subse-
the five-syllable pool were hippopotamus, tuberculo- quently recalling those words.
sis, university, Yugoslavia. Ten lists of five words were
100
made up of random permutations within each pool.
words take longer to rehearse and so fewer can be many options open. Compare this with a sequence of
refreshed within the time limit set by the rapidity of dissimilar items such as RJQL, where being able to
the decay process. Baddeley et al. (1975) also exam- remember that the third item had a /u/ sound would
ined individual differences and found that faster be of much more help.
speakers tended to recall more information than This model of the phonological loop was also able
slower speakers. This is consistent with the model to explain the results of dual-task experiments in
given the plausible assumption that faster speakers which immediate serial recall was combined with
can rehearse more rapidly. The model could also articulatory suppression (a secondary task involving
account for the phonemic similarity effect, as a given the repetition of a redundant and irrelevant word such
amount of decay would have a greater effect on the as the the the the). This low-level secondary task is
ability to discriminate the memory traces of items intended to occupy the phonological loop with irrele-
that share phonological features. To appreciate this vant (but unavoidable) activity, so that performance
point, suppose you have been presented with the on the primary task has to manage without the assis-
sequence of phonemically similar letters BTCG to tance of the phonological loop (or at least without a
recall. If as a result of partial forgetting you could large part of its functioning). Baddeley et al. (1975)
only remember that the third item contained an /e/ found that articulatory suppression disrupted recall,
sound, this would not be very helpful as it leaves consistent with disrupting the phonological loop.
276 PART 3 MEMORY
Suppression also removed differences between the developmental changes in verbal STM as children
recall of longer and shorter words and between pho- grow up.
nemically similar and dissimilar items. These further
effects are also consistent with disruption of the loop. 2.2.1Developmental and cross-linguistic
However, the effects of word length and phonemic differences
similarity only disappeared when items were pre- The two-part model of the phonological loop is inter-
sented visually and not when they were presented esting in a number of different ways. Not least is that
auditorily. This unexpected effect of presentation the model can be applied to phenomena outside its
modality was for some time something of a puzzle. initial scope. One example is the developmental
The position was eventually clarified in experiments growth of memory span during childhood, for which
carried out by Baddeley et al. (1984) where suppres- many competing explanations had been proposed
sion was continued during recall as well as item pres- (Dempster, 1981). Thinking in terms of the phono-
entation. Under these conditions, suppression logical loop suggests it would be informative to meas-
removed the word-length effect for auditory items, ure children’s recall of lists of words of different
but still did not remove the phonemic similarity effect. lengths and the speed at which they can articulate the
Baddeley et al. (1984) explained these results in terms words, as in Baddeley et al.’s (1975) study of adults.
of a modified theoretical account in which the phono- The results of doing this are quite striking. As chil-
logical loop consists of a decaying phonological store dren’s ages increase, their average level of recall
(the locus of the phonemic similarity effect) and a increases in proportion to the rise in their average
control process of sub-vocal rehearsal (the locus of the speech rate (Nicolson, 1981; Hulme et al., 1984; see
word-length effect) (see Figure 9.4). According to this Figure 9.5). Furthermore, the size of the word-length
account, spoken stimuli access the loop automatically effect in children of different ages reflects the time it
whereas visual inputs have to be verbally recoded, an takes to articulate words of different lengths. Finding
optional control process that involves sub-vocaliza-
tion. Suppression eliminates the word-length effect for 6
both visually and auditorily-presented stimuli by dis-
rupting rehearsal, but only eliminates the effect of 5
phonemic similarity for visually-presented stimuli, as
Mean number recalled per list
0
0 1 2 3 4
Sub-vocalization Speech rate (words/sec.)
such a clear empirical relationship is informative and that having to ignore irrelevant speech was more
suggests a possible explanation for the developmental interfering than ignoring irrelevant noise, leading
growth in memory span, namely that older children them to suggest that unattended speech enters the
can rehearse faster and can therefore maintain more phonological store whereas non-speech sounds do
items within the time-limit set by trace decay in the not. Consistent with such an interpretation, blocking
phonological store. The phonological loop suggests a people’s ability to verbally recode visual stimuli by
similar explanation for the existence of some curious having them perform articulatory suppression
cross-linguistic differences in STM span. For exam- removes the disruptive effect of irrelevant speech
ple, differences in mean digit span between English (Salamé and Baddeley, 1982). However, the phono-
(7.2), Spanish (6.4), Hebrew (6.5), and Arabic (5.8) logical loop interpretation was challenged by evidence
are highly correlated with the rates at which the digits that irrelevant non-speech sounds can interfere with
can be articulated in these languages, faster rates verbal STM, the amount of interference being deter-
being associated with higher spans (Naveh-Benjamin mined by the same factors as for speech. Thus steady-
and Ayres, 1986). state streams, where the irrelevant sounds remain the
The phonological loop model has prompted further same, cause less disruption than changing-state
questions about developmental change. One of these streams, where the irrelevant sounds vary over time
concerns how children remember a series of nameable (Macken and Jones, 1995). Such observations have
objects. Older children and adults show the standard been used to question the assumption that irrelevant
tendency for poorer recall of items with longer names. speech has an effect that is specific to the phonological
However, children under the age of seven show no loop. They suggest a broader explanation of the inter-
such effect, though they do show a word-length effect ference caused by irrelevant sounds in terms of gen-
when the items are presented in the form of their spo- eral memory mechanisms that are not specific to the
ken names instead of pictures (Hitch et al., 1989). verbal domain, as in Jones’s (1993) concept of a multi-
Moreover, when recalling nameable pictures, younger modal ‘episodic record’. The explanation of irrelevant
children find it harder when the pictures are visually sound effects has developed into an area of consider-
similar to one another, whereas older children find it able controversy (see for example Baddeley, 2007,
harder when the names of the pictures are phonemi- Chapter 3; Baddeley and Larsen, 2003; Jones et al.,
cally similar (Hitch et al., 1988). These observations 2006). Although this debate continues, a possible res-
are consistent with the assumption that spoken stim- olution is that irrelevant speech affects a serial order-
uli gain automatic access to the loop but that phono- ing mechanism common to speech and non-speech
logical recoding is necessary for visual stimuli (see sounds (see for example Beaman and Jones, 1997) as
Section 2.2). They suggest further that the process of well as the speech-specific phonological store (Page
recoding is somewhat slow to develop and that and Norris, 2003).
younger children are more reliant on visuo-spatial
working memory. Subsequent research has confirmed 2.2.3 Neural basis
the developmental progression from visual to phono- Before closing this part of the discussion, we shall
logical coding and suggests that it may be related to consider some evidence about the neural basis of the
learning to read, being markedly delayed in dyslexic phonological loop. An obvious challenge for any
children (Palmer, 2000a; 2000b). model is to explain neuropsychological cases of selec-
tive impairment of memory span of the type demon-
2.2.2 The irrelevant speech effect strated by Shallice and Warrington (1970). Vallar and
Yet another application of the phonological loop Baddeley (1984) made a detailed investigation of one
model was to explain why exposure to background such patient, known as PV. Following a stroke damag-
speech sounds disrupts STM for visually presented ing the left parietal cortex, PV’s auditory digit span
verbal stimuli. Salamé and Baddeley (1982) showed was reduced to only two items. However, many of her
278 PART 3 MEMORY
other abilities were unimpaired. For example, her distinction between these two aspects of the phono-
speech was fluent and her rate of articulation was nor- logical loop. Furthermore, localization of the store to
mal. Vallar and Baddeley (1984) found that PV’s an area in the left parietal cortex corresponded
memory span for spoken sequences was poorer for approximately to the locus of damage in patients like
phonemically similar items but unaffected by items’ PV. Other neuroimaging studies of working memory
word length, which they interpreted as indicating a converge with – but also complicate – this simple pic-
phonological store deficit. If the store was functioning ture, especially with regard to the involvement of
at a reduced level, spoken inputs would nevertheless other brain areas (see for example Henson, 2001;
access it automatically and immediate recall would be Baddeley, 2007, Chapter 13). Our purpose here is
sensitive to phonemic similarity. However, PV would merely to illustrate an early success in using the pho-
not find sub-vocal rehearsal a useful strategy with a nological loop model to guide the collection and
damaged store and hence would not show an effect of interpretation of neuroimaging data.
word length. Like other patients of this type, PV’s
memory span for verbal materials was higher with 2.2.4 Theoretical issues
visual than spoken presentation. Moreover, her visual We have seen how a relatively simple model of the pho-
span was unaffected by phonemic similarity or word nological loop has been productive in ways that extend
length of the materials. PV may have been relying on well beyond its initial remit. These applications cover a
visuo-spatial working memory to remember visual surprisingly extensive range that includes develop-
stimuli and there may be an interesting parallel to be mental and cross-linguistic differences, effects of irrel-
drawn with children’s reliance on visuo-spatial work- evant speech, cases of neuropsychological impairment,
ing memory for remembering visual stimuli early on and results of neuroimaging studies. The model has
in development when, albeit for different reasons, turned out to be remarkably successful – it has evi-
their ability to use the phonological loop is restricted dently ‘travelled well’. However, some of its limitations
(see Section 2.2.1). are steadily becoming more apparent, as in its explana-
The advent of neuroimaging techniques provided tion of the effects of irrelevant speech. Other recent
the opportunity to study the neuroanatomical basis of evidence suggests that the word-length effect may not
the phonological loop in the normal brain. In an early be due to differences in items’ spoken duration. Thus,
study, Paulesu et al. (1993) investigated which areas of there is little or no effect of word duration when the
the brain are active in tasks thought to involve the phonological complexity of items is carefully con-
phonological loop. Such experiments depend on a trolled (Lovatt et al., 2000). Another difficulty is that
subtraction logic whereby brain activation observed young children show a clear word-length effect in STM
in one experimental task is compared with that in for spoken items before developing the ability to use
another. By arranging that the two tasks differ solely in sub-vocal rehearsal (Gathercole et al., 1994; Hulme
the process of interest, the areas of activation specific et al., 1984). Other authors have shown that output
to that particular process can be obtained by subtrac- delays are sufficient to cause word-length effects, with-
tion. This of course is not as simple as it sounds and out appealing to rehearsal (Brown and Hulme, 1995;
typically involves making theoretical assumptions Cowan et al., 1992; Gathercole and Hitch, 1993).
about the tasks under consideration. Paulesu et al. Whether the limitations of the phonological loop as
(1993) compared activation patterns in a verbal mem- a model count as falsifications is an interesting scien-
ory task requiring storage and rehearsal, a rhyme tific issue that could send us back to the drawing board
judgement task that required rehearsal but not stor- for an entirely new account. Some authors have taken
age, and a control task requiring neither storage nor this approach (Nairne, 2002). The alternative strategy
rehearsal (Box 9.5 describes the experiment in more is to revise the model to overcome its limitations,
detail). The results suggested separate localization of while at the same time preserving its original insights.
storage and rehearsal, consistent with the theoretical We saw an earlier example of this in the elaboration of
CHAPTER 9 WORKING MEMORY 279
Paulesu et al. (1993) used positron emission tomog- Subtracting activation patterns revealed that the
raphy (PET) to measure blood flow in different consonant memory task was associated with
regions of the brain. This technique involves giving increased blood flow in left hemisphere regions
an intravenous injection of radioactive water and corresponding to Broca’s area and the supramar-
then scanning the brain to record the spatial distri- ginal gyrus of the parietal cortex.
bution of radioactivity. Scanning is performed during A second comparison was between a rhyme
matched tasks that differ with regard to a feature of judgement task and a shape judgement task. In the
interest. Subsequent comparison of the two activa- rhyme task participants saw a series of consonants
tion patterns allows brain regions associated with and indicated whether each one rhymed with the
the feature of interest to be identified. (A similar letter B, which was always present. The shape task
logic applies to functional magnetic resonance imag- was identical except that the stimuli were Korean
ing (fMRI), a more recent technique that does not characters and the judgement was one of shape
involve radioactivity.) similarity. Previous research suggested that the
Paulesu et al. compared brain activation patterns rhyme judgement task would engage the sub-vocal
in phonological and non-phonological memory rehearsal system but not the phonological store.
tasks. The phonological task involved showing a Subtraction of the scans indicated that the rhyme
sequence of six consonants followed by a probe let- task activated Broca’s area but not the left supra-
ter. Participants indicated whether the probe item marginal gyrus. Thus, the sub-vocal rehearsal sys-
had appeared in the sequence. The non-phonologi- tem can be identified with Broca’s area and, by
cal memory task was identical except that the items revisiting the subtraction for the memory tasks, the
were unfamiliar Korean characters. The two tasks phonological store can be identified with the left
were therefore closely matched, but only remem- supramarginal gyrus.
bering consonants engaged the phonological loop.
the account of the phonological loop to explain why 2.3 Executive processes
the effects of articulatory suppression differ when the
memory items are seen rather than heard (see Section The central executive is, in general terms, responsible
2.2). A more recent example is the effort to develop for controlling and coordinating mental operations in
the concept of the phonological loop through more working memory. Baddeley and Hitch (1974) sug-
detailed computational modelling (see Section 4). It gested that the functions of the executive included
is probably too soon to say which of these strategies supervising slave stores such as the phonological loop
will be the more productive – a totally new approach and the visuo-spatial sketchpad, as well as interactions
or development based on the present model. Only with LTM. However, as we shall see, more precise
time will tell. For the present we note that, despite its identification of executive functions is a matter of con-
limitations, the phonological loop continues to pro- tinuing development and debate. The executive is at
vide a simple, usable framework for linking a robust once the most important component of working
set of psychological phenomena (see for example memory, the most controversial, and the least under-
Baddeley, 2007, Chapter 3) and is still widely used. stood. At various times it has been described as a ‘rag-
However, before continuing with further discussion bag’ or an area of ‘residual ignorance’ and, in a review,
of the phonological loop, we turn to the main aspect Andrade (2001) referred to it as ‘problematic’. There
of working memory in the tripartite model: the cen- are good reasons for these remarks. One is that the
tral executive.
280 PART 3 MEMORY
executive could be seen as a reinvention of the homun- Case et al. (1982) took these results as evidence for a
culus, a person inside the head. The well-known prob- simple model in which speed is a marker for the pro-
lem here is that of explaining what controls the portion of limited workspace required to support
homunculus without appealing to an infinite regress counting, and hence for the remaining proportion free
of further homunculi. Another difficulty is that, at an for storing count totals. However, further evidence is
intuitive level, executive processes clearly have links to needed to confirm that it is useful to think of the span
our sense of conscious awareness. This is another dif- of working memory as reflecting the capacity of a cen-
ficult concept with a long history of intractability (see tral workspace or ‘mental blackboard’.
Chapter 18 on consciousness; see also Baddeley, 2007, Several investigators have tried to examine more pre-
Chapter 16). Fortunately, rather than allowing them- cisely what limits the span of working memory in tasks
selves to be put off by these problems, researchers have such as reading span and listening span. Given that the
attempted to understand what aspects of executive number of items in store increases from the start to the
control they can, with the long-term goal of steadily end of a trial, the workspace hypothesis predicts a
reducing the area of residual ignorance. decline in the resources available to support processing
as each trial progresses. This would follow from the
2.3.1 Central workspace trade-off between resources within the workspace.
We read earlier how Baddeley and Hitch (1974) con- Towse et al. (1998) tested this prediction by studying the
ceptualized the executive as a limited-capacity central performance of children on reading span, operation
workspace with resources that could be flexibly allo- span, and counting span in a series of parallel experi-
cated to various combinations of mental operations ments. The results gave no clear support for a resource
and temporary information storage. We also saw how trade-off, in that there was no systematic change in the
Daneman and Carpenter’s (1980) reading span task speed of processing operations within trials. Towse et al.
was designed as a method for assessing the capacity of (1998) entertained an alternative hypothesis according
such a workspace. Thus, given the assumption that to which, rather than sharing attention between pro-
resources for processing and storage trade off against cessing and storage, children switch attention back and
each other, reading span can be interpreted as a meas- forth between processing and storage. Thus, in reading
ure of residual storage capacity when the workspace is span for example, children might read a sentence, store
also occupied in supporting reading processes. A the final word, read the next sentence, store its final
major boost for this hypothesis came from the work of word, and so on. According to this ‘task-switching’
Case et al. (1982) on counting span, a task with the account, reading span is limited by the rate of forgetting
same structure as reading span but a different combi- sentence-final words during the time intervals spent in
nation of processing and storage. Participants count reading. This is similar to the way in which errors in
the number of target items in a series of visual dis- mental arithmetic were explained (Hitch, 1978) and is
plays, each containing a mixture of targets and dis- quite different from the resource-sharing account. To
tractors, and at the end of the set they attempt to recall test the task-switching hypothesis, Towse et al. (1998)
the count totals. Like reading span, counting span is manipulated the time intervals over which information
determined as the set size above which accurate recall had to be stored in different conditions in which the
is no longer possible. Case et al. (1982) found that the total amount of processing was held constant. This was
observed growth of counting span during childhood achieved by altering the order of presentation of the
could be predicted from an observed increase in the items within a set, some of the items being designed to
speed of counting. Furthermore, when counting was take longer to process than others. In line with the pre-
artificially slowed down in adults by requiring them to diction from task-switching, spans were lower when the
use unfamiliar nonsense syllables instead of normal intervals over which information had to be maintained
number names, this reduced their counting span to were longer. This was true for all three tasks, reading
the level predicted by their slower counting speed. span, operation span, and counting span, suggesting a
CHAPTER 9 WORKING MEMORY 281
result of some generality. Subsequent research con- Norman and Shallice (1986) to provide a unified
firmed this by showing that manipulating the order of explanation for slips of action in everyday life and the
presentation of items has similar effects in adults (Towse more serious disturbances of behaviour seen in
et al., 2000). patients with frontal lesions (frontal patients). One
Other investigators have also found an effect of the striking example of such a disturbance is ‘utilization
length of the intervals devoted to processing operations behaviour’ (Lhermitte, 1983) where patients have dif-
in working memory span tasks, but have also shown ficulty inhibiting stereotyped responses to everyday
that span is lower when the operations themselves are objects. For instance, the sight of a toothbrush during
more complex (Barrouillet and Camos, 2001). Effects a clinical assessment may lead to a patient brushing
such as these have led towards a mixed model that his or her teeth even though this is totally inappropri-
involves both attention switching and resource sharing. ate to the situation.
Further evidence suggests that other factors are also Norman and Shallice (1986) proposed a model in
involved in limiting working memory span. For exam- which the control of action involves two levels. At the
ple, de Beni et al. (1998) found that individuals with low lower level is a set of learned schemata for routine
working memory spans made more intrusion errors of sequences of actions or mental operations, each of
recalling items from previous trials, suggesting that the which fires automatically to a specific ‘trigger stimulus’.
ability to inhibit potentially interfering information is For example, if we overhear someone mention our own
an important aspect of working memory capacity (see name we automatically orient our attention towards the
also Conway and Engle, 1994). To complicate matters speaker. These schemata are arranged in parallel, so that
further, it seems that the capacity to inhibit breaks at any moment there is competition among those that
down into two or three distinct subtypes of inhibition potentially might fire. At the higher level sits a supervi-
(Friedman and Miyake, 2004). sory attentional system (SAS), a limited-capacity
Taking all these observations together, it seems that resource capable of intervening at the lower level. A
a simplistic interpretation of working memory span as typical example would be the SAS intervening to stop a
reflecting the capacity of a central workspace is schema from firing despite the presence of its trigger
unlikely to be entirely accurate. Working memory stimulus. The Norman and Shallice model explains the
span tasks clearly share something important in com- difficulties of frontal patients in terms of a deficit in the
mon but seem nevertheless to require a more complex resources available for executive control. Thus in utili-
theoretical account. Such a conclusion points to the zation behaviour, strongly triggered schemata fire even
difficulty of sustaining any simple conceptualization when they lead to contextually inappropriate behav-
of executive processes. Indeed, an important issue to iour. Diary studies of slips and lapses in everyday life
emerge in recent studies of executive function is reveal that these too often involve making an inappro-
whether the executive is a single, unified entity (e.g. priate but frequent action in a familiar context. For
Duncan and Owen, 2000) or a system that is fraction- example, one diarist recorded intending to get his car
ated into distinct sub-components (e.g. Shallice, out of the garage, but on the way there he stopped to put
2002). This question of fractionation has led to an on his boots and gardening jacket, as if to work in the
interest in tasks other than working memory span that garden (Reason, 1984). Such ‘capture errors’ tended to
capture different aspects of executive function. occur at choice points when diarists reported their
attention being distracted elsewhere. The Norman and
2.3.2 Attention Shallice (1986) model would explain such errors in
The view of the executive put forward by Baddeley terms of distraction rendering the SAS temporarily
(1986) was substantially different from that proposed unavailable to inhibit a familiar and therefore strongly
earlier by Baddeley and Hitch (1974), stemming in triggered habit at the choice point.
part from difficulties with the idea of resource trade- Baddeley (1986) adopted the SAS as a model of
off. It was inspired by an imaginative attempt of executive control, thus moving away from the notion
282 PART 3 MEMORY
In the random generation task, participants are or familiar acronyms (e.g. FBI). The degree of ran-
asked to select items repeatedly at random from a domness can be estimated in various ways, one
restricted pool such as the digits 0–9 or the letters of the simplest being to count the proportion of
of the alphabet. Generation is usually required at a stereotyped pairs produced. Baddeley (1986)
specified rate, such as one per second. Some idea of described evidence that randomness declined sys-
the difficulty of the task can be gained by asking tematically when either the pace of generation or
someone to try it for a minute and noting down the difficulty of a secondary card-sorting task was
their responses. Most people soon start hesitating increased. These observations are consistent with
or repeating themselves, typically emitting stereo- the suggestion that random generation taxes a
typical sequences such as alphabetic runs (e.g. ABC) limited-capacity system.
of the executive as a workspace combining both pro- Thus attention is focused when listening to one mes-
cessing and storage, to a purely attentional system. sage and ignoring another, but divided when two mes-
This theoretical move led more or less directly to a sages have to be monitored simultaneously, or when
search for fresh ways of investigating executive pro- different activities have to be combined, as in dual-
cesses. One such task involves generating a random task experiments. Attention-switching, on the other
stream of responses using only the digits 0–9, a sur- hand, refers to situations where attention must be
prisingly difficult task (see Box 9.6). A major source of repeatedly shifted from one process to another. For
difficulty is the avoidance of stereotyped sequences example, in generating a random sequence of digits,
such as ascending or descending series of digits, or in attention must constantly shift between different
the case of letters, alphabetical runs. This type of error retrieval plans in order to avoid stereotypical patterns
is consistent with a task analysis in which the require- of responses. This in turn is somewhat different from
ment for randomness involves pitting the capacity for the role of attention when actively searching for infor-
supervised inhibitory control against the tendency to mation in LTM. Baddeley (1996) described a certain
execute strongly learned habits, sometimes called amount of empirical support for the separability of
‘pre-potent’ responses. Experimental evidence con- executive functions. For example, patients with
firms that random generation is a demanding task, but Alzheimer’s disease have an exaggerated difficulty in
also shows that it is a very complex task, suggesting combining concurrent tasks, whereas normal ageing
that it is unlikely to be a pure measure of executive is associated with increasing difficulty in focusing
function (see Towse, 1998). attention. However, in general the paper was theoreti-
cal and was in essence an attempt to set the agenda for
2.3.3 Fractionation future research.
In an attempt to develop the concept of the executive One way that the agenda has been taken forward is
still further, Baddeley (1996) proposed that the system through the study of individual differences in execu-
could be fractionated into a number of separate but tive function in the normal population. In one such
related functions dealing with different aspects of study, Miyake et al. (2000) gave a large sample of stu-
attention. These were focusing, dividing, and switch- dents a range of tasks designed to involve different
ing attention, and using attention to access informa- facets of attentional control. These were shifting atten-
tion in LTM. To give a general idea of these distinctions, tion, monitoring and updating information, and
focusing is required when irrelevant information has inhibiting pre-potent responses. Analysis of the data
to be ignored, whereas dividing is necessary when showed that a statistical model based on these three
attention has to be shared between different tasks. components gave a better account of relationships
CHAPTER 9 WORKING MEMORY 283
among abilities than simpler (i.e. one or two-factor) fails to address (Jones, 1993). We encountered Jones’s
models. This outcome is broadly consistent with the work when discussing the disruptive effect of irrele-
general idea that executive function is fractionated, vant sounds on immediate memory for verbal
but the number of functions and their identity differ sequences (Section 2.2.2 and Chapter 2). Jones et al.
from Baddeley’s (1996) proposal. Such a discrepancy (1995) argued that interference from speech and non-
is difficult to interpret, especially as a limitation of fac- speech sounds obeys the same principles, even when
tor analysis is that it can only reveal the structure in the memory task involves spatial information, and is
the variables that are entered into the analysis. Miyake best explained in terms of a common level of repre-
et al. (2000) went on to assess individual differences in sentation in a unitary memory system. This common
a number of other tasks that are widely used as tests of ‘episodic record’ minimizes the binding problem by
executive function. The results showed that these tasks storing different types of information in one place and
mapped onto the three putative components of execu- avoids the difficulty caused by their dispersal over
tive function in different and sometimes unexpected separate stores.
ways. These are interesting findings and illustrate the Do these considerations imply that attempts to frac-
need for further development in measuring executive tionate working memory should be abandoned and the
function (see also Section 2.3.1). unitary view proposed by Jones is correct? Not neces-
As a general conclusion, the present state of knowl- sarily. Similar patterns of interference across modali-
edge is that executive function appears to fractionate, ties do suggest a common mechanism, but such a
but it is not yet clear how (compare this with Chapter mechanism could supplement rather than replace
2 on multiple types of attention). Thus, we still need to modality-specific stores, as discussed in Section 2.2.2.
separate out and identify the various components of Perhaps the strongest reason for not abandoning frac-
executive control (see Baddeley, 2007, Chapter 7). tionation is that the irrelevant sound paradigm is a
Whatever the outcome, there is a further issue of how narrow basis on which to build a general theory. Thus
such a diverse executive can operate in a unitary way. a unitary account cannot begin to explain the array of
That is, how do the components of a many-faceted evidence for dissociations from the wide variety of
executive system interact coherently and avoid con- sources we have already discussed. Nevertheless, by
flict in the control of perception, thought, and action? suggesting an alternative interpretation of the irrele-
vant speech effect and drawing attention to the binding
2.3.4 Coherence and the binding problem problem, the approach of Jones and his colleagues
It is interesting to note that the problem of coherence made an important contribution.
is not restricted to executive processes and applies to
working memory more generally. Thus, if any system 2.3.5 The episodic buffer
consists of a number of separate sub-systems, then the The three-component model of working memory
question arises as to how the sub-systems interact to failed to address a number of issues that can be related
ensure that the system as a whole operates in an inte- to the question of binding in one way or another. We
grated manner. For example, if visuo-spatial informa- have already touched on the added complexity needed
tion about multiple objects is stored separately from to explain performance in working memory span
verbal information about the same objects, then the tasks such as reading span (see Section 2.3.1). One
system must have a way of keeping track of which aspect of the problem is that maintaining items whilst
information refers to what object. This is sometimes reading a series of sentences exceeds the storage
referred to as the binding problem. Indeed, one cri- capacity of the phonological loop. A related issue is
tique of the working memory model of Baddeley and the effect of expertise in boosting working memory
Hitch (1974) and its subsequent development by capacity, as in the example of chess. In both cases per-
Baddeley (1986) is that the assumption of separate formance benefits from chunking but the absence of
sub-systems creates a binding problem that the model any link between working memory and long-term
284 PART 3 MEMORY
results on visual feature binding, loading the central binding itself takes place outside the episodic buffer
executive with an attention-demanding concurrent and that the phonological loop and visuo-spatial
task led to an overall impairment in memory perfor- sketchpad feed the episodic buffer directly rather than,
mance, but this was no greater for sentences than for as had been initially assumed (Baddeley, 2000), via the
scrambled word lists. central executive (cf. Figure 9.6).
Baddeley et al. (2011) interpreted these unexpected Baddeley et al. (2011) were keen to emphasize that
findings as suggesting that binding is largely automatic, they regard the multi-component approach to work-
whether it be the chunking together of words using ing memory as providing a broad framework that
information in long-term memory or the integration attempts to capture what we already know in a rela-
of perceptual features into representations of objects. tively simple way and generate further questions. The
This in turn suggests a modification of the multi-com- episodic buffer provides a neat illustration of how ask-
ponent model in which the episodic buffer is a passive ing further questions led to a revision of the frame-
rather than an active system. The buffer is still assumed work. Time will tell whether it can continue to grow
to serve the crucial integrative role of holding informa- incrementally or will ultimately have to be abandoned
tion from different sources bound into unitized epi- in favour of alternative approaches.
sodes or chunks. However, the evidence suggests that
SUMMARY OF SECTION 2
• According to Baddeley and Hitch (1974), working memory is a multi-component system. The main
components initially were the phonological loop, the visuo-spatial sketchpad, and the central executive.
• The phonological loop has been further fractionated into the phonological store and a control pro-
cess of sub-vocal rehearsal. The visuo-spatial sketchpad has been divided into separate visual and
spatial components. A possible kinaesthetic component of working memory has yet to be firmly
established.
• The central executive may also involve several sub-components. However, these have yet to be
clearly defined and understood.
• The operation of a fractionated system needs to ensure that multiple sub-systems do not result in
incoherence. One aspect of this is the binding problem, which refers to the need for the system to
keep track of information spread between different sub-systems.
• Concepts such as the episodic record (Jones, 1993) and the episodic buffer (Baddeley, 2000) may be
viewed as different attempts to solve the binding problem.
Neuropsychological
3.1 heard (e.g. Blonterstaping). Non-word repetition was
devised as a more demanding test of memory for pho-
evidence nological form than digit span, and is typically more
highly correlated with vocabulary scores than digit
Some of the clearest evidence linking the phonological span. Furthermore, individual differences in the
loop with vocabulary acquisition comes from the pre- capacity of the phonological loop predict children’s
viously described patient PV, whose phonological performance on a simulated vocabulary learning task
store had a markedly reduced capacity (see Section (Gathercole et al., 1997). Understanding the causal
2.2.3). PV had normal long-term memory for familiar basis of these relationships is far from straightforward,
items, but encountered profound difficulty in learning however. For example, longitudinal studies suggest
new word forms. Baddeley et al. (1988) showed this that short-term phonological storage capacity limits
experimentally by testing her ability to learn pairings vocabulary growth early on in child development,
such as Rosa–Svieti, where the first word was in her whereas later on vocabulary knowledge influences
native Italian and the second was an unfamiliar performance in phonological short-term memory
Russian word. The result was dramatic: PV showed no tasks (Gathercole and Baddeley, 1989; see also Metsala,
learning at all. However, when the second words were 1999).
also Italian she showed normal learning. These obser- As a postscript, it is interesting to note that meas-
vations establish a relationship between short-term ures of the phonological loop also correlate with
phonological storage and long-term phonological vocabulary in second-language learning. For example,
learning. This in turn resurrects a classic debate about Service (1992) found that Finnish children’s ability to
the relationship between short- and long-term mem- repeat English-sounding non-words before starting to
ory. Similar patients, such as KF (see Section 1.2), who learn English predicted their English vocabulary some
had impaired STM but normal LTM, were historically two years later. Furthermore, Papagno and Vallar
important to the argument for separate memory (1995) showed that polyglots selected for being fluent
stores. That dissociation still stands, but the fact that in at least three languages had superior auditory digit
PV could only learn pairings of familiar items (whose span and non-word repetition when compared with
phonetic structure is already stored in LTM) indicates controls. The polyglots were especially good at learn-
a more complex relationship between STM and LTM. ing word–non-word pairs but were no better than
This is illustrated in the partitioning of LTM into lin- controls at learning word–word pairs.
guistic and episodic regions in Baddeley’s (2000)
revised model of working memory and the assump-
tion that each region has a separate link to the phono- 3.3 Experimental studies
logical store (see Figure 9.6).
Yet another way of assessing the involvement of the
phonological loop in new word learning is to take an
3.2 Individual differences experimental approach. In a series of studies, Papagno
and her colleagues investigated adults learning sets of
If learning new vocabulary items involves the capacity either word–non-word pairs or word–word pairs.
to hold a phonological sequence over a short interval, Papagno and Vallar (1992) showed that increasing
then the two abilities should be correlated with each the phonemic similarity of the non-words or their
other. A number of studies have shown that children’s number of syllables impaired learning. However, cor-
auditory digit span does indeed correlate with their responding manipulations in the word–word learn-
performance on tests of vocabulary (see Baddeley ing task had no effect. Furthermore, Papagno et al.
et al., 1998). Further evidence has come from studying (1991) found that articulatory suppression impeded
the child’s ability to repeat a non-word they have just the learning of word–non-word pairs but had no
CHAPTER 9 WORKING MEMORY 287
effect on learning word–word pairs. The absence of between word–word and word–non-word learning fit
effects on the word–word learning task provides well with the data on individual differences and
confirmation that the role of the loop is specific to patient PV in these same tasks.
learning novel words. These experimental differences
SUMMARY OF SECTION 3
• The phonological loop is involved in learning new word forms but not new associations between
familiar words. These tasks dissociate in the neuropsychological patient PV and healthy adults.
• Individual differences in vocabulary correlate with performance in tasks that reflect the capacity of
the phonological loop in children and adults.
• However, the causal nature of the relationship between the phonological loop and vocabulary during
development may be complex.
4MODELLING THE
PHONOLOGICAL LOOP
A number of attempts have been made to develop extending the concept of the phonological loop to
mathematical and computational models of the pho- account for long-term learning and serial ordering,
nological loop (see for example Brown et al., 2000; while at the same time attempting to preserve its orig-
Burgess and Hitch, 1992, 1999, 2006; Page and Norris, inal insights.
1998). Part of the impetus behind these efforts is the One argument for using computational modelling
need to explain phenomena that the initial concept to develop and express theories is the increasing com-
fails to address. For example, the phonological loop plexity of the facts we have to explain. As should be
was originally presented as an account of immediate evident from the present discussion, one strength of
recall, and although Baddeley (2000) subsequently the original concept of the phonological loop is its
showed it as linked to long-term memory (see Figure simplicity and the ease with which it can be used to
9.6), the revised model does not say how this link generate testable predictions. In passing we may also
operates. Clearly, extra assumptions are needed to note that this same strength has also allowed investi-
account for how phonological forms of newly learned gators to assess whether each of its assumptions is cor-
words are acquired. Even within immediate recall, the rect (see Section 2.2.4). This is an important part of
phonological loop is far from providing a complete the normal scientific process. However, revising and
account. The most common type of error in the imme- extending the concept of the phonological loop to
diate recall of sequences of familiar items such as dig- cope with errors and omissions runs the risk of gener-
its or letters is where the items themselves are correct ating an increasingly unwieldy informal account. In
but their order is confused. However, the original con- particular, adding capabilities for serial ordering and
cept of the phonological loop does not explain how learning may render the concept too complex to work
information about order is encoded or how order with. Moving from an informal, verbal–conceptual
errors are generated. These omissions make a case for level of theorizing to a more explicit, computational
288 PART 3 MEMORY
model that can simulate human behaviour is one way that what interests us here is the specific question of
of attempting to overcome this problem. what type of ordering mechanism underpins the oper-
The most basic test of the adequacy of a computa- ation of the phonological loop.
tional model is whether it reproduces the human According to the chaining hypothesis, serial order is
behaviour when presented with the same tasks. coded by forming associations between consecutive
However, this is not necessarily a very convincing test, items (e.g. Jones, 1993; Wickelgren, 1965). However,
as the model-builder knows in advance the phenom- although chaining might seem highly plausible, it
ena of interest and in general will have made sure the encounters some basic problems. One is explaining
model succeeds in reproducing them. A more power- recall of a sequence containing repeated items, such as
ful test is to run further simulations in which the the number 2835867. If order is encoded as a chain of
model is presented with novel experiments. The mod- associations, then the repeated item (8) will be associ-
el’s pattern of behaviour corresponds to its prediction ated with not one but two following items (3 and 6).
about human behaviour in the same circumstances. Consequently sequences containing repeated items
The experiments can then be run with human partici- should be difficult to recall and errors should occur after
pants to see whether the model’s predictions are each occurrence of the repeated item. Although
upheld (see for example Burgess and Hitch, 2006; sequences containing repeats are more difficult to recall
Hitch et al., 2009). Unfortunately, it is not quite as sim- in verbal STM tasks, errors tend to occur on rather than
ple as this sounds, and there are many reasons for after the repeated item (Jahnke, 1969). Further evidence
being cautious before embarking on computational against chaining comes from errors in recalling
modelling. One is that developing a mechanistic sequences in which phonemically similar items alter-
account involves making a large number of assump- nate with phonemically dissimilar items, such as
tions in order for the model to ‘run’. Sometimes the BXDJTQVR. These errors show a characteristic zig-zag
challenge of justifying these assumptions is hard pattern as one goes through the list, with more errors on
to meet. In the case of auditory–verbal STM we are the similar-sounding items (i.e. BDTV) and fewer on the
fortunate that there is a wealth of published data with dissimilar items (Baddeley, 1968; Henson et al., 1996).
which to constrain model-building. However, the Furthermore, dissimilar items are recalled with the same
same cannot be said at present for executive function, accuracy in alternating lists as in pure lists where all the
and detailed computational modelling would almost items are dissimilar (see Figure 9.7). According to chain-
certainly be premature in this case. In the following ing theories, extra errors ought to occur on the dissimi-
section, we describe briefly some constraints that lar items, as these follow similar cues. For these reasons,
influence the solution to the problem of how to handle chaining seems unlikely to explain how the phonologi-
serial order in the context of a computational model of cal loop deals with serial order. It is, however, a very per-
the phonological loop. Note that we do not discuss vasive concept and some models combine chaining with
models in detail, nor evaluate fully their ability to further assumptions and manage to achieve some degree
explain existing data. These are important topics, but of success (Botvinick and Plaut, 2006; Lewandowsky
would take us beyond our present goal of providing a and Murdock, 1989).
basic introduction to the way modelling has begun to One alternative to chaining is the positional
influence theorizing about working memory. hypothesis, according to which order is coded by asso-
ciations between each item and a representation of its
position within the sequence. In the simplest example
4.1 Serial order of this type of model, Conrad (1965) assumed that
verbal STM is composed of an ordered array of slots,
The general problem of explaining serial order in each containing a successive item in a list. To remem-
behaviour is widely recognized and several types of ber the sequence, the contents of the slots are simply
mechanism have been proposed (Lashley, 1951). We read out. This simple model has no problem explain-
will briefly describe some of these, bearing in mind ing how sequences containing repeated items are
CHAPTER 9 WORKING MEMORY 289
1.0 the second of these two stages less efficient, but has no
0.9 effect on the first stage. Burgess and Hitch (1999)
report simulations by their model. For alternating
0.8
conditions, these have the same zig-zag form as the
p (correct)
groups brings about a marked reduction in order extend the model to include combinations of primacy
errors in immediate recall (Ryan, 1969). Thus, recall of gradients at different levels.
a sequence such as 318476205 is more accurate if it is Modelling is presently developing in a number of
presented as groups of three items, i.e. 318,476,205 broad directions. One is extending positional models
(where the commas denote pauses). Moreover, group- of ordering at the lexical level to account for serial
ing changes the pattern of order errors. Instead of the ordering at phonological and syllabic levels (Gupta
most common mistake being to transpose an item to and MacWhinney, 1997; Hartley and Houghton,
an adjacent position, errors of recalling an item in a 1996). This is important as language perception and
corresponding position in a different group become production depend on simultaneous ordering at a
much more frequent, as in 316,478,205. These effects of number of different levels and understanding how
grouping suggest a positional coding system in which these are integrated presents a serious challenge.
position can be encoded at different levels. That is, a Another direction is extending such models to
higher level codes the position of groups within a list account for long-term sequence learning (Burgess and
and a lower level codes the position of items within Hitch, 2006; Hitch et al., 2009). Again, this is impor-
groups. Hitch et al. (1996) show how their computa- tant not only as part of the theoretical challenge of
tional model captures these hierarchical effects of posi- characterizing the relationship between working
tion in memory. Insofar as Page and Norris’s (1998) memory and LTM, but also as a pathway towards
primacy model encodes order on a single dimension, greater understanding of how new word-forms are
it cannot explain evidence for the coding of order on learned in vocabulary acquisition.
different levels. However, it would not be impossible to
SUMMARY OF SECTION 4
• One of the arguments for modelling is to go beyond the verbally expressed original concept of the
phonological loop and address a wider range of phenomena such as serial ordering and non-word
learning.
• Modelling is appropriate when we have a reasonably good general understanding of the system we
are trying to model and there are extensive data with which to constrain model-building.
• The modelling of serial order in the phonological loop illustrates how existing data can be used to
help make decisions about underlying mechanisms.
• The chaining hypothesis has difficulty explaining certain aspects of serial order recall. However, other
hypotheses have had more success, for example, the positional hypothesis and non-associative
accounts.
5 CONCLUSION
We have examined the concept of working memory as the visuo-spatial sketchpad, and the central executive,
a multi-component system, with particular emphasis and the subsequent development of the model. Progress
on phonological working memory and executive in tackling different aspects of working memory has
control. Taking a historical approach, we have traced developed at different rates. In the case of the phono-
the emergence of the concepts of the phonological loop, logical loop, experimental evidence from a variety of
CHAPTER 9 WORKING MEMORY 291
sources converged on a relatively simple two-compo- promising beginning made by Norman and Shallice
nent account. In turn, this account led to insights into a (1986) and develops the sorts of ideas discussed by
range of phenomena, including the development of Baddeley (1996).
STM, its neuropsychological impairment, and chil- In closing, we note that specifying the structure of
dren’s learning of vocabulary. Although the original working memory is useful but cannot be the whole
model of the phonological loop has been shown to be story. A number of important issues have emerged
inadequate in a number of details, it nevertheless pre- from viewing working memory as a multi-component
serves sufficient insights to have encouraged computa- system. One of these concerns how such a system
tional modellers to develop more detailed accounts that functions in a coherent and coordinated way, with the
explain a greater range of phenomena. episodic buffer being proposed to address the particu-
In the case of the central executive the story is lar issue of binding. A second issue concerns how
rather different. Here progress has been much slower working memory is linked to the cognitive system as a
and has consisted of various attempts to get an ade- whole. Here too, work has begun in addressing the
quate conceptual handle on the problem. In this con- role of working memory in long-term learning and
text the difficulty of devising satisfactory and the effects of previously acquired knowledge on work-
reasonably well-understood tests of the various ing memory. Only when broader issues such as these
aspects of executive function that have been proposed are addressed can we start to give a more precise and
should perhaps not surprise us. What is needed is a coherent account of the role of working memory in
greater conceptual understanding of the various func- such ordinary but complex everyday activities as plan-
tions of executive control, one that goes beyond the ning a shopping trip or reading a newspaper.
FURTHER READING
Andrade, J. (ed.) (2001) Working Memory in Perspective, Hove, Miyake, A. and Shah, P. (1999) Models of Working Memory:
Psychology Press. Chapters by experienced researchers present Mechanisms of Active Maintenance and Executive Control,
a critical assessment of the Baddeley and Hitch (1974) model of Cambridge, Cambridge University Press. Proponents of com-
working memory. peting theoretical approaches to working memory were invited to
Baddeley, A.D. (2000) ‘Is working memory still working?’, present their views in a format that was designed to help clarify
American Psychologist, vol.56, pp.851–64. In 2001 Alan areas of agreement and disagreement.
Baddeley received the American Psychological Association’s Baddeley, A.D. (2007) Working Memory, Thought, and
Award for Distinguished Scientific Contributions. This article pre- Action, Oxford, Oxford University Press. This is a broad-ranging
sents his award address, which took the form of a personal review book that reviews the current status of the multi-component
of the current state of the Baddeley and Hitch (1974) model of model and extends it to topics such as emotion, consciousness,
working memory. and neuroimaging.
REFERENCES
Allen, R.J., Baddeley, A.D., and Hitch, G.J. (2006) ‘Is the bind- Andrade, J. (2001) ‘The working memory model: consen-
ing of visual features in working memory resource-demand- sus, controversy, and future directions’, in Andrade, J. (ed.)
ing?’ Journal of Experimental Psychology: General, vol.135, Working Memory in Perspective, Hove, Psychology Press.
pp.298–313. Atkinson, R.M. and Shiffrin, R.M. (1971) ‘The control of
Allen, R.J., Hitch, G.J., and Baddeley, A.D. (2009) ‘Cross- short-term memory’, Scientific American, vol.225, pp.82–90.
modal binding and working memory’, Visual Cognition, Baddeley, A.D. (1966a) ‘Short-term memory for word
vol.17, pp.83–102. sequences as a function of acoustic, semantic and formal
292 PART 3 MEMORY
similarity’, Quarterly Journal of Experimental Psychology, Beaman, C.P. and Jones, D. (1997) ‘The role of serial order
vol.18, pp.362–5. in the irrelevant speech effect: tests of the changing-state
Baddeley, A.D. (1966b) ‘The influence of acoustic and seman- hypothesis’, Journal of Experimental Psychology: Learning,
tic similarity on long-term memory for word sequences’, Memory and Cognition, vol.23, pp.459–71.
Quarterly Journal of Experimental Psychology, vol.18, pp.302–9. Botvinick, M. and Plaut, D.C. (2006) ‘Short-term memory
Baddeley, A.D. (1968) ‘How does acoustic similarity influ- for serial order: a recurrent neural network model’,
ence short-term memory?’ Quarterly Journal of Experimental Psychological Review, vol.113, pp.201–33.
Psychology, vol.20, pp.249–64. Brener, R. (1940) ‘An experimental investigation of memory
Baddeley, A.D. (1983) ‘Working memory’, Philosophical span’, Journal of Experimental Psychology, vol.26, pp.467–83.
Transactions of the Royal Society of London B, vol.302, pp.311–24. Brown, G.D. and Hulme, C. (1995) ‘Modelling item length
Baddeley, A.D (1986) Working Memory, Oxford, Oxford effects in memory span: no rehearsal needed?’ Journal of
University Press. Memory and Language, vol.34, pp.594–621.
Baddeley, A.D. (1996) ‘Exploring the central executive’, Brown, G.D., Preece, T., and Hulme, C. (2000) ‘Oscillator-
Quarterly Journal of Experimental Psychology, vol.49A, pp.5–28. based memory for serial order’, Psychological Review, vol.107,
Baddeley, A.D. (2000) ‘The episodic buffer: a new compo- pp.127–81.
nent of working memory?’ Trends in Cognitive Sciences, vol.4, Brown, J. (1958) ‘Some tests of the decay theory of immedi-
pp.417–23. ate memory’, Quarterly Journal of Experimental Psychology,
Baddeley, A.D. (2007) Working Memory, Thought, and vol.10, pp.12–21.
Action, Oxford, Oxford University Press. Burgess, N. and Hitch, G.J. (1992) ‘Toward a network
Baddeley, A.D. and Hitch, G.J. (1974) ‘Working memory’, model of the articulatory loop’, Journal of Memory and
in Bower, G. (ed.) The Psychology of Learning and Motivation: Language, vol.31, pp.429–60.
Advances in Research and Theory, vol.8, New York, Academic Burgess, N. and Hitch, G.J. (1999) ‘Memory for serial order:
Press. a network model of the phonological loop and its timing’,
Baddeley, A.D. and Larsen, J.D. (2003) ‘The disruption of Psychological Review, vol.106, pp.551–81.
STM: a response to our commentators’, Quarterly Journal of Burgess, N. and Hitch, G.J. (2006) ‘A revised model of short-
Experimental Psychology, vol.56A, pp.1301–6. term memory and long-term learning of verbal sequences’,
Baddeley, A.D. and Lieberman, K. (1980) ‘Spatial working Journal of Memory and Language, vol.55, pp.627–52.
memory’, in Nickerson, R.S. (ed.) Attention and Performance Caplan, D. and Waters, G.S. (1999) ‘Verbal working mem-
VIII, Hillsdale, NJ, Erlbaum. ory and sentence comprehension’, Behavioural and Brain
Baddeley, A., Allen, R.J., and Hitch, G.J. (2011) ‘Binding in Sciences, vol.22, pp.77–126.
visual working memory: the role of the episodic buffer’, Case, R.D., Kurland, D.M., and Goldberg, J. (1982)
Neuropsychologia, vol.49, pp.1393–400. ‘Operational efficiency and the growth of short-term memory
Baddeley, A., Gathercole, S., and Papagno, C. (1998) ‘The span’, Journal of Experimental Child Psychology, vol.33,
phonological loop as a language learning device’, Psychological pp.386–404.
Review, vol.105, pp.158–73. Conrad, R. (1965) ‘Order errors in immediate recall of
Baddeley, A.D., Hitch, G.J., and Allen, R.J. (2009) ‘Working sequences’, Journal of Verbal Learning and Verbal Behavior,
memory and binding in sentence recall’, Journal of Memory vol.4, pp.161–9.
and Language, vol.61, pp.438–56. Conway, A.R.A. and Engle, R.W. (1994) ‘Working memory
Baddeley, A.D., Lewis, V.J., and Vallar, G. (1984) ‘Exploring and retrieval: a resource-dependent inhibition model’, Journal
the articulatory loop’, Quarterly Journal of Experimental of Experimental Psychology: General, vol.123, pp.354–73.
Psychology, vol.36A, pp.233–52. Cowan, N. (1988) ‘Evolving conceptions of memory stor-
Baddeley, A.D., Papagno, C., and Vallar, G. (1988) ‘When age, selective attention, and their mutual constraints within
long-term learning depends on short-term storage’, Journal of the human information processing system’, Psychological
Memory and Language, vol.27, pp.586–96. Bulletin, vol.96, pp.341–70.
Baddeley, A.D., Thomson, N., and Buchanan, M. (1975) Cowan, N. (2005) Working Memory Capacity, Hove,
‘Word length and the structure of short-term memory’, Journal Psychology Press.
of Verbal Learning and Verbal Behavior, vol.14, pp.575–89. Cowan, N., Day, L., Saults, J.S., Keller, T.A., Johnson, T., and
Barrouillet, P. and Camos, V. (2001) ‘Developmental Flores, L. (1992) ‘The role of verbal output time in the effects
increase in working memory span: resource sharing or tempo- of word length on immediate memory’, Journal of Memory and
ral decay?’ Journal of Memory and Language, vol.45, pp.1–20. Language, vol.31, pp.1–17.
CHAPTER 9 WORKING MEMORY 293
Craik, F.I.M. and Lockhart, R.S. (1972) ‘Levels of process- Gathercole, S.E. and Baddeley, A.D. (1989) ‘Evaluation of
ing: a framework for memory research’, Journal of Verbal the role of phonological STM in the development of vocabu-
Learning and Verbal Behavior, vol.11, pp.671–84. lary in children: a longitudinal study’, Journal of Memory and
Daneman, M. and Carpenter, P.A. (1980) ‘Individual differ- Language, vol.28, pp.200–13.
ences in working memory and reading’, Journal of Verbal Gathercole, S.E. and Hitch, G.J. (1993) ‘Developmental
Learning and Verbal Behavior, vol.19, pp.450–66. changes in short-term memory: a revised working memory
de Beni, R., Palladino, P., Pazzaglia, F., and Cornoldi, C. perspective’, in Collins, A.F., Gathercole, S.E., Conway, M.A.,
(1998) ‘Increases in intrusion errors and working memory and Morris, P.E. (eds.) Theories of Memory, Hove, Lawrence
deficit of poor comprehenders’, Quarterly Journal of Erlbaum Associates.
Experimental Psychology, vol.51A, pp.305–20. Gathercole, S.E., Adams, A-M., and Hitch, G.J. (1994) ‘Do
Dempster, F.N. (1981) ‘Memory span: sources of individual young children rehearse? An individual differences analysis’,
and developmental differences’, Psychological Bulletin, vol.89, Memory and Cognition, vol.22, pp.201–7.
pp.63–100. Gathercole, S.E., Hitch, G.J., Service, E., and Martin, A.J.
de Renzi, E. and Nichelli, P. (1975) ‘Verbal and non-verbal (1997) ‘Phonological short-term memory and new word
short term memory impairment following hemisphere dam- learning in children’, Developmental Psychology, vol.33,
age’, Cortex, vol.11, pp.341–53. pp.966–79.
Duncan, J. and Owen, A.M. (2000) ‘Common regions of Gupta, P. and MacWhinney, B. (1997) ‘Vocabulary acquisi-
the frontal lobe recruited by diverse cognitive demands’, tion and verbal short-term memory: computational and neu-
Trends in Neurosciences, vol.23, pp.475–83. ral bases’, Brain and Language, vol.59, pp.267–333.
Engle, R.W., Carullo, J.W., and Collins, K.W. (1991) Hartley, T. and Houghton, G. (1996) ‘A linguistically con-
‘Individual differences in working memory and comprehension: strained model of short-term memory for nonwords’, Journal
a test of four hypotheses’, Journal of Experimental Psychology: of Memory and Language, vol.35, pp.1–31.
Learning, Memory and Cognition, vol.18, pp.972–92. Healy, A.F. (1974) ‘Separating item from order information
Engle, R.W., Kane, M.J., and Tuholski, S.W. (1999a) in short-term memory’, Journal of Verbal Learning and Verbal
‘Individual differences in working memory capacity and what Behavior, vol.13, pp.644–55.
they tell us about controlled attention, general fluid intelli- Henson, R. (2001) ‘Neural working memory’, in Andrade, J.
gence and the functions of the prefrontal cortex’, in Miyake, A. (ed.) Working Memory in Perspective, Hove, Psychology Press.
and Shah, P. (eds.) Models of Working Memory: Mechanisms of Henson, R.N.A., Norris, D.G., Page, M.P.A., and Baddeley,
Active Maintenance and Executive Control, Cambridge, A.D. (1996) ‘Unchained memory: error patterns rule out
Cambridge University Press. chaining models of immediate serial recall’, Quarterly Journal
Engle, R.W., Tuholski, S.W., Laughlin, J.E., and Conway, of Experimental Psychology, vol.49A, pp.80–115.
A.R.A. (1999b) ‘Working memory, short-term memory and Hitch, G.J. (1978) ‘The role of short-term working
general fluid intelligence: a latent variable approach’, Journal of memory in mental arithmetic’, Cognitive Psychology, vol.10,
Experimental Psychology: General, vol.128, pp.309–31. pp.302–23.
Ericsson, K.A. and Kintsch, W. (1995) ‘Long-term working Hitch, G.J., Brandimonte, M.A., and Walker, P. (1995) ‘Two
memory’, Psychological Review, vol.102, pp.211–45. types of representation in visual memory: evidence from the
Estes, W.K. (1972) ‘An associative basis for coding and effects of stimulus contrast on image combination’, Memory
organization in memory’, in Melton, A.W. and Martin, E. and Cognition, vol.23, pp.147–54.
(eds.) Coding Processes in Human Memory, Washington, DC, Hitch, G.J., Burgess, N., Towse, J.N., and Culpin, V. (1996)
Winston. ‘Temporal grouping effects in immediate recall: a Working
Farah, M.J. (1984) ‘The neurological basis of visual imagery: Memory analysis’, Quarterly Journal of Experimental
a componential analysis’, Cognition, vol.18, pp.245–72. Psychology, vol.49A, pp.116–39.
Farrell, S. and Lewandowsky, S. (2003) ‘Dissimilar items Hitch, G.J., Flude, B., and Burgess, N. (2009) ‘Slave to the
benefit from phonological similarity in serial recall’, Journal of rhythm: experimental tests of a model for verbal short-term
Experimental Psychology: Learning, Memory and Cognition, memory and long-term sequence learning’, Journal of Memory
vol.29, pp.838–49. and Language, vol.61, pp.97–111.
Friedman, N.P. and Miyake, A. (2004) ‘The relations among Hitch, G.J., Halliday, M.S., Dodd, A., and Littler, J.E. (1989)
inhibition and interference control functions: a latent variable ‘Development of rehearsal in short-term memory: differences
analysis’, Journal of Experimental Psychology: General, vol.133, between pictorial and spoken stimuli’, British Journal of
pp.101–35. Developmental Psychology, vol.7, pp.347–62.
294 PART 3 MEMORY
Hitch, G.J., Halliday, M.S., Schaafstal, A., and Schraagen, Luck, S.J. and Vogel, E.K. (1997) ‘The capacity of visual
J.M. (1988) ‘Visual working memory in young children’, working memory for features and conjunctions’, Nature,
Memory and Cognition, vol.16, pp.120–32. vol.390, pp.279–81.
Hitch, G.J., Towse, J.N., and Hutton, U. (2001) ‘What limits Macken, W.J. and Jones, D.M. (1995) ‘Functional charac-
children’s working memory span? Theoretical accounts and teristics of the “inner voice” and the “inner ear”: single or dou-
applications for scholastic development’, Journal of ble agency?’ Journal of Experimental Psychology: Learning,
Experimental Psychology: General, vol.130, pp.184–98. Memory and Cognition, vol.21, pp.436–48.
Hulme, C., Thomson, N., Muir, C., and Lawrence, A. (1984) Metsala, J.L. (1999) ‘Young children’s phonological aware-
‘Speech rate and the development of short-term memory ness and nonword repetition as a function of vocabulary
span’, Journal of Experimental Child Psychology, vol.38, development’, Journal of Educational Psychology, vol.91,
pp.241–53. pp.3–19.
Jahnke, J.C. (1969) ‘The Ranschburg effect’, Psychological Miller, G.A. (1956) ‘The magical number seven plus or
Review, vol.76, pp.592–605. minus two: some limits on our capacity for processing infor-
Jones, D.M. (1993) ‘Objects, streams and threads of audi- mation’, Psychological Review, vol.63, pp.81–97.
tory attention’, in Baddeley, A. and Weiskrantz, L. (eds.) Miyake, A. and Shah, P. (1999) Models of Working Memory:
Attention, Awareness and Control, Oxford, Oxford University Mechanisms of Active Maintenance and Executive Control,
Press. Cambridge, Cambridge University Press.
Jones, D.M., Farrand, P., Stuart, G., and Morris, N. (1995) Miyake, A., Friedman, N.P., Emerson, M.J., Witzki, A.H.,
‘Functional equivalence of verbal and spatial information in and Howerter, A. (2000) ‘The unity and diversity of executive
serial short-term memory’, Journal of Experimental Psychology: functions and their contributions to complex “frontal lobe”
Learning, Memory and Cognition, vol.21, pp.1008–18. tasks: a latent variable analysis’, Cognitive Psychology, vol.41,
Jones, D.M., Hughes, R.W., and Macken, W.J. (2006) pp.49–100.
‘Perceptual organization masquerading as phonological short- Murdock, B.B. Jr. (1967) ‘Recent developments in short-
term storage: further support for a perceptual-gestural view of term memory’, British Journal of Psychology, vol.58, pp.421–33.
short-term memory’, Journal of Memory and Language, vol.54, Nairne, J.S. (2002) ‘Remembering over the short-term: the
pp.265–81. case against the standard model’, Annual Review of Psychology,
Just, M.A. and Carpenter, P.A. (1992) ‘A capacity theory of vol.53, pp.53–81.
comprehension: individual differences in working memory’, Naveh-Benjamin, M. and Ayres, T.J. (1986) ‘Digit span,
Psychological Review, vol.99, pp.122–49. reading rate, and linguistic relativity’, Quarterly Journal of
Karlsen, P., Allen, R.J., Baddeley, A.D., and Hitch, G.J. Experimental Psychology, vol.38A, pp.739–52.
(2010) ‘Binding across space and time in visual working mem- Nicolson, R.S. (1981) ‘The relationship between memory
ory’, Memory & Cognition, vol.38, pp.292–303. span and processing speed’, in Friedman, M., Das, J.P., and
Klauer, K.C. and Zhao, Z. (2004) ‘Double dissociation in O’Connor, N. (eds.) Intelligence and Learning, New York,
visual and spatial short-term memory’, Journal of Experimental Plenum Press.
Psychology: General, vol.133, pp.355–81. Norman, D.A. and Shallice, T. (1986) ‘Attention to action:
Lashley, K. (1951) ‘The problem of serial order in behavior’, willed and automatic control of behavior’, in Davidson, R.J.,
in Jeffress, L.A. (ed.) Cerebral Mechanisms in Behavior, New Schwartz, G.E., and Shapiro, D.E. (eds.) Consciousness and
York, Wiley. Self-Regulation: Advances in Research and Theory, vol.4, New
Lewandowsky, S. and Farrell, S. (2008) ‘Phonological simi- York, Plenum Press.
larity in serial recall: constraints on theories of memory’, Page, M.P.A. and Norris, D.G. (1998) ‘The primacy model:
Journal of Memory and Language, vol.58, pp.429–48. a new model of immediate serial recall’, Psychological Review,
Lewandowsky, S. and Murdock, B.B. Jr. (1989) ‘Memory for vol.105, pp.761–81.
serial order’, Psychological Review, vol.96, pp.25–57. Page, M.P.A. and Norris, D.G. (2003) ‘The irrelevant sound
Lhermitte, F. (1983) ‘“Utilization behaviour” and its rela- effect: what needs modeling and a tentative model’, Quarterly
tion to lesions of the frontal lobes’, Brain, vol.106, pp.237–55. Journal of Experimental Psychology, vol.56A, pp.1289–1300.
Logie, R.H. (1995) Visuo-Spatial Working Memory, Hove, Palmer, S. (2000a) ‘Working memory: a developmental
Lawrence Erlbaum Associates. study of phonological recoding’, Memory, vol.8, pp.179–94.
Lovatt, P.J., Avons, S.E., and Masterson, J. (2000) ‘The Palmer, S. (2000b) ‘Phonological recoding deficit in work-
word-length effect and disyllabic words’, Quarterly Journal of ing memory of dyslexic teenagers’, Journal of Research in
Experimental Psychology, vol.53A, pp.1–22. Reading, vol.23, pp.28–40.
CHAPTER 9 WORKING MEMORY 295
Papagno, C. and Vallar, G. (1992) ‘Phonological short-term study’, Quarterly Journal of Experimental Psychology, vol.22I,
memory and the learning of novel words: the effect of phono- pp.261–73.
logical similarity and item length’, Quarterly Journal of Smyth, M.M. and Waller, A. (1998) ‘Movement imagery in
Experimental Psychology, vol.44A, pp.47–67. rock climbing: patterns of interference from visual, spatial and
Papagno, C. and Vallar, G. (1995) ‘Short-term memory and kinaesthetic secondary tasks’, Applied Cognitive Psychology,
vocabulary learning in polyglots’, Quarterly Journal of vol.12, pp.145–57.
Experimental Psychology, vol.48A, pp.98–107. Towse, J.N. (1998) ‘On random generation and the central
Papagno, C., Valentine, T., and Baddeley, A.D. (1991) executive of working memory’, British Journal of Psychology,
‘Phonological short-term memory and the foreign-language vol.89, pp.77–101.
vocabulary learning’, Journal of Memory and Language, vol.30, Towse, J.N., Hitch, G.J., and Hutton, U. (1998) ‘A re-evalua-
pp.331–47. tion of working memory capacity in children’, Journal of
Paulesu, E., Frith, C.D., and Frackowiack, R.S.J. (1993) ‘The Memory and Language, vol.39, pp.195–217.
neural correlates of the verbal component of working mem- Towse, J.N., Hitch, G.J., and Hutton, U. (2000) ‘On the
ory’, Nature, vol.362, pp.342–4. interpretation of working memory span in adults’, Memory
Reason, J. (1984) ‘Lapses of attention in everyday life’, in and Cognition, vol.28, pp.341–8.
Parasuraman, R., Davies, R., and Beatty, J. (eds.) Varieties of Turner, M.L. and Engle, R.W. (1989) ‘Is working memory
Attention, Orlando, FL, Academic Press. capacity task dependent?’ Journal of Memory and Language,
Ryan, J. (1969) ‘Grouping and short-term memory: differ- vol.28, pp.127–54.
ent means and patterns of grouping’, Quarterly Journal of Ueno, T., Allen, R.J., Hitch, G.J., Baddeley, A.D., and
Experimental Psychology, vol.21, pp.137–47. Saito, S. (2011) ‘Disruption of visual feature binding in work-
Salamé, P. and Baddeley, A.D. (1982) ‘Disruption of short- ing memory’, Memory and Cognition, vol.39, pp.12–23.
term memory by unattended speech: implications for struc- Vallar, G. and Baddeley, A.D. (1984) ‘Fractionation of
ture of working memory’, Journal of Verbal Learning and working memory: neuropsychological evidence for a phono-
Verbal Behavior, vol.21, pp.150–84. logical short-term store’, Journal of Verbal Learning and Verbal
Service, E. (1992) ‘Phonology, working memory, and Behavior, vol.23, pp.151–61.
foreign-language learning’, Quarterly Journal of Experimental Wheeler, M.E. and Treisman, A.M. (2002) ‘Binding in
Psychology, vol.45A, pp.21–50. short-term visual memory’, Journal of Experimental
Shallice, T. (2002) ‘Fractionation of the supervisory system’, Psychology: General, vol.131, pp.48–64.
in Stuss, D.T. and Knight, R.T. (eds.) Principles of Frontal Lobe Wickelgren, W.A. (1965) ‘Short-term memory for repeated
Function, New York, Oxford University Press. and non-repeated items’, Quarterly Journal of Experimental
Shallice, T. and Warrington, E.K. (1970) ‘Independent Psychology, vol.17, pp.14–25.
functioning of verbal memory stores: a neuropsychological
THINK ING
Introduction
10 Problem solving
Alison J.K. Green and Ken Gilhooly
12 Reasoning
Mike Oaksford
298 PART 4 THINKING
INTRODUCTION
In Part 4, the focus shifts to what have been termed problems in the same way. Secondly, as the authors
thinking processes. Specifically, the chapters address also point out, experts themselves differ from one
three distinct kinds of thinking that arise in different another in relevant ways – that is, they do not form a
kinds of task – in general terms, these are tasks that homogeneous group – and novices also differ from
require us to solve problems (Chapter 10), come to one another.
judgements and make decisions (Chapter 11) and to Certain aspects of the study of problem solving that
reason and draw conclusions (Chapter 12). are raised in Chapter 10 become themes for the whole
In Chapter 10, Alison Green and Ken Gilhooly of Part 4. One is that cognitive psychologists place at
address human problem solving. You might think least as much emphasis on the study of errors in prob-
that problem solving is a somewhat artificial activity, lem solving as they do on cases of success. Indeed, as
inspired by abstract and contrived problems such as we shall see, errors provide important information
crossword puzzles or the Rubik’s cube. But problem concerning underlying cognitive processes, and this
solving in cognitive psychology is intended to theme is continued in Chapters 11 and 12.
encompass a wide range of activities in which we Another theme established in Chapter 10 is the
need to identify the solution to a current problem. importance of establishing a framework within which
Everyday problems range from the easy, such as how phenomena can be analysed and understood, and
to make a cup of tea in someone else’s kitchen, to the which in turn can be used to derive new research
complex, such as how to achieve career success. questions. In Chapter 10, Alison Green and Ken
Everyday problems are not always easily defined – Gilhooly introduce the notion of a ‘state–space’ dia-
think of the different problems that need solving in gram and show how this notion can help us to under-
order to achieve a successful career – and so psychol- stand problems and to analyse human performance
ogists have often relied on more formally specified when attempting to solve them.
problems, of which the authors of Chapter 10 pro- In Chapter 11, Peter Ayton introduces the topics of
vide numerous examples. judgement and decision making. How do we form
In Chapter 1 it was pointed out that cognitive psy- judgements and make decisions, and how best should
chology tends to avoid the study of individual differ- we understand and analyse these cognitive activities?
ences because it aims to understand cognitive One thing the author makes clear from the outset is
processes in general. However, in Chapter 9 of Part 3, that it is possible to develop different kinds of theory
we saw how the study of individual differences can depending on the starting point and purpose of the
help us to evaluate theories of cognition and, con- theorist. A theory could, for example, emphasize how
versely, how the theories can help us to understand the judgement and decision-making processes ought to
nature of the individual differences. In Chapter 10, the proceed, and use this as a basis for analysing human
importance of individual differences is emphasized performance. Alternatively, a theorist could take as
again. Firstly, the authors note that some individuals their starting point an understanding of how people
are novices in solving certain classes of problem and actually make decisions, including poor ones. That
some are expert. In playing chess, for example, some there are these two approaches – normative and
individuals achieve grand master status whereas oth- descriptive – continues the theme, established in
ers, while knowing the rules of the game, are consider- Chapter 10, of the importance of researchers estab-
ably less skilled. The problem-solving approaches of lishing an appropriate explanatory framework.
these groups differ in important ways, and so it is not In essence, the chapter can be seen as an extended
true to say that people in general tackle chess discussion of whether two particular normative
INTRODUCTION 299
approaches provide an adequate understanding of valuable framework for trying to understand human
human judgement and decision making. reasoning. It has also helped researchers to establish
In the first part of Chapter 11, Peter Ayton discusses the core phenomena of reasoning, and to develop par-
the normative theory of subjective expected utility ticular tasks to investigate these.
and its use as a vehicle for understanding human deci- As with Chapter 11, a key observation also running
sion making. As you will see, this theory requires us to throughout Chapter 12 is that human reasoning sys-
express the likelihood of particular outcomes as math- tematically departs from the normative standards
ematical probabilities, though you may be relieved to established by logic. Predicting and understanding
know that the key mathematical ideas are relatively these logical errors has thus become an important
simple. Probabilities are also required to understand a benchmark for theories of human reasoning. A num-
normative approach to judgement under uncertainty, ber of such theories have been developed, and the
which involves the application of Bayes’ Theorem. chapter focuses mostly on three approaches – mental
While the normative approaches rely on mathemati- logic, mental models, and the probabilistic approach.
cal formulations of how judgement and decision mak- Each of these approaches is evaluated against evidence
ing ought to proceed, the majority of the chapter that has accrued from the use of two key tasks –
discusses evidence that human performance actually conditional inference and the Wason selection task –
departs from these mathematical standards – that and we see again the use of expected utilities and also
human performance is characterized by apparent errors. Bayes’ Theorem. It is worth noting that Chapter 12
The chapter compares such normative theories with uses the terms Type I and Type II processing in a com-
descriptive accounts of actual human performance – pletely different sense to the way in which they were
prospect theory and the heuristics and biases approach. used in Chapter 8, and the usages should not be con-
Although these accounts are seen ultimately to be more fused.
successful, the normative approaches nonetheless play Specifically in connection with a version of the
an important role in helping researchers to develop a Wason selection task, the chapter also discusses a
more appropriate explanatory framework. In particular, fourth approach to reasoning. This approach empha-
observations that human performance deviates system- sizes the importance of theories of reasoning positing
atically from mathematical standards have provided processes that can be seen to have an evolutionarily
researchers with extremely valuable information. adaptive function. Mike Oaksford also discusses the
The particular descriptive approaches discussed in relationship between logical reasoning and IQ, show-
the chapter are not without their problems, however. ing once again the importance of individual differ-
One important line of criticism comes from an ences.
approach that considers the adaptive function, in evo- As suggested above, there are a number of themes
lutionary terms, of decision-making processes. Some running throughout the three chapters of Part 4. One
researchers have argued that such processes would theme that has not been mentioned so far is rationality.
have evolved to be ‘fast and frugal’, and the chapter Errors, or departures from a logical or mathematical
cites evidence in favour of this view. standard, could be taken as signs of the intrinsic irra-
Some of these concerns can also be found in tionality of human thought. After all, so the argument
Chapter 12. In this chapter, Mike Oaksford shows how goes, if human beings are rational they ought to solve
research into reasoning also started from a formal problems, make judgements and decisions, and reason
framework for understanding how people ought to according to certain standards, often assumed to be
reason – that of logic. The first part of Chapter 12 out- provided by formal models, such as mathematics and
lines the nature of logic, and in particular the forms of logic. Departures from these mathematical and logical
reasoning that are taken to be logically valid and those standards would then be signs of irrationality. However,
taken to be logically invalid. As with the normative although these three chapters do not take rationality as
approaches discussed in Chapter 11, logic provides a their central focus, the establishment of theories of
300 PART 4 THINKING
actual human performance provide grounds for under- with this is the fact that some researchers are appealing
standing rationality differently. In connection with to evolution to help provide an explanatory frame-
Chapter 11, for example, perhaps it would be rational work. The suggestion that researchers are still grap-
to use heuristics and biases to come to a judgement, or, pling with difficult questions at Marr’s computational
related to Chapter 12, perhaps it would be rational to level provides one way of understanding the emphasis
rely on a probabilistic method for tackling a task, even on formal approaches – such as state–space diagrams
if this sometimes generates logical ‘errors’. in Chapter 10, probability in Chapter 11, and logic in
Finally, one thing you may notice about the three Chapter 12. Such formal approaches provide an ideal-
chapters in this part is that there is very little mention ized model of what needs to be computed, i.e. Marr’s
of computer modelling, neuropsychology, or neuroim- level 1 (idealized because we observe systematic depar-
aging. Although this inevitably reflects to a degree the tures from this in actual human thinking). The combi-
practical limits imposed by writing a chapter to a cer- nation of these models and observations of systematic
tain length, it also reflects a particular emphasis com- human ‘error’ provides researchers with an effective
mon to the three chapters on trying to develop an means for analysing human thinking. As research
appropriate explanatory framework. If you recall the develops further, and detailed questions subsequently
discussion of Marr’s levels of explanation in Chapter 1, arise concerning the actual processes by which think-
it is as if cognitive psychologists studying thinking are ing is achieved, neuropsychological, neuroimaging,
still trying to establish what is computed when we rea- and computer modelling work is likely to become
son, or make decisions, or solve problems. Consistent much more relevant.
CHAPTER 10
PROB LEM
SOLVING
Alison J.K. Green and Ken Gilhooly
1 INTRODUCTION
Problem solving is an essential, familiar, and perva- (for example, sprinkling coffee instead of sugar over
sive part of everyday life. Examples are all around us. cornflakes at breakfast) but other errors can be quite
Consider an infant trying to fit shapes into the appro- catastrophic (for example, an oil-laden vessel running
priate holes of a shape-sorting toy, or a child trying aground). Diagnosing errors and redesigning tasks to
to count out the correct sum of money to buy a new guard against critical errors are important applica-
music CD, or perhaps an adult weighing up the pros tions for problem-solving research. We discuss others
and cons of a job offer. While we shall be looking later on in the chapter.
here at examples of human problem solving, prob- Where does problem solving ‘sit’ in relation to other
lem solving occurs in animal life too. Naturally areas of psychology? Problem solving is an activity
occurring instances include tool use and searching that draws together the various different components
for food. Problem solving in all its manifestations is of cognition. For instance, linguistic skills are used to
an activity that structures everyday life in meaning- read about a political problem and engage in a debate
ful ways. about it, but language may also enhance our prob-
By studying the myriad ways in which we solve lem solving capabilities, as we shall see later. Visual
problems, we hope to learn how problems are solved perception is necessary for understanding a graphi-
effectively and to understand what goes wrong when cally-presented engineering problem and for drawing
they are not. Why should we be interested in finding a solution. We use memory to recover any prior
out about unsuccessful problem solving? An interest- knowledge we might have that could be relevant to
ing aspect of failure involves investigating the errors solving a new problem, and attention plays a role in all
that people make in order to understand why a par- problem solving.
ticular error occurred and to try to prevent it from Problem solving takes place over time, interleaving a
happening again. Some errors are made with little cost range of cognitive processes and drawing upon pieces
302 PART 4 THINKING
of knowledge that are represented in various ways. The different, or observe an antiques expert establishing
notion of ‘representation’ is central to cognitive psy- what an item is and then estimating its worth. Some of
chology, as you will see later in Chapter 17. For now, us undoubtedly while away the hours working on
we shall ask you to assume that information used in tricky crossword puzzles or computer games, or trying
problem solving comes to be internally represented. to make (or repair) something at home.
Because problem solving occurs over time, we need Our aim in this chapter is to present an overview
to study not just the cognitive processes and mental of research on problem solving. In doing this we have
representations involved in problem solving, but also had to be selective, and have elected to present work
the ways in which these processes and representations that we believe has been both influential and inter-
interact with others. Problem solving then, like esting to try to give you a flavour of what has been
reasoning, judgement, and decision making, is an going on in the field. As you read on, you will learn
activity that necessarily draws upon a range of cogni- that how people represent problems is a principal
tive processes. determinant of problem-solving success. Much of
In fact, problem solving often involves reasoning, the research we shall examine addresses the question
judgement, and decision making. For instance, a of which factors influence the construction of a
general practitioner gathering information about a problem representation.
sick patient’s symptoms may deduce from the We aim to show you how ideas about problem
description the patient gives that the problem is a solving have developed and changed. You will learn
bacterial, rather than a viral, infection. The doctor that early work on problem solving was often con-
may then make a judgement about the severity of the fined to puzzle problems, and that later on research-
infection, before making a decision on an antibiotic ers became interested in more complex domains,
to prescribe. where knowledge and experience are central to suc-
In this chapter, we examine the ways in which indi- cessful problem solving. The issues we shall explore
viduals approach a variety of problem types, ranging centre on the nature of problem solving and the rela-
from simple puzzle problems to more complex real- tionships between problem solving, learning, experi-
world problems. Everyday problems can be complex ence, and creativity. The kinds of questions we shall
and challenging, with constraints in operation that be asking include:
mean that the solution we choose or find may not be an
ideal one. As individuals we can, if we are reasonably 1. What are the different forms of problem-solving
adept, persistent, or just plain lucky, solve many of the activity?
problems that come our way. Quite often, though, our 2. How do we solve different sorts of problems?
initial attempts fail and we have to turn to another
3. Why are representation and similarity important?
source to help solve the problem – a manual, for instance,
in the case of a tricky computer installation problem, or First, we shall try to define a ‘problem’ and then look
perhaps someone knowledgeable in the problem area if at conceptions of problems and problem solving.
all else fails.
While some problems may be viewed as unwel-
come obstacles, to be avoided where possible, there 1.1 What is a ‘problem’?
are occasions where we keenly seek out problems to
occupy our time. An expert mathematician, for Before reading on, try Activity 10.1.
instance, may spend hours identifying a problem, pri- Consider the following examples of problems that a
marily for the pleasure derived in exploring and solv- given individual might come across, some more com-
ing it. Similarly, make-over television programmes monplace than others:
can be very entertaining as viewers watch an undeco-
rated room or a derelict garden transformed by the 1. Who can I ask to babysit the children so that I can
experts in a matter of days into something quite go out next Thursday evening?
CHAPTER 10 PROBLEM SOLVING 303
ACTIVIT Y 10.1
What do you think are the defining attributes of prob- that you want to vary your definition depending
lems? You will probably draw upon some examples upon the type of problem you have in mind. You
from your own experience to help you. You might like may find that you cannot come up with a definition
to think back to Chapter 5 to help you think of prob- at all or that you came up with several and cannot
lems in terms of properties, categories, and so on. choose between them. Of course, if it is difficult to
Make a list of all the attributes you can think of, and then define what we mean by a ‘problem’, then it becomes
try to construct a sentence or two defining problems. even more difficult to construct models and theo-
Try not to spend more than a couple of minutes on this. ries of problem-solving behaviour, and to compare
and contrast such models and theories. Clear defini-
COM M ENT
tions are therefore important at the outset.
The answer to the question, ‘What is a problem?’ is
not at all easy, as the exercise shows. You may find
2. How can I make sure that the stone I have just more to do with experience, knowledge, and skill,
played in my game of Go1 ‘lives’? although motivation (does playing badly matter?), per-
3. Is there a way I can arrange some paper pattern sonality and emotion (are there personal costs in play-
pieces on my dress material so that all the pieces ing badly?), and cultural factors (different cultures have
fit and I don’t have to buy any more material? different conventions for Go) may well be involved too.
Again, there are different solutions available, in that a
The problem in the first example is finding a babysitter, number of different moves may achieve the goal of
which could involve searching through an address ensuring the ‘survival’ of the stone in question.
book, recovering some names from memory, or calling The final problem is different again, because it
round on a friend and asking for a favour. If these fail involves perception in ‘seeing’ how to lay all the pieces
to produce a name then other options include carrying out, together with some creative or lateral thinking in
out a more extensive search. A bit of inspired guess- optimizing layout so that all the pieces do indeed fit cor-
work might lead to an internet babysitting site and rectly. There may be one or more possible ways to arrange
locating a babysitter to solve the problem. Notice that the pieces and solve the problem, one of which may be
there are several ways to satisfactorily solve this prob- better (for example, in ensuring that cut pieces of fabric
lem, and that the possible solutions vary in degree of fit together in a way that matches up a pattern at seams).
novelty. The availability of a possible solution method These examples show that while problems do share
may well vary too, depending upon the context (is some common characteristics (see the discussion of
there time to explore different possible solutions to the concepts in Chapter 5), it is also true that different
problem?), social setting (is there a network of likely problems are affected by different factors, both inter-
babysitters to call upon?), and culture (is it acceptable nal (for example, motivation and personality) and
to use an internet babysitting agency?). external (for example, social and cultural factors).
The problem in the second example centres on the Duncker (1945, p.1) offered a concise definition of
ancient Korean game of Go. Here, the problem seems a problem that captures something of the essence of
our everyday experience of problems. He wrote that: ‘a
1 The aim in Go is to use stones (one player takes black stones, problem exists when a living organism has a goal but
the other white) to surround territory on a board. A stone (or does not know how this goal is to be reached’. The
stones) ‘lives’ if it cannot be surrounded and therefore removed
definition is still serviceable today because it conveys
from the board. Territory is ‘won’ if stones of one colour com-
pletely surround stones of the other colour, and the winner is the the notion of a ‘gap’ between a current state and a goal
player who surrounds the most territory. or desired state. If there are no obstacles preventing
304 PART 4 THINKING
the individual from moving from the current state to is information processing, that information is stored in
the desired state, then there cannot be said to be a different memory stores, and that recently acquired
problem. Problems, then, consist of three compo- information is retained in working memory. Protocol
nents: a starting state, a goal state, and a set of available analysis then centres on elucidating thought processes.
actions to move from the starting state to the goal In contrast, ‘verbal analysis’ (Chi, 1997) focuses on the
state. According to this type of definition, what consti- content of verbal data, and thus the emphasis is on the
tutes a problem for one individual may not be a prob- representation of knowledge that is used to support
lem for another. For instance, a moderate Go player problem solving rather than the underlying processes.
might have some difficulty in ensuring that a newly A further key distinction between the two methods
placed stone survives in their current game if their centres on how the data are collected. Protocol analysis
opponent is a much stronger player. The stronger aims to elucidate what is heeded as a task is carried out,
opponent, however, will almost certainly have consid- while verbal analysis is concerned with the explana-
erably less difficulty in making sure their stones live. tions, rationalizations, and justifications people pro-
So far, we have tried to present some defining char- duce. Instructions to think aloud in protocol analysis
acteristics of problems. Before we move on to discuss are therefore deliberately geared towards not altering
research on problem solving, we want to draw your the individual’s normal approach to performing the
attention to one of the principal methods used in task, whereas the procedure used to generate data for
problem-solving research: protocol analysis. verbal analysis will often explicitly invite the individual
to generate self-explanations or rationalizations, activi-
ties that are in fact likely to alter performance of the
Protocol analysis in
1.2
task. A good example of this is the study of the role of
problem-solving research self-explanation in learning by Chi et al. (1989), which
we describe later in Section 5.2.1.
Cognitive scientists make extensive use of a method Protocol analysis has many uses, particularly in help-
known as ‘protocol analysis’. Protocol analysis is one of a ing to identify differences between individuals in terms
cluster of methods for analysing verbal data. At the core of information heeded, and processes and strategies
of the approach is the view that information represented used, as a task is carried out. Let us suppose that our
in working memory may be verbalized without the research question centres on investigating cognitive
sequence of thoughts being disrupted. Verbalization of processes in arithmetic, and that we have asked two
such heeded information may take place either directly individuals to think aloud while calculating the sum of
if that information is in verbal form, or through transfor- 63 + 37. Both give the answer ‘100′. Did both arrive at
mation if in non-verbal form. Heeded information then the answer in the same way? One way of addressing this
(the contents of working memory at a given point) may question is to compare the verbal reports produced:
reflect both recently encoded information and informa-
First individual: ‘OK, what is the sum of 63 plus 37?
tion retrieved from long-term memory. Information
Easy – that’s 100’. Second individual: ‘What is the
retained in long-term memory must first be transferred
sum of 63 plus 37? 60 plus 30 . . . 60, 70, 80, 90. 3 plus
to working memory before it can be reported. Thus, the
7 is 10. 90 plus 10 is 100. It’s 100.’
‘protocol’ of protocol analysis is a verbal account of
information that is heeded as a task is carried out. The The first individual simply reads out the problem state-
protocol that results from thinking aloud is assumed to ment and then reports the answer. There is little evi-
preserve the order in which information has been dence of any problem solving here, and the answer
heeded. Using careful instructions, and with a little prac- appears to be readily available – it is as if the individual
tice, most people can ‘think aloud’, either while working is retrieving a number fact. The second individual also
on a task, or immediately after completing a task. begins by reading the problem statement, but then
Protocol analysis depends upon fundamental goes about the problem rather differently. The protocol
assumptions, the most basic of which are that cognition suggests that their strategy is a ‘counting on’ strategy,
CHAPTER 10 PROBLEM SOLVING 305
starting with 60, then counting on 30, giving 90. They some models of the ways in which simple arithmetic
then add the units 3 and 7, giving 10, and finally add 10 problems, like those above, may be solved.) Of course,
to 90 to give the answer. The example shows that differ- there are situations where protocol analysis is not a
ent people can arrive at the same answer, but use differ- suitable approach (for example, where the require-
ent methods. It also shows that protocol analysis can ment to think aloud might actually change the way in
reveal useful information about strategies underlying which the task is carried out).
behaviour. It is important to recognize that thinking aloud is not
Protocol analysis is a very useful tool for identifying the direct externalization of our cognitive processes.
different strategies that people use in problem solv- Rather, mental processes may be inferred through the
ing – strategies that may not be obvious from problem careful analysis of verbal protocols. We illustrate an
solutions alone. (In Chapter 19 you will encounter application of protocol analysis in Box 10.1.
Medical diagnosis is a complex skill, requiring the clini- third-year medical students (the ‘novices’) to think
cian to bring to bear his or her knowledge and skill in aloud while they studied and diagnosed eight different
accurately diagnosing a given patient’s disorder. Expert ECG traces, presented with no context information.
clinicians have acquired both biomedical and clinical They then analysed the protocols, examining them for
knowledge. Biomedical knowledge includes knowl- evidence of biomedical and clinical knowledge. For
edge of anatomy, biochemistry, and physiology, while example, use of key terms such as ‘polarization’, ‘acti-
clinical knowledge is often expressed in terms of asso- vation’, or ‘conducting’ was categorized as biomedical
ciations between symptoms or clinical findings and dis- reference. Use of words such as ‘chronic’ or ‘hyper-
ease categories. There has been some debate over the tension’ was classified as clinical reference. Clinicians
extent to which expert clinicians use biomedical also described the ECG traces directly in their proto-
knowledge in making diagnoses. Lesgold et al. (1998) cols, giving a third category of words. In this way, the
found that expert clinicians made extensive use of bio- protocols produced by the clinicians were segmented
medical knowledge, whereas Boshuizen and Schmidt into much smaller chunks, corresponding to clinical or
(1992) found that they made very little use of it. biomedical inferences or trace descriptions.
Gilhooly et al. (1997) hypothesized that when Reassuringly, the more experienced and skilled
experts can use contextual information (e.g. the clinicians were, the more accurate their diagno-
patient’s age, gender, and lifestyle habits) to aid a ses. The results of the protocol analysis showed that
diagnosis, their use of biomedical knowledge may more skilled clinicians made more extensive use of
be suppressed. Gilhooly et al. tested this hypothesis their biomedical knowledge than less skilled clini-
through their analysis of think-aloud protocols pro- cians, particularly in evaluating possible diagnoses.
duced by clinicians varying in skill level. They asked a They also made more use of their clinical knowledge
group of clinicians to interpret electrocardiogram than the less skilled clinicians.
(ECG) trace information. The ECG is regularly used What does this study tell us? First, it resolves the
to assess the electrical activity of the heart, and to apparently discrepant findings in the literature.
help identify abnormal patterns of activity that Increased use of biomedical knowledge is associated
might indicate an underlying problem. Skill is with expertise, when clinicians are not able to use
required to interpret an ECG trace and to use this in shortcuts to aid a diagnosis. Second, the study shows
making an accurate diagnosis, which then becomes that protocol analysis can be a very useful tool in help-
the basis for a patient’s treatment regime. ing us to understand problem solving in real-world sit-
Gilhooly et al. asked groups of registrars (the uations. Verbal protocols can give valuable insights into
‘experts’), house officers (the ‘intermediates’), and knowledge and processes involved in problem solving.
306 PART 4 THINKING
SUMMARY OF SECTION 1
• Problems involve a start state, a goal state, and a set of actions or operators that may be applied to
move from one state to the next until the goal is achieved.
• Protocol analysis is a key method in problem-solving research, yielding valuable information on the
cognitive processes supporting task performance.
• Verbal analysis is another valuable means of analysing verbal data, providing insights into the knowl-
edge representations underpinning task performance.
Cross-section of abdomen
Tumour
X-ray X-ray
X-ray
(a)
Cross-section of abdomen
Weak x-ray
X-ray
(b)
healthy tissue. This sub-goal led to the solution of Given three jars (A, B, and C) of capacities 18, 43,
using a number of weaker rays, which then con- and 10 units respectively, how could you obtain
verged on the tumour at lethal intensity, thereby exactly 5 units of water?
destroying the tumour. (An alternative solution
involved using a lens to focus a broad band of weak The solution may be expressed as B − A − 2C. After a
rays on the tumour so that lethal intensity was series of problems with that same general solution,
reached only at the focal point.) participants had great difficulty with the following
The Gestalt psychologists also investigated cases problem:
where insight was generally not achieved because
Given three jars (A, B, and C) of capacities 28, 76,
participants were trapped by misleading representa-
and 3 units respectively, how could you obtain exactly
tions that prevented solution. So-called ‘set’ effects
25 units of water?
arise when learned or habitual ways of tackling a
problem prevent the solver from identifying better In fact, the solution to this problem is quite simple
and simpler methods, or when unwarranted assump- (i.e. A − C) but when this problem was presented after
tions are made. a series of problems involving the long solution
Set can be induced by experience with a series of (B − A − 2C) many participants used the inefficient
similar problems. Luchins and Luchins (1959) studied method and either failed to solve the problem or took
problem sets in a series of experiments using water jar considerably longer to use the A − C method than did
problems (presented as a pencil-and-paper exercise). a control group of participants.
In these tasks participants were asked to say how one Figure 10.2 illustrates the 9-dot problem, often used
could get exactly a specified amount of water using to investigate this particular type of set effect. This
jars of fixed capacity and an unlimited source of water. problem is another example of the set effect, this time
For example: produced by the layout of the task. Try Activity 10.2.
308 PART 4 THINKING
ACTIVIT Y 10.2
COM M ENT
Most participants interpret the instructions as
meaning that they must stay within the square
shape of the dots; however, a solution is not possi-
ble without breaking this set and going outside the
square. Figure 10.3 at the end of the section shows
a solution.
FIGU RE 10. 2 The 9-dot problem.
the tacks. It was found that the solving rate was much
higher in the control group than in the experimental
group. Duncker explained this result in terms of a fail-
ure to perceive the possible platform function of the
boxes when they were presented as containers.
Functional fixity has been independently demon-
strated and explored further in a number of later stud-
ies (e.g. Adamson and Taylor, 1954; Glucksberg and
Danks, 1968).
Adults often find it difficult to think of novel uses
for familiar objects, as shown in the candle problem.
However, young children (5 years old) suffered less
from functional fixity in tasks requiring unusual uses
of familiar objects, presumably because they had less
FIGU RE 10. 3 A solution to the 9-dot problem. strongly fixed associations between possible uses and
objects (Defeyter and German, 2003). Similarly,
A related block to effective problem solving, known Amazonian Indians, unfamiliar with the tools to be
as ‘functional fixity’ (also identified by work in the used in a task, showed less functional fixity than
Gestalt tradition), tends to be observed when an object Westerners for tasks requiring the tools to be used in
has to be used in a new way. Duncker (1945) carried unusual ways – until the typical use was shown to
out the classic study of functional fixity using the ‘box’ them (German and Barrett, 2005), whereupon they
(or ‘candle’ problem). In this task, participants were also showed functional fixity at similar levels to
presented with tacks, matches, three small boxes, and Western participants.
three candles. The problem was to mount the candles Overall, the phenomenon of functional fixity
side by side on a door, so that they could burn safely. appears to be a robust one and is a likely source of dif-
For one group of participants the boxes were empty, ficulty in real-life problem solving. There are many
but for the other group (experimental group) the boxes real-world examples of functional fixity effects. An
were used as containers and held matches, tacks, and interesting early example is the history of the steam
candles. The solution is to use the boxes not as contain- engine. In 1775, the first Watt steam engine was used to
ers but as platforms and fix them to the door using pump water from a colliery, thus solving the problem
CHAPTER 10 PROBLEM SOLVING 309
of flooding. Before steam engines, either buckets or another example of a state–space diagram, drawn to
inefficient suction pumps had been used. It was some illustrate the structure of the simpler ‘hobbits and
years before it was appreciated that steam engines orcs’ problem, previously known as the ‘missionaries
could be used for locomotion as well as pumping water. and cannibals’ problem).
These early studies demonstrate the importance of Problems that share the same underlying structure
representation and its impact upon problem solving. (i.e. have identical state–space diagrams) are said to be
Later research, as we shall see in the next section, went isomorphic. Simon and Hayes contrasted two struc-
on to examine representational effects in a wider range turally similar versions of a ‘monster’ problem. Their
of problems in more depth. ‘monster’ problem was itself isomorphic to the Tower
of Hanoi problem. In the ‘move’ version, differently
sized monsters transferred globes of different sizes to
each other according to a set of rules. In the ‘change’
Representation in puzzle
2.2
version, monsters differing in size each held a globe,
problem solving which had to be changed in size to conform to partic-
ular rules. Despite being isomorphs, the ‘change’ prob-
The ‘representational effect’ has been acknowledged lem was considerably harder to solve than the ‘move’
for some time in problem-solving research. Simon problem. People seemed to construct rather different
and Hayes (1976) constructed several versions of the representations of the two problems; the representa-
Tower of Hanoi problem (see Figure 10.4 below), tion constructed for the ‘move’ problem entailed sim-
which involves discs of varying sizes arranged on pler processing operations than that constructed for
three pegs. The goal is to move the three discs from the ‘change’ problem. Our ability to perceive similari-
one peg (e.g. peg A) to another peg (e.g. peg C) using ties between problems, then, may be influenced by the
a sequence of legal moves. Typical constraints for this manner in which problems are represented.
problem are that a larger disc can never be placed on Zhang and Norman (1994) developed a theory to
top of a smaller disc (see below, though, for a variation account for representational effects with these sorts of
on this rule) and only one disc may be moved at a problems. They designed a number of isomorphic ver-
time. sions of the basic Tower of Hanoi problem, and
‘State–space’ diagrams present a given problem’s explored ways in which different rules influenced
state at each move juncture. Problem structures can be problem difficulty. Their theoretical framework dis-
mapped out and compared using state–space dia- tinguishes between ‘internal’ and ‘external’ represen-
grams. (The state–space diagram for the Tower of tations. Internal problem representations entail a
Hanoi is quite complex. See Figure 10.5, though, for processing and representational burden, because the
A B C
information needed to solve the problem has to be tiles around a small board until they form a particu-
encoded and maintained in some form. Internal rules, lar pattern or picture). Alternatively, solving some
then, are rules that need to be memorized, such as: problems may entail selecting or discovering a sin-
gle action from a large set; for example, using one
1. Only one disc may be transferred at a time. object that can meet the goal from all objects known
2. A smaller disc may never be placed on top of a to the solver. Within the information processing
larger disc (notice that this is the reverse of the approach, problem solving is generally seen as a
usual rule for this problem). search process.
The initiator of problem solving is a current goal,
External rules differ, however, in that they are not that is, a representation of a state that is desired but
stated explicitly in the instructions but are implied or not currently true. Therefore, goals direct the course
necessitated by the problem itself. For instance, a form of thinking by guiding retrieval of goal-relevant
of the Tower of Hanoi where discs are replaced by cups material and aiding in the assessment of directions of
of different sizes filled with coffee involves an external search as promising or not. Search may proceed in a
version of Rule 2 above (a smaller cup would fall into forwards direction from the starting state by gener-
the larger cup, spilling coffee). The environment, then, ating possible actions, evaluating the results of those
can provide constraints, so some rules need not be actions, and then choosing those with the best out-
internalized. Size and location are properties that need comes when assessed against the goal for further
not be internally represented, since differences in size exploration. Search may also proceed backwards
and location are readily perceived. However, dimen- from the goal by using a problem-reduction or
sional information may be represented internally. means–ends approach, which breaks down the
For instance, if colour is used to represent some task- overall goal into sub-goals that should be easier to
relevant information, then the relationships between achieve.
colours and information may have to be learned. For example, the problem of booking a trip to New
External representations appear to make problem York from London might be broken down (or
solving easier, although they also change the nature of ‘reduced’) into sub-goals that could include ‘buying a
the task. We return to this point later in Section 5 in ticket’ and ‘getting our passports updated’. ‘Buying a
our examination of the relationship between problem ticket’ can be broken down further into sub-goals such
solving and learning. as ‘finding an airline’ and ‘deciding on travel dates’
Some problem representations have attributes that (which in turn can be broken down further still to
may hamper (or facilitate) problem solving. Once a ‘check availability of seats’). The initial goal of getting
problem has been encoded and represented, problem to New York cannot be achieved until all the steps, and
solving may be described as a search through a set of their required conditions, have been identified. The
possible moves (or ‘problem space’). problem is solved by working ‘backwards’ from the
goal, starting with the first sub-goal for which the con-
ditions may be met (e.g. establishing that there are
seats available for the date on which we want to travel
The information
2.3
and selecting these), and then completing other sub-
processing approach: goals until the major goal is achieved and the trip is
booked.
problem solving as search A number of studies of search in problem solving
have used the Tower of London task (which is similar
Solving a problem may require us to find a suitable to the Tower of Hanoi). The problem has a number of
sequence of actions drawn from a small set of variants but basically requires participants to plan out
actions (for instance, moving a series of coloured how to move a set of coloured, same-sized discs
CHAPTER 10 PROBLEM SOLVING 311
arranged over three pegs from a starting pattern to a Response data from both the hobbits and orcs and
target pattern by moving only one disc at a time. the water jugs problems suggest a model in which
Search processes are assumed to involve the holding solvers look ahead, evaluating a few possible steps at
of goals and intermediate results in the limited-capac- each point in terms of whether they appear to lead to
ity working memory (see Chapter 9). new states closer to the goal or not. For example, at
Gilhooly et al. (1999) studied individuals think- State 331 in Figure 10.5, a solver could look ahead to
ing aloud while solving the Tower of London prob- the next move and evaluate two possibilities, which
lem. Their results suggest that working memory would move them either to State 220 or State 310.
limitations tend to shape search patterns so that Solvers appear to prefer moves that seem to take them
typically one action is selected from those available closer to the goal, repeating the entire procedure until
at each step. Search builds up a limited length of the goal is reached (Jeffries et al., 1977). The prefer-
sequence before returning to the start state and re- ence for new states is a heuristic to avoid looping (or
exploring. (This process of searching depth first to a revisiting old states in a particular sequence or cycle),
certain limit, then backing up and systematically as it is all too easy in these tasks to go round in circles!
searching all branches of the search tree to the Avoiding loops is also important in the Tower of
depth limit, is known as ‘progressive deepening’.) London task, and Davies (2000) found that partici-
Gilhooly et al. found that the general strategy used pants did not simply rely on memory to judge whether
was means–ends analysis, which generated a search a state had been encountered previously, but would
pattern focused on reducing differences between the seek to infer whether it could have been a precursor of
current state and the goal state. Means–ends analy- the present state. If the state in question could not
sis has been generally found to be the typical have been a precursor then it was safe to assume that
approach in the related Tower of Hanoi problem it was new.
(Luger, 1976).
Similar results, indicating very focused mental
search, have also arisen from studies of the hobbits
and orcs task (Thomas, 1974; Simon and Reed, 1976)
Information processing
2.4
and the water jars task (Atwood and Polson, 1976). approaches to insight
The state–space diagram for the hobbits and orcs task
(Figure 10.5) appears later in Box 10.2. Sometimes, a change of representation may be
Means–ends analysis typically involves reducing required in order to solve problems that initially
differences between the current state and the goal induce unhelpful ways of representing the problem.
state, and so moves that bring the solver closer to the As we discussed earlier, the Gestalt school in the 1920s
goal tend to be preferred. Thomas (1974) found that and 1930s regarded such restructuring as the basis of
participants solving the hobbits and orcs problem insight into difficult problems. Though the Gestalt
found the transition from State 110 to State 221 (see approach was criticized for a lack of clarity in
Figure 10.5) especially problematic. The move involves explaining how restructuring took place, Ohlsson
bringing back one hobbit and one orc, which seems at (1992) offered some suggestions as to how restructur-
odds with the general strategy of moving closer and ing might occur.
closer towards the goal. Ohlsson (1992) proposed that when working on a
The water jars problem has also been used to exam- problem people generate possible actions or opera-
ine search in problem solving. The problem requires tors from long-term memory, which are cued by the
participants to find a way of moving water between problem representation. Applying the operators to
jars of given capacities, from a starting state in which the current problem state leads to a new problem
the largest is full, to a goal state in which the water is state, which in turn elicits further possible opera-
distributed in a particular way over the three jars. tors. In this way a problem with a useful initial
312 PART 4 THINKING
The hobbits and orcs task requires participants to orcs on the left and right banks of the river at any given
find a way of transporting three hobbits and three time. Each state is labelled with a three-digit number,
orcs safely across a river in a boat. The boat can only with the first digit representing the number of hobbits,
hold two creatures at a time and on either side of the the second the number of orcs, and the third the num-
river the orcs must never outnumber the hobbits at ber of boats all on the left bank of the river. So, for
any time. example, State 331 (near top left) indicates the start of
In this state–space diagram (see Figure 10.5), each the problem, with three hobbits, three orcs and the
box represents a single state of the task. The number boat all on the left bank of the river. State 000 (top
of hobbits (H) and orcs (O) on the left- and right-hand right) is the solution state, with all six creatures and
side of each box indicates the number of hobbits and the boat transported to the opposite side.
320
HHH 0
00 Boat
10
331 000
HHH HHH
000 000
Boat Boat
1H10 20 1H10 20
1H 10 1H 10
321 010
HHH HHH
00 0 0 00
Boat Boat
20 20
300 031
HHH HHH
000 000
Boat Boat
10 10
311 020
HHH HHH
0 00 00 0
Boat Boat
2H 2H
110 221
H HH 1H 10 HH H
0 00 00 0
Boat Boat
FIGU RE 10. 5 State–space diagram for the hobbits and orcs problem.
CHAPTER 10 PROBLEM SOLVING 313
Version A Version B
• • • • • •
• • • • • •
• • • • • •
FIGU RE 10.7 Progress Monitoring theory: MacGregor et al.’s version A and version B of the 9-dot problem.
CHAPTER 10 PROBLEM SOLVING 315
FIGU RE 10.10 a) Taxi problem: move the cars to let the taxi out of the parking area. b) More complex taxi problem:
move the cars to let the taxi out of the parking area.
tend to precede moving the taxi, and that Rotated Jones (2003). The results suggested that Progress
and Easy conditions did lead to better performance Monitoring applies to the first stage of solving, leading
than the Normal condition. Further, earlier impasses to impasse, and that Representational Change applies
were associated with better performance on the to breaking of impasse and subsequent insight. Thus,
insight task. it seems that both theories have support and that the
In conclusion, both Representational Change and two theories deal with different stages of insight solv-
Progress Monitoring received some support from ing, so are complementary rather than contradictory.
SUMMARY OF SECTION 2
• Problem solving begins with a problem representation.
• The information processing approach analyses problem solving in terms of search within the space of
possibilities arising from a particular way of representing the problem.
• Manipulating instructions and the appearance of problems appears to influence the nature of the prob-
lem representation constructed, which in turn can affect the ease with which the problem may be solved.
• Some representations of supposedly ‘simple’ problems render the problems extremely difficult to
solve.
of an analogy. Whilst other animals make use of asso- participants who had not been given the analogue,
ciation and similarity, it is arguably the facility with somewhat higher when the analogue alone had been
which humans perceive and use relational similarity given, and markedly higher for the analogue followed
that sets us apart. In this section, we examine some of by a hint.
the reasons why analogical thinking is so important. Later studies (Holyoak and Koh, 1987; Keane, 1988)
indicated that the closer the base story is in surface
features to the target problem, the more transfer is
likely. For example, Keane found that a very close
Analogies in problem
3.1
analogy of a surgeon treating a brain tumour by radia-
solving tion was much more often retrieved and used in tack-
ling the x-ray problem, even after a week’s delay, than
Spellman and Holyoak (1992) found that experimen- the more remotely analogous story of the general
tal participants readily accepted analogies of the kind dividing his forces.
often used in discussions of international politics. For Anolli et al. (2001) found that retrieval of a remote
example, when Saddam Hussein attacked Kuwait in analogy was ineffective in itself without provision of a
1990, many commentators likened him to Adolf Hitler hint that the analogy contained a useful clue to the
and George Bush Sr. to Winston Churchill. Similarly, solution. In a series of seven studies, little benefit in
some regarded the ‘Domino’ theory – the US govern- terms of solving was found for simply reminding par-
ment’s belief that if one Asian country fell to commu- ticipants of the analogous story without a hint to use
nism then others would quickly follow – as compelling the story. However, retrieval plus a hint was very
justification for the war in Vietnam. effective.
In science, analogies have often been used to Dunbar (2001) has noted that there is an analogical
develop understanding. For example, the heart has paradox. The paradox is that in real life, use of abstract
been seen as analogous to a water pump and atomic analogies that depend on deep structural similarities
structure as similar to that of the Solar System. In cog- is common, while in laboratory studies, participants
nitive psychology, we hope that analogies between tend to use superficial features and have difficulty with
human and computer information processing will deeper forms of analogy. Blanchette and Dunbar
likewise prove useful. (2000) found that participants who were asked to pro-
Studies of analogy use in problem solving have duce analogies that could be used in arguments about
often used Duncker’s x-ray problem, which you met in whether or not drastic cuts should be made in public
Section 2, as the target problem. You may remember spending during a budgetary crisis readily produced
that the problem involved using rays to destroy a deep analogies that drew on a range of content areas
tumour in the centre of a body without destroying having little superficial resemblance to political mat-
healthy tissue. The solution was to have a number of ters. Blanchette and Dunbar proposed that generating
weak rays converge on the tumour, which would then analogies requires participants to use structural rather
have a cumulative effect at that point. Gick and than superficial features; also, the subject matter of the
Holyoak (1980) gave their participants an analogous naturalistic analogy studies has been familiar and
(or ‘base’) story about a general seeking to take a castle understood in some depth. In typical laboratory stud-
who had to divide his forces into small groups, which ies, on the other hand, the material is not highly famil-
then attacked the castle simultaneously on all sides. iar and there is little pressure to encode the base story
Participants were then given the x-ray problem, with in a deep way. A possible interpretation of Anolli
and without a hint. The hint indicated that solvers et al.’s (2001) results (namely, target problem solution
should try to use the story to solve the x-ray problem. is increased by reminding of the base story plus a hint
A control group did not receive the analogue before that the analogy contained a useful clue to the solu-
tackling the x-ray problem. Rate of solving was low for tion) is that the hint encouraged a deeper structural
318 PART 4 THINKING
representation of the base story, which in turn facili- problems; people who used crowd analogies were bet-
tated application of the analogy. ter on resistor problems. People pre-trained on one or
other of the analogies also showed similar results.
A curious and almost counterintuitive aspect of the
3.2 How do analogies work? process of analogical mapping is Gentner’s (1983)
claim that this is symmetric at the outset, though the
The first detailed theory of how people apply analogies inferences that are subsequently projected may be
in problem solving was the ‘structure-mapping’ theory directional. Thus, Gentner’s position would argue that
(Gentner, 1983; Gentner and Markman, 1997; Gentner in the initial stages of processing, ‘my legs are like lead’
et al., 2001). According to this theory, there is a process would be as comprehensible as ‘lead is like my legs’. An
of analogical mapping whereby a structural alignment is alternative position, associated with Glucksberg et al.
established between the representations of the base (1982) for example, asserts that metaphor processing
and the target. That is to say, explicit correspondences is directional from the beginning. If this were the case,
are established between the represented elements and then reverse metaphors such as ‘lead is like my legs’
relationships in the two situations. As an example, con- should not be comprehensible. The debate hinges on
sider the Solar System analogy of the atom. Typically, whether metaphor use is based on comparison pro-
the Solar System would be represented as having two cessing or on category processing (see Chapter 5). A
types of object (the Sun and the planets) and these metaphor may be described in terms of the ‘vehicle’
exhibit various properties and relationships (e.g. the and the ‘topic’. Take for example the metaphor my
Sun is more massive than the planets; the planets orbit child is a monster. In this case, the topic is ‘my child’
the Sun). The analogy would align the Sun with the and the vehicle is ‘a monster’. Gentner argues that in
nucleus of the atom and the planets with electrons. understanding this metaphor, we compare the topic
Aspects of the Solar System model that do not map are and base representations and then arrive at a common
omitted (e.g. no equivalent of moons in the atom). relational system: ‘My child is bad, just as monsters are
Higher-order relationships also guide the alignment bad’. For Glucksberg et al., in using a metaphor one
process. Thus, there is a higher-order relationship such asserts that the topic (‘child’) is a member of the cate-
that less massive objects orbit more massive objects; gory of which the vehicle (‘monster’) is a prototypical
this guides the inference from the Solar System anal- member. An issue for category theories is what incites
ogy that the electrons revolve around the nucleus. the listener to create a metaphorical category for the
Falkenhaimer et al. (1986) have successfully imple- vehicle, rather than using its literal meaning.
mented the detailed model as a computer model One way to test the symmetry hypothesis is to use a
known as the ‘structure mapping engine’ (SME). variant on Glucksberg et al.’s (1982) metaphoric inter-
Gentner and Gentner (1983) showed that different ference technique, which requires participants to state
base analogies were common for understanding elec- whether metaphors are comprehensible or not. Wolff
trical flow. These influenced how well people solved and Gentner (2000) used four types of statement: false
different problems regarding electrical flow through statements (e.g. some cats are peanuts); forward meta-
circuits with batteries and resistors arranged in paral- phors (e.g. some jobs are prisons, some builders are
lel or in series. The main analogies were electricity as a cowboys); scrambled metaphors (e.g. some jobs are
flow of fluid through pipes or as a flow of crowds cowboys); and reverse metaphors (e.g. some prisons
through passageways. Example differences between are jobs). Participants verify the statements as either
the two analogical mappings are that in the fluid true or false after either a 600 ms or a 1200 ms
analogy electrical resistance would be mapped to exposure. Typically what is found is that the standard,
pipe width, while in the crowd analogy resistance forward metaphors interfere with true-false judge-
is mapped to gates in the passageway. People who ments, these judgements being slower than judge-
used the fluid analogy performed better on battery ments of the literal false statements. One interpretation
CHAPTER 10 PROBLEM SOLVING 319
of this is that metaphor processing occurs very early were equally as fast in comprehending forward and
on. If metaphor use is based on categorical processing reverse metaphors after 600 ms, and it was only after
as Glucksberg et al.’s finding suggests, then we should 1200 ms of exposure that forward metaphors were
see the influence of both categorical information asso- judged more comprehensible than reverse metaphors.
ciated with the vehicle, and attributes of the topic, but Underpinning our ability to engage in analogical
only for the standard, forward metaphors. Reverse thinking is our capacity for relational reasoning.
metaphors would simply be anomalous and verifica- Relational concepts must be learned, and our capacity
tion times should be comparable to false statements to acquire and use relational concepts is augmented by
and to scrambled metaphors. If, on the other hand, language. Gentner (2003) notes that enhanced rela-
metaphor processing is symmetrical at the outset, then tional encoding may be brought about by the acquisi-
reverse metaphors should show similar levels of inter- tion of a more uniform relational structure (reflected
ference to forward metaphors. Results supported the in vocabulary use, for example), and this in turn sup-
symmetry position by showing that the interference ports relational retrieval. Rattermann and Gentner
effect was comparable for forward and reverse meta- (1998) showed that teaching 3-year-olds how to use
phors, providing further support for the structure- relational labels (such as big, tiny, little) enabled them
mapping theory.2 Interestingly too, the exposure to reason as well as 5-year-olds who already under-
manipulation corroborates this conclusion. Individuals stood and used such labels.
SUMMARY OF SECTION 3
• Research on analogical problem solving illustrates a paradox: we often cannot help but be reminded
of problems similar to one we presently face. However, we often fail to see the crucial relationships
between a current problem and one we have previously encountered.
• Representation seems to be at the core of the paradox.
• The mapping of correspondences between target and base constituents appears to be a very early
stage in the analogical mapping process, which is symmetrical.
view of the expert might well have encapsulated the capacities, searching further ahead and conducting
view that experts owe their skill to superior mental broader searches for candidate moves. The evidence
capacities, rather than to a vast body of specialist from the think-aloud protocols, however, was surpris-
knowledge. The shift in emphasis began with some ing and revealed no reliable quantitative differences at
ground-breaking research on chess skill. We shall all between the grand masters and the highly skilled
examine this work in some detail, because much of the players. The only difference that did emerge between
later research on expert and novice problem solving the two groups was unremarkable – the grand masters
developed from the early chess studies, and because ultimately chose better moves.
findings obtained in later studies tend to echo those of De Groot also employed what is known as a ‘recall-
the chess experiments described below. reconstruction’ paradigm (see Box 10.3). He showed
First, some words on terminology. Researchers have chess players chessboards with pieces arranged from
examined both adversary and non-adversary problem actual games. The boards were presented to players for
solving. Chess play is an example of adversarial prob- 2–15 seconds and then removed. He then asked the
lem solving, because the game of chess involves an chess players to reconstruct the board positions from
opponent. Code-breaking, de-bugging computer pro- memory. The chess masters could reconstruct the
grams, and medical diagnosis are examples of non- boards almost without error (91 per cent of pieces
adversarial problem domains. Those engaged in correctly replaced), whereas the poorer players aver-
adversary problem solving must consider not only their aged only 41 per cent correct. Skill level was then
own possible actions, but also those of an opponent. linked to the amount of information remembered
about the chessboard positions.
Chase and Simon (1973b) devised a second task,
where players had to reconstruct a chessboard while
The role of knowledge in
4.1
the board they had to correctly match was still in view.
expert problem solving Although this may seem an odd task, the point was to
find out how many pieces were placed on the target
board after each glance at the board they were copying,
4.1.1 Early chess studies what those pieces were, and how much time elapsed
De Groot (1965; original 1946) carried out a series of between placing pieces on the board. Chase and Simon
now classic studies of chess players. These were extremely found that the strongest chess players replaced more
significant and heralded the start of a new emphasis on chess pieces on the board following each glance than
knowledge in skilled problem solving. Information pro- the weaker players did, replaced pieces more quickly,
cessing had taken centre stage as the dominant para- and were more likely to replace pieces together that
digm and many researchers busied themselves with the bore some meaningful relationship to each other.
construction of models of cognitive processors and pro- These findings suggested that experts not only possess
cesses. Up until then, it had been implicitly, if not explic- more knowledge about their domain of expertise, but
itly, assumed that skilled problem solvers must have that their knowledge is organized in more meaningful
superior information processing capabilities. De Groot and readily accessible ways.
tested this assumption in a novel way. These early studies of chess skill showed that skill
De Groot asked five grand masters (the highest skill depended at least in part on the acquisition of domain
level attainable in chess) and five skilled players to knowledge, and stimulated a vast amount of research
think aloud as they studied a chessboard and chose a on the nature of expert problem solving and the
move. If information processing capacities are a key relationship between knowledge and skill. We
determinant of expertise, then we would expect to summarize some of the key studies below. These stud-
find the grand master players, with their superior ies sought to characterize the empirical phenomena
CHAPTER 10 PROBLEM SOLVING 321
Chase and Simon (1973a) extended the basic chess- the position just seen. Results from the first mem-
board recall-reconstruction paradigm, originally ory trial showed that the master player was much
used by Lemmens and Jongman in an unpublished better (16 pieces replaced correctly) at accurately
study in 1964. In one study, Chase and Simon pre- replacing the chess pieces than both the class A
sented boards with between 20 and 22 chess pieces player (8 pieces replaced correctly) and the novice
arranged on them to three chess players (a master, player (only 4 pieces replaced correctly). The skilled
a class A (highly skilled) player, and a novice). Some players’ advantage only held for chessboards with
of the boards were presented with chess pieces pieces placed in plausible, real-game positions.
arranged as they might be in a real game (see Figure When the different players were asked to recon-
10.11), while others were presented with the chess struct the random boards from memory, all players
pieces arranged at random. performed equally poorly, correctly replacing only a
Players were given five seconds to study each small proportion of pieces. This suggested a con-
board. The board was then covered up and each nection between memory for meaningful patterns
player was asked to reconstruct on another board and problem-solving skill.
FIGU RE 10.11 A chessboard position from a real game. Source: adapted from Chase and Simon, 1973a
322 PART 4 THINKING
associated with skill in problem solving, phenomena The two skill groups did not differ on quantitative
that theories of skill acquisition and problem solving measures, such as number of categories or time to
would ultimately have to accommodate and explain. categorize. This showed that novices were not lim-
ited in their capacity to discriminate problems.
4.1.2 Experts work forwards However, there were clear qualitative differences in
Larkin et al. (1980) were interested in possible stra- the nature of the categories into which problems
tegic differences between experts and novices. were sorted. Novices referred to objects and key
Experts know more than novices, but do they also words contained in the problem (such as ‘levers’ and
use qualitatively different problem-solving strate- ‘pulleys’), and appeared to use these irrelevant ‘sur-
gies from those used by novices? They asked expert face structure’ details as a basis for categorization.
and novice physicists to solve a range of physics Experts, on the other hand, referred to the physics
problems. Using protocol analysis, they found that principles and laws (the ‘deep structure’) that were
experts tended to use a working forwards strategy, needed to solve the problems in their justifications.
beginning with information given in the problem Problems that could be solved by reference to the
statement and using that to derive a solution. same principle or law were perceived by the experts
Novices, on the other hand, used a working back- to be similar and were grouped together. Novices
wards strategy (means–ends analysis), starting with tended to group together problems that were simi-
the goal, or quantity to be solved, and working back- lar in ‘surface structure’, while experts sorted prob-
wards from that to the given information until they lems on the basis of similarity in ‘deep structure’.
were able to solve one part of the problem. Novices It seems then that experts are aware of commonali-
then typically retraced their steps, working forwards ties between problems in terms of how they might
until the problem was solved. be solved.
Why do experts and novices use different problem- Schoenfeld and Herrmann (1982) carried out a
solving strategies? It appears that experts use their rather similar study, looking at mathematical prob-
domain knowledge to generate a good problem repre- lem categorization among mathematics professors
sentation, which supports the use of a working for- and novices. Their participants read through the set
wards strategy. In the absence of detailed knowledge of problems and then grouped together those prob-
about the relationships between variables relevant to lems they considered to be mathematically similar.
the problem, novices seem to have no option but to The study confirmed the findings of Chi et al. (1982),
fall back on means–ends analysis, or even trial and with novices sorting the problems on the basis of
error learning. superficial details, or surface structure, and the pro-
fessors sorting problems on the basis of similarities
Experts have better problem
4.1.3
in solution methods, or deep structure. (You will
representations notice some similarities here with the discussion in
Chi et al. (1982) tackled the issue of problem represen- Chapter 5 of how different groups of people catego-
tation and categorization by experts and novices. rized trees.)
Experts know more and they use distinct problem- Chi et al. found in their study that experts were able
solving strategies. Is expert problem solving also sup- to perceive an appropriate solution method within 45
ported by more effective ways of representing and seconds. This suggests that knowledge useful for a
categorizing problems? Chi et al. asked expert and nov- particular problem is accessed, or becomes available,
ice physicists to think aloud as they categorized physics when a problem is categorized as a specific type. These
problems on the basis of similarities in terms of how the categories may correspond to problem schemata or
problems might be solved. Unusually, then, participants ‘packets’ of knowledge that can be used to solve a par-
did not actually have to solve the problems. ticular type of problem.
CHAPTER 10 PROBLEM SOLVING 323
‘expert–novice’ paradigm. The model of chess exper- Although supported by the data, these initial
tise that emerged became known as the ‘pattern recog- observations about expertise seem descriptive and
nition hypothesis’, because it assumed that skilled lack explanatory power. Sternberg (1995) is just one
performance depended upon the ability to access pre- of the researchers to have commented upon this.
viously learned patterns, such as configurations of Over-use of the paradigm appeared to constrain
chess pieces on a board, from long-term memory. the nature of the findings to a series of observa-
The general idea that performance depends upon a tions about experts ‘knowing more’ than novices.
large body of highly structured domain-relevant Accounting for these findings was nonetheless a
knowledge and skill has been borrowed by researchers challenge for theories of skill acquisition, but many
examining skill-related differences in non-adversarial researchers recognized that there was more to exper-
domains such as physics (Chi et al., 1982), mathemati- tise than the gradual accumulation of domain-spe-
cal problem solving (Schoenfeld and Herrmann, 1982), cific knowledge.
computer programming (McKeithen et al., 1981), and As we shall see in the next section, when research-
political science problem solving (Voss et al., 1983). ers began to explore different questions about the
Results consistently showed a link between expertise nature of expertise and about skill acquisition, some
and knowledge, suggesting that a ‘modal model’ of findings emerged that challenged the prevailing view
expertise was emerging, whereby expertise depends of expertise while at the same time yielding valuable
upon the acquisition and organization in long-term insights into the relationship between memory and
memory of domain-relevant knowledge and skill. skill, and the development of expertise itself.
SUMMARY OF SECTION 4
• In memory tests for information from their domain of expertise, experts recall more than novices.
• Experts are superior to novices in knowledge rather than in basic capacities.
• Experts use a working forwards strategy, while novices tend to work backwards.
• Experts construct better problem representations than novices.
• Experts become expert through extensive practice.
research on chess skill, which had originally played consistent with the notion of a long-term working
such a large part in stimulating research on expert and memory (Ericsson and Kintsch, 1995). We turn to
novice problem solving. this in the next section.
Long-term working memory is consistent with of the design experts’ reasoning was comparable to
accounts of expertise in a range of domains, an inter- that of the domain experts. When knowledge is lack-
esting example of which is acting. Actors must rap- ing, it seems that there may be skills of intermediate
idly assimilate information about a role, and that generality that do transfer. These findings are at odds
information includes the lines the character speaks, with theoretical frameworks that argue for the
the emotions that must be expressed at various points, domain-specificity of expertise.
the characters’ intentions, and more. Noice and Noice Schunn and Anderson (1999) carried out a similar
(2006) note that actors have acquired with experience study to examine whether expert scientists from dif-
a vast amount of knowledge in long-term memory on ferent domains shared some skills. They asked
human motivations, and intentions that are applied to domain experts (psychologists skilled in designing
those motivations. For example, an actor must under- memory experiments), task experts (psychologists
stand the nature of alcoholic addiction in order to skilled in areas other than memory research), and
move across the stage in a performance, pick up a bot- undergraduate students studying different courses to
tle of whisky, and say, ‘This is how I solve my prob- think aloud while designing an experiment to
lems’. Understanding motivation and intention investigate an unexplained aspect of memory.
influence how the actor carries out this action and Analysis of protocols and performance data showed
delivers the line. The intentions then serve as the that the domain experts designed the best experi-
retrieval cues that support the performance. Noice ments. Domain experts and task experts differed in
and Noice (2006) argue that this explains the ability of terms of domain-specific skills, while task experts
experts to go to a particular part of a performance (in and undergraduates differed on domain-general
rehearsal, for example) and to then play the part from skills. Through the analysis of verbal protocols, the
there with conviction. researchers were able to identify a much larger set of
domain-general skills that are important in scientific
The role of general and specific
5.1.3
reasoning.
methods
Schraagen (1993) carried out a more detailed exami-
nation of the problem-solving performance of differ- 5.2 Individual differences
ent groups of experts and novices. Most studies of
expertise have shown that experts draw upon a large The expert–novice paradigm contrasts the perfor-
body of domain knowledge when asked to solve a mance of experts and novices solving the same set of
problem from their domain of expertise. Anderson’s problems drawn from a given domain. Although the
(1983) ACT* theory predicts that when domain problems used are likely to be non-trivial to the nov-
knowledge is lacking, experts should fall back on gen- ices, they scarcely present a problem in any mean-
eral strategies, or ‘weak methods’. Schraagen asked his ingful sense to the experts. This is necessarily so
participants to design an experiment in the area of because if the problems were truly challenging for
sensory psychology. He compared the reasoning of the experts, novices would not be able to even begin
domain experts (psychologists with around 10 years’ to solve them. However, if the experts have not really
experience in designing experiments in the area of been taxed with a ‘problem’, have we learned any-
sensory psychology) with ‘design’ experts (psycholo- thing at all about expert problem solving? The
gists with around 10 years’ experience in designing expert–novice paradigm also tends to imply that
psychology experiments in general). The problem fac- novices know nothing, or know little of relevance.
ing subjects was to design an experiment to investi- As we shall see, novices do not approach novel prob-
gate what people taste when they drink a given brand lems with ‘empty heads’. They bring to bear whatever
of cola. While domain knowledge was important (the knowledge and strategies they are able to and, in
domain experts generated better solutions), the form doing so, it is clear that some novices are better
CHAPTER 10 PROBLEM SOLVING 327
learners than others. We shall now examine the Chi et al. (1989) and Chi et al. (1994) have been
extent to which implicit assumptions about the especially interested in the role played by explanation
homogeneity of both novice and experts groups are in learning and, in particular, whether novices may be
reasonable. distinguished by the extent to which they generate
explanations while solving problems. In their studies,
5.2.1 Are all learners the same? they equated students for background knowledge (of
Novices have tended to be described in terms of what physics and biology) and then analysed the think-
they do not have, or do not do. A more positive aloud protocols students produced as they studied the
approach is to examine what novices can do, and ways problems. In one study, good learners seemed to spon-
in which they differ. In so doing, this work shifts the taneously self-explain more than poor learners. Good
emphasis from problem-solving performance to learners used the examples they had studied to check
learning and the acquisition of skill in problem solv- their solutions, whereas poor learners used the exam-
ing. Models and theories of problem-solving perfor- ples to help them to find solutions. Chi et al. (1994)
mance must not only account for differences between showed that prompting students to self-explain as
skilled and less-skilled individuals; they must also they studied led to better problem solving than simply
explain how skill is acquired. asking students to study the materials. Renkl (1997)
Some interesting work has examined differences showed that the self-explaining effect is not simply
between good and poor learners, and this has shed due to some students spending longer studying. In a
some light on what might mediate between practice study that controlled for time-on-task, Renkl found
and performance. Many of us will have noticed that that quality of self-explanations reliably predicted
people tend to differ in rate of learning. While it is an learning success. Generating self-explanations, then,
over-simplification to suggest that novices start with a whether spontaneously or in response to a prompt to
blank slate, most novices begin from a position of not do so, seems to serve an elaborating role in early learn-
having much of the skill in question. If knowledge rel- ing, aiding understanding and schema development.
evant to the skill does not mediate or support their Schema development is of course central to skill
performance early on, then what does? development.
Thorndyke and Stasz (1980) examined learning
strategies, differentiating good from poor learners Can we enhance the rate of skill
5.2.2
variables as you can’. A second group of novices that seemed to lead to slower learning paid off later on
received the same problems, but the final sentences by giving rise to better problem solving. Different
were altered to include a specific goal, e.g. ‘In 18 sec a instructions influence the nature of the task or prob-
racing car can start from rest and travel 305.1 m. What lem representation, and this in turn affects both learn-
speed will it reach?’ ing and problem-solving performance. This echoes
Participants who were given the no-goal problems the point we made earlier with regard to the impact of
switched more swiftly to a working forwards strategy internal and external representations upon learning
than did novices who were given the goal problems. and problem solving.
One interpretation of these findings is that the pres- Some recent studies by Haider and Frensch (1996,
ence of a goal biases individuals towards the use of a 1999a,b) have focused on ways in which we learn to
means–ends strategy, which imposes high processing ignore task-irrelevant information and process only
demands. This would have the effect of reducing the task-relevant information. Haider and Frensch have
available resources for acquiring knowledge about shown that as we become more skilled, we typically
the relationships among principles. De-emphasizing learn to ignore redundant information. Not all indi-
the goal, then, could work by reducing working- viduals behave in the same way though. In one of their
memory load, thereby freeing resources. This would studies, they found that some individuals fail to reduce
facilitate schema acquisition, thereby enhancing the amount of information heeded, even after
learning. extended practice. Green and Wright (2003) have
There is an alternative explanation for the facilitat- extended these findings, examining what happens
ing effect of reduced goal specificity on learning. when two information sources associated with one
Vollmeyer et al. (1996) examined the effects of goal event are presented. When individuals have a choice
specificity and systematicity of learning strategy in of information sources relevant to the task, they
learning and transfer within a complex dynamic sys- tend to prefer to use the first encountered source.
tem. Their findings were consistent with Sweller’s Information reduction then serves to reduce process-
claim that general problem-solving methods might ing of task-irrelevant, as well as duplicated (but possi-
enable a person to attain a specific goal, but do not bly task-relevant) information. The assumption that
promote learning of the overall structure of a problem we come to process less information is at odds with
space. Burns and Vollmeyer (2002) have taken this some theories of skill acquisition like ACT* and
work further, and have shown that non-specific goals ACT-R (which you will explore in more detail in
seem to aid learning by encouraging more hypothesis Chapter 19).
testing. Their work shows that it seems to be hypoth- The studies we have discussed in this section pro-
esis testing, rather than the reduction in goal-specific- vide some clues as to how individuals learn to solve
ity, that encourages learning. problems more effectively. What is apparent is that
There may be another dimension to the effects of learners do not all behave in the same way. Certain
goal specificity on learning and problem solving. learning procedures and strategies facilitate knowl-
Green (2002) argued that reducing goal specificity edge acquisition, and there is evidence that problem
also has the effect of altering the way in which a prob- representation again plays a key role.
lem comes to be represented. In her experiment, it was Novices seem to differ from each other, then, and
the nature of the problem representation that was their rates of learning can vary. Do experts form a
crucial to performance, rather than the reduction in homogeneous group? We examine this question next.
goal specificity. Green also points out that it is impor-
tant to distinguish learning from problem solving. 5.2.3 Do experts differ?
Instructions that led to swift learning seemed to It is sometimes tacitly assumed that experts form a
result in poor problem solving, while instructions homogeneous group, with considerable overlap
CHAPTER 10 PROBLEM SOLVING 329
among experts in what they know. If this is the case, as such that are logically sufficient to solve most
then we may safely generalize from studies of experts, problems.
and talk about ‘typical’ expert problem-solving behav- Chess, computer programming, and physics are,
iour. However, it is likely that the assumption of nonetheless, well-defined domains. In the case of
homogeneity is at best an over-simplification. chess in particular, certain problem states can become
This point has been made by Charness (1991) in his highly familiar, and stronger players can capitalize
examination of chess skill, who found that chess upon their ability to recognize good problem states.
masters do not know the full range of opening varia- Sometimes, though, recognition hinders the con-
tions (there are some 50,000), middle-game combina- struction of optimal representations.
tions (around 1,817), and end-games (some 8,500). Our notions of ‘expertise’ are becoming more
Indeed, it is questionable whether they could actually sophisticated. Many of the examples considered here
learn the full set. Instead, chess masters specialize in a conform to the ‘classic expert’ model – the chess mas-
subset of each of the three classes. Secondly, we can ter, for example, or the physicist. Other kinds of expert
see that there are different kinds of expertise. The are entrepreneurs, master chefs, and actors. A third
physics expert, for example, is an expert in a domain category might be labelled specialists, and this would
where knowledge of the principles themselves is suf- include individuals who have a niche of specialist
ficient to solve most of the problems that may be knowledge or skill – a local historian, perhaps, or the
encountered. Chess masters exercise their skill in a person who is very knowledgeable on the works of a
domain where it is virtually impossible to learn all particular author or poet. The notion of ‘expert’ has a
there is to know. There is not a body of ‘principles’ currency, and experts have status.
SUMMARY OF SECTION 5
• Neither experts nor novices form a homogeneous group.
• Skill in problem solving involves more than just the accumulation of knowledge.
• Problem-solving skill may be enhanced in a number of ways.
6 CONCLUSIONS
Nearly a century of research on problem solving has have been made in understanding how we become
yielded some impressive findings. Important phenom- skilled in solving problems from a wide range of com-
ena, such as insight and fixation, which have long taxed plex domains, which have in turn led to a better under-
researchers, are now amenable to more rigorous, sys- standing of expertise and learning.
tematic investigation thanks to methodological and We do not yet have a theory of problem solving; nor
theoretical advances, not to mention the evolution of do we have a theory of learning, but progress is being
ever more sophisticated approaches to cognitive mod- made. Underpinning research on problem solving is a
elling. We now have a better understanding of analogi- recurring theme, and it is this: representation is
cal reasoning, helping us to appreciate how analogical fundamental to problem solving, just as it is funda-
reasoning occurs and why it sometimes fails. Advances mental to many other areas of psychology. Problem
330 PART 4 THINKING
representation is likely to be influenced by many vari- of psychology sufficiently that you will see the poten-
ables, some of which we have only begun to explore. tial for problem-solving research in terms of its wider
We hope we have stimulated your interest in this area application, as well as its theoretical significance.
FURTHER READING
Chronicle, E.P., MacGregor, J.N., and Ormerod, T.C. (2004) Anderson, J.R. (2002) ‘Spanning seven orders of magni-
‘What makes an insight problem? The roles of heuristics, goal tude: a challenge for cognitive modeling’, Cognitive Science,
conception, and solution recoding in knowledge-lean prob- vol.26, pp.85–112. In this paper the author applies his ideas to a
lems’, Journal of Experimental Psychology: Learning, Memory range of problems, from those that are dealt with very rapidly to
and Cognition, vol.30, pp.14–27. This paper provides an analysis those that may require hours or weeks of thought.
of what is meant by the term ‘insight problem’ and four experiments
investigating factors relevant to the solution of such problems.
REFERENCES
Adamson, R.E. and Taylor, D.W. (1954) ‘Functional fixedness Chase, W.G. and Simon, H.A. (1973a) ‘The mind’s eye in
as related to elapsed time and set’, Journal of Experimental chess’, in Chase, W.G. (ed.) Visual Information Processing, New
Psychology, vol.47, pp.122–6. York, Academic Press.
Anderson, J.R. (1983) The Architecture of Cognition, Chase, W.G. and Simon, H.A. (1973b) ‘Perception in chess’,
Cambridge, MA, Harvard. Cognitive Psychology, vol.4, pp.55–81.
Anolli, L., Antonietti, A., Crisafulli, L., and Cantoia, M. Chi, M.T.H. (1997) ‘Quantifying qualitative analyses of
(2001) ‘Accessing source information in analogical problem- verbal data: a practical guide’, Journal of the Learning Sciences,
solving’, Quarterly Journal of Experimental Psychology, vol.6, pp.271–315.
vol.54A, pp.237–61. Chi, M.T.H., Bassok, M., Lewis, M.W., Reimann, P., and
Atwood, M.E. and Polson, P.G. (1976) ‘A process model Glaser, R. (1989) ‘Self-explanations: how students study and
for water jug problems’, Cognitive Psychology, vol.8, pp.191– use examples in learning to solve problems’, Cognitive Science,
216. vol.13, pp.145–82.
Blanchette, I. and Dunbar, K. (2000) ‘How analogies are Chi, M.T.H., de Leeuw, N., Chiu, M-H., and LaVancher, C.
generated: the roles of structural and superficial similarity’, (1994) ‘Eliciting self-explanations improves understanding’,
Memory and Cognition, vol.28, pp.108–24. Cognitive Science, vol.18, no.3, pp.439–77.
Boshuizen, H.P.A. and Schmidt, H.G. (1992) ‘On the role of Chi, M.T.H., Glaser, R., and Rees, E. (1982) ‘Expertise in
biomedical knowledge in clinical reasoning by experts, inter- problem solving’, in Sternberg, R.J. (ed.) Advances in the
mediates and novices’, Cognitive Science, vol.16, pp.153–84. Psychology of Human Intelligence, Hillsdale, NJ, Erlbaum.
Burns, B.D. and Vollmeyer, R. (2002) ‘Goal specificity Davies, S.P. (2000) ‘Move evaluation as a predictor and
effects on hypothesis testing in problem solving’, The moderator of success in solutions to well-structured prob-
Quarterly Journal of Experimental Psychology, vol.55A, no.1, lems’, Quarterly Journal of Experimental Psychology, vol.53A,
pp.241–61. no.4, pp.186–201.
Card, S.K., Moran, T.P., and Newell, A. (1983) The Defeyter, M.A. and German, T.P. (2003) ‘Acquiring an
Psychology of Human–Computer Interaction, Hillsdale, NJ, understanding of design: evidence from children’s insight
Erlbaum. problem solving’, Cognition, vol.89, pp.133–55.
Charness, N. (1991) ‘Expertise in chess: the balance De Groot, A.D. (1965) Thought and Choice in Chess (origi-
between knowledge and search’, in Ericsson, K.A. and Smith, J. nal edition in Dutch, 1946), The Hague, Mouton.
(eds.) Towards a General Theory of Expertise: Prospects and Dunbar, K. (2001) ‘The analogical paradox: why analogy is
Limits, Cambridge, MA, Cambridge University Press. so easy in naturalistic settings, yet so difficult in the psychol-
CHAPTER 10 PROBLEM SOLVING 331
ogy laboratory’, in Gentner, D., Holyoak, K.J., and Kokinov, B. in diagnostic thinking: the case of electrocardiogram (ECG)
(eds.) Analogy: Perspectives from Cognitive Science, Cambridge, interpretation’, European Journal of Cognitive Psychology,
MA, MIT Press. vol.9, no.2, pp.199–223.
Duncker, K. (1945) ‘On problem solving’, Psychological Gilhooly, K.J., Phillips, L.H., Wynn, V., Logie, R.H., and
Monographs, vol.58, whole, no.270, pp.1–113. Della Sala, S. (1999) ‘Planning processes and age in the 5 disk
Ericsson, K.A. (1991) ‘Prospects and limits of the empirical Tower of London task’, Thinking and Reasoning, vol.5, no.4,
study of expertise: an introduction’, in Ericsson, K.A. and pp.339–61.
Smith, J. (eds.) Towards a General Theory of Expertise: Prospects Glucksberg, S. and Danks, J.H. (1968) ‘Effects of discrimi-
and Limits, Cambridge, MA, Cambridge University Press. native labels’, Journal of Verbal Learning and Verbal Behaviour,
Ericsson, K.A. and Harris, M. (1990) ‘Expert chess memory vol.7, pp.72–6.
without chess knowledge. A training study’, poster presenta- Glucksberg, S., Gildea, P., and Bookin, H. (1982) ‘On
tion at the 31st Meeting of the Psychonomics Society, New understanding non-literal speech: can people ignore meta-
Orleans. phors?’ Journal of Verbal Learning and Verbal Behavior, vol.1,
Ericsson, K.A. and Kintsch, W. (1995) ‘Long-term working pp.85–96.
memory’, Psychological Review, vol.102, no.2, pp.211–45. Gobet, F. (1998) ‘Expert memory: a comparison of four
Ericsson, K.A. and Polson, P.G. (1988) ‘Memory for restau- theories’, Cognition, vol.66, pp.115–52.
rant orders’, in Chi, M.T.H., Glaser, R., and Farr, M. (eds.) The Gobet, F. and Simon, H.A. (2000) ‘Five seconds or sixty?
Nature of Expertise, Hillsdale, NJ, Erlbaum. Presentation time in expert memory’, Cognitive Science, vol.24,
Ericsson, K.A., Krampe, R.T., and Tesch-Rohmer, C. (1993) pp.651–82.
‘The role of deliberate practice’, Psychological Review, vol.100, Green, A.J.K. (2002) ‘Learning procedures and goal speci-
no.3, pp.363–406. ficity in learning and problem solving tasks’, European Journal
Falkenhainer, B., Forbus, K.D., and Gentner, D. (1986) ‘The of Cognitive Psychology, vol.14, no.1, pp.105–26.
structure-mapping engine’, Proceedings of the Meeting of the Green, A.J.K. and Gilhooly, K.J. (1990) ‘Individual differ-
American Association for Artificial Intelligence, pp.272–7. ences and effective learning procedures: the case of statistical
Gentner, D. (1983) ‘Structure-mapping: a theoretical computing’, International Journal of Man-Machine Studies,
framework for analogy’, Cognitive Science, vol.7, pp.155–70. vol.33, pp.97–119.
Gentner, D. (2003) ‘Why we’re so smart’, in Gentner, D. Green, A.J.K. and Wright, M.J. (2003) ‘Reduction of task-
and Goldin-Meadow, S. (eds.) Language in Mind: Advances in relevant information in skill acquisition’, European Journal of
the Study of Language and Thought, Cambridge, MA, MIT Cognitive Psychology, vol.15, no.2, pp.267–90.
Press. Haider, H. and Frensch, P.A. (1996) ‘The role of informa-
Gentner, D. and Gentner, D.R. (1983) ‘Flowing waters or tion reduction in skill acquisition’, Cognitive Psychology,
teeming crowds: mental models of electricity’, in Gentner, D. vol.30, no.3, pp.304–37.
and Stevens, A.L. (eds.) Mental Models, Hillsdale, NJ, Lawrence Haider, H. and Frensch, P.A. (1999a) ‘Eye movement dur-
Erlbaum Associates. (Reprinted in Brosnan, M.J. (ed.) ing skill acquisition: more evidence for the information reduc-
Cognitive Functions: Classic Readings in Representation and tion hypothesis’, Journal of Experimental Psychology: Learning,
Reasoning, Eltham, London, Greenwich University Press.) Memory, and Cognition, vol.25, no.1, pp.172–90.
Gentner, D. and Markman, A.B. (1997) ‘Structure mapping Haider, H. and Frensch, P.A. (1999b) ‘Information reduc-
in analogy and similarity’, American Psychologist, vol.52, no.1, tion during skill acquisition: the influence of task instruction’,
pp.45–56. Journal of Experimental Psychology: Applied, vol.5, no.2,
Gentner, D., Bowdle, B., Wolff, P., and Boronat, C. (2001) pp.129–51.
‘Metaphor is like analogy’, in Gentner, D., Holyoak, K.J., and Hall, T. (1970) Carl Friedrich Gauss: A Biography (trans-
Kokinov, B.N. (eds.) The Analogical Mind: Perspectives from lated by A. Froderberg), Cambridge, MA, MIT Press.
Cognitive Science, Cambridge, MA, MIT Press. Holding, D.H. (1985) The Psychology of Chess Skill,
German, T.P. and Barrett, H.C. (2005) ‘Functional fixed- Hillsdale, NJ, Erlbaum.
ness in a technologically sparse culture’, Psychological Science, Holding, D.H. and Reynolds, R.I. (1982) ‘Recall or evalua-
vol.16, pp.1–5. tion of chess positions as determinants of chess skill’, Memory
Gick, M.L. and Holyoak, K.J. (1980) ‘Analogical problem and Cognition, vol.10, pp.237–42.
solving’, Cognitive Psychology, vol.12, pp.306–55. Holyoak, K.J. and Koh, K. (1987) ‘Surface and structural
Gilhooly, K.J., McGeorge, P., Hunter, J., Rawles, J.M., Kirby, similarity in analogical transfer’, Memory and Cognition,
I.K., Green, C., and Wynn, V. (1997) ‘Biomedical knowledge vol.15, pp.332–40.
332 PART 4 THINKING
Holyoak, K.J. and Thagard, P. (1989) ‘A computational computer programmers’, Cognitive Psychology, vol.13,
model of analogical problem solving’, in Vosniadou, S. and A. pp.307–25.
Ortony (eds.) Similarity and Analogical Reasoning, Cambridge, Neisser, U., Novick, R., and Lazar, R. (1963) ‘Searching for
MA, Cambridge University Press. ten targets simultaneously’, Perceptual and Motor Skills, vol.17,
Jeffries, R., Polson, P.G., Razran, L., and Atwood, M.E. pp.955–61.
(1977) ‘A process model for missionaries-cannibals and Noice, H. and Noice, T. (2006) ‘Artistic performance: act-
other river crossing problems’, Cognitive Psychology, vol.9, ing, ballet and contemporary dance’, in Ericsson, K.A.,
pp.412–20. Charness, N., Feltovich, P.J. and Hoffman, R.R. (eds.) The
Jones, G. (2003) ‘Testing two theories of insight’, Journal of Cambridge Handbook of Expertise and Expert Performance,
Experimental Psychology: Learning, Memory and Cognition, Cambridge, Cambridge University Press.
vol.29, pp.1017–27. Ohlsson, S. (1992) ‘Information processing explanations of
Keane, M. (1988) Analogical Problem Solving, Chichester, insight and related phenomena’, in Keane, M.T. and Gilhooly,
Ellis Horwood. K.J. (eds.) Advances in the Psychology of Thinking, London,
Keane, M.T. (1994) ‘Constraints on analogical mapping: a Harvester Wheatsheaf.
comparison of three models’, Cognitive Science, vol.18, no.3, Ormerod, T.C., MacGregor, J.N., and Chronicle, E.P. (2002)
pp.387–438. ‘Dynamics and constraints in insight problem solving’, Journal
Knoblich, G., Ohlsson, S., Haider, H., and Rhenius, D. of Experimental Psychology: Learning, Memory, and Cognition,
(1999) ‘Constraint relaxation and chunk decomposition in vol.28, no.4, pp.791–9.
insight problem solving’, Journal of Experimental Psychology: Rattermann, M.J. and Gentner, D. (1998) ‘More evidence
Learning, Memory and Cognition, vol.25, no.6, pp.1543–55. for a relational shift in the development of analogy: children’s
Kolers, P.A. (1975) ‘Memorial consequences of automa- performance on a causal-mapping task’, Cognitive Develop-
tized encoding’, Journal of Experimental Psychology: Human ment, vol.13, pp.453–78.
Learning and Memory, vol.1, pp.689–701. Renkl, A. (1997) ‘Learning from worked-out examples: a
Larkin, J., McDermott, J., Simon, D.P., and Simon, H.A. study of individual differences’, Cognitive Science, vol.21, no.1,
(1980) ‘Models of competence in solving physics problems’, pp.1–29.
Cognitive Science, vol.4, pp.317–45. Schoenfeld, A.H. and Herrmann, D.J. (1982) ‘Problem per-
Lesgold, A.M., Rubinson, H., Feltovich, P.J., Glaser, R., ception and knowledge structure in expert and novice math-
Klopfer, D., and Wang, Y. (1998) ‘Expertise in a complex ematical problem solvers’, Journal of Experimental Psychology:
skill: diagnosing X-ray pictures’, in Chi, M.T.H., Glaser, R., Learning, Memory and Cognition, vol.8, no.5, pp.484–94.
and Farr, M. (eds.) The Nature of Expertise, Hillsdale, NJ, Schraagen, J.M. (1993) ‘How experts solve a novel problem
Erlbaum. in experimental design’, Cognitive Science, vol.17, no.2,
Logan, G.D. (1988) ‘Toward an instance theory of automa- pp.285–309.
tization’, Psychological Review, vol.95, pp.492–527. Schultetus, S. and Charness, N. (1999) ‘Recall vs. position
Luchins, A.S. and Luchins, E.H. (1959) Rigidity of evaluation revisited: the importance of position-specific
Behaviour, Eugene, OR, University of Oregon Press. memory in chess skill’, American Journal of Psychology,
Luger, G.F. (1976) ‘The use of state-space to record the vol.112, no.4, pp.555–69.
behavioural effects of subproblems and symmetries on the Schunn, C.D. and Anderson, J.R. (1999) ‘The generality/
Tower of Hanoi problem’, International Journal of Man- specificity of expertise in scientific reasoning’, Cognitive
Machine Studies, vol.8, pp.411–21. Science, vol.23, no.3, pp.337–70.
Lung, C-T. and Dominowski, R.L. (1985) ‘Effects of strat- Simon, H.A. and Chase, W.G. (1973) ‘Skill in chess’,
egy instructions and practice on nine-dot problem solving’, American Scientist, vol.61, pp.394–403.
Journal of Experimental Psychology: Learning, Memory, and Simon, H.A. and Hayes, J.R. (1976) ‘The understanding
Cognition, vol.11, pp.804–11. process: problem isomorphs’, Cognitive Psychology, vol.8,
MacGregor, J.N., Ormerod, T.C., and Chronicle, E.P. (2001) pp.165–90.
‘Information-processing and insight: a process model of per- Simon, H.A. and Reed, S.K. (1976) ‘Modelling strategy shifts
formance on the nine-dot and related problems’, Journal of on a problem solving task’, Cognitive Psychology, vol.8, pp.86–97.
Experimental Psychology: Learning, Memory and Cognition, Snoddy, G.S. (1926) ‘Learning and stability’, Journal of
vol.27, pp.176–201. Applied Psychology, vol.10, pp.1–36.
McKeithen, K.B., Reitman, J.S., Rueter, H.H., and Hirtle, Spellman, B.A. and Holyoak, K.J. (1992) ‘If Saddam is
S.C. (1981) ‘Knowledge organization and skill differences in Hitler then who is George Bush? Analogical mapping between
CHAPTER 10 PROBLEM SOLVING 333
systems of social roles’, Journal of Personality and Social Vollmeyer, R., Burns, B.D., and Holyoak, K.J. (1996) ‘The
Psychology, vol.62, pp.913–33. impact of goal specificity on strategy use and the acquisition of
Sternberg, R.J. (1995) ‘Expertise in complex problem solv- problem structure’, Cognitive Science, vol.20, pp.75–100.
ing’, in Frensch, P.A. and Funke, J. (eds.) Complex Problem Voss, J.F., Greene, T.R., Post, T.A., and Penner, B.C. (1983)
Solving, Hillsdale, NJ, Erlbaum. ‘Problem solving skill in the social sciences’, in Bower, G. (ed.)
Sweller, J. (1988) ‘Cognitive load during problem solv- The Psychology of Learning and Motivation, vol.17, New York,
ing: effects on learning’, Cognitive Science, vol.12, no.2, Academic Press.
pp.257–85. Weisberg, R.W. and Alba, J.W. (1981) ‘An examination of
Sweller, J., Mawer, R.F., and Ward, M.R. (1983) the alleged role of “fixation” in the solution of several “insight”
‘Development of expertise in mathematical problem solving’, problems’, Journal of Experimental Psychology: General,
Journal of Experimental Psychology: General, vol.112, no.4, vol.110, pp.169–92.
pp.639–61. Wolff, P. and Gentner, D. (2000) ‘Evidence for role-neutral
Thomas, J.C. Jr. (1974) ‘An analysis of behaviour in the hob- initial processing of metaphors’, Journal of Experimental
bits–orcs problem’, Cognitive Psychology, vol.6, pp.257–69. Psychology: Learning, Memory, and Cognition, vol.26, pp.529–41.
Thorndyke, P.W. and Stasz, C. (1980) ‘Individual differ- Zhang, J. and Norman, D.A. (1994) ‘Representations in
ences in procedures for knowledge acquisition from maps’, distributed cognitive tasks’, Cognitive Science, vol.18, no.1,
Cognitive Psychology, vol.12, pp.137–75. pp.87–122.
J U DG EMENT
AND DECI SION
MAK ING
Peter Ayton
1 INTRODUCTION
How do people make judgements and decisions? The This influence from outside psychology left its
question has become a steadily increasing preoccupa- mark – mathematicians and economists have differ-
tion of cognitive psychology. Plainly, making decisions ent concerns to psychologists. The question posed
is a fundamental and everyday human and animal and pursued by thinkers from outside psychology
(and perhaps machine) activity. Yet, until the 1950s was not how do people actually make decisions but
psychologists had hardly given the question any seri- how, ideally, should decisions be made? What are
ous thought. Doubtless this had something to do with good judgements and decisions and how should we
the dominance of the behaviourist school of thought recognize them? As we will see, behavioural judge-
throughout the first half of the twentieth century. The ment and decision research – the investigation of how
behaviourists assumed that human behaviour could be people make decisions – has been strongly influenced
explained entirely in terms of reflexes, stimulus– by a fundamental underlying premise: that the objec-
response associations, and the effects of reinforcers tive of decision making should be to make the ‘best’
upon them. Accordingly, they shunned the study of choice, and that the best choice can, by some method,
mental processes and entirely excluded ‘mental’ terms be computed.
like desires and goals. As a historical consequence, the Judgement and decision making are sometimes dis-
foundations of decision research, and hence its con- tinguished on the basis that judgements are what
temporary shape, have been strongly influenced by underlie decisions. Judgements can be estimates of
thinking from disciplines outside psychology – specifi- some objective quantity – how far away is this object?
cally from mathematics and economics. How dangerous is that hobby? Decisions typically
CHAPTER 11 JUDGEMENT AND DECISION MAKING 335
reflect judgements of the qualities of options – but also absurd; for instance, human memory is manifestly fal-
the preferences of the decision maker. lible and yet we do not conclude from this that peo-
Of course, real people are not idealized decision- ple’s memories are inherently inadequate for the
making machines or supercomputers; they do not purpose of living their lives.
have unlimited time, knowledge, and computational While persistent errors of judgement or choice could
power but a rather limited information-processing be taken to indicate a fundamental irrationality,
capacity. Accordingly, not infrequently, people make researchers in judgement and decision making have
mistakes – for example, they may overlook or forget tended to adopt a similar position to researchers work-
important considerations; they also get bored, suffer ing in vision. For instance, vision scientists do not con-
anxiety, and may not always be sure quite what they clude from the robustness of the Müller–Lyer illusion
want or are trying to achieve. As a consequence, what (see Chapter 3, Section 1) that people are generally
people do is not always quite the same as what they poor at inferring object lengths – let alone that visual
themselves would agree that they should do. perception is fundamentally incompetent. Nevertheless,
as we will see, people do make judgements and deci-
sions that are inconsistent with normative theory.
Theories of decision
1.1
making Supporting decision
1.2
Psychologists are of course interested in understanding making
what people actually do, but this has very often been
studied in comparison to what it has been assumed they If people don’t behave as normative theories prescribe,
should do. As a result, there are two types of theory of what can be done about it? What should people do to
decision making – the ‘ought’ and the ‘is’ – commonly make better choices? What instruction, modes of
referred to as normative and descriptive theories thinking, or decision aids can help real people to make
respectively. Normative theories define the supposed better decisions? A third strand of research straddling
ideal decision while descriptive theories attempt to the normative and descriptive – the prescriptive
characterize how people actually make decisions. approach – investigates how to help people make bet-
The very existence of this dichotomy suggests that ter decisions. One prescriptive approach is decision
perhaps human decision making is faulty. Indeed, analysis. Decision analysis is the attempt to help peo-
debating whether or not people are essentially rational ple to make better decisions that conform to norma-
or irrational decision makers has long been a preoc- tive theory. However, decision analysis is more than
cupation of researchers in this field (see Cohen, 1981), just that; helping people to understand and explicate
just as the rationality of thought has been a key con- their own objectives and values, search for options
cern for researchers studying human reasoning (as and evidence, and appreciate their implications is not
you will see in Chapter 12). However, noting a dispar- a straightforward matter. Decision analysis uses a
ity between the ideal and the actual should not, in number of techniques, including decision trees (which
itself, cause us to leap to the conclusion that there is you will meet in Section 2.1), to help people decom-
something fundamentally wrong with the way people pose complex decisions into more manageable com-
make judgements and decisions. In other areas of cog- ponents, elicit values and beliefs for the elements, and
nitive psychology, such a step would be seen as clearly apply normative principles to their reintegration.
SUMMARY OF SECTION 1
• Judgements underlie decisions.
• Researchers distinguish between actual (descriptive) and ideal (normative) decision making.
• Decision analysis can support people in making better decisions – a prescriptive approach.
336 PART 4 THINKING
Rain
(p = 0.3) 0
Picnic Overcast
(p = 0.5) 40
Sunny
(p = 0.2) 100
Rain
(p = 0.3) 75
Essay Overcast
(p = 0.5) 30
Sunny
(p = 0.2) 20
FIGU RE 11.1 Decision tree for deciding whether to go on a picnic or write an essay.
affect the value or utility of the resulting six identifiable We also need likelihoods for the three different
outcomes. Of course, there could be many more weather conditions. In some countries weather fore-
options (students’ weekend options involve more than casters routinely broadcast these, but as long as they
essays and picnics) and possible future conditions accurately reflect our real beliefs, we could use our
(there may well be more than the weather to consider). own judgements. Decision theory can only tell you
The utilities, as in this case, will often reflect subjective how to decide given your beliefs about the utility and
evaluations of the quality of the outcomes – though for likelihood of the relevant events. With these data, we
business or financial decisions they might reflect mon- can now compute the expected utility of the two
etary profits. Here, the scale for utility is arbitrary – let’s actions identified in the tree. The expected utility of
suppose the student was asked to rate each of the six each outcome is defined as the probability or likeli-
possible outcomes on a 0–100 scale, assigning 0 to the hood of that outcome (P) multiplied by its utility (U).
worst outcome, 100 to the best, and scaling the others The expected utility of an action is the sum of such
relative to those. A picnic in the sun is rated the best expected utilities for each of the possible outcomes. So,
outcome and a picnic in the rain the worst. Writing an the expected utility of the picnic action is the sum of
essay at home is affected by the weather, albeit differ- the expected utilities for the rainy picnic, the overcast
ently, because, as any student knows, a sunny day is the picnic, and the sunny picnic:
worst time to have to stay in and work – especially if
you know your friends are out having fun. These fig- SEU ( picnic ) = ΣP × U = P (rainy picnic ) × U (rainy picnic )
ures might not reflect your own utilities for these out- + P (overcast picnic) × U (overcast picnic)
comes – utility is personal. You might revel in rainy + P (sunny picnic) × U (sunny picnic)
picnics – if so, your utilities for this decision would be = (0.3 × 0) + (0.5 × 40) + (0.2 × 100)
quite different. = 40
338 PART 4 THINKING
That is, by multiplying the utility of each outcome the issues at hand. A good model captures the essential
by the likelihood of obtaining it, we can calculate that elements of a decision situation for the purposes of the
the expected utility for the picnic is 40. Similarly, we decisions to be made. An iterative procedure is fol-
can calculate that the expected utility for the essay is lowed, involving constructing the model, analysis,
41.5. Because the expected utility of the essay is model refinement, and subsequent re-analysis. At the
greater than that for the picnic, this student should point when no additional intuitions emerge from fur-
write the essay. ther analysis, the model is said to be requisite. The
The difference between 41.5 and 40 may seem claim is that this procedure helps to develop a shared
rather close, but remember that the numerical scales understanding and fosters commitment to the way for-
are arbitrary. In practice, a decision analyst using this ward. Note that these are social purposes. The techni-
procedure as part of the prescriptive approach to assist cal computations of a decision analysis are less than
decision making would go back and check that rea- half the story of improving decision making.
sonable variations in the values entered in the tree do Constructing representations of decisions and eliciting
not alter the decision. If they do, then the user must be values are not achieved by mechanical operations; they
sure that the numbers genuinely reflect their beliefs often involve deep thought – or what some (see Watson
and values. and Buede, 1987) call ‘soul searching’. Perhaps the
Since its initial inception, the role of decision analy- greatest virtue of decision analysis is that it obliges
sis has changed (Phillips, 1989). Nowadays, decision decision makers to make explicit all the bases of a
analysts view decision trees as tools to aid thinking, not decision.
as providing solutions (von Winterfeldt and Edwards, In the next section, we shall examine some of
1986). The theory of requisite decision modelling the principles underlying SEU, and consider the
(Phillips, 1984) claims that models of decisions need extent to which SEU accurately describes human
only be sufficient in structure and content to resolve decision making.
ACTIVIT Y 11.1
Axioms underlying
2.2 example, the comparability axiom is threatened by
claims that people may not be indifferent just because
subjective expected utility they are unable to say which of two states they prefer.
theory Curiously, even the original architects of the theory
admitted that it might not always be a reasonable
Mathematicians such as von Neumann and Savage assumption:
established that SEU is implied by the acceptance
of certain principles or axioms: comparability, tran- We have conceded that one may doubt whether a
sitivity, dominance, independence, and invariance. person can always decide which of two alterna-
According to SEU, if a decision maker violates one or tives . . . he prefers. If the general comparability
more of these axioms, then their choices will not max- assumption is not made, a mathematical theory . . .
imize expected utility and so will not be normative. is still possible.
The axioms therefore define a kind of coherence to (von Neumann and Morgenstern, 1944, pp.19–20)
our choices and give them internal consistency. We
shall look at them in more detail now: The axioms also seem to vary somewhat in their
intuitive appeal; while independence and transitivity
• Comparability (or completeness): If you have to
might not be obvious requirements for rational
evaluate two alternatives, A and B, you must be
choice, dominance and invariance appear essential.
able to say whether you:
Nonetheless, psychologists have shown that, under
1. prefer A to B, or certain conditions, systematic violations of each of
2. prefer B to A, or the axioms can be observed in people’s choices
(Tversky and Kahneman, 1986). Since violations of
3. are indifferent between A and B.
the axioms imply that people are not choosing
• Transitivity: If you prefer A to B and B to C, then according to the normative theory, we could con-
you must prefer A to C. That is, choices should be clude one of two things: either that there is some-
capable of being ordered. thing wrong with the choices or that there is
• Dominance: An option is dominant and must be something wrong with the normative theory (or
preferred if, when compared to another option, it perhaps both). In any case, as we shall now see,
is better in at least one respect and at least as good SEU does not provide a good description of actual
or better in every other respect. Dominated options human choices.
must never be preferred.
2.3.1 Violations of transitivity
• Independence: If there is some outcome that is
Observed violations of the transitivity axiom have
unaffected by, or independent of, your choice, then
generally led to the conclusion that people’s choices
this outcome should not affect your choice.
are not ideal. For example, Tversky (1969) asked peo-
• Invariance: Different representations of the same ple to state their preferences between pairs of college
choice problem should result in the same choices. applicants rated on three dimensions – intelligence,
That is, the preference for options should be emotional stability, and social facility (as in Table 11.1).
independent of how they are described. Now try Activity 11.2.
If people reliably mapped all the dimension scores
of each option onto a common currency of utility,
2.3 Violations of the axioms then systematic violations of transitivity would not
occur – so demonstrations of intransitive preference
Although the axioms might strike you as unconten- are revealing about the nature of the choice process.
tious and straightforward, they can be questioned. For For Tversky (1969, p.46), this was key: ‘The main
340 PART 4 THINKING
ACTIVIT Y 11.2
Consider the following pairs of applicants in Table 11.1: pair at a time, and were similarly told to weight intel-
A–B, B–C, C–D, D–E, and E–A. For each pair, ligence more than the other two dimensions. Subjects
write down which of the two applicants you would typically preferred A to B; B to C; C to D; and D to E.
prefer given their ratings. Do note, however, that However, violations of transitivity were demon-
you should weight intelligence more highly than strated by the typical simultaneous preference for E
either of the other dimensions. over A. Did your own preferences coincide with
these? If not, try to work out why Tversky’s subjects
COM M ENT
might have adopted the preferences they did.
Tversky’s subjects were presented with all possible
pairs of applicants (together with some others), one
TAB LE 11.1 Ratings of five applicants on three information) assumes that people have limited infor-
dimensions mation-processing capacity.
In relation to SEU, intransitivity is an irrational pat-
Applicant Intelligence Emotional Social
tern of choice, but it may be reassuring to note that it
stability facility
is not a uniquely human condition. For instance, in an
A 69 84 75 experiment where bees chose between artificial flow-
B 72 78 65 ers that offered varying amounts of nectar with vary-
C 75 72 55
ing degrees of accessibility, Shafir (1994) found that
D 78 66 45
they violated transitivity in their foraging preferences
E 81 60 35
for flowers. As bees have been successfully foraging
for millions of years it is tempting to assume that
interest in the present results lies not so much in the perhaps the costs – intransitive preferences cannot
fact that transitivity can be violated but rather in what maximize expected utility – are outweighed by the
these violations reveal about the choice mechanism.’ gains – presumably, reduced information processing.
Tversky suggested ways in which decision making When confronted with evidence of intransitivity in
might be rendered less cognitively demanding by their choices, people typically immediately concede
applying decision rules that simplify the task. He that there is some inconsistency and are usually will-
offered two hypotheses about the choice process: (1) ing to change their choices to preserve transitivity.
people compare the alternatives on each dimension in Hence, they seem to endorse the normative status of
turn, rather than evaluating each option on all dimen- the axiom even though their violations show that
sions before comparing overall evaluations; and (2) transitivity is not descriptive of human choice.
people ignore dimensions on which the alternatives –
even if discriminable – are rated similarly. 2.3.2 Violations of the independence axiom
For example, when comparing successive pairs in the Violations of the independence axiom are more prob-
chain (such as A and B) on intelligence, subjects may lematic, and have proved a serious challenge to both
decide that the difference between them is negligible – the normative and descriptive status of SEU. The first
and so, in the interests of simplifying the decision, challenge came from the French economist and Nobel
ignore it altogether. However, small differences add laureate Maurice Allais, who published a paper in
up – at the ends of the chain the difference in intelli- 1953 describing what is now called the Allais paradox
gence between A and E is too big to ignore – hence, the (Allais, 1953; 1979).
observed pattern of intransitivity. Note that this expla- Allais observed that people are reluctant to
nation (that people try to simplify decisions by ignoring exchange a certain prospect of something wonderful
CHAPTER 11 JUDGEMENT AND DECISION MAKING 341
(e.g. receiving $1,000,000) for a not quite certain pros- choices were wrong and that the theory was norma-
pect of something even more wonderful (e.g. 99 per tively correct.
cent chance of receiving $5,000,000). The paradox When made aware that they are violating the inde-
occurs because if both the above prospects are reduced pendence axiom, people sometimes alter their choices
in likelihood by a similar amount (so that neither to conform to it (Keller, 1985) but sometimes – even
offers certainty) people are usually willing to exchange after a thorough explanation of its virtues – they don’t
a smidgen of likelihood for a substantial increase in (Slovic and Tversky, 1974). Slovic and Tversky sug-
benefit. Box 11.1 shows how this is a problem for SEU. gested that people may alter their choices to concur
Allais made it perfectly clear that he considered that with the axiom not through appreciating the merits of
the intuitions that produced the paradox should over- doing so, but because they might be intimidated by
rule the independence axiom; that is, the normative the suggestion that not doing so would be irrational.
theory was not valid. He even claimed: ‘It is quite dis- Their paper concludes with a delightful imaginary
appointing to have to exert so much effort to prove the debate between Savage and Allais wherein Savage
illusory character of a formulation whose over-simpli- insists that people only reject the axiom when they do
fication is evident to anyone with a little psychological not understand it, while Allais (who plausibly claimed
intuition’ (Allais and Hagen, 1979, p.105). Others, to both understand and reject the axiom) asks how
including Savage (who, embarrassingly, initially suc- Savage could distinguish between failure to under-
cumbed to the paradox in his own choices), felt differ- stand the axiom and enlightened rejection of it. The
ently and argued that the intuitions underlying the debate highlights an irresolvable conflict between two
Table 11.2 shows two separate situations where you prospect of getting nothing at all in order to have a
can choose to take part in one of two lotteries and chance of winning $5,000,000. To see how this vio-
draw one ticket from the lottery you choose. In lates the independence axiom, simply cover up the
Situation 1 you can choose between lotteries A and last column – now the two situations appear identi-
B. If you are like most people you would choose A, cal. As the contents of the last column are identical
as this guarantees $1,000,000. B could deliver for A and B in Situation 1 (i.e. $1,000,000), and also
$5,000,000 but there is a small chance of ending up for C and D in Situation 2 ($0), then, according to
with nothing at all. the axiom, the information in this column should
However, when faced with the choice in Situation not influence your choice. So, if you prefer A to B,
2, between C and D, most people prefer D – now you should also prefer C to D.
they are willing to face a very slight increase in the
TAB LE 11. 2 The Allais paradox as a choice of lotteries: each lottery involves 100 tickets. The table shows the
number of tickets that win anything from $0 to $5,000,000
1 2–11 12–100
different intuitions – those that support the axiom and status of SEU and its axioms is not in any sense a
those that support the pattern of choices in the Allais demonstrable truth – they only appeal (or not) as
paradox. Ultimately, rather like the Ten Command- principles to live by.
ments (which are also often violated), the normative
SUMMARY OF SECTION 2
• SEU provides a normative theory of decision making under uncertainty.
• Decision analysis offers a prescription for making decisions using SEU.
• Conforming to SEU is equivalent to adhering to certain axioms.
• Human decision making has been shown to violate these axioms, implying that it is not adequately
described by SEU.
Gamble A Gamble B
(p = 0.6) (p = 0.2)
£2.00 £14.00
(p = 0.4) (p = 0.8)
£4.00 £0.00
their choices between gambles. Later, Lichtenstein $ bet: 2/12 chance of winning 79 chips
et al. (1969) found that expected value is irrelevant 10/12 chance of losing 5 chips
even when the concept was carefully explained to
respondents. These two gambles were chosen equally often by the
casino subjects; however, the $ bet received a higher
selling price about 88 per cent of the time. Among
The ‘preference reversal
3.1
those choosing the p bet, 87 per cent gave a higher
phenomenon’ selling price to the $ bet. So, people value the $ bet
more highly than the p bet, but don’t prefer the $ bet
Far worse was to come for SEU, however, when the any more than the p bet. From a rational perspective
preference reversal phenomenon was discovered. this is a hopeless pattern of behaviour.
Slovic and Lichtenstein (1968) had noticed that ratings The finding, replicated numerous times since
of a gamble’s attractiveness, as well as choices between (Slovic, 1995), clearly poses a major threat to the SEU
pairs of gambles, were strongly influenced by the prob- view of rational choice. Two economists, Grether and
ability of winning and losing. Yet when asked how Plott (1979, p.623), realizing that: ‘it suggests that no
much they would be willing to pay in order to take the optimisation principle of any sort lies behind even the
gamble, or the smallest amount they would be willing simplest of human choices’, conducted a series of stud-
to sell the gamble for, people were more heavily influ- ies ‘designed to discredit the psychologists’ works as
enced by the amounts that could be won or lost. applied to economics’. However, even after controlling
Lichtenstein and Slovic (1973) realized that if there was for all the economic explanations of the phenomenon
a different basis for choosing than for valuing, it should that they could find – including that the experiment
be possible to construct pairs of gambles so that people be conducted by economists rather than psychologists
would prefer A to B but pay more for B than A. They (‘Psychologists have the reputation for deceiving sub-
were able to demonstrate this effect in a series of stud- jects’, p.629) – the reversals persisted.
ies – including one conducted with real gambles in a
Las Vegas casino. Typically, one bet would have a high
probability of winning a modest amount (called the ‘p
3.2Causes of anomalies
bet’) while the other would offer a lower probability of in choice
winning a higher amount (called the ‘$ bet’):
Why do preference reversals occur? Slovic (1995)
p bet: 11/12 chance of winning 12 chips
summarized the evidence in favour of a ‘scale compat-
1/12 chance of winning 24 chips ibility hypothesis’. The idea is that the weight of an
344 PART 4 THINKING
before items that do not. It seems that rather than TAB LE 11. 3 Attributes of two dictionaries in Hsee’s
ranking options in order, as mandated by SEU, people (1998) study
look for reasons for their decisions. This has led to the
Year of Number of Any
proposal of a reason-based theory of choice (Shafir publication entries defects?
et al., 1993), according to which reasons for choosing
No, it’s like
are more influential when we choose rather than Dictionary A 1993 10,000
new
reject, and reasons for rejecting are more influential
Yes, the
when we reject rather than choose.
cover is torn;
Failure to resolve conflict in choices can also be Dictionary B 1993 20,000
otherwise
revealing of reasoning. The economist, Thomas it’s like new
Schelling, tells of an occasion when he went to buy an
encyclopaedia for his children (see Shafir et al., 1993). tionary. In the joint-evaluation condition, partici-
At the bookshop he was presented with two attractive pants were shown two dictionaries, A and B (see
encyclopaedias and, finding it difficult to choose Table 11.3) and asked how much they would be will-
between them, went home with neither – despite feel- ing to pay for each. Willingness-to-pay was higher
ing that he would have happily bought either if it had for Dictionary B ($27) than A ($19), presumably
been the only one available. Unresolved conflict can because of its greater number of entries. However, in
cause people to defer choosing because they lack a the single evaluation condition, when one group of
clear reason to select either option. participants evaluated only A and another group
evaluated only B, the mean willingness-to-pay was
3.2.3 The ‘evaluability principle’ higher for A ($24) than B ($20).
Difficulty in interpreting value is addressed in a Hsee explains this reversal by means of the evaluabil-
study conducted by Hsee (1998), who has developed ity principle. He argues that, without a direct compari-
the notion of evaluability to explain a type of prefer- son, the ‘number of entries’ attribute is hard to evaluate
ence reversal that occurs when items are evaluated because the evaluator does not have a precise notion of
separately or jointly. For example, if shopping for a how good or how bad 10,000 (or 20,000) entries is.
piano in a musical instrument shop you might com- However, the ‘defects’ attribute is evaluable because it
pare several pianos. At an auction or second-hand translates easily into a precise good/bad response –
shop, however, you might have to consider a single most people find a defective dictionary unattractive
piano. Hsee argues that attributes vary in how easy or and a like-new one attractive – and thus it carries more
difficult they are to evaluate, and that their evaluabil- weight in the independent evaluation. Under joint
ity varies according to whether options are consid- evaluation, however, the buyer can see that B is far
ered in isolation or in relation to other options. In superior on the more important attribute, number of
one experiment Hsee asked people to assume they entries. Thus, the ‘number of entries’ attribute becomes
were music students looking for a used music dic- evaluable through the comparison process.
SUMMARY OF SECTION 3
• Preference reversals illustrate that SEU fails to predict aspects of human decision making.
• The prominence and evaluability of attributes, and whether a task involves choosing or rejecting,
have been shown to influence people’s choices, effects not predicted by SEU.
346 PART 4 THINKING
4 PROSPECT THEORY
v($)
One important general conclusion that follows from
these demonstrations of anomalies in choice is that
people don’t have a set of pre-existing stable values
(that is, preferences) that they simply apply to choice
situations. What is evident is that decisions change
because the underlying bases of decisions change
according to the demands of the decision task and the
nature and context of the information presented. The $
unstable nature of preferences raises difficult – per-
haps even unsolvable – questions regarding people’s
preferences. If different procedures for eliciting pref-
erences elicit different choices, then how can prefer-
ences be defined and how should they be measured?
Kahneman and Tversky (1979) have proposed a
descriptive model for decision making under risk,
FIGU RE 11. 3 The value function in prospect theory
called prospect theory, which explains many of the
showing the subjective value of a gain or loss as a
phenomena that cannot be accounted for by SEU. function of the actual or objective amount of gain
Unlike SEU, prospect theory does not define ideal or loss.
choices. It is a descriptive not a normative theory,
intended to account for human choices. Prospect the-
between $0 and $10 is greater than that between $100
ory is essentially an adapted version of SEU, which is
and $110. Notice that there is a similar effect for
modified so as to account for the observed discrepan-
losses – the slope to the left of the origin shows that
cies with SEU. Prospect theory identifies two phases to
losses also diminish in a similar fashion. As the slope
the choice process:
is not uniform, your attitude to risks varies as a func-
1. In the editing phase, the decision problem is tion of where you see yourself on the curve. For con-
represented; ‘negligible’ components may be templating gains (to the right of the origin) decisions
discarded and a reference point is used to enable will tend to be risk averse – most people decline to risk
decision outcomes to be construed as ‘gains’ a gain of $10 for a 50 per cent chance of winning $20.
or ‘losses’. By contrast, with losses (to the left of the origin) deci-
sions tend to be risk seeking – in order to avoid a sure
2. In the second evaluation phase, attitudes towards
loss of $10, most people would be tempted to risk a 50
risks involving gains and losses are used to
per cent chance of losing $20.
evaluate the identified prospects.
4.3 ‘Framing’ effects with the shape of the value function. With gains, the
reference point is defined by what will happen if
Kahneman and Tversky have reported numerous nothing is done: 600 dead. Programme A looks
experiments demonstrating phenomena not antici- attractive as it definitely saves 200 while Programme
pated by SEU but predicted by prospect theory. B risks a two-thirds chance of saving nobody. The
For example, the idea that gains and losses are deter- relative over-weighting of certainty will also contrib-
mined by application of a reference point predicts ute to the relative attractiveness of the sure gain of
framing effects. Tversky and Kahneman (1981) asked Programme A. In the domain of loss, the reference
respondents to imagine that the USA was preparing point is defined by the present: nobody has yet died.
for the outbreak of an unusual disease expected to kill Programme D is more attractive as, because of the
600 people. Two alternative programmes had been shape of the value function 600 deaths are not seen as
proposed to combat the disease: substantially worse than 400, and it offers a chance
that nobody will die.
• If Programme A is adopted, 200 people will be Prospect theory is supported by a large number of
saved. laboratory studies as well as data from field studies (see
• If Programme B is adopted, there is a one-third Camerer, 2000), which avoid some of the doubts that
probability that 600 people will be saved and a economists have about laboratory studies (recall
two-thirds chance that no people will be saved. Grether and Plott’s 1979 scepticism about preference
reversals). For example, Camerer et al. (1997) studied
You should note that the options are described in New York cab drivers. Many said that they set an earn-
terms of gains – the number of lives that might be ings target for the day and quit once they met it. This
saved. Of the respondents, 72 per cent chose sounds sensible: target setting can be motivating for
Programme A and 28 per cent chose Programme B – unpleasant or tedious activities, like exercise or exam
definitely saving 200 lives is seen as more attractive revision. However, as a result, the drivers quit earlier on
than a one-third chance of saving 600 lives. For gains, days when it was easier to get fares (more people want
as we saw in Figure 11.3, people are risk averse – as a cabs on rainy days, for example) – which is quite coun-
result, gains that are certain are more attractive than a ter to their economic interests. If instead they had quit
gamble of equal expected value. early on slow days and worked longer hours on good
A second group of respondents was presented with days, they could have earned 8 per cent more. Camerer
a different description of the two programmes: et al. attribute this to loss aversion: drivers hate to quit
before they reach the target (a ‘loss’) but, once they
• If Programme C is adopted, 400 people will die. reach it, they aren’t as enthusiastic about trying to go
• If Programme D is adopted, there is a one-third beyond, (a ‘gain’). The cab drivers’ irrationality doesn’t
probability that nobody will die and a two-thirds just punish themselves: on busier days it will be even
chance that 600 people will die. harder for customers to find a cab.
gamble – a result that prospect theory explains by assum- some calling for a different theory of choice for expe-
ing that people over-weight small probabilities. However, rience-based decisions (Hertwig et al., 2004) and oth-
recently evidence has emerged that if people learn about ers arguing that the difference is due to insufficient
the likelihoods of decision outcomes via experience – sampling of rare outcomes in experience-based deci-
instead of by reading descriptions – they have different sions (Hadar and Fox, 2009) or memory limitations
preferences. In experiments where subjects learned (see Rakow et al., 2008). Others claim that sampling
about each option by pressing unmarked buttons and and memory effects cannot account for it (Ungemach
sampling the outcomes until they felt ready to choose, et al., 2009). Is this a problem for prospect theory? The
people preferred the $1 for sure (e.g. Hertwig et al., 2004). answer is not yet clear but it is obviously important;
This looks like under-weighting of small probabilities – although most experiments have tested described
the opposite of prospect theory’s prediction. decisions, most of our choices in life are made without
The reason for this difference is the subject of much the benefit of described probabilities and we must rely
debate – see Rakow and Newell’s (2010) review – with on experience.
SUMMARY OF SECTION 4
• Prospect theory can account for an enormous range of observed anomalies in choice, both in labora-
tory experiments and in field data representing real-life decisions.
• People feel losses more than they do gains of equivalent value.
• Framing of options influences preference patterns.
• Experience-based decisions show under-weighting of small likelihoods, counter to the predictions of
prospect theory and yet to be satisfactorily accounted for.
5JUDGEMENT UNDER
UNCERTAINT Y
As noted earlier, judgement and choice can be distin- book bag and poker chip paradigms. A typical experi-
guished on the basis that judgements are what under- ment would involve two opaque bags. Each bag con-
lie choices. To compute the ideal choice, the normative tained 100 coloured poker chips in different but stated
theory requires inputs of value and likelihood, which proportions of red to blue. Suppose Bag A contains 70
typically will be judgements by decision makers. red and 30 blue chips, while Bag B contains 30 red and
Plainly, evaluating likelihood is a crucial prerequisite 70 blue chips. The experimenter first chooses one bag at
for effective decision making under uncertainty. For random and then draws a series of chips from it. After
this reason, research on judgement of likelihood has a each draw, the poker chip is replaced and the bag well
particular significance. shaken before the next chip is drawn. The subjects’ task
is to say how confident they are – in probability terms
Judging probabilities and
5.1 – that the chosen bag is A, containing predominantly
red chips, or B, containing predominantly blue chips.
Bayes’ Theorem Bayes’ Theorem can be used to calculate how the
objective probabilities change after each piece of new
In the 1960s, Ward Edwards and his colleagues con- information, and so can be used to evaluate human
ducted a number of studies using what were called the performance (see Box 11.2). Where the two competing
350 PART 4 THINKING
So, how good are people at judging probabilities? In You should note that p(H|D) stands for the proba-
order to work this out, we can try using an objec- bility that the hypothesis is true, given that the
tive standard to which we can compare human per- datum or information D is true (read the vertical line
formance. One early benchmark used for this as ‘given’). Then, reading the formula from left to
purpose was Bayes’ Theorem (which you will also right, the three terms are:
meet in Chapter 12), a mathematical formula used –
1 The posterior odds ratio of H and H (not H)
for combining probabilities; it is of interest to deci-
being true given D.
sion makers as it can be used as a normative theory
2 The likelihood ratio, representing the informa-
for how degrees of belief in a hypothesis might be
tion value of D (the datum or information).
revised in the light of new information. –
3 The prior odds of H and H (not H) being true
Bayes’ Theorem states that the odds of a hypoth-
before D is known.
esis being correct in the light of new information
(posterior odds) is the product of two elements: If the probability of observing D when H is true is
(1) the prior odds (the initial odds) of the hypothe- different from the probability of observing D when
–
sis being correct before the information is observed, H is not true, then the information is diagnostic and
multiplied by (2) the likelihood ratio – the ratio of the posterior odds will be different to the prior
the probabilities that, given the information, the odds. The equation can be applied to any pair of
– competing hypotheses (A and B) by replacing H and
hypothesis is correct (H) or incorrect (H ).
–
H with A and B.
p(H | D) p(D | H ) p(H )
= ×
p(H | D) p(D | H ) p(H )
(H = hypothesis; D = datum)
hypotheses are that the bag is A and the bag is B, and Therefore, the odds for Bag A over Bag B after drawing
the information is the drawing of a red chip, Bayes’ one red chip are 0.35:0.15 or, converting these into
Theorem gives the following equality: percentage probabilities, 70 per cent for Bag A and 30
per cent for Bag B. Bayes’ Theorem can then be used
P ( A | RED) P (RED | A) p( A)
= × after each subsequent drawing of a chip to calculate
P (B | RED) P (RED | B) p(B)
how these probabilities should change.
where p(A|RED) stands for the probability that the Thus, for example, following the drawing of the red
bag is A, given that a red chip has been drawn. chip and prior to drawing a second chip, our new prior
Prior to drawing any chips, the probability that the odds ratio is 0.7 . If we replaced the red chip and shook
0.3
bag is A and that the bag is B is 0.5 for both; if we draw the bag so that the probabilities of drawing a red and
one red chip the likelihood of this is 0.7 for Bag A and blue chip remained as before, the impact of drawing a
0.3 for Bag B. We can substitute these values into second chip would now be applied to our new prior
Bayes’ Theorem: ratio to compute another posterior odds ratio. If it was
yet another red chip, belief in Bag A would be
p( A | RED) 0.7 0.5 0.7 0.7 0.49
× = – roughly 85%:15% – even more favour-
= × 0.3 0.3 0.09
p(B | RED ) 0.3 0.5 able for Bag A. If the second chip was blue, the informa-
tion for each bag would be equivocal – our new
p( A | RED) 0.35
= posterior odds ratio would be 00..73 × 00..73 = 00..21
21
that is,
p(B | RED ) 0.15
50:50 odds that it is Bag A or Bag B.
CHAPTER 11 JUDGEMENT AND DECISION MAKING 351
A crucial aspect of the logic of these studies is that then there wouldn’t be much point in devising sys-
the experimenter is able to compare the subjective tems to help them to combine them. ‘Garbage in –
probabilities estimated by subjects with the objective garbage out’ was a popular aphorism for summarizing
probabilities calculated using Bayes’ Theorem. All of this possibility.
the information required as inputs to Bayes’ Theorem is However, before any firm conclusions were reached
explicit and unambiguous. Ironically, though, this as to the cause of conservatism, the research exploring
underplays the importance of the subjectivity of the the phenomenon fizzled out. Two reasons for this can
probabilities. Because the experimenters assumed that be identified. One cause (which we will consider in
they could objectively compute the correct answer, they Sections 5.3 and 5.4) was the emergence of research
reasoned that the subjective probabilities should be the into heuristics and biases and, in particular, the dis-
same for all subjects faced with the same evidence. covery of what Kahneman and Tversky (1973) called
Calculating the objective probabilities and using them base-rate neglect. Before this development, however,
as a comparison was absolutely necessary in order to be growing disquiet was being voiced about the validity
able to assess the accuracy of people’s judgements. of book bag and poker chip experiments for assessing
However, it also indicates the artificiality of this kind of judgement.
task, and is at the root of the difficulties that were to Several studies had shown that quite subtle differ-
emerge with interpreting subjects’ behaviour. ences in the way that the tasks were presented to sub-
jects resulted in considerable variability in the amount
of conservatism. For example, the diagnosticity of the
Does Bayes’ Theorem
5.2
data seemed an important variable. Diagnosticity of
describe human judgement? information means how much impact it has on opin-
ion revision. Diagnosticity is indicated by the likeli-
The experiments conducted with the procedure dis- hood ratio. Imagine, instead of our two bags with a
cussed above produced ample evidence that human 70/30 split in the proportions of blue and red poker
judgement under these conditions is not well chips, the bags contained 51 chips of one colour and
described by Bayes’ Theorem. Although subjects’ revi- 49 of the other. Clearly, two consecutive draws of a red
sions of their probability judgements were propor- chip would not be very diagnostic as to which of the
tional to the values calculated from Bayes’ Theorem, two bags was being sampled. Phillips and Edwards’
they did not revise their opinions sufficiently in the (1966) experiments showed that the more diagnostic
light of the evidence – a phenomenon that was labelled the information, the more conservative was the sub-
conservatism. The clear suggestion was that human ject. But when the information was very weakly diag-
judgement was poor, although there was some debate nostic, as in this particular example, human probability
as to the precise reason for this. Perhaps it was due to revision, far from being conservative, was too extreme.
a failure to understand the impact of the evidence or Another important factor was how the information
to an inability to combine the probability estimates was presented. Presenting information all at once or
according to Bayes’ Theorem. one bit at a time is irrelevant according to Bayes’
Aside from the theoretical interest in these possi- Theorem, but Peterson et al. (1965) found that pre-
bilities, there were practical implications of this senting one item of information at a time, eliciting
debate. If people are good at assessing probabilities revisions after each item, produced less conservatism
but poor at combining them (as Edwards, 1968 sug- than giving the same information all in one go. Pitz
gested) then perhaps they could be helped; a rela- et al. (1967) described this as an inertia effect: if an
tively simple remedy would be to design a support initial sequence of information favoured one of the
system that took the human assessments and com- hypotheses under evaluation, subjects tended not to
bined them using Bayes’ Theorem. However, if people reduce their belief when confronted with later con-
were poor at assessing the component probabilities, flicting information.
352 PART 4 THINKING
DuCharme and Peterson (1968) investigated prob- 2. In most experiments, the contents of the bags are
ability revision in a situation they considered nearer to fixed but in reality our hypotheses are not always
real life than the standard paradigm. Most experi- constant; indeed, evidence may cause us to change
ments, they complained, usually restricted informa- the set of hypotheses under consideration.
tion to one of two discrete possibilities (red or blue 3. In reality, information may be somewhat
chip). In the real world, information leading to revi- unreliable and therefore less diagnostic than the
sion of opinion does not have discrete values but var- perfectly reliable colours of the poker chips.
ies along a continuum. They gave their subjects the
4. Typical experiments offer very diagnostic
task of deciding which population was being sampled
evidence – clearly favouring one hypothesis –
from – males or females – on the basis of the informa-
whereas in reality evidence is very often weakly
tion given by randomly sampling heights from one of
diagnostic. Again, the result of generalizing from
the populations. Using this task, DuCharme and
experience may be the appearance of
Peterson found conservatism reduced to half the level
conservatism. You will recall Phillips and
found in the more artificial tasks. They concluded that
Edwards’ (1966) discovery that probability
this was due to their subjects’ greater familiarity with
revision was too extreme with very weakly
the height distributions underlying their task.
diagnostic evidence.
Winkler and Murphy (1973) expressed further
doubt concerning the validity of the conclusions from Winkler and Murphy (1973) concluded that ‘conserv-
the book bag and poker chip paradigms. They argued atism may be an artifact caused by dissimilarities
that the standard task differed in several crucial between the laboratory and the real world’.
aspects from the real world:
subjects made errors but that the errors revealed how many hobbies which include home carpentry, sailing
people made use of relatively simple but error-prone and mathematical puzzles.
heuristics for making judgements.
Half the subjects were told that the description had
5.3.1 The ‘representativeness’ heuristic been drawn from a sample of 70 engineers and 30 law-
The representativeness heuristic is used to determine yers while the other half were told that the description
how likely it is that an event is a member of a category was drawn from a sample of 30 engineers and 70 law-
by considering how similar or typical the event is to yers. So, the base rate or prevalence of engineers for
the category (remember the similarity-based the two groups was 70 per cent and 30 per cent respec-
approach to categorization discussed in Chapter 5?). tively. However, when asked to estimate the probabil-
For example, people may judge the likelihood that a ity that Jack was an engineer, the mean estimates of
given individual is a librarian by the extent to which the two groups were only very slightly different (50
the individual resembles a ‘typical’ librarian. This per cent vs 55 per cent). On the basis of such results,
may seem a reasonable strategy but it neglects consid- Kahneman and Tversky concluded that prior proba-
eration of the relative prevalence of librarians in soci- bilities are largely ignored when individuating infor-
ety as a whole: the so-called base rate. We have seen mation is made available.
that Bayes’ Theorem prescribes that prior likelihood Kahneman and Tversky then gave a description
is an important component when assessing the designed to be totally uninformative about the profes-
impact of new information. So, when given informa- sion of the individual:
tion about an individual, the chances that he or she is
Dick is a 30-year-old man. He is married with no
a member of a profession will still be influenced by
children. A man of high ability and high motivation,
the prior likelihood – or base rate – for that profes-
he promises to be quite successful in his field. He is
sion. Knowing that someone regularly works in the
well liked by his colleagues.
British Library might increase your belief that they
are a famous writer, but it is still more likely that she When contemplating this description, subjects given
or he is a librarian because there are more librarians markedly different base rates produced identical
than famous writers. Tversky and Kahneman found median estimates of 50 per cent. Kahneman and
that when base rates of different categories varied, Tversky concluded that base rates were properly uti-
judgements of the occupations of described people lized when no specific information was given, but that
were correspondingly biased – due to base-rate base rates were neglected when even worthless infor-
neglect. People using the representativeness heuristic mation was provided (as in this example).
for forecasting were employing a form of stereotyping Tversky and Kahneman (1983) also invoked judge-
in which similarity dominated other cues as a basis ment by representativeness to explain the conjunction
for judgement. fallacy, whereby a conjunction of two events is judged
In Kahneman and Tversky’s (1973) experiments to be more likely than one of those events alone. The
demonstrating neglect of base rates, subjects were fallacy violates a simple principle of probability: the
found to ignore information concerning the prior probability of a conjunction A and B can never exceed
probabilities of the hypotheses – the polar opposite of either the probability of A or the probability of B.
conservatism. For example, in one study subjects were Nevertheless, subjects who read a description of a
presented with this brief personal description of an woman called Linda who had a history of interest in
individual called Jack. liberal causes thought it more likely that she was a
feminist bank clerk (i.e. a conjunction – Linda is a
Jack is a 45-year-old man. He is married and has feminist and a bank clerk) than just a bank clerk,
four children. He is generally conservative, careful thereby violating the conjunction rule. Of course,
and ambitious. He shows no interest in political and though all feminist bank clerks are bank clerks,
social issues and spends most of his free time on his feminist bank clerks are more representative of people
354 PART 4 THINKING
interested in liberal causes than bank clerks in general. be. Kahneman and Tversky (1982) made clear that the
So, while valid probabilities respect the conjunction main goal of their research was to understand the pro-
rule, judgements of representativeness may not. cesses that produce both valid and invalid judgements.
However, it soon became apparent that ‘although
5.3.2 The ‘availability’ heuristic errors of judgement are but a method by which some
The availability heuristic is invoked when people esti- cognitive processes are studied, the method has
mate likelihood or relative frequency by the ease with become a significant part of the message’ (Kahneman
which instances can be brought to mind. Instances of and Tversky, 1982, p.494). So how should we regard
frequent events are typically easier to recall than human judgement?
instances of less frequent events, so availability will There has been an enormous amount of discussion
often be a valid cue for estimates of likelihood. of Tversky and Kahneman’s findings and claims.
However, availability is affected by factors other than Researchers in the heuristics and biases tradition have
likelihood. For example, recent events and emotion- generated shock and astonishment that people seem
ally salient events are easier to recollect. It is a com- so bad at judging probability despite the fact that we
mon experience that the perceived riskiness of air all live in an uncertain world. Not surprisingly, these
travel rises in the immediate wake of an air disaster. claims have been challenged. Some question whether
Judgements made on the basis of availability, then, are the demonstrations of biases in judgement apply to
vulnerable to bias whenever availability and likeli- experts operating in their domain of expertise or
hood are uncorrelated. merely to student samples. Another argument is that
the experimental tasks set to subjects provide a mis-
5.3.3 The ‘anchor and adjust’ heuristic leading perspective of their competence. A third argu-
The anchor and adjust heuristic is used when people ment is that the standards for the assessment of
make estimates by starting from an initial value and judgement are inappropriate.
then adjust it to arrive at their final estimate. The Consideration of a prominent critique of Tversky
claim is that adjustment is typically insufficient. For and Kahneman’s argument is given below.
instance, one experimental task required subjects to
estimate various quantities stated in percentages (e.g. Representativeness and base-rate
5.4.1
Kahneman and Tversky’s original experiments the requested to assess how many people in a survey of
descriptions were not actually randomly sampled (as 100 adult males had had heart attacks and then were
the subjects were told) but especially selected to be asked to assess the number who were both over 55
‘representative’ of the professions. If subjects sus- years old and had had heart attacks. Only 25 per cent
pected that this was the case then they would be enti- of subjects violated the conjunction rule by giving
tled to ignore the offered base rate. higher values to the latter than to the former. When
Gigerenzer et al. (1988) let their subjects experience asked about likelihoods for single events, however, it is
the sampling themselves. Their subjects examined ten typically the vast majority of subjects who violate the
pieces of paper each marked lawyer or engineer in rule. This difference in performance between fre-
proportion to the base rates. Subjects then drew one of quency and single-event versions of the conjunction
the pieces of paper from an urn and unfolded it so problem has been replicated several times since (see
they could read a description of an individual without Gigerenzer, 1994).
being able to see the mark defining it as being of a law- Gigerenzer (1994) has suggested that people are
yer or engineer. In these circumstances, subjects used naturally adapted to reasoning with information in
the base rates in a proper fashion – base-rate neglect the form of frequencies and that because of this the
‘disappeared’. However, in a replication where base conjunction fallacy ‘disappears’ if reasoning is based
rates were asserted rather than sampled, Kahneman on frequencies. This suggests that the difficulties that
and Tversky’s base-rate neglect was replicated. people experience in solving probability problems can
Kahneman and Tversky (1996) have argued that a be reduced if the problems require subjects to assess
fair summary of the research would be that explicitly relative frequency for a class of events rather than the
presented base rates are generally under-weighted probability of a single event. Thus, it is possible that if
but not ignored. They also pointed out that, in judgements were elicited with frequency formats then
Gigerenzer et al.’s (1988) experiment, subjects who there would be no biases. Kahneman and Tversky
sampled the information themselves still produced (1996) disagree and argue that the frequency format
judgements that deviated from the Bayesian solution serves to provide subjects with a powerful cue to the
in the direction predicted by representativeness. relation of inclusion between sets that are explicitly
Evidently, then, representativeness is useful for pre- compared or evaluated in immediate succession.
dicting judgements. However, to the extent that base When the structure of the conjunction is made more
rates are not entirely ignored (Koehler, 1995), the apparent, then subjects who appreciate the constraint
heuristic rationale for representativeness is limited. supplied by the rule will be less likely to violate
You will recall that the original explanation for base- it. According to their account, salient cues to set
rate neglect was the operation of a simple heuristic inclusion – not the frequency information per se –
that reduced the need for integration of information. prompted subjects to adjust their judgement.
If judgements in these experiments reflect use of To test this explanation, Kahneman and Tversky
base rates – albeit to a limited extent – it is hard to (1996) reported a new variation of the conjunction
account for findings by the operation of a simplifying problem experiment where subjects made judgements
representativeness heuristic. of frequencies but the cues to set inclusion were
removed. They presented subjects with the descrip-
5.4.2 Frequency and the conjunction fallacy tion of Linda and then asked their subjects to suppose
Tversky and Kahneman (1983) reported evidence that that there were 1,000 women who fit the description.
violations of the conjunction rule largely disappeared They then asked one group of subjects to estimate how
when subjects were requested to assess the relative fre- many of them would be bank tellers; a second, inde-
quency of events rather than the probability of a single pendent group of subjects to estimate how many were
event. Thus, instead of being asked about the likeli- bank tellers and active feminists; and a third group to
hood for a particular individual, subjects were make evaluations for both categories. As predicted,
356 PART 4 THINKING
those subjects who evaluated both categories mostly knowledgeable, and they may have reasons for want-
conformed to the conjunction rule. However, in a ing a particular answer to be true. Typical laboratory
between-groups comparison of the other two groups, studies of calibration ask subjects to answer binary
the estimates for ‘bank tellers and active feminists’ questions such as:
were found to be significantly higher than the esti-
‘Which is further south?’ (a) Rome, or (b) New York
mates for bank tellers. Kahneman and Tversky argue
that these results show that subjects use the represent- Subjects are required to indicate the answer that they
ativeness heuristic to generate their judgements and think is correct and then state how confident they are
then edit their responses to respect class inclusion on a probability scale ranging from 50 per cent to 100
where they detect cues to that relation. Thus, they con- per cent (the minimum is 50 per cent since one of the
cluded that the key variable controlling adherence to answers is always correct and 50 per cent is the prob-
the conjunction rule is not the relative frequency for- ability of guessing correctly). To be well calibrated, an
mat per se, but the opportunity to detect the relation of assessed probability should correspond with the num-
class inclusion. ber of correct judgements over a number of assess-
Other authors have investigated the impact of fre- ments. For example, if you assign a probability of 70
quency information (Evans et al., 2000; Girotto and per cent to each of ten predictions then you should get
Gonzales, 2002) and concluded that it is not the fre- seven of those predictions correct. Typically, however,
quency information per se but the perceived relations people tend to give overconfident responses – their
between the entities that is affected by different ver- average confidence is higher than their proportion of
sions of the problem, though this is rejected by correct answers. McClelland and Bolger (1994) and
Hoffrage et al. (2002). We need to understand more Harvey (1997) give comprehensive reviews of this
of the reasons underlying the limiting conditions of aspect of probabilistic judgement.
cognitive biases – how it is that seemingly inconse- Overconfidence has been recorded in the judge-
quential changes in the format of information can so ments of experts. For example, Christensen-Szalanski
radically alter the quality of judgement. Biases that and Bushyhead (1981) explored the validity of the
can apparently be cured so simply cannot plausibly probabilities given by physicians to diagnoses of pneu-
be held to reveal fundamental and immutable char- monia. They found that the probabilities were poorly
acteristics of judgement processes. We shall now calibrated and very overconfident; the proportion of
consider the history of one well-known cognitive patients who turned out to have pneumonia was far
bias: overconfidence. less than the probability statements implied. Wagenaar
and Keren (1986) found overconfidence in lawyers’
predictions of the outcome of court trials in which
5.5 Overconfidence they represented one side. As they point out, it is
inconceivable that the lawyers do not pay attention
In the 1970s and 1980s a considerable amount of evi- to the outcomes of trials in which they have partici-
dence was marshalled for the view that people suffer pated, so why don’t they learn to make well-calibrated
from an overconfidence bias, often assumed to result judgements?
from information-search strategies and motivation Could the circumstances in which some experts
(see Kunda, 1990). Associative memory and confirm- operate impede the proper monitoring of feedback
atory search strategies could facilitate retrieval of necessary for the development of well-calibrated
information that is consistent with initial impres- judgements? A consideration of the reports of well-
sions, and those impressions also then bias the inter- calibrated experts supports this notion; they all appear
pretation of subsequent ambiguous evidence. to be cases where some explicit unambiguous quanti-
Motivational factors could cause or exacerbate the fication of uncertainty is routinely made and the out-
bias. People like to think that they are intelligent and come feedback is prompt and unambiguous. Doctors
CHAPTER 11 JUDGEMENT AND DECISION MAKING 357
and lawyers don’t routinely quantify their uncertainty heights of fathers and their sons are positively – but
and may have to wait months to discover the out- not perfectly – correlated. Consequently, a sample of
comes of their judgements, the truth of which may the (adult) sons of extremely tall fathers will, on aver-
never be revealed. age, be shorter than their fathers and at the same time
The most commonly cited example of well-cali- a sample of the fathers of extremely tall (adult) sons
brated judgements is weather forecasters’ estimates of will, on average, be shorter than their sons. Thus,
the likelihood of rainfall (Murphy and Winkler, 1984) depending on how you sampled – either looking at
but there are others. Keren (1987) found highly expe- very tall sons or very tall fathers – you could be led to
rienced tournament bridge players (but not experi- two opposite conclusions about the direction of a
enced non-tournament players) made well-calibrated (non-existent) difference between the populations. If,
forecasts of the likelihood that their bids would be as Erev et al. argued, confidence and accuracy are both
made, and Phillips (1987) reports well-calibrated fore- essentially noisy measures of something else (the
casts of horse races by bookmakers. In each of these strength of the underlying information), then regres-
three cases, the judgements made by the experts are sion effects are inevitable. When Erev et al. analysed
precise numerical statements and the outcome feed- accuracy as a function of confidence (the usual
back is unambiguous and received promptly, and so method for studies of overconfidence) they found
can be easily compared with the initial forecast. Under overconfidence; but when they used the same data to
these circumstances, experts are unlikely to be insen- analyse confidence as a function of accuracy they
sitive to the experience of being surprised; there is found underconfidence. They concluded that people’s
very little scope for neglecting, or denying, any mis- confidence judgements reflect lots of random error,
match between forecast and outcome. but little or no systematic bias.
Following the ideas of Brunswik (1943, 1955) – that They also pointed out that such regression effects
cognition is well adapted to people’s natural environ- could explain the conservatism effect discussed ear-
ments – some judgement researchers have argued that lier, where judgements are less extreme than values
overconfidence is an artefact of artificial experimental calculated using Bayes’ Theorem and where confi-
tasks and the non-representative sampling of stimulus dence is analysed as a function of the ‘objective’ prob-
materials. Gigerenzer et al. (1991) and Juslin (1994) abilities. Indeed, to highlight the paradox that
claim that overconfidence is observed because overconfidence studies point to judgements being too
the typical general knowledge quizzes used in most extreme while conservatism studies conclude that
experiments contain a disproportionate number of judgements were less extreme than they should be,
misleading items. For example, most people judge they call conservatism underconfidence.
wrongly that Rome is south of New York. These So could it really be that all the evidence for over-
authors found that when knowledge items are ran- confidence is merely an illusion created by inappro-
domly sampled, the overconfidence phenomenon dis- priate sampling of test items and regression effects?
appears. Gigerenzer et al. (1991) presented their Budescu et al. (1997) attempted to measure and con-
subjects with randomly selected pairs of German trol for the regression effects caused by random varia-
cities. When asked to select the biggest and indicate tion in judgements by presenting the same items
their confidence, overconfidence was not observed. (random pairs of large American cities) on several
Erev et al. (1994) spotted another misleading source occasions to their subjects. They found that the vast
of evidence of overconfidence. They explained that majority of the individuals in their study (87 per cent)
overconfidence might, to some degree, reflect an were biased towards overconfidence even after the
underlying random component of judgement. When effects of random error in their judgements had been
any two variables are not perfectly correlated – and taken into account. As they also used a representative
confidence and accuracy aren’t perfectly correlated – sample of items, both the artefactual sources of over-
there will be a regression effect. For example, the confidence should have been eliminated.
358 PART 4 THINKING
However, Juslin et al. (2000) report a meta-analysis that they were x per cent sure that the correct answer
comparing 35 studies where the items for judgement was within the interval, the answer was inside their
were randomly sampled from a defined domain, with interval much less than x per cent of the time. If, for
95 studies where items were selected non-randomly example, people are asked to indicate confidence
by experimenters. While overconfidence was evident intervals for their judgements about when various
for selected items, it was close to zero for randomly items were invented (e.g. the ball point pen) that
sampled items, which suggests that overconfidence is should include the true value with probability 0.9, the
not simply a ubiquitous cognitive bias. This analysis proportion of intervals including the true value tend
suggests that the appearance of overconfidence may to be far below 0.9, often closer to 0.4 or 0.5. An over-
be an illusion – not one experienced by experimental confidence score is determined as the probability for
subjects, but one inadvertently created and suffered by the interval minus the hit rate for that interval. For
researchers, and so not a cognitive bias in their example, if a subject used the 90 per cent confidence
respondents. interval for a set of questions and gave ranges that
Nevertheless, in other studies, using what is called included the true value for only 50 per cent of the
interval estimates of confidence, people have been items, they would have an overconfidence score of
found to be persistently overconfident – even when 90 – 50 = 40 per cent, or 0.4.
controlling for the way items are sampled and for A number of subsequent studies have confirmed
regression effects from random error in the judge- what is called ‘format dependence’ – variation in over-
ment process. In these studies participants do not confidence depending on the choice of response for-
choose between binary answers, but rather provide mat and greater overconfidence when giving
estimates of a quantity in terms of ranges or bounda- confidence intervals (Soll and Klayman, 2004;
ries that correspond to a given degree of confidence. Winman et al., 2004). Because confidence intervals
For example, if asked ‘When was Charles Darwin are often made by experts and the difference in
born?’ a response might be ‘I’m 90 per cent sure the expected return for a probability 0.9 or 0.4 can be
answer is between 1790 and 1820′. Although interval enormous, the phenomenon is not only theoretically
estimates are less studied than binary choices, they are puzzling but of profound applied relevance. Curiously,
more like the judgements that people commonly make however, when participants are provided with the
in many contexts. When people decide when to leave same intervals and asked to assess the probability that
for the airport, how much money to change into for- the value falls within the interval, the overconfidence
eign currency when going abroad, or how much food bias tends to diminish or even disappear (Winman
to buy at the supermarket, they implicitly make judge- et al., 2004). Of course the method of measurement
ments about a plausible interval for the time the jour- should not affect underlying confidence, which in
ney will take, how much they will need to spend, or itself suggests that the problem is not inappropriate
the rates of consumption and decay. Yaniv and Foster confidence but an artefact of measurement.
(1997) found that people signal a rough sense of con- It is worth recording that experts are not immune
fidence in an interval estimate by varying the preci- to overconfidence in confidence interval judgements.
sion with which they express information. ‘I think it McKenzie et al. (2008) examined both information
was during the first half of the 19th century’ conveys a technology (IT) experts’ and novices’ judgements
different degree of confidence from ‘I think it was about the IT industry – e.g. one item asked ‘How
around 1825’. much money did US businesses spend on software last
Klayman et al. (1999) and Juslin et al. (1999) found year?’ Experts reported intervals that had midpoints
that interval estimates are prone to a great deal of closer to the true value – which increased hit rate –
overconfidence – even when using representatively and that were narrower (i.e. more informative) –
sampled items and controlling for random error. which decreased hit rate. The net effect was that
When people were asked to provide intervals such overconfidence remained largely the same.
CHAPTER 11 JUDGEMENT AND DECISION MAKING 359
Significant theory developments can account for distribution, except one (i.e. the one actually contain-
many – though not yet all – of the observations by ing the maximum and minimum values of the distri-
invoking sampling and random error rather than sys- bution). The four Asian countries whose populations I
tematic biases in information processing. For exam- knew might well not reflect the variance of the popu-
ple, Juslin et al.’s (2007) naïve sampling model can lations of all Asian countries.
account for overconfidence with intuitive confidence Other judgement formats won’t encounter this dif-
intervals, yet relatively accurate judgement with other ficulty – thus, to assess your percentage confidence
probability judgement formats. The model assumes that Thailand has more than 25 million inhabitants
that people correctly represent the uncertainty implied you may, for example, retrieve a sample of Asian coun-
by the samples of information they experience, but tries with a known number of inhabitants and assess
naïvely assume that sample properties reflect popula- the proportion of those that exceed 25 million.
tion properties. To see how it works, imagine that the Assuming a representative sample and no regression
75 per cent confidence interval for, say, the number of effects, the process should produce accurate confi-
inhabitants of Thailand may be formed by retrieving a dence judgements – exactly what has been reported
sample of Asian countries with a known number of (Gigerenzer et al., 1991; Juslin, 1994; Juslin et al., 2000;
inhabitants and reporting an interval that includes Klayman et al., 1999).
75 per cent of the values in this sample. Thus if I knew By contrast Soll and Klayman (2004) propose that
the populations of four Asian countries and that three the overconfidence bias is explained by selective and
of them had populations between 20 and 70 million I confirmatory search of memory. They report a num-
would use this as my 75 per cent confidence interval. ber of results that are hard to accommodate in a sam-
Overconfidence arises because the samples one expe- pling error framework. For example, men were almost
riences will tend to underestimate the variance of the twice as overconfident as women; women’s estimates
distribution of populations – for example, in the were not more accurate but their intervals were more
extreme case where you repeatedly sample just twice than 50 per cent wider than men’s. As Klayman
from a distribution on a continuous dimension, all et al. (1999) put it, whether judgements are overconfi-
samples will underestimate the complete range of the dent depends on how, what, and whom you ask.
SUMMARY OF SECTION 5
• There have been many demonstrations of human judgemental error, linking errors to the operation
of various heuristics and biases.
• There is evidence that many of these reported biases disappear when the wording of the problems
is changed. Whether this reflects sensitivity to particular cues or adaptivity to frequency information
formats is the subject of debate.
• Overconfidence research shows a significant change in theorizing. Early explanations invoked the idea
of systematic bias in cognitive processes. More recent theories emphasize that overconfidence may
not arise primarily from biased processing per se, but from inabilities to correct for the effects of
sampling and the effects of random – not systematic – error.
360 PART 4 THINKING
than any process that retrieves multiple bits of infor- other, pick the city you have heard of. As you usually
mation and attempts integration of the information. hear about the bigger cities of foreign countries before
The result is important for demonstrating that, the smaller ones, this will be a pretty good cue. Because
although adherence to normative rules may be suffi- the Americans had heard of both cities they couldn’t
cient for good judgement, it is not necessary. apply this cue and had to rely on other, apparently less
Further demonstrations of the efficacy of fast and valid, cues. In the same way, for city-size decisions,
frugal heuristics have studied binary decisions in a American students were slightly more accurate about
wide range of types of knowledge environment (e.g. German cities than American cities. A large number
which professor has the highest salary? Which US city of subsequent studies confirm that ignorance can even
has more homeless people?). These studies extended sometimes be helpful because simple mental heuris-
the application beyond choice to value estimation, cat- tics can exploit the structure of information in the
egorization, and memory (Gigerenzer et al., 1999). environment to make good inferences (see Gigerenzer
Goldstein and Gigerenzer (2002) asked American and and Goldstein, 2011). As a consequence of such
German students which is bigger: San Antonio or San results, we might question the present pre-eminent
Diego? While 62 per cent of the Americans correctly status of normative rules for defining rationality and
named San Diego, 100 per cent of the German stu- for serving as a benchmark for assessing human
dents were correct. The Germans were applying a rec- judgement.
ognition heuristic – if you recognize one and not the
SUMMARY OF SECTION 6
• Human decision making may employ fast and frugal heuristics – simple rules that yield quick decisions
yet can be highly accurate in certain natural environments.
7 CONCLUSION
The idea that people don’t decide as they should was judgement and decision: ‘Who could design a brain
appreciated by psychologists very early on. In a semi- that could perform the way this model mandates?
nal paper, which effectively introduced the study of Every single one of us would have to know and under-
decision making to psychology, Edwards (1954, p.382) stand everything completely, and at once’ (Daniel
wrote: ‘It is easy for a psychologist to point out that an Kahneman, quoted by Bernstein, 1996).
economic man . . . is very unlike a real man.’ Yet for While it may be a tad optimistic to presume that
economists this disparity is less clear. As Lopes (a psy- the social sciences are on the verge of reconciliation
chologist) put it: ‘Economics considers itself a norma- and consensus on this subject, psychology has, since
tive science, the very term an oxymoron of ought and the 1950s, made enormous progress in establishing
is’ (1994, p.222). Psychologists and economists think that actual human decision making cannot be
rather differently about the behavioural research satisfactorily characterized in the idealized way
exploring decision making (cf. Hertwig and Ortmann, that mathematics and economics have assumed.
2001; Lopes, 1994). To psychologists, it is evident that Moreover, alternative descriptive theories that
people cannot conceivably represent all the relevant account for the discrepancies are emerging. Perhaps
information that normative models require for the best recent piece of evidence for that claim is that
362 PART 4 THINKING
a psychologist – Daniel Kahneman – shared the 2002 In my (admittedly fallible) judgement the issues sur-
Nobel Prize for Economics ‘for having integrated rounding the nature and evaluation of human judge-
insights from psychological research into economic ment and decision making are profound and will not
science, especially concerning human judgement and be resolved easily or in the near future. To make fur-
decision making under uncertainty’ (Nobel ther progress, we need studies that do more than
Foundation, 2002). merely knock down the straw man defined by norma-
Does the rejection of normative theory as a model tive models. Among the many questions that arise, two
for human judgement and choice imply that judge- broad issues can be framed: first, how is it that we are
ment and choice must be poor or even ‘irrational’? No. as competent as we evidently are? Second, what can we
Although the evidence that people do not perform do about how incompetent we evidently are? Quite
ideally is clear, any reasonable standards of rationality how it is that people perform as effectively as they do
must surely accept that the computational require- by applying non-normative mental strategies to the
ments of normative models are beyond the capacity of limited information that they can process – and how
a human brain; nevertheless, such bounded rational- we might learn to improve our decision making –
ity (cf. Simon, 1956) does not imply irrationality. remain to be explored and explained.
FURTHER READING
Hardman, D.K. (2009) Judgment and Decision Making: here. The roles of emotions, group and inter-personal judgement,
Psychological Perspectives, Chichester, John Wiley & Sons. and how choices vary over time are not covered. For these issues
Koehler, D. and Harvey, N. (eds.) (2004) Blackwell and more on the topics I have covered I recommend David
Handbook of Judgment and Decision Making, Oxford, Hardman’s textbook Judgment and Decision Making and the
Blackwell Publishing. Due to limited space some important Blackwell Handbook of Judgment and Decision Making. Both provide
issues and many interesting developments could not be included good coverage of the topics omitted here and much more besides.
REFERENCES
Allais, M. (1953) ‘Le comportement de l’homme rationnel Brunswik, E. (1955) ‘Representative design and probabilis-
devant le risque, critique des posulats et axioms de l’école tic theory in a functional psychology’, Psychological Review,
Américaine’, Econometrica, vol.21, pp.503–46. vol.62, pp.193–217.
Allais, M. (1979) ‘The foundations of a positive theory of Budescu, D., Wallsten, T.S., and Au, W.T. (1997) ‘On the
choice involving risk and a criticism of the postulates and axi- importance of random error in the study of probabilistic
oms of the American school’, in Allais, M. and Hagen, O. judgement. Part II: Applying the stochastic judgement model
(eds.) Expected Utility Hypothesis and the Allais Paradox, to detect systematic trends’, Journal of Behavioral Decision
Dordrecht, Reidel. Making, vol.10, pp.173–88.
Allais, M. and Hagen, O. (eds.) (1979) Expected Utility Camerer, C.F. (2000) ‘Prospect theory in the wild: evi-
Hypothesis and the Allais Paradox, Dordrecht, Reidel. dence from the field’, in Kahneman, D. and Tversky, A. (eds.)
Bar-Hillel, M. (1980) ‘The base-rate fallacy in probability Choices, Values, and Frames, Cambridge, UK, Cambridge
judgements’, Acta Psychologica, vol.44, pp.211–33. University Press.
Bernstein, P.L. (1996) Against the Gods: The Remarkable Camerer, C.F., Babcock, L., Loewenstein, G. and Thaler, R.
Story of Risk, New York, Wiley. (1997) ‘Labor supply of New York City cab drivers: one
Brunswik, E. (1943) ‘Organismic achievement and environ- day at a time’, Quarterly Journal of Economics, vol.112,
mental probability’, Psychological Review, vol.50, pp.255–72. pp.407–41.
CHAPTER 11 JUDGEMENT AND DECISION MAKING 363
Christensen-Szalanski, J.J.J. and Bushyhead, J.B. (1981) Goldstein, D.G. and Gigerenzer, G. (2002) ‘Models of eco-
‘Physicians’ use of probabilistic information in a real clinical logical rationality: the recognition heuristic’, Psychological
setting’, Journal of Experimental Psychology, Human Perception Review, vol.109, pp.75–90.
and Performance, vol.7, pp.928–35. Grether, D.M. and Plott, C.R. (1979) ‘Economic theory of
Cohen, L.J. (1981) ‘Can human irrationality be experimen- choice and the preference reversal phenomenon’, The American
tally demonstrated?’ The Behavioral and Brain Sciences, vol.4, Economic Review, vol.69, pp.623–38.
pp.317–70. Hadar, L. and Fox, C.R. (2009) ‘Information asymmetry in
DuCharme, W.M. and Peterson, C.R. (1968) ‘Intuitive decision from description versus decision from experience’,
inference about normally distributed populations’, Journal of Judgment & Decision Making, pp.317–25.
Experimental Psychology, vol.78, pp.269–75. Harvey, N. (1997) ‘Confidence in judgement’, Trends in
Edwards, W. (1954) ‘The theory of decision making’, Cognitive Sciences, vol.1, pp.78–82.
Psychological Bulletin, vol.41, pp.380–417. Hertwig, R. and Ortmann, A. (2001) ‘Experimental prac-
Edwards, W. (1955) ‘The prediction of decisions among tices in economics: a methodological challenge for psycholo-
bets’, Journal of Experimental Psychology, vol.50, pp.201–14. gists?’ Behavioral and Brain Sciences, vol.24, p.383.
Edwards, W. (1968) ‘Conservatism in human information Hertwig, R., Barron, G., Weber, E.U., and Erev, I. (2004)
processing’, in Kleinmuntz, B. (ed.) Formal Representation of ‘Decisions from experience and the effect of rare events in
Human Judgment, New York, Wiley. risky choice’, Psychological Science, vol.15, pp.534–9.
Edwards, W. (1992) ‘Toward the demise of economic man Hoffrage, U., Gigerenzer, G., Krauss, S., and Martignon, L.
and woman: bottom lines from Santa Cruz’, in Edwards, W. (ed.) (2002) ‘Representation facilitates reasoning: what natural fre-
Utility Theories: Measurements and Applications, Dordrecht, quencies are and what they are not’, Cognition, vol.84, pp.343–52.
Kluwer. Hsee, C.K. (1998) ‘Less is better; when low-value options
Erev, I., Wallsten, T.S., and Budescu, D.V. (1994) are valued more highly than high-value options’, Journal of
‘Simultaneous over- and underconfidence: the role of error in Behavioral Decision Making, vol.11, pp.107–21.
judgement processes’, Psychological Review, vol.101, pp.519–28. Juslin, P. (1994) ‘The overconfidence phenomenon as a
Evans, J.St.B.T., Handley, S.J., Perham, N., Over, D.E., and consequence of informal experimenter-guided selection of
Thompson, V.A. (2000) ‘Frequency versus probability formats almanac items’, Organizational Behavior and Human Decision
in statistical word problems’, Cognition, vol.77, pp.197–213. Processes, vol.57, pp.226–46.
Gigerenzer, G. (1994) ‘Why the distinction between single Juslin, P., Wennerholm, P., and Olsson, H. (1999) ‘Format
event probabilities and frequencies is important for psychol- dependence in subjective probability calibration’, Journal of
ogy and vice-versa’, in Wright, G. and Ayton, P. (eds.) Subjective Experimental Psychology: Learning, Memory, and Cognition,
Probability, Chichester, Wiley. vol.28, pp.1038–52.
Gigerenzer, G. and Goldstein, D.G. (1996) ‘Reasoning the Juslin, P., Winman, A., and Hansson, P. (2007) ‘The naïve
fast and frugal way: models of bounded rationality’, Psychological intuitive statistician: a naïve sampling model of intuitive con-
Review, vol.103, pp.650–69. fidence intervals’, Psychological Review, vol.114, pp.678–703.
Gigerenzer, G. and Goldstein, D.G. (2011) ‘The recognition Juslin, P., Winman, A., and Olsson, H. (2000) ‘Naive empir-
heuristic: a decade of research’, Judgment and Decision Making, icism and dogmatism in confidence research: a critical exami-
vol.6, pp.100–21. nation of the hard-easy effect’, Psychological Review, vol.107,
Gigerenzer, G., Hell, W., and Blank, H. (1988) ‘Presentation pp.384–96.
and content: the use of base rates as a continuous variable’, Kahneman, D. and Tversky, A. (1972) ‘Subjective probabil-
Journal of Experimental Psychology: Human Perception and ity: a judgement of representativeness’, Cognitive Psychology,
Performance, vol.14, pp.513–25. vol.3, pp.430–54.
Gigerenzer, G., Hoffrage, U., and Kleinbölting, H. (1991) Kahneman, D. and Tversky, A. (1973) ‘On the psychology
‘Probabilistic mental models: a Brunswikian theory of confi- of prediction’, Psychological Review, vol.80, pp.237–51.
dence’, Psychological Review, vol.98, pp.506–28. Kahneman, D. and Tversky, A. (1979) ‘Prospect theory: an
Gigerenzer, G., Todd, P.M., and The ABC Research Group analysis of decision making under risk’, Econometrica, vol.47,
(1999) Simple Heuristics that Make us Smart, Oxford, Oxford pp.263–91.
University Press. Kahneman, D. and Tversky, A. (1982) ‘On the study of sta-
Girotto, V. and Gonzales, M. (2002) ‘Chances and frequen- tistical intuitions’, in Kahneman, D., Slovic, P., and Tversky, A.
cies in probabilistic reasoning: rejoinder to Hoffrage, Gigerenzer, (eds.) Judgement under Uncertainty: Heuristics and Biases,
Krauss, and Martignon’, Cognition, vol.84, pp.353–9. Cambridge, Cambridge University Press.
364 PART 4 THINKING
Kahneman, D. and Tversky, A. (1996) ‘On the reality of cog- Nisbett, R. and Ross, L. (1980) Human Inference: Strategies
nitive illusions: a reply to Gigerenzer’s critique’, Psychological and Shortcomings, Englewood Cliffs, NJ, Prentice Hall.
Review, vol.103, pp.582–91. Nobel Foundation (2002) The Bank of Sweden Prize in
Kahneman, D., Knetsch, J.L., and Thaler, R. (1990) Economic Sciences in Memory of Alfred Nobel, http://www.
‘Experimental tests of the endowment effect and the Coase nobel.se/economics/laureates/2002/index.html (accessed 27
theorem’, Journal of Political Economy, vol.98, pp.1325–48. July 2004).
Kahneman, D., Slovic, P., and Tversky, A. (eds.) (1982) Peterson, C.R., Schneider, R.J., and Miller, A.J. (1965)
Judgement under Uncertainty: Heuristics and Biases, Cambridge, ‘Sample size and the revision of subjective probability’, Journal
Cambridge University Press. of Experimental Psychology, vol.69, pp.522–7.
Keller, L.R. (1985) ‘The effects of problem representation Phillips, L.D. (1984) ‘A theory of requisite decision-models’,
on the sure-thing and substitution principles’, Management Acta Psychologica, vol.56, pp.29–48.
Science, vol.31, pp.738–51. Phillips, L.D. (1987) ‘On the adequacy of judgmental prob-
Keren, G.B. (1987) ‘Facing uncertainty in the game of ability forecasts’, in Wright, G. and Ayton, P. (eds.) Judgemental
bridge: a calibration study’, Organizational Behavior and Forecasting, Chichester, Wiley.
Human Decision Processes, vol.39, pp.98–114. Phillips, L.D. (1989) ‘Decision analysis in the 1990s’, in
Klayman, J., Soll, J.B., Gonzalez-Vallejo, C., and Barlas, S. Shahini, A. and Stainton, R. (eds.) Tutorial Papers in
(1999) ‘Overconfidence: it depends on how, what, and whom Operational Research 1989, Birmingham, Operational Research
you ask’, Organizational Behavior and Human Decision Society.
Processes, vol.79, pp.216–47. Phillips, L.D. and Edwards, W. (1966) ‘Conservatism in
Knetsch, J.L. and Sinden, J.A. (1984) ‘Willingness to pay simple probability inference tasks’, Journal of Experimental
and compensation demanded: experimental evidence of an Psychology, vol.72, pp.346–57.
unexpected disparity in measures of value’, Quarterly Journal Pitz, G.F., Downing, L., and Rheinold, H. (1967) ‘Sequential
of Economics, vol.99, pp.507–21. effects in the revision of subjective probabilities’, Canadian
Koehler, J.J. (1995) ‘The base-rate fallacy reconsidered – Journal of Psychology, vol.21, pp.381–93.
descriptive, normative, and methodological challenges’, Raiffa, H. (1968) Decision Analysis, Reading, MA, Addison
Behavioral and Brain Sciences, vol.19, pp.1–55. Wesley.
Kunda, Z. (1990) ‘The case for motivated reasoning’, Rakow, T. and Newell, B.R. (2010) ‘Degrees of uncertainty:
Psychological Bulletin, vol.108, pp.480–98. an overview and framework for future research on experi-
Lichtenstein, S. and Slovic, P. (1973) ‘Response-induced ence-based choice’, Journal of Behavioral Decision Making,
reversals of preference in gambling: an extended replication vol.23, pp.1–14.
in Las Vegas’, Journal of Experimental Psychology, vol.101, Rakow, T., Demes, K.A., and Newell, B.R. (2008) ‘Biased
pp.16–20. samples not mode of presentation: re-examining the apparent
Lichtenstein, S., Slovic, P., and Zink, D. (1969) ‘Effect of underweighting of rare events in experience-based choice’,
instruction in expected value on optimality of gambling deci- Organizational Behavior and Human Decision Processes,
sions’, Journal of Experimental Psychology, vol.79, pp.236–40. vol.106, pp.168–79.
Lopes, L.L. (1994) ‘Psychology and economics: perspec- Samuelson, P.A. (1963) ‘Risk and uncertainty: a fallacy of
tives on risk, cooperation, and the marketplace’, Annual large numbers’, Scientia, vol.98, pp.108–13.
Review of Psychology, vol.45, pp.197–227. Samuelson, W. and Zeckhauser, R. (1988) ‘Status quo bias
McClelland, A.G.R. and Bolger, F. (1994) ‘The calibration in decision making’, Journal of Risk & Uncertainty, vol.1,
of subjective probabilities: theories and models 1980–1994’, pp.7–59.
in Wright, G. and Ayton, P. (eds.) Subjective Probability, Savage, L. (1954) The Foundations of Statistics, New York,
New York, Wiley. Wiley.
McKenzie, C.R.M., Liersch, M.J., and Yaniv, I. (2008) Schlaifer, R. (1969) Analysis of Decisions under Uncertainty,
‘Overconfidence in interval estimates: what does expertise buy New York, McGraw Hill.
you?’ Organizational Behavior and Human Decision Processes, Shafir, E. (1993) ‘Choosing versus rejecting: why some
vol.107, pp179–91. options are both better and worse than others’, Memory and
Murphy, A.H. and Winkler, R.L. (1984) ‘Probability fore- Cognition, vol.21, pp.546–56.
casting in meteorology’, Journal of the American Statistical Shafir, E., Simonson, I., and Tversky, A. (1993) ‘Reason-
Association, vol.79, pp.489–500. based choice’, Cognition, vol.49, pp.11–36.
CHAPTER 11 JUDGEMENT AND DECISION MAKING 365
Shafir, S. (1994) ‘Intransitivity of preferences in honeybees: Tversky, A., Slovic, P., and Kahneman, D. (1990) ‘The
support for “comparative” evaluation of foraging options’, causes of preference reversal’, American Economic Review,
Animal Behaviour, vol.48, pp.55–67. vol.80, pp.204–17.
Simon, H.A. (1956) ‘Rational choice and the structure of Ungemach, C., Chater, N., and Stewart, N. (2009) ‘Are
the environment’, Psychological Review, vol.63, pp.129–38. probabilities overweighted or underweighted, when rare out-
Slovic, P. (1975) ‘Choice between equally valued alterna- comes are experienced (rarely)?’ Psychological Science, vol.20,
tives’, Journal of Experimental Psychology: Human Perception pp.473–9.
and Performance, vol.1, pp.280–7. von Neumann, J. and Morgenstern, O. (1944) Theory
Slovic, P. (1995) ‘The construction of preference’, American of Games and Economic Behavior, Princeton, Princeton
Psychologist, vol.50, pp.364–71. University Press.
Slovic, P. and Lichtenstein, S. (1968) ‘Relative importance von Winterfeldt, D. and Edwards, W. (1986) Decision
of probabilities and payoffs in risk taking’, Journal of Analysis and Behavioral Research, Cambridge, Cambridge
Experimental Psychology Monograph, vol.78, pp.1–18. University Press.
Slovic, P. and Tversky, A. (1974) ‘Who accepts Savage’s Wagenaar, W.A. and Keren, G.B. (1986) ‘Does the expert
axiom?’ Behavioral Science, vol.19, pp.368–73. know? The reliability of predictions and confidence ratings of
Slovic, P., Fischhoff, B., and Lichtenstein, S. (1977) experts’, in Hollnagel, E., Mancini, G., and Woods, D.D. (eds.)
‘Behavioral decision theory’, Annual Review of Psychology, Intelligent Decision Support in Process Environments, Berlin,
vol.28, pp.1–39. Springer-Verlag.
Soll, J.B. and Klayman, J. (2004) ‘Overconfidence in inter- Watson, S.R. and Buede, D.M. (1987) Decision Synthesis:
val estimates’, Journal of Experimental Psychology: Learning, The Principles and Practice of Decision Analysis, Cambridge,
Memory, and Cognition, vol.30, pp.299–314. Cambridge University Press.
Tversky, A. (1969) ‘Intransitivity of preferences’, Psychological Wilson, T.D., Houston, C.E., Etling, K.M., and Brekke, N.
Review, vol.76, pp.31–48. (1996) ‘A new look at anchoring effects: basic anchoring and
Tversky, A. and Kahneman, D. (1974) ‘Judgement under its antecedents’, Journal of Experimental Psychology: General,
uncertainty: heuristics and biases’, Science, vol.185, pp.1124–31. vol.125, pp.387–402.
Tversky, A. and Kahneman, D. (1981) ‘The framing of deci- Winkler, R.L. and Murphy, A.M. (1973) ‘Experiments in
sions and the psychology of choice’, Science, vol.211, pp.453–8. the laboratory and the real world’, Organizational Behavior
Tversky, A. and Kahneman, D. (1983) ‘Extensional versus and Human Performance, vol.20, pp.252–70.
intuitive reasoning: the conjunction fallacy in probability Winman, A., Hansson, P., and Juslin, P. (2004) ‘Subjective
judgement’, Psychological Review, vol.90, pp.293–315. probability intervals: how to cure overconfidence by interval
Tversky, A. and Kahneman, D. (1986) ‘Rational choice and evaluation’, Journal of Experimental Psychology: Learning,
the framing of decisions’, Journal of Business, vol.59, S251–S278. Memory, and Cognition, vol.30, pp.1167–75.
Tversky, A., Sattath, S., and Slovic, P. (1988) ‘Contingent Yaniv, I. and Foster, D.P. (1997) ‘Precision and accuracy of
weighting in judgement and choice’, Psychological Review, judgmental estimation’, Journal of Behavioral Decision Making,
vol.95, pp.371–84. vol.10, pp.21–32.
R E A SONING
Mike Oaksford
1 INTRODUCTION
Suppose a friend tells you that ‘if John finds out, he reason according to logical rules at the pinnacle of his
will be furious’ (i). You later discover that ‘John found stage theory of cognitive development, i.e. at the for-
out’ (ii). If you conclude that ‘John was furious’ (iii), mal operational stage (Inhelder and Piaget, 1958).
then you have engaged in a passage of reasoning: you One of our main concerns in this chapter will be to
have inferred a conclusion (iii) from some premises, determine whether logic provides a good model of
i.e. (i) and (ii). Reasoning has been studied since the human reasoning. This does not mean that we should
time of the ancient Greeks when Aristotle suggested expect people to reason perfectly logically. Although
that reasoning is one of the abilities that mark us out we may all be capable of logical performance, perfect
from the other animals. Only we use language and performance may, for example, take up too much
only we reason. Therefore only we possess minds memory. In which case, we might expect some errors
capable of rational thought. Aristotle also developed to emerge and, as we will see, such errors have been
the first system of logic. That is, he produced a set of observed.
rules by which to judge whether certain passages of Another theme that will emerge is whether logic is
reasoning, like the one above, were valid, i.e. for tell- appropriate to describe real human reasoning at all.
ing whether the conclusion (iii) really does follow The full title of Boole’s (1854) book was An Investigation
from the premises, (i) and (ii). This is one of the of the Laws of Thought, on Which are Founded the
sources of a strong line adopted by some researchers Mathematical Theories of Logic and Probabilities.
in this area: reasoning is the process of applying logi- Almost half of the book was devoted to probability
cal laws. This strong line also emerges in the founda- theory, which Boole thought may provide a better
tions of modern logic in Boole’s The Laws of Thought theory of everyday reasoning. As we will see, some
(1854). In that book, Boole describes a set of rules researchers do not view people’s reasoning behaviour
that determine how we can draw inferences from as error prone but logical. Rather they view it as rela-
statements like ‘if . . . then’ (as in example (i)). The tively error free but probabilistic. This difference
book’s title clearly reveals that the author’s intention emerges as a result of assigning differing meanings to
was to describe the laws that determine human rea- the important words that figure in a passage of reason-
soning. More recently, Piaget placed the ability to ing. In this chapter, we will concentrate heavily on the
CHAPTER 12 REASONING 367
words ‘if . . . then’. According to some researchers, each other’s behaviour assume that we are reasoning
‘if . . . then’ should be interpreted logically, in terms of all the time.
the conditions under which it is true or false. For
example, (i) is false if John does not get furious when
he finds out; otherwise it is true. Other researchers 1.1 Reasoning in everyday life
view (i) as describing a causal relation between two
events, i.e. John finding out causes him to get furious. People are so dependent on reasoning processes that
On this view, (i) should be interpreted probabilisti- they tend to go unnoticed. Nonetheless, it is simple to
cally, in terms of the evidence one might have for John show that a great deal of human behaviour depends
getting furious given he finds out. Of course, different on reasoning processes. Suppose you see your neigh-
people may know different things about John, bour’s wife arriving home. She passes her garage and
which may lead them to different evaluations of the she sees that her husband’s car is on the drive. When
probability that he gets furious when he finds out. she reaches the door, instead of taking out her key and
This could lead to individual differences in reasoning, opening the door as she has done every night for the
and as we will see, such differences have also been last 20 years, she rings the doorbell. Why your neigh-
observed. bour broke her habitual pattern of behaviour can be
A further theme of this chapter arises from the fact explained in an instant:
that the experimental work on human reasoning
She saw that the car was there. She knows that for it
shows that according to logic, people do make many
to be there, someone must have driven it from town
errors. If being logical is what we mean by being
where her husband dropped her off in the morning.
rational then these results may have some serious
Because she knows that only her husband has the
consequences. For example, in law people can only be
keys, she infers that her husband drove it. She further
held responsible for their actions if they can ration-
infers that if the car is on the drive then her husband
ally evaluate the consequences of those actions. But if
is in the house and hence he can open the door when
people are not rational, then how can society hold
she rings the bell. Consequently, rather than take out
them responsible for what they do? Moreover, where
her key, she rings the doorbell.
is the boundary between sanity and insanity to be
drawn? A sane person is one who responds rationally Two pieces of information combine in the first infer-
to the world and to other people. But if most normal ence. One comes directly from perception, i.e. the car
adults are irrational then who is sane and who is was there, and the other from prior knowledge, i.e. if
insane? In evaluating psychological theories in this the car was there then someone drove it. This informa-
area, it will therefore be important for us to pay close tion is combined in an inference to yield new informa-
attention to what they have to say about human tion: someone drove the car.
rationality. The given information can be regarded as the prem-
The first issue we address is the sheer ubiquity ises and the new information as the conclusion of a
of human reasoning. Reasoning may seem like an passage of reasoning. The subsequent steps that lead
activity we rarely, if ever, engage in. However, most of her to the final conclusion that she should ring the
our common-sense psychological explanations of doorbell can all be characterized in the same way. So it
would seem that even the most mundane passage of be new information too, but it does not seem to be
human behaviour involves complex reasoning pro- related to the premises in the right kind of way: believ-
cesses that require using given information (premises) ing the premises in (1) in no way compels you to believe
to infer new information (conclusions). this conclusion. Trying to describe this relationship
The question we now need to address is how do we between premises and conclusions is the core of charac-
know when we can draw a conclusion from some set of terizing logical or deductive reasoning. The idea, as we
premises? For example, the conclusion in (1) could be saw in Aristotle and Boole, is to provide some rules to
replaced with ‘Her partner had a cream tea’. This would determine when a conclusion does and does not follow.
2DEDUCTIVE REASONING
AND LOGIC
Logic provides an account of the relationship the truth value of a proposition. So if it is true that
between the premises and the conclusion of a deduc- ‘John has a runny nose’ then ‘John does not have a
tive argument. Logic starts from the idea that sen- runny nose’ must be false. Conversely, if it is false
tences are made up of two very general building that ‘John has a runny nose’ then ‘John does not
blocks. First there are descriptive clauses that say have a runny nose’ must be true. What about the
something true or false about the world, e.g. ‘John other connectives? Notice that the other three con-
has a runny nose’ or ‘John has a cold’. These sentences nectives all connect two propositions, e.g. ‘John has
are said to describe propositions, i.e. they describe a runny nose and John has a cold’. Each proposition
how the world may or may not be. Second, there are making up this complex sentence can be true or
structure-building words that allow us to combine false. Thus there are four possibilities, letting
propositions to produce more complex sentences, p = ‘John has a runny nose’ and q = ‘John has a cold’:
e.g. ‘John has a runny nose and John has a cold’ or ‘if either p is true and q is true; or p is true and q is
John has a runny nose, then he has a cold’. Along with false; or p is false and q is true; or p is false and q is
and and if . . . then, other structure-building words false. In only one of these possibilities would we
include or and not. Collectively these words are intuitively say that ‘John has a runny nose and John
called connectives because they connect two simpler has a cold’ is true, i.e. when p is true and q is true,
sentences together. The most important of these is if otherwise this complex sentence is false. So we can
p then q, which is called the conditional. The p clause regard the connective ‘and’ as mapping pairs of
is called the antecedent and the q clause is called the truth values on to a truth value. When both p and q
consequent. are true, then p and q is true; for all other pairs it is
Propositions are simply true or false depending false. We can show this mapping in what is called a
on whether what they say holds in the world or not, truth table (see Table 12.1).
so the sentence ‘John has a runny nose’ is true if and With these truth tables it is easy to show what we
only if John has a runny nose, otherwise it is false. said about the relation between the premises and the
However, how do we determine whether the more conclusion of a deductive argument. We said that if
complex sentences made using the structure-build- you believed the premises of a deductive argument
ing words or connectives are true or false? Well, not then somehow you must believe the conclusion. This
is particularly simple because all it does is reverse means, for example, that if it is true that ‘if John has
CHAPTER 12 REASONING 369
a runny nose then he has a cold’ and it is true that TAB LE 12 .1 Truth tables. Truth tables for the logical
‘John has a runny nose’, then it has to be true that connectives and, if . . . then, and or. The two leftmost
columns show the four possible combinations of truth
‘John has a cold’. The truth tables in Table 12.1 allow
values for the propositions p and q. They also figure as
us to show this. Again, let p = ‘John has a runny one of the premises and the conclusion of an inference
nose’ and q = ‘John has a cold’. If we look at Table involving the connectives. The columns for each
12.1, then we see that if p then q and p are only both connective show the truth value each particular pair is
true when q is also true (first row of the table). So if mapped onto by that connective.
both the premises, if p then q and p are true, then the
p q p and q if p then q p or q
conclusion, q, must be true; there is no other possi-
bility! We describe this by saying that the inference true true true true true
is logically valid. This inference is also referred to as true false false false true
modus ponens, or MP for short, and it typically false true false true true
appears in logic textbooks as: false false false true false
Another logically valid inference with the condi- table where p is false, and so not-p is true. So if these
tional is modus tollens, or MT for short (3). We can two premises are true then not-p must be true also, as
again show this using Table 12.1. Of course, not-q is again there is no other possibility. So if the conditional
true when q is false. Consequently, if p then q and is true and John does not have a cold, then John can-
not-q are only both true in the last line of the truth not have a runny nose.
There are two other inference patterns investigated consequent (AC) and denying the antecedent (DA):
in the psychology of reasoning: affirming the
ACTIVIT Y 12 .1
See if you can work out why AC and DA are not both true, the conclusion was true. Is there a line
logically valid from Table 12.1. As a clue, we found in the truth table (Table 12.1) for which the
that MP and MT were valid because in the only premises of AC or DA are true but the conclusion
line in the truth table where the premises were is false?
We can now illustrate a critical distinction in logic in (2). That is, (1) is simply a particular instantiation of
between form and meaning. (2) and (3) show the form (2). With (2) we can automatically make the logically
of the logically valid inferences MP and MT. We know valid inference simply by virtue of the form of the
they are logically valid because of the meanings we argument without having to worry about what it
have assigned to the connectives in the truth tables in means. This distinction between form and meaning is
Table 12.1. These tell us that if the premises are true central to two of the theories of reasoning we look at
then the conclusion must be true, which is the defini- later on. One theory, mental logic, argues that we have
tion of logical validity. However, to draw the MP or formal inference rules, like (2) to (5), in our heads, i.e.
MT inference does not require that we make reference inferences only rely on form. The other, mental models,
to the truth table, i.e. to the meaning of the condi- argues that we do something much more like consid-
tional. For example, to draw the inference in (1) all ering the truth tables, i.e. inferences rely on the mean-
you would need to do is to match it to the formal rule ing of the connectives.
SUMMARY OF SECTION 2
• Logic provides a set of rules to determine if an inference is logically valid.
• Logic divides words into propositions and structure-building words.
• Propositions are true or false; structure-building words or connectives map pairs of truth values onto
a truth value.
• These mappings can be displayed in truth tables, which can be used to determine if an inference is
logically valid. If when the premises are true, the conclusion must be true, then the inference is valid.
• This semantic way of establishing validity contrasts with the formal method of using rules of inference
(2) and (3).
3PSYCHOLOGICAL THEORIES
OF REASONING
In the psychology of human reasoning there are a lined and discussed. Three theories are introduced:
wide variety of theoretical approaches. In this mental logic, mental models, and the probabilistic
section the main theoretical approaches are out- approach. These are general theories of reasoning,
CHAPTER 12 REASONING 371
i.e. they are intended to apply to most reasoning This is the core of the mental models theory. In this
tasks. account each possibility is referred to as a ‘mental
model’. How people manipulate these mental models
explains their reasoning performance.
3.1 Mental logic
This group of theories – there are several different
versions of this basic account (Braine and O’Brien,
The probabilistic
3.3
1998; Rips, 1994) – are also known as formal rule approach
theories. As the name suggests, these accounts are
close in spirit to Piaget, who argued that adult human According to the probabilistic approach, the goal of a
thought was the operation of formal logic (Inhelder psychological theory of reasoning is to account for
and Piaget, 1958). The idea behind these theories is people’s everyday inferences (Oaksford and Chater,
that people possess a system of formal mental 1994, 1998, 2007, 2009). According to this view, logic
logic that contains inference rules like (2) and (3). is not the right theory of how people should make
However, people may not possess all the formal logi- these inferences. For example, according to logic a
cal rules that are licensed by the truth tables in Table good reason to believe that if John has a runny nose
12.1. Without a particular rule some inferences then he has a cold is that you do not believe that John
might be more complicated than others. has a runny nose. This is because, according to logic, a
conditional is true when its antecedent is false, i.e.
lines 3 and 4 of Table 12.1. However, not believing that
3.2 Mental models John has a runny nose does not seem to be sufficient
grounds to believe that this conditional is true. What
Mental models theory (Johnson-Laird, 1983, 2006; would appear to be required is the belief that John
Johnson-Laird and Byrne, 1991) shares the intuition having a runny nose makes it very likely that he has a
with mental logic that people are at least in principle cold. This involves assessing the conditional probabil-
capable of logical reasoning. However, rather than ity that John has a cold given he has a runny nose. So
applying formal rules, mental models theory argues if you have noticed John having a runny nose on, say,
that people reason over pictorial representations of 100 occasions, 95 of which involved him having a
what those sentences mean. These representations cold, then the relevant conditional probability is 0.95,
concern the different possibilities that a logical i.e. P(John has a cold | John has a runny nose) = 0.95
expression may allow. This is familiar from our dis- (the bar ‘|’ = given). This is then your degree of belief
cussion of truth tables. In Table 12.1, each row cor- in the conditional. It is also the probability with which
responds to a different possibility depending on people would be expected to draw the MP inference. If
whether p and q are true or false, which leads to four all you know is that John has a runny nose, then your
possibilities. One way of thinking about the connec- degree of belief in this rule indicates that there is a
tives is that they exclude different possibilities. So for 95 per cent chance that he has a cold. According to the
example, if if p then q is true then the possibility probabilistic approach, most inferences are uncertain
where p is true and q is false is excluded, leaving because the conditional rules on which they are based
three other possibilities. As we know (see Chapter 9), describe the real world in which logical certainty is a
working memory has limited capacity. This means rare commodity. This account of reasoning perfor-
that people may not represent all these possibili- mance therefore suggests replacing logic with proba-
ties at once when interpreting a connective. Rather, bility theory as the account of the inferences people
there may be a preferred initial representation. should make.
372 PART 4 THINKING
The contrast between the first two general theories of Assessing theories in any area of science depends
reasoning and the last is important because the con- first and foremost on the ability to explain the data. In
cept of what it is to be rational fundamentally changes. the next two sections we therefore look at some of the
In the first two theories, rationality is still defined as experimental results on the two principal reasoning
reasoning according to logic. However, people make tasks that have been used to assess human reasoning
mistakes mainly because of the limited nature of performance: the conditional inference task (Evans,
short-term memory. In contrast, according to the 1977; Taplin, 1971) and the Wason Selection Task
probabilistic approach, probability theory replaces (Wason, 1968).
logic as the criterion of what is rational.
SUMMARY OF SECTION 3
In this section we have outlined the three main general theories of reasoning.
• In mental logic theories, people use formal rules of inference but people do not possess all possible
rules. This means that some inferences will be more difficult.
• In mental models theory, people represent the true possibilities licensed by a connective. However,
they may represent only one of these possibilities, which could be the source of errors.
• In the probabilistic approach, people are not trying to draw deductive inferences. The degree to which
inferences are endorsed depends on the appropriate conditional probability.
4 CONDITIONAL INFERENCE
In a conditional inference task (Evans, 1977; Taplin, numbers. The idea was to try and rule out any effects
1971) participants are presented with a conditional of prior knowledge so as to investigate reasoning ‘in
sentence as in our example, if John has a runny nose, the raw’. A similar motivation for studying recall of
then he has a cold (the conditional premise), and vari- meaningless letter triples, e.g. UVJ, was originally pro-
ous facts relating to the antecedent or consequent of vided in memory research (Ebbinghaus, 1885). In
the sentence (the categorical premise), e.g. John has a both cases, the idea was to investigate the basic oper-
runny nose (MP), John does not have a runny nose ating characteristics of the cognitive system. Of
(DA), John has a cold (AC), Johnny does not have a cold course, this may just be throwing out the baby with
(MT). From these pairs of premises, logic dictates that the bath water because the memory and reasoning
various inferences introduced in Section 2 should be systems may operate very differently when prior
made or withheld. We now review the main findings knowledge is relevant, which is surely the norm.
on conditional inference. For each finding we discuss In the abstract conditional inference task partici-
how the main theories explain the results. pants are told to assume that, for example, the prem-
ises if A then 2 and there is an A are true and are asked
whether they can conclude that there is a 2 (MP). In a
summary of 65 of these experiments, on average
4.1The abstract conditional 97 per cent of participants endorse MP, 55 per cent
inference task endorse DA, 63 per cent endorse AC, and 72 per cent
endorse MT (Schroyens and Schaeken, 2003). If we
Typically these reasoning tasks were conducted compare these mean values two at a time, i.e. pair-
using abstract alphanumeric stimuli, i.e. letters and wise, then all six comparisons reveal highly significant
CHAPTER 12 REASONING 373
differences. MP is endorsed more than MT, which is should endorse both DA and AC but they should
endorsed more than AC, which is endorsed more than endorse AC more than DA. This corresponds to the
DA. This pattern is not consistent with logic, accord- pattern of endorsements observed in Schroyens and
ing to which participants should endorse MP and MT Schaeken’s (2003) summary of the data. So, according
equally and should not endorse any other inference. to the mental logic theory, people’s performance on
this task is rational because it is actually logical; it is
4.1.1 Mental logic just that some logical inferences are harder than oth-
Mental logicians (Rips, 1994) explain the difference ers given the logical rules we possess.
between MP and MT by the proposal that while peo-
ple possess the MP inference rule ((2) in Section 2) 4.1.2 Mental models
they do not possess the MT inference rule ((3) in Table 12.2 (a) shows the initial mental model repre-
Section 2). This means that to draw the MT inference sentation for the conditional. It represents the possi-
requires indirect and more complex reasoning. The bility in which p is true and q is true, i.e. it is like the
MT inference is, If John has a runny nose, then he has first line in Table 12.1. The three dots (or ellipsis) indi-
a cold, He does not have a cold, therefore, He does not cate that there may be other relevant mental models.
have a runny nose. Rips (1994) argues that to reach That is, there are other possibilities that are not cur-
this conclusion, people assume the contrary of the rently being considered. These other possibilities are
conclusion, i.e. John has a runny nose, and show that a available, perhaps held in some temporary short-term
contradiction results. If this assumption is true then it memory store, but they are not explicitly represented.
can be combined with the conditional premise to yield The square brackets indicate that p cannot be paired
the conclusion, John has a cold, by MP. But this con- with any other term. In particular, this captures the
clusion contradicts the categorical premise, that John fact that p cannot be paired with not-q (¬q), i.e. line 2
does not have a cold. So the assumption must be false, in Table 12.1, because this is the possibility that the
i.e. John has a runny nose must be false and so John conditional excludes. Table 12.2 (c) shows the initial
does not have a runny nose must be true! This way of mental model for the bi-conditional. Both p and q are
drawing the inference is called reductio ad absurdum now in square brackets because neither can be paired
or RAA. The additional complexity of RAA explains with anything else. This rules out the p, not-q and the
why MT is drawn less often than MP. not-p, q possibilities. Table 12.2 (b) shows the fleshed-
Indeed, this strategy may also explain the results for out mental model for the conditional, where the other
DA and AC (Rips, 1994). Conditionals in natural lan- possibilities not excluded by this interpretation are
guage can be ambiguous and may sometimes be inter- explicitly represented. Table 12.2 (d) shows the same
preted as bi-conditionals. In terms of truth tables fleshed-out mental model for the bi-conditional. The
(Table 12.1) this means that the conditional is also fact that mental models only represent the true possi-
true when both antecedent (p) and consequent (q) are bilities, and the distinction between initial mental
false. It also means that if John has a runny nose, then models and fleshed-out mental models, are the pri-
he has a cold may be taken to also mean its converse mary means by which mental models explains the
that if John has a cold, then he has a runny nose. Those data on conditional inference. The explanation
people who interpret the rule this way will make just depends on different subsets of participants adopting
MP and MT on the standard rule. However, they these four different interpretations.
should also make MP and MT on the converse rule. If a participant adopts the initial conditional inter-
Thus they will look like they are making DA and AC pretation (Table 12.2 (a)) then they can only draw the
inferences on the standard rule because DA and AC MP inference. While the categorical premise of both
on if John has a runny nose, then he has a cold is equiv- MP (p) and AC (q) match the model, q may be paired
alent to MT and MP (respectively) on if John has a with something other than p. However, p can only be
cold, then he has a runny nose. Consequently, those paired with q. However, if participants adopt the
participants who interpret the rule as a bi-conditional fleshed-out conditional interpretation (Table 12.2 (b))
374 PART 4 THINKING
TAB LE 12 . 2 Mental models for the conditional. Initial mental models for the conditional (a) and bi-conditional (c) and
once they have been fleshed-out (b) and (d). The inferences that can be drawn in each model are also shown.
they can now also make the MT inference in addition 4.1.3 Probabilistic approach
to MP. Although the categorical premise of all infer- According to the probabilistic approach people will
ences now match the model, only not-q (¬q) is con- draw inferences depending on how probable they
strained to only be paired with not-p (¬p). If think the conclusion is given the premises (Oaksford
participants adopt the initial bi-conditional interpre- and Chater, 2003a; Oaksford et al., 2000). MP is
tation (Table 12.2 (c)) they can make the MP inference straightforward. Given the conditional premise, if
and the AC inference. MP goes through for the same John has a runny nose (r), then he has a cold (c), this
reason as for the initial conditional interpretation. AC inference will be drawn in proportion to the condi-
goes through because now q can only be paired with p. tional probability that John has a cold given that he
Finally, if participants adopt the fleshed-out bi-condi- has a runny nose (P(c|r)). So for example, given the
tional interpretation (Table 12.2 (d)), then they can categorical premise, John has a runny nose (and no
draw all inferences. This is because the categorical other information) the best bet as to the probability
premise of all inferences find a match in the model that John has a cold is the proportion of times that
and each is uniquely paired with only a single item. John has a cold when he has a runny nose. In our
Table 12.2 shows that MP can be endorsed in all example above, this was 0.95. Calculating probabili-
representations, DA can only be endorsed in one, and ties for the remaining inferences requires the
AC and MT can both be endorsed in two. So if equal assumption that people possess information about
numbers of participants adopted each representation, the probability of John having a runny nose (P(r))
then MP will be endorsed more than both AC and and the probability that he has a cold (P(c)).
MT, which will be endorsed in equal proportion, and Consider the AC inference in which you are told
all will be endorsed more than DA. However, that John has a cold and are asked whether you
participants endorse more MT than AC inferences. would endorse the conclusion that John has a runny
Explaining this result assumes that more participants nose. What you are interested in is the probability
flesh out the conditional interpretation (Table 12.2 that John has a runny nose given that John has a cold
(b)) than endorse the initial bi-conditional interpreta- (P(r|c)), i.e. the converse of MP. Probability theory
tion (Table 12.2 (c)).
ACTIVIT Y 12 .2
For each of the inferences, work through the mental You should find that the process is very like checking
models in Table 12.2 and be sure that you can tell the truth table in Activity 12.1.
why each inference is valid or not in each model.
CHAPTER 12 REASONING 375
allows us to calculate this probability using Bayes’ inferences can be defeated in this way they are called
Theorem (see Chapter 11): defeasible inferences. Or to take another example, we
P (c | r )P (r ) generally believe that birds fly, which can be expressed
P (r | c ) = as the conditional if something is a bird then it flies. So
P (c | r )P (r ) + P (c | ¬r )P (¬r )
we might conclude that Tweety can fly on learning that
We know that P(c|r) = 0.95. Suppose that John rarely Tweety is a bird. However, if we then discover the new
has a runny nose and so over the year he has only a information that Tweety is an ostrich, then this infer-
5 per cent chance of having one, so P(r) = 0.05 and ence is defeated. It thus seems that many of the infer-
P(¬r) = 0.95. What about P(c|¬r), i.e. the probability ences we draw in everyday life may be non-deductive,
of John having a cold given he does not have a runny i.e. the truth of the premises does not guarantee the
nose? This is likely to be quite low but not 0. Let us set truth of the conclusion.
this to 0.03. P(r|c) is then equal to 0.61, which is the There have been many experiments investigating
probability that you should draw the AC inference. these aspects of everyday reasoning. They show that
Probabilities can also be derived in a similar way for the inferences, MP and MT, and the fallacies, DA and
DA and MT. AC, can be suppressed by providing information about
To assess how well this account can explain the possible defeaters. For example, if you are told that if
standard abstract results, the equations predicting the the key is turned then the car starts and that the key is
probabilities with which each inference should be turned, you are likely to endorse the MP inference to
drawn can be fitted to the data. This means that values the conclusion that the car starts. However, if you are
of P(c|r), P(r), and P(c) can be estimated that provide also told that the petrol tank is empty, you are less
the closest possible predictions for the frequencies likely to endorse this conclusion because the car will
with which each inference is endorsed. The probabil- not start if the petrol tank is empty. An empty petrol
istic account provides quite a close fit to the abstract tank provides an exception to the rule. This exception
data, predicting the following frequencies of drawing would also mean that you are less likely to endorse
each inference (actual frequencies in brackets): MT. If you knew that the car didn’t start you may not
MP = 0.88 (0.97), DA = 0.51 (0.55), AC = 0.68 (0.63), infer that the key was not turned because the empty
MT = 0.77 (0.72) (Oaksford and Chater, 2003b). The petrol tank may be the cause of the car not starting.
ability to fit the data in this way is not unique to the These exceptions have been called ‘additional anteced-
probabilistic approach. The numbers of participants ents’ (Byrne, 1989). Other information can suppress
adopting the conditional or bi-conditional interpreta- DA and AC. For example, if you are told that if the key
tion and the numbers fleshing out or drawing RAA is turned then the car starts and that the key is not
inferences are all free to vary and must be fixed from turned, you might endorse the DA inference to the
the data, just as for the probabilities in the probabilis- conclusion that the car does not start. However, if you
tic approach. are also told that the car was hot-wired, you may be
less likely to endorse this conclusion because the car
may start even though the key was not turned because
it has been hot-wired. This condition would also mean
Everyday reasoning and
4.2
that you are less likely to endorse AC. If you knew that
the suppression effect the car started you may not infer that the key was
turned because the car starting may have been caused
A general property of everyday inferences is that they by it being hot-wired. These conditions have been
can be defeated (Oaksford and Chater, 1998). For called ‘alternative antecedents’ (Byrne, 1989).
example, if you infer that John has a cold because he Byrne (1989) demonstrated all these effects by pro-
has a runny nose, but then discover that he has viding participants with explicit rules containing this
hay fever, your inference is defeated. Because such additional information.
376 PART 4 THINKING
0.8
Proportion endorsed
0.6
0.4
0.2
0
MP DA AC MT MP DA AC MT MP DA AC MT
Inference
ACTIVIT Y 12 . 3
For (7′) see if you can work out why DA and AC equivalent to the key is not turned and the car is not
should be suppressed. A clue for the DA inference is hot-wired.
that not (the key is turned or the car is hot-wired) is
may represent these premises as single rules but with Just as for the mental logic approach, mental models
complex antecedents: theory (Byrne et al., 1999) suggests that people repre-
sent information about additional antecedents using
(6′) If the key is turned and there is fuel in the tank,
and, and they represent information about alternative
then the car starts
antecedents using or. This yields the following mental
(7′) If the key is turned or it is hot-wired, then the
models representations for (6′): if you turn the key (p)
car starts
and there is fuel in the tank (q), then the car starts (r)
Let us look at each inference in turn for (6′). (additional) and for (7′): if you turn the key (p) or it is
MP Inference: The categorical premise the key is hot-wired (q), then the car starts (r) (alternative) (for the
turned does not satisfy the antecedent, which is only moment, ignore the models after the ellipsis, i.e. . . .):
true if the key is turned and there is fuel in the tank (see
Table 12.1). Consequently, logically this single cate- And p q r Or p r
gorical premise does not licence the conclusion that ... q r
the car starts and so the MP inference should be ...
suppressed. p ¬q ¬r ¬p q r
MT Inference: This leads to the negation of the ante-
cedent, i.e. (not the key is turned and there is fuel in the For (6′) a fully fleshed-out version of the mental
tank), which is equivalent to the key is not turned or model for and will include the case where the key is
there is no fuel in the tank. Consequently, logically you turned (p is true) but the car does not start (not r is
cannot infer that the key was not turned because there true) because there is no fuel (not q is true). For (7′) a
could be no fuel in the tank, and so the MT inference fully fleshed-out version of the mental model for or
should be suppressed. Similar reasoning applies to (7′) will include the case where the key is not turned (not p
for the DA and the AC inferences. is true) but the car does start (r is true) because it was
Mental logic suggests that reasoning behaviour is hot-wired (q is true). These models are shown after the
all or nothing on this task; this is hard to reconcile ellipsis. This particular example shows why these
with Cummins’ (1995) data, which revealed graded counterexamples should be available. We have delib-
effects. Mental logicians have responded by arguing erately picked an example that appeals to your prior
for a clear distinction between deductive and non- knowledge of cars and the factors that determine
deductive inference (Rips, 2001, 2002). The strength whether they start or not. This is called the principle of
of a non-deductive inference can be thought of as how pragmatic modulation (Johnson-Laird and Byrne,
probable the conclusion is given the premises, as in 2002). That is, general knowledge in long-term mem-
the probabilistic approach. Rips (2002) therefore sug- ory can modulate the interpretation of conditionals,
gests that reasoning theories should stick to their own in this case making certain counterexamples much
proper domains. easier to access and represent.
Mental models also suggests that suppression
4.2.2 Mental models effects should be all or nothing. However, some
The mental models explanation of the suppression researchers working within the mental models frame-
effects depends on the availability of counterexamples. work (Quinn and Markovits, 2002; Schroyens and
378 PART 4 THINKING
Schaeken, 2003) have suggested that mental models first estimate when all you knew was that the key was
should be supplemented with a validating search pro- turned. That is, your estimate of the probability that
cedure. A conclusion is suggested by the mental model, the car starts is suppressed. In the suppression experi-
and then long-term memory for world knowledge is ments people are not provided with the information
searched to see if there is a counterexample. These can in this way. Rather, they are given reminders about
influence reasoning either in an all-or-nothing way general preventive factors, like empty fuel tanks.
(Quinn and Markovits, 2002) or in a graded, probabil- According to the probabilistic approach, this has the
istic way (Schroyens and Schaeken, 2003). Going effect of reducing people’s estimates of the conditional
down this route means that people can no longer be probability of the car starting given you turn the key,
thought of as performing logical inferences. This is P(car starts|key turned). Thus, information about
because if they interpret a conditional logically and additional antecedents suppresses MP and MT
assume it is true, then there can’t be any counterexam- inferences.
ples, i.e. p and not-q possibilities, to search for. Explaining suppression effects for alternative ante-
cedents follows a similar pattern. Alternative anteced-
4.2.3 Probabilistic approach ents emphasize that, for example, it is possible to start
Suppression effects in conditional inference are cars without turning the key, e.g. by hot-wiring. They
explained in terms of the effects of additional and therefore suggest that the probability of the car start-
alternative antecedents on the appropriate conditional ing given you don’t turn the key, P(s|¬k), is higher
probabilities (Oaksford and Chater, in 2010b). than you first thought. This has to reduce the proba-
Suppose you are provided with an additional anteced- bility of the car not starting given that you do not turn
ent, or you retrieve one from memory. For example, the key, P(¬s|¬k). This is simply because these proba-
suppose you are presented with or retrieve from mem- bilities must sum to 1, i.e. P(s|¬k) + P(¬s|¬k) = 1. So if
ory the possibility that the petrol tank is empty. Your one goes up, the other must come down. The probabil-
estimate of the probability that the car will start must ity of the car not starting given that you do not turn
be based on the proportion of times it has started the key is the probability that you must assess to deter-
given you have turned the key. Because an empty pet- mine whether to draw the DA inference. This is why
rol tank will prevent your car from starting, then you alternative antecedents suppress the DA and AC infer-
must believe that this probability is smaller than your ences according to the probabilistic approach.
SUMMARY OF SECTION 4
In this section we have looked at two major experimental paradigms in conditional inference:
• the standard abstract task
• the suppression experiments.
How the various theories of the reasoning address these results was discussed:
• The abstract conditional inference task yields results that do not look consistent with logic.
• The mental logic theory explains these data by people using the more complex RAA inference to
perform MT and by some people adopting a bi-conditional interpretation.
• The mental model theory also appeals to the bi-conditional interpretation but proposes initial
semantic representations that can be ‘fleshed out’.
• The probabilistic approach suggests that the data can be explained by people assessing the appropriate
conditional probabilities.
CHAPTER 12 REASONING 379
These selections are rarely observed in the experi- This account relies on the following identities: MP = p
mental results. Typical results are: p and q cards card, DA = not-p card, AC = q card, and MT = not-q
(46 per cent); p card only (33 per cent); p, q, and not-q card.
cards (7 per cent); p and not-q cards (4 per cent); However, this account predicts that the proportion
other card combinations (10 per cent) (Johnson-Laird of people selecting the cards in the selection task
and Wason, 1970). That is, as few as 4 per cent of par- should mirror the proportion of participants endors-
ticipants select the response predicted by logic. ing the corresponding conditional inferences. But this
Participants typically select cards that could confirm is not observed. In particular, while the q card is
the rule, i.e. the p and q cards. However, according to endorsed more than the not-q card in the selection
logic, the choice of the q card is irrational, and is an task, the MT inference is endorsed more than the AC
example of so-called ‘confirmation bias’. That is, peo- inference in the conditional inference task. However,
ple appear to be trying to find cards that have an A (p) one reason for this may be the way the categorical
on one side and a 2 (q) on the other side. Consequently, premises are presented in the selection task. Take MT.
if we judge whether people are rational by a logical In the conditional inference task, people see if A then
standard then these results seem to indicate that peo- 2, not-2, therefore not-A. However, in the selection
ple are irrational. task, they see if A then 2, 7, with no explicit conclu-
The degree of people’s irrationality was further sion. The point is that they have to infer that 7 is an
illustrated by work on the matching effect. Evans and instance of the category of numbers that are not-2.
Lynch (1973) used rules that also contained nega- Presenting a negated premise in this way has been
tions, e.g. if there is an A on one side then there is not labelled an implicit negation (Evans et al., 1996) and
a 2 on the other side. Participants continued to select this is always the method used in the selection task. So
the A and the 2 card. For this rule these are now the what happens when implicit negations are used in the
logical responses because a card that does not have conditional inference task? The typical pattern for the
not-2 on it must have a 2 on it. However, if they were if A then 2 rule was MP = 95 per cent, DA = 38 per
showing confirmation bias they should now select the cent, AC = 79 per cent, and MT = 58 per cent (Evans
A and the 7 card. Selecting the A and the 2 card for and Handley, 1999), i.e. very close to the correspond-
both the standard and the negated rules seems only ing pattern of card selections in the selection task,
consistent with matching bias. That is, participants are given the identities above. This account may also
not engaging rationally in the task at all but are sim- explain the matching effect. If, for example, not-2 is
ply matching the cards to the letters and numbers shown on the cards, rather than 7, then the matching
mentioned in the rule. effect goes away (Evans et al., 1996). So the matching
effect may be a result of processing implicit negations
5.1.1 Mental logic and not a result of any inherent illogicality. In sum, it
The mental logic approach to the selection task is would appear that people may indeed be drawing con-
identical to the conditional inference task. The card ditional inferences in the selection task using the
sides that participants can see act as the categorical upturned face as the categorical premise.
premises in conditional inferences. So, for example,
given the rule if A then 2, deciding whether to turn the 5.1.2 Mental models
A card is equivalent to drawing an MP inference to The explanation of the selection task results is very
predict that there is a 2 on the other side. Moreover, similar to the conditional inference task. However,
suppose you adopt the bi-conditional interpretation, now people consider each possibility for whether
so you also believe that if 2 then A. Given this interpre- there could be something on the other side of the card
tation, deciding whether to turn the not A card is like that bears on the truth or falsity of the rule. We exam-
drawing an MT inference to predict that there is a not ine the card that should be turned for each interpreta-
2 on the other side (which is DA on the original rule). tion in Table 12.2 (page 374).
CHAPTER 12 REASONING 381
ACTIVIT Y 12 .4
See if you can work out which cards should be identities between card selections and conditional
selected for the bi-conditional interpretations and inferences in the mental logic section.
why (Table 12.2(c) and (d)). A clue is given by the
If the conditional interpretation is adopted but it is quantified as bits of information. People are initially
not fleshed out ((a) in Table 12.2) then people will assumed to be maximally uncertain about the rela-
only turn the A (p) card. This is because if it has a 2 on tionship between runny noses and colds. That is, the
the other side it confirms the rule but if it has a 7 (not- hypotheses that they are dependent and that they are
q) on the other side it falsifies the rule. The 2 card is independent are given an even chance (0.5) of being
not turned because whatever is on the other side, this true. This means that people’s uncertainty is the high-
card makes the rule true (refer back to the truth tables est it can be at 1 bit. Turning cards to reveal data
in Table 12.1). If the conditional interpretation is reduces this uncertainty. So, for example, turning the
adopted and fleshed out ((b) in Table 12.2) then peo- runny nose (p) card to find that John did not have a
ple will turn the A (p) and the 7 (not-q) cards. The cold (not-q) on this occasion should reduce my uncer-
reason for the selection of the A (p) card is the same as tainty about which hypothesis is true. I should now be
in (a). The 7 (not-q) card is now selected because it is more certain that, for John, runny noses and colds are
represented and if it has an A (p) on the other side it independent (see Box 12.1). This reduction in my
falsifies the rule. The frequencies of card selections uncertainty is called information gain. However, par-
depend on the proportions of participants adopting ticipants don’t actually turn the cards over. So what
the different interpretations. gets calculated is expected information gain. This is the
The matching effect is given exactly the same expla- reduction in uncertainty averaged over the two possi-
nation in mental models theory as in mental logic. bilities, i.e. the other side of the runny nose card could
That is, it is a product of having to process implicit reveal that John had a cold or that he did not, on this
negations (Evans and Handley, 1999; Johnson-Laird occasion.
and Byrne, 2002). Expected information gain can be calculated for
each card (Box 12.1 shows the calculation for just the
5.1.3 Probabilistic approach p card [runny nose]). Calculating the relevant proba-
The probabilistic approach suggests that selecting bilities of what is on the other side for each card
the p and the q card, far from being irrational, is the involves the same three probabilities as in the condi-
optimal response. The general idea is quite simple, tional inference task. That is, the probability that John
although the mathematics can be a bit off-putting has a runny nose, P(r), the probability that he has a
(Oaksford and Chater, 1994, 1996). We provide a cold, P(c), and the probability that he has a cold given
worked example in Box 12.1. The idea is that in the that he has a runny nose, P(c|r). If P(r) and P(c) are
selection task people are looking for the most inform- both low (as in Box 12.1, i.e. 0.2 and 0.3 respectively)
ative evidence to decide whether John’s having a runny then the expected information gain for the q card
nose is more often associated with having a cold than (John has a cold) is higher than for the not-q card (John
you would expect by chance. If it is, then there is a does not have a cold). Therefore, this model explains
relationship between his runny nose and his having a the standard finding as a rational consequence of
cold so that his runny nose allows you to predict that seeking the most informative data. We can perhaps
he has a cold: they are dependent. If there is no such see why this happens intuitively using an alternative
relationship, then they are independent. To determine example rule: if a pan drops in the kitchen, then it
which cards are more informative, information is makes a clanging noise. According to logic, testing this
382 PART 4 THINKING
HD Dependence Hypothesis: if
runny nose then cold P(c|r) = 0.9
Runny
nose HI Independence Hypothesis:
No relationship P(c|r) = P(c) = 0.3
Assume runny nose card is turned to
Seen Side reveal no cold; this is the data, D.
P(r) = 0.20
Belief before turning the card:
P(HD) = P(HI) = 0.5
P(c) = 0.30
Unseen
Uncertainty Before: I(Hi) =
Side
⎛ 1 ⎞
∑ P (Hi)log2 ⎜ ⎟ = 1 bit
i ⎝P (Hi)⎠
Cold No cold
Therefore, uncertainty after = 0.125 log2 (1/0.125) + 0.875 log2 (1/0.875) = 0.544 bits
Amount by which uncertainty has reduced, or Information Gain = I(Hi) – I(HD|D) =
1 – 0.544 = 0.456 bits. However, the card is never turned. So the expected uncertainty
after turning the card is calculated. By similar means we can calculate the uncertainty after
finding cold = 0.811. Expected uncertainty = 0.5 × (0.9 + 0.3) × 0.811 + 0.5 × (0.1 + 0.7)
× 0.544 = 0.704.
Therefore, the expected reduction in uncertainty, or expected information gain, after
turning the runny nose card = 1 – 0.704 = 0.296 bits.
hypothesis would involve investigating every instance people should select the John has a cold card for this
of not hearing a clanging noise, to see whether a pan rule as well, which is the matching effect.
has dropped noiselessly so falsifying this rule. This
clearly makes no sense because not hearing a clanging
noise is a very rare event. 5.2 The deontic selection task
This account also explains the matching effect as a
rational consequence of manipulating probabilities In this section we look at the task that has recently
(Oaksford and Chater, 1994). The probability that engendered the most controversy in reasoning
John does not have a cold is greater than the probabil- research. This is largely because of the strong claim
ity that he does: most people are cold free most of the made by evolutionary psychology that this research
time. So, apart from being implausible, a rule like if reveals the effects of various innate cognitive modules.
John has a runny nose, he does not have a cold, intro- In this section we will therefore also consider this
duces a high probability event in the consequent. It approach to human reasoning.
turns out that if either the antecedent or consequent Some early work on the selection task seemed to
has a high probability, then the expected information show that logic-like performance was observed when
gain for the not-q card is higher than for the q card. So real-world materials, as opposed to abstract materials,
CHAPTER 12 REASONING 383
were used (Wason and Shapiro, 1971). People seemed This point came sharply into focus when researchers
to make more logical p and not-q card selections for began to investigate the factors that affect reasoning
rules like: with deontic conditionals. Rule (10) is an obligation
rule, i.e. it describes the pre-conditions (having an inoc-
(8) If Johnny travels to Manchester, he takes the ulation against cholera) that you are obliged to satisfy to
train and carry out an action, i.e. entering the country. These
deontic rules can also be framed as permission rules
(Cosmides, 1989). So Rule (10) could be expressed as:
(9) If you use a 2nd class stamp, you must leave
the envelope unsealed. (11) If you have a cholera inoculation, then you
may enter the country.
revealed that logical reasoning was not being facili- Factual possibility ¬enter ¬inoculation Deontic
tated. This is because the not-p and q card selection possibility
cannot be predicted from logic, although it makes Factual possibility enter ¬inoculation Deontic
perfect sense for the rules introduced in the deontic impossibility
selection task. We now look at how these findings have
been interpreted by the different psychological theo- That is, people explicitly label or mentally tag the dif-
ries of reasoning. ferent possibilities indicating whether they are per-
missible (deontically possible) or impermissible
5.2.1 Mental logic (deontically impossible). Exactly the same mental rep-
Mental logicians have not explicitly addressed the resentation is formed of (11) If you have a cholera
deontic selection task. However, philosophers and inoculation, then you may enter the country. So in both
mathematicians have formulated logical theories that cases people are looking for cases that are deontically
deal with the ‘modal’ terms, e.g. must and may, which impossible. This explains why the logically differ-
feature in deontic conditionals. So, mental logic might ent cases are selected for the rules (10) and (11).
be extended to these inferences in the future Even though different logical cases are being selected
(Manktelow and Over, 1987). because of the action and precondition switching
between antecedent and consequent, the same deon-
5.2.2 Mental models tic case is being selected (Johnson-Laird and
In its basic principles the mental models account of the Byrne, 2002).
deontic selection task is continuous with the explanation
provided for the standard selection task and indeed for 5.2.3 The probabilistic approach
all reasoning. People represent possibilities and identify The probabilistic approach to the deontic selection
counterexamples. The crucial distinction for explaining task adopts the decision theoretic approach first pro-
the deontic selection task is that what is deontically pos- posed by Manktelow and Over (1987, 1991). In deci-
sible or permissible does not correspond to what is factu- sion theory (see Chapter 11) people make choices that
ally possible (Johnson-Laird and Byrne, 2002). So for help to maximize expected utility, where utilities are
example, if it is true that if I turn the key then the car the values people place on various outcomes. In the
starts, then the three models in Table 12.2(b) are factually deontic selection task, the instructions ask people to
possible, but the model in which the key is turned but the place a high value on instances of unfairness, e.g.
car does not start is not possible. However, take the rule where someone enters the country without a cholera
(10) If you are entering the country, you must have a chol- inoculation.
era inoculation. For this rule, all four truth table cases are Oaksford and Chater’s (1994) formal model can be
factually possible – even the case where someone enters very easily illustrated by annotating probabilities and
the country without a cholera inoculation. The deontic utilities in a mental model (Johnson-Laird et al., 1999)
rule does not say that this does not happen, it says that it of the possible outcomes in a deontic selection task:
should not happen, i.e. it is factually possible but deonti-
Utilities Probabilities
cally impermissible. This means that the representation
of (10) is as follows: enter inoculation –0.1 0.25
¬enter inoculation –0.1 0.25
10 ¬enter ¬inoculation –0.1 0.25
Factual possibility enter inoculation Deontic enter ¬inoculation 5 0.25
possibility
When you are told that you are an enforcer of the regula-
Factual possibility ¬enter inoculation Deontic tion that if you are entering the country, then you must
possibility have a cholera inoculation, you realize that your goal is to
CHAPTER 12 REASONING 385
find people who are entering the country but who do seems to support these predictions (Kirby, 1994;
not have an inoculation against cholera. You therefore Manktelow et al., 1995).
assign a high positive utility of 5 to this case. All other
possibilities are not interesting so they are assigned a 5.2.4 Evolutionary psychology
small negative utility of –0.1. Assume that on the par- Evolutionary psychology is a general movement in psy-
ticular plane that has just landed you have no knowledge chology that sees many of our cognitive mechanisms as
either of how likely people are to have a cholera inocula- innately specified, having evolved to cope with adaptive
tion or how likely they are to be trying to enter the coun- problems confronted by early humans. Evolutionary
try. Consequently the four possibilities are equally likely. psychologists have argued that various aspects of
You can now calculate the expected utility associated human reasoning might also be under the control of
with turning each card. So for the card marked enter you innately specified cognitive modules (Cosmides, 1989;
need to consider the probability that this person has or Fiddick et al., 2000). In particular, they suggest that
has not got a cholera inoculation. Therefore you need to deontic reasoning is one such domain.
calculate two probabilities. The probability of the person Many of the effects observed in the deontic selec-
having an inoculation given they are trying to enter is tion task can be explained by cognitive modules for
0.5, i.e. the probability of entering with an inoculation social contracts modules (Cosmides, 1989; Fiddick
(0.25) divided by the probability of having a cholera et al., 2000). This domain was vital in the past when
inoculation (0.5). A similar calculation gives the same early humans were evolving in social groups. A social
values for the probability that the person does not have exchange situation involves satisfying some kind of
an inoculation given that they are trying to enter. These requirement in order to receive a benefit from some
probabilities are then multiplied by the corresponding other individual or group. This can be expressed as the
utilities and summed to provide the expected utility social contract: if you accept the benefit then you must
(EU) associated with turning the card: satisfy the requirement. An equivalent form of this rule
is if you satisfy the requirement then you are entitled to
EU(enter) = P(inoculation | enter) × U(enter, the benefit. The cognitive module specialized for rea-
inoculation) + P(¬inoculation | enter) soning about social contracts is largely insensitive to
× U(enter, ¬inoculation) the logic of the conditionals used to describe them.
EU(enter) = (0.5 × 5) + (0.5 × –0.1) = 2.45 What is important for survival out on the Savannah is
that you do not get cheated in these social exchange
Similar calculations can be carried out for each card: situations. Consequently, you should be on the look-
out for people who take the benefit but who do not
EU(¬enter) = (0.5 × –0.1) + (0.5 × –0.1) = –0.1 meet the requirement. Of course, for the if you are
EU(inoculation) = (0.5 × –0.1) + (0.5 × –0.1) = –0.1 entering the country, then you must have a cholera
EU(¬inoculation) = (0.5 × 5) + (0.5 × –0.1) = 2.45 inoculation rule, this corresponds to someone trying
to enter the country without an inoculation against
According to the principle of maximizing expected cholera. Consequently, this account can explain the
utility, you should therefore pick the enter (p) card and results of the standard deontic selection task.
the not-inoculation (not q) card. What distinguishes this account from other expla-
This decision theoretic account gives the same nations? The point of invoking cognitive modules is
answers as mental models theory. However, it suggests that they are automatically invoked and will tend to
that people’s deontic reasoning should be sensitive to override any domain-general reasoning abilities we
more than the deontic permissibility of the available may possess. Moreover, because they are domain spe-
possibilities. It suggests that manipulations of utility cific, they should only apply to situations where there
and probability should also affect people’s deontic is a clear benefit and requirement involved. Cosmides
reasoning in a graded manner. There is evidence that (1989) constructed two task versions using rules like if
386 PART 4 THINKING
a student is to be assigned to Grover High School, then I want some potatoes, to which you respond I want
that student must live in Grover city. In one version of some corn. Participants are then given four cards cor-
the task participants were told that going to Grover responding to four people marked: you gave this per-
High was a benefit compared to going to Hanover son potatoes, you gave this person nothing, this person
High (the not-p case). In another version this infor- gave you corn, and this person gave you nothing.
mation was not included, so although one is obliged to Participants are asked to check whether any of the
live in Grover city to go to Grover High, there is no people represented by the cards have cheated them.
suggestion that going to Grover High is of any benefit Both groups performed equally well. Now this could
to you. Far more people selected the p and not-q cards be because people interpret the rule-less version as
when the benefit was explicitly mentioned than when involving the rule. However, Fiddick et al. (2000)
it was not. Consequently, it would appear that the observed that people could translate the rule-less sce-
obligation rule form is not sufficient to produce the p nario into any one of four different underlying rules,
and not-q response; the p and the q must be under- any one of which would be consistent with a social
stood as a benefit and as a requirement respectively. exchange, but only one of which could produce the
Further experiments appeared to show that people observed results. Consequently, it would seem that
have an automatic understanding of social exchange reliable deontic selection task performance requires
situations in the absence of any rules (Fiddick et al., the appropriate benefits and requirements to be speci-
2000). In one condition, participants were given the fied but is independent of the use of a conditional rule.
rule if you give me some potatoes, then I will give you The latter excludes any explanation of these tasks
some corn. In another condition participants were told where the logic of the conditional plays a role.
to imagine they were a farmer who walks into the However, this interpretation has been the subject of
neighbouring village and meets someone who says intense debate (Sperber and Girotto, 2002).
SUMMARY OF SECTION 5
In this section we have looked at two major reasoning paradigms using the Wason selection task:
• the standard abstract task and the matching effect
• the deontic selection task.
How the various theories of reasoning address these results was discussed. For the abstract task:
• Mental logic suggests that people use the card face they can see to draw conditional inferences.
• Mental models suggests that people check their mental models for cases that might bear on the truth
or falsity of the rule.
• The probabilistic approach suggests that people are seeking the most informative evidence to deter-
mine whether p and q are dependent or not.
For the deontic selection task:
• Mental logic has not been extended to these data, although there are logics for this mode of reasoning.
• Mental models proposes that people label the various factual possibilities with whether they are deon-
tically permissible or impermissible.
• The probabilistic approach explains these effects by the way that the context affects the utilities associ-
ated with the various possible outcomes of turning a card.
• Evolutionary psychology proposes that we possess innate cognitive modules for reasoning about social
contracts that are independent of the conditional rules.
The current controversy concerns whether domain-general accounts can explain these results or
whether domain-specific mechanisms are needed.
CHAPTER 12 REASONING 387
6 DISCUSSION
We have seen how these different theories account for the • They preserve a full logical conception of what it is
most researched experimental tasks in human reasoning. to reason rationally.
The ability to explain these results is one main criterion by
However, they also have some disadvantages:
which to judge these theories. As we saw they all fared
reasonably well. In this final section, we continue evaluat- • It is unclear how mental logic can apply to a range
ing these different theories, in particular for what they of data on, for example, the graded phenomena
have to say about the issue of human rationality. We also observed in the suppression experiments.
take the opportunity to introduce some further evidence • Consequently, the range of coverage of the theory
that might help decide between these theories. In evaluat- is quite narrow.
ing theories, there are two possible approaches, competi-
tive and integrative. In a competitive approach, each Recently, this has led some mental logicians (Rips,
theory is regarded as in competition to be the one true 2001, 2002) to propose a sharp distinction between
theory of reasoning. The idea is that the proponents of non-deductive and deductive reasoning. The former
each theory fight their own corner, attempting to find the are evaluated in terms of how probable the premises
killer argument or experiment that will support their the- make the conclusion, which Rips calls inductive
ory and falsify all the others. This approach tends to lead strength. People may be able to evaluate arguments for
to acrimonious exchanges in the literature. However, both inductive strength and deductive validity. This last
rarely is any argument or evidence regarded as fatal. issue points to a possible integration whereby mental
Indeed, in this and in many other areas of psychology, logic deals with clear-cut cases of deductive reasoning
such wrangles usually end up in some kind of compro- and theories like the probabilistic approach deal with
mise position where it is conceded that each theory prob- the rest.
ably has its own merits and proper domain of application.
Consequently, the final position arrived at is often an inte- 6.1.2 Mental models
gration of theoretical positions. In this light, we first look Features in favour of mental models include:
at the relative merits of each theory before closing this
chapter by looking to integrative approaches. • The range of coverage of the data. For many
phenomena in human reasoning mental models
provides the only existing account. This suggests
6.1 Theoretical evaluation that while mental logic may have the advantage of
depth, mental models has the advantage of
In this section we look at each theory and examine breadth.
further evidence to distinguish between these theories • More reasoning researchers work in this
where it exists. However, this evaluation will fall short framework than in any other.
of plumping for one theory over another.
However, as with mental logic there are some
6.1.1 Mental logic problems:
Mental logic theories have several advantages:
• Pragmatic modulation does not seem consistent
• They are formally very well specified. This means with graded effects. If a counterexample is
that theoreticians are able to prove mathematically accessed then the inference should not be drawn,
what can be predicted by these theories. and if it is not accessed then it should be drawn.
388 PART 4 THINKING
There are also some more general issues: 6.1.3 Probabilistic approach
• The attempt to provide the ‘crucial experiment’
The general advantages of the probabilistic approach
that clearly falsifies mental logic while supporting
are:
mental models has largely been unsuccessful
(although this is largely in the eye of the beholder • Much more of human reasoning behaviour can be
and some recent work may be argued to play this seen as rational but account must be taken of
role; Johnson-Laird and Savary, 1999). people’s prior knowledge of the environment, e.g.
the rarity assumption.
It is difficult to gauge what mental models theory says
about human rationality. Although initially motivated • Predictions can be derived for how manipulating
by the logical meanings associated with the structure- probabilities and utilities should affect reasoning
building words, mental models theory has been performance. These have generally been
extended well beyond the scope of standard logic. confirmed.
Within the scope of standard logical inference, mental The disadvantages of the probabilistic approach are:
models can be seen as preserving human rationality
• The coverage of the probabilistic approach is small
because it approximates logical reasoning. However,
compared to the mental models approach.
beyond the scope of standard logical inference, mental
models theorists rarely show that their theories • The theory only provides an account of how the
approximate any logical or mathematical theory of cognitive system should behave given certain
reasoning. Consequently, in these domains it is diffi- inputs. It does not provide an account of the
cult to tell whether the theory preserves human cognitive representations and processes involved
rationality or not. This is where the mental logic the- that some feel is the proper level of psychological
ory and the probabilistic approach agree – both explanation.
attempt to preserve human rationality by showing that It is important to bear in mind that this theory sug-
most reasoning behaviour approximates to either gests that the standard of rationality should change.
logic or probability theory. Rather than judge human reasoning by logical stand-
The cognitive neuroscience of reasoning may also ards, it should be judged by a probabilistic standard.
address the issue of whether people reason with a lan- When it is, a lot more of people’s behaviour can be
guage-based mental logic or more imagery-based viewed as rational than the early experiments on
mental models. For example, there is a neuroimaging human reasoning led us to expect.
study that analysed people while they performed con-
ditional inference and other reasoning tasks (Goel 6.1.4 Evolutionary psychology
et al., 1998). It was found that activation was primarily It is difficult to judge the evolutionary psychology
restricted to the left hemisphere language centres approach by the same standards as the other theories
rather than the right hemisphere imagery systems. because even compared to the mental logic and proba-
Results like this seem to argue for a mental logic bilistic approaches its scope is extremely limited.
approach. More recently, Kroger et al. (2008) have However, within the domain of deontic reasoning
shown that regions in the right prefrontal cortex and there is some further neuropsychological evidence
inferior parietal lobe were more active in reasoning, that may be relevant. The evolutionary approach sug-
consistent with an imagery-based mental models gests that people have two innate cognitive modules,
approach. However, such data is far from conclusive one for social contracts and one for reasoning about
and there are serious difficulties in localizing reason- hazard management. The latter involves reasoning
ing ability in the brain (Goel, 2007). Nonetheless, this about rules like if you clear up blood, you must wear
is certainly an interesting future direction for reason- rubber gloves (Manktelow and Over, 1991). The rule
ing research. indicates the precautions you should take given that
CHAPTER 12 REASONING 389
you encounter a hazardous situation. According to the rational in one sense when their reasoning conforms
domain-general theories, such rules are dealt with by to a normative standard like logic. They are rational
the same mechanisms that deal with social contract in another sense when they reason so as to achieve
rules. However, there is recent evidence of a neuropsy- their goals in the world, regardless of whether their
chological patient with brain damage who shows an reasoning conforms to a normative standard.
impaired ability to reason about social contracts but Different mental processes are involved in these
an intact ability to reason about hazard management forms of reasoning.
rules (Stone et al., 2002). This seems to suggest that One way of conceiving of the distinction between
this patient has an intact innate hazard management the processes involved is in terms of what Evans
module but a damaged innate social contract module. (2007) refers to as Type 1 and Type 2 processing.
However, unless a patient is found with the opposite Type 1 consists of long-term memory (LTM) pro-
deficit, i.e. impaired hazard management reasoning cesses (see Chapter 8) involving associations and
and intact social contract reasoning, these results heuristics. Type 2 consists of analytic processes that
remain inconclusive. are carried out in working memory (WM), which is
a late evolutionary development (see Chapter 9).
That is, these processes go on in different parts of the
6.2 Integrative approaches cognitive architecture (see Chapter 19). (NB This
is wholly different to the use of the terms Type I
One of the most important recent developments in the and Type II processing in relation to long-term
psychology of reasoning has been the attempt to see memory – see Chapter 8.)
how far an integrative approach is possible that appeals
to more than one theory. Indeed, in a recent edited 6.2.2 Individual differences
collection of work on conditional inference (Oaksford An important recent source of evidence for a dual
and Chater, 2010a), nearly a third of the chapters took process approach is the study of individual differences
an explicitly integrative approach. Two pre-existing (Stanovich, 2011; Stanovich and West, 2000). For
strands in the psychology of reasoning have under- example, it has been shown that the ability to make the
pinned these developments: dual process theories and logically correct response on the selection task is asso-
work on individual differences. ciated with IQ (Stanovich and West, 1998). It would
appear that participants with high IQ are capable of
6.2.1 Dual process theories interpreting this task logically. However, if these par-
Dual process theories have a long pedigree in rea- ticipants are removed then IQ seems to correlate with
soning research (Evans, 1984, 2007; Evans and Over, the standard p and q card response (Newstead et al.,
1996; Stanovich, 2011; Stanovich and West, 2000). 2004). This evidence seems to argue for a dual process
These theories suggest a two-way partition in rea- theory. People possess automatic unconscious reason-
soning abilities. As we have already suggested, this is ing mechanisms that operate in accordance with
similar to the ideas of some mental logic theorists probabilistic standards of reasoning. However, those
who have invoked the distinction between deductive with higher IQs are capable of ignoring the prior
and non-deductive reasoning (Rips, 2002). Typically knowledge that is required to determine the relevant
these theories suggest that we do have a, perhaps probabilities, and of reasoning logically about
limited, ability for explicit logical reasoning that may the task.
be embodied in a mental logic or in mental models.
However, a lot of reasoning goes on implicitly and is Direct evidence for integrative
6.2.3
evidence that within individuals both processes may multinomial processing tree model. The fine detail need
be observed. We mention two sources of such evi- not concern us. What this approach does is to assign
dence for dual processing. First, there is evidence that values to how likely participants are to make particu-
Type 1 processes involving prior probabilistic beliefs lar processing choices and combinations of choices.
held in LTM are produced rapidly, but when people The model homes in on those values that will result in
take more time they produce responses more consist- the observed patterns of data. This approach also pro-
ent with analytic Type 2 processes (Verschueren et al., vides an index of how well each model fits the data, i.e.
2005; but see Handley et al., 2011). Second, in an how well each model predicts each data point. The
ingenious neuroimaging experiment, De Neys et al. conclusion was that a particular dual process account
(2008) monitored the brain regions believed to be provided better fits to the data than, in particular, the
involved in conflict detection (anterior cingulate) probabilistic approach. However, this may be an odd
when people either produced a Type 1 belief-biased comparison to make, as for many proponents of dual
response not consistent with the Type 2 analytic process theories the probabilistic approach provides
response, or when they produced a Type 2 analytic the theory of Type 1 processes. More recent modelling
response. They found that conflict detection centres of dual processes (Oaksford and Chater, 2010b) shows
were active in the brain when both responses were how given the WM/LTM cognitive architecture
produced. So, even when responding reflexively via assumed in almost all cognitive theory, implementing
Type 1 processes, people seem unconsciously to the probabilistic approach will require WM represen-
‘know’ that there is conflict with the response they tations like those proposed by mental models theory
‘should’ produce via Type 2 analytic processes. (see also Evans, 2007).
In conclusion, while the jury is still very far from
6.2.4 Modelling integrative approaches delivering a verdict on the correct theory of human
Other evidence for the particular processes involved reasoning, the recent emergence of integrative
comes from attempts to model the underlying cogni- approaches seems like a very positive development.
tive processes (see Chapter 19) to see which theory or This marks out the last ten years of research as
combination of theories provides the best fit to the something of a paradigm shift towards what Over
data. For example, Oberauer (2006) tested a variety of (2009) refers to as a new paradigm psychology of
theories by combining them using something called a reasoning.
FURTHER READING
Evans, J.St.B.T. (2007) Hypothetical thinking: Dual Processes in Oxford University Press. The definitive statement of Oaksford
Reasoning and Judgment, Hove, UK, Psychology Press. The and Chater’s probabilistic approach, which provides the philo-
definitive statement of dual process theory by its originator, sophical motivation and origins in the instructive failures of artifi-
Jonathan Evans. cial intelligence.
Johnson-Laird, P.N. (2006) How We Reason, Oxford, Stanovich, K.E. (2011) Rationality and the Reflective Mind,
Oxford University Press. The most recent book-length treat- Oxford, Oxford University Press. The most recent summary of
ment of Johnson-Laird’s long-standing mental models theory. Keith Stanovich’s dual process approach, richly integrated into
Oaksford, M. and Chater, N. (2007) Bayesian Rationality: contemporary philosophy of rationality and mind.
The Probabilistic Approach to Human Reasoning, Oxford,
CHAPTER 12 REASONING 391
REFERENCES
Boole, G. (1854) An Investigation of the Laws of Thought on representations and inferences in the Wason selection task’,
which are Founded the Mathematical Theories of Logic and Cognition, vol.77, no.1, pp.1–79.
Probabilities, Cambridge, UK, Macmillan & Co. Goel, V. (2007) ‘The anatomy of deductive reasoning’,
Braine, M.D.S. and O’Brien, D.P. (eds.) (1998) Mental Trends in Cognitive Sciences, vol.11, pp.435–41.
Logic, Mahwah, NJ, Lawrence Erlbaum Associates. Goel, V., Gold, B., Kapur, S., and Houle, S. (1998)
Byrne, R.M.J. (1989) ‘Suppressing valid inferences with ‘Neuroanatomical correlates of human reasoning’,
conditionals’, Cognition, vol.31, pp.1–21. Neuropsychologia, vol.29, pp.901–9.
Byrne, R.M.J., Espino, O., and Santamaria, C. (1999) Handley, S.J., Newstead, S.E., and Trippas, D. (2011) ‘Logic,
‘Counterexamples and the suppression of inferences’, Journal beliefs, and instruction: a test of the default interventionist
of Memory and Language, vol.40, pp.347–73. account of belief bias’, Journal of Experimental Psychology:
Cheng, P.W. and Holyoak, K.J. (1985) ‘Pragmatic reasoning Learning, Memory, and Cognition, vol.37, pp.28–43.
schemas’, Cognitive Psychology, vol.17, pp.391–416. Inhelder, B. and Piaget, J. (1958) The Growth of Logical
Cosmides, L. (1989) ‘The logic of social exchange: has natu- Reasoning, New York, Basic Books.
ral selection shaped how humans reason? Studies with the Johnson-Laird, P.N. (1983) Mental Models, Cambridge,
Wason selection task’, Cognition, vol.31, pp.187–276. Cambridge University Press.
Cummins, D.D. (1995) ‘Naive theories and causal deduc- Johnson-Laird, P.N. (2006) How We Reason, Oxford,
tion’, Memory and Cognition, vol.23, no.5, pp.646–58. Oxford University Press.
Cummins, D.D., Lubart, T., Alksnis, O., and Rist, R. (1991) Johnson-Laird, P.N. and Byrne, R.M.J. (1991) Deduction,
‘Conditional reasoning and causation’, Memory & Cognition, Hillsdale, NJ, Erlbaum.
vol.19, pp.274–82. Johnson-Laird, P.N. and Byrne, R.M.J. (2002) ‘Conditionals:
De Neys, W., Vartanian, O., and Goel, V. (2008) ‘Smarter a theory of meaning, pragmatics, and inference’, Psychological
than we think: when our brains detect that we are biased’, Review, vol.109, no.4, pp.646–78.
Psychological Science, vol.19, pp.483–9. Johnson-Laird, P.N. and Savary, F. (1999) ‘Illusory infer-
Ebbinghaus, H. (1885) Memory (H.R. and C.E. Bussenius, ences: a novel class of erroneous deductions’, Cognition, vol.71,
trans.), New York, Teachers College, Columbia University no.3, pp.191–229.
(1913). Johnson-Laird, P.N. and Wason, P.C. (1970) ‘Insight into a
Evans, J.St.B.T. (1977) ‘Linguistic factors in reasoning’, logical relation’, Quarterly Journal of Experimental Psychology,
Quarterly Journal of Experimental Psychology, vol.29, vol.22, no.1, pp.49–61.
pp.297–306. Johnson-Laird, P.N., Legrenzi, P., Girotto, V., Legrenzi,
Evans, J.St.B.T. (1984) ‘Heuristic and analytic processes in M.S., and Caverni, J.P. (1999) ‘Naive probability: a mental
reasoning’, British Journal of Psychology, vol.75, pp.451–68. model theory of extensional reasoning’, Psychological Review,
Evans, J.St.B.T. (2007) Hypothetical Thinking: Dual Processes vol.106, no.1, pp.62–88.
in Reasoning and Judgment, Hove, UK, Psychology Press. Kirby, K.N. (1994) ‘Probabilities and utilities of fictional
Evans, J.St.B.T. and Handley, S.J. (1999) ‘The role of nega- outcomes in Wason’s four card selection task’, Cognition,
tion in conditional inference’, Quarterly Journal of vol.51, pp.1–28.
Experimental Psychology: Human Experimental Psychology, Kroger, J.K., Nystrom, L.E., Cohen, J.D., and Johnson-Laird,
vol.52A, no.3, pp.739–69. P.N. (2008) ‘Distinct neural substrates for deductive and math-
Evans, J.St.B.T. and Lynch, J.S. (1973) ‘Matching bias in the ematical processing’, Brain Research, vol.1243, pp.86–103.
selection task’, British Journal of Psychology, vol.64, pp.391–7. Manktelow, K.I. and Over, D.E. (1987) ‘Reasoning and
Evans, J.St.B.T. and Over, D.E. (1996) Rationality and rationality’, Mind and Language, vol.2, pp.199–219.
Reasoning, Hove, UK, Psychology Press. Manktelow, K.I. and Over, D.E. (1991) ‘Social roles and
Evans, J.St.B.T., Clibbens, J., and Rood, B. (1996) ‘The role utilities in reasoning with deontic conditionals’, Cognition,
of implicit and explicit negation in conditional reasoning bias’, vol.39, pp.85–105.
Journal of Memory and Language, vol.35, no.3, pp.392–409. Manktelow, K.I., Sutherland, E.J., and Over, D.E. (1995)
Fiddick, L., Cosmides, L., and Tooby, J. (2000) ‘No interpre- ‘Probabilistic factors in deontic reasoning’, Thinking and
tation without representation: the role of domain-specific Reasoning, vol.1, pp.201–20.
392 PART 4 THINKING
Newstead, S.E., Handley, S.J., Harley, C., Wright, H., and Quinn, S. and Markovits, H. (2002) ‘Conditional reasoning
Farrelly, D. (2004) ‘Individual difference in deductive reason- with causal premises: evidence for a retrieval model’, Thinking
ing’, Quarterly Journal of Experimental Psychology, vol.57, and Reasoning, vol.8, no.3, pp.179–91.
pp.33–60. Rips, L.J. (1994) The Psychology of Proof, Cambridge, MA,
Oaksford, M. and Chater, N. (1994) ‘A rational analysis of MIT Press.
the selection task as optimal data selection’, Psychological Rips, L.J. (2001) ‘Two kinds of reasoning’, Psychological
Review, vol.101, pp.608–31. Science, vol.121, no.2, pp.129–34.
Oaksford, M. and Chater, N. (1996) ‘Rational explanation Rips, L.J. (2002) ‘Reasoning imperialism’, in Elio, R. (ed.)
of the selection task’, Psychological Review, vol.103, pp.381–91. Common Sense, Reasoning and Rationality, New York, Oxford
Oaksford, M. and Chater, N. (1998) Rationality in an University Press.
Uncertain World: Essays on the Cognitive Science of Human Schroyens, W. and Schaeken, W. (2003) ‘A critique of
Reasoning, Hove, Psychology Press. Oaksford, Chater, and Larkin’s (2000) conditional probability
Oaksford, M. and Chater, N. (2003a) ‘Computational levels model of conditional reasoning’, Journal of Experimental
and conditional inference: reply to Schroyens and Schaeken Psychology: Learning, Memory, and Cognition, vol.29, no.1,
(2003)’, Journal of Experimental Psychology: Learning, Memory, pp.140–9.
and Cognition, vol.29, no.1, pp.150–6. Sperber, D. and Girotto, V. (2002) ‘Use or misuse of the
Oaksford, M. and Chater, N. (2003b) ‘Optimal data selec- selection task? Rejoinder to Fiddick, Cosmides, and Tooby’,
tion: revision, review and re-evaluation’, Psychonomic Bulletin Cognition, vol.85, no.3, pp.277–90.
and Review, vol.10, pp.289–318. Stanovich, K.E. (2011) Rationality and the Reflective Mind,
Oaksford, M. and Chater, N. (2007) Bayesian Rationality: Oxford, Oxford University Press.
The Probabilistic Approach to Human Reasoning, Oxford, Stanovich, K.E. and West, R.F. (1998) ‘Cognitive ability and
Oxford University Press. variation in selection task performance’, Thinking and
Oaksford, M. and Chater, N. (2009) ‘Precis of Bayesian Reasoning, vol.4, no.3, pp.193–230.
rationality: the probabilistic approach to human reasoning’, Stanovich, K.E. and West, R.F. (2000) ‘Individual differ-
Behavioral and Brain Sciences, vol.32, pp.69–120. ences in reasoning: implications for the rationality debate?’
Oaksford, M. and Chater, N. (eds.) (2010a) Cognition and Behavioral and Brain Sciences, vol.23, no.5, pp.645–64.
Conditionals: Probability and Logic in Human Thinking, Stone, V.E., Cosmides, L., Tooby, J., Kroll, N., and Knight,
Oxford, Oxford University Press. R.T. (2002) ‘Selective impairment of reasoning about social
Oaksford, M. and Chater, N. (2010b) ‘Conditionals and exchange in a patient with bilateral limbic system damage’,
constraint satisfaction: reconciling mental models and the Proceedings of the National Academy of Sciences, vol.99, no.17,
probabilistic approach?’ in Oaksford, M. and Chater, N. (eds.) pp.11 531–11 536.
Cognition and Conditionals: Probability and Logic in Human Taplin, J.E. (1971) ‘Reasoning with conditional sentences’,
Thinking, Oxford, Oxford University Press. Journal of Verbal Learning and Verbal Behaviour, vol.10,
Oaksford, M., Chater, N., and Larkin, J. (2000) ‘Probabilities pp.219–25.
and polarity biases in conditional inference’, Journal of Verschueren, N., Schaeken, W., and d’Ydewalle, G. (2005)
Experimental Psychology: Learning, Memory, and Cognition, ‘A dual-process specification of causal conditional reasoning’,
vol.26, pp.883–99. Thinking & Reasoning, vol.11, pp.239–78.
Oberauer, K. (2006) ‘Reasoning with conditionals: a test of Wason, P.C. (1968) ‘Reasoning about a rule’, Quarterly
formal models of four theories’, Cognitive Psychology, vol.53, Journal of Experimental Psychology, vol.20, pp.273–81.
pp.238–83. Wason, P.C. and Shapiro, D. (1971) ‘Natural and contrived
Over, D.E. (2009) ‘New paradigm psychology of reasoning’, experience in a reasoning problem’, Quarterly Journal of
Thinking & Reasoning, vol.15, pp.431–8. Experimental Psychology, vol.23, pp.63–71.
CONTR IB UTION S
FROM THE
COG NITIVE
NEU ROSCIENCES
Introduction
13 Cognitive neuropsychology
Gianna Cocchini
14 Neuroimaging
Ingrid Johnsrude and Olaf Hauk
15 Cognitive neuropsychiatry
David Okai, Angus Gellatly, and Anthony David
394 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
INTRODUCTION
This part of the book represents a shift in emphasis. be implemented in the brain. No matter how well the
While the preceding chapters have each focused on a model might have been developed and argued, learn-
topic within cognition and explored what the research ing that it could not possibly be implemented in a
of cognitive psychologists has revealed, the next three human brain would be prima facie evidence that
chapters all, in one way or another, detail a different human beings don’t achieve visual perception in the
approach to investigating cognition. It is an approach way the model proposes. The constraint from the
that brings together a focus on cognition with research hardware level can also work the other way around. It
programmes that are typically described as instances is possible that we discover interesting properties of
of neuroscience. the brain that lead us to believe some classes of algo-
Why should a cognitive psychologist be interested rithm are more plausible than others. Connectionist
in neuroscience? A simple answer is one that we have models are predicated on this idea – since they are
already briefly touched on in Chapter 1. If cognition is built on an–admittedly–simple model of how the
a form of complex information processing then we brain processes information, to the extent that models
can understand it at any one of Marr’s (1982) three of cognition can be implemented as connectionist
levels of analysis. At level 1, the computational level, networks, such models are thought to be more plausi-
cognition is understood in terms of what the mind ble candidates for how the mind actually works.
computes and why. Visual perception, for example, Though this discussion is abstract, in this part of
might compute a function mapping patterns of light the book it becomes much more concrete. Each of
that fall onto the retina (the inputs to the function) the three chapters shows how paying attention to
into a description of the scene this corresponds to, the work within neuroscience contributes greatly to our
objects within the scene, their spatial relations, and so understanding of cognition and cognitive processes.
on (the outputs of the function). Why should cogni- However, there is a further shift in emphasis that
tion compute such a function? Because doing so should be noted. Thus far, we have not explicitly
recovers true (and valuable) information about what focused on the methods that cognitive psychologists
things lie in our immediate visually perceptible envi- use. You may be much relieved that we have not –
ronment. At level 2, the algorithmic level, the cogni- after all, learning about experimental method,
tive psychologist is concerned with specifying the research design, statistical analysis, and the like can
processing steps that intervene between these inputs seem dry and dusty. We have tended to assume that in
and outputs, trying to understand how it is that the studying cognitive psychology you will already have
mind can achieve this recovery of useful information. encountered such methodological rudiments in other
At the hardware or implementational level, level 3, the accompanying courses, and so we have tended to
focus is on how the processing steps specified at level assume that you know enough about such matters for
2 are physically realized in the human brain and body. us not to dwell on them in this book. However, gener-
Some scientists and philosophers would argue that ally speaking, these assumptions cannot be made in
this last question is of little direct concern to cognitive the case of the special methods that attach to neuro-
psychology, and you can read some of these argu- scientific work.
ments later on in Chapter 20. However, these argu- Thus each of the following chapters reveals much of
ments can easily be challenged. Marr himself believed the content of neuroscientific work, focusing on topics
that the hardware level, level 3, constrains the kinds of sometimes quite different from the ones we have stud-
algorithmic processing steps that may be found at ied so far, and also its distinctive methods. In each,
level 2. Put another way, suppose that we found out however, the emphasis is on the contribution that this
that a particular model of visual perception could not area of neuroscience makes to our understanding of
INTRODUCTION 395
cognition, and we advise you to keep this firmly in and 19, and so no involved discussion of them is
mind as you encounter material that may appear as offered here.
new and unfamiliar. In Chapter 14, Ingrid Johnsrude and Olaf Hauk
In Chapter 13, Gianna Cocchini introduces cogni- introduce another method that can rightly lay claim to
tive neuropsychology, a key discipline at the bound- being a significant growth area within neuroscience:
ary of cognitive psychology and neuroscience. neuroimaging. Neuroimaging is a rapidly developing
Cognitive neuropsychology is a field with a long his- field, with many techniques having been developed
tory, having developed from a mix of research-related and many more in development. The authors describe
and clinically-related concerns. The chapter intro- a number of different techniques for imaging the
duces the topic in the context of its historical develop- brain’s activity. Each depends on being able firstly to
ment, indicating the evolution and multiplicity of the detect the activity of neurons by some means, and sec-
goals of neuropsychology, and the varied techniques ondly to generate a measure of the activity. The meas-
that neuropsychologists use to understand a patient’s ure can then be used to provide images displaying the
impairment and its possible significance for models spatial or temporal locus of neuronal activity and, per-
of cognition. haps more importantly, to support statistical analysis.
To sense some of the complexity involved, you The authors outline a number of different techniques
might like to imagine trying to work out the informa- in all, though they concentrate primarily on EEG,
tion-processing characteristics of your PC or Mac MEG, PET, and fMRI, outlining the limitations and
from an analysis of its errors. More often than not, it advantages of each.
is extremely difficult to gain an understanding of Much controversy still surrounds the use of neuro-
information processing from observing just one imaging evidence. As becomes apparent in the course
(impaired) computer. Perhaps through observing of Chapter 14, the different means for measuring
many different computers, and systematically observ- neuronal activity are limited. For example, EEG and
ing the patterns of impairment, one might ultimately MEG have good temporal but poor spatial resolution –
begin to uncover some of the structure of their infor- they are better at determining when neuronal activity
mation processes. In spite of the inherent difficulties takes place than exactly where. The reverse pattern
the strategy faces, this is the position of the cognitive holds for PET and fMRI. Such limitations – and many
neuropsychologist with regard to human information more are discussed in the chapter – remind us that
processing or cognition. neuroimaging techniques are informative only to the
The difficulty of drawing inferences from patterns extent that we are prepared to draw inferences from
of impairment about the nature of cognitive processes the data they provide to the nature of cognitive pro-
is much reduced by making certain assumptions, and cesses, and that the validity of these inferences
the author discusses a number of these – such as sub- depends on many assumptions being satisfied. One
tractivity, for example, and the central assumption of thing that all the techniques have in common is that
modularity (which is further discussed in Chapter 20). they measure physical qualities of neuronal activity.
The chapter also details many of the techniques used But cognitive processes are usually cast in terms of
by neuropsychologists, such as standardized tests and information processing. How can we be sure that phys-
the use of experiments. The chapter deliberately ical activity is the vestigial trace of cognitive activity;
avoids in-depth discussion of some techniques that that the physical signs we observe correspond to
are being increasingly used by neuropsychologists, cognition?
however. Cognitive modelling and neuroimaging are Of course, researchers have developed strategies to
frequently used in conjunction with neuropsycho- enhance the reliability of their inferences. By compar-
logical findings, providing researchers with (hope- ing the images deriving from the performance of tasks
fully) converging evidence from different sources. that differ in just one component, for example,
However, these techniques are detailed in Chapters 14 researchers can be more confident that the physical
396 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
activity they see corresponds to the cognitive activity old diagnosed with a Korsakoff-like amnesia (see
required by that task component. However, you can Chapter 8). What is clear from this case study is the
perhaps sense the difficulties involved if you imagine importance of developing a rounded understanding of
trying to produce physical images of a computer’s individuals such as Mr E in order to properly diagnose
activity. One could perhaps produce images of your PC and treat their conditions. Thus, it is vital to under-
or Mac’s electrical or magnetic activity during a word- stand someone’s pre-illness history, their social and
processing task, and you might find that particular psychological functioning, and their own understand-
regions were active in certain tasks and not others. But ing and perception of their symptoms and illness.
it is hard to see how the images alone would tell you Herein lies a general moral for the relation of cogni-
exactly what information processing the computer was tive neuropsychiatry to cognitive psychology. A full
performing. To draw those kinds of inference we understanding of disorders and their relation to nor-
would need some prior knowledge of the information- mal cognition also requires an understanding of a
processing characteristics of the task – at the very least wide range of factors – social, cognitive, behavioural,
we would need a good information-processing model – and biological. As the chapter progresses we see that
and it would help if we knew quite a bit already about researchers are already postulating the roles played by
the computer’s architecture. In psychology, neuroim- these different factors.
aging data are similarly likely to prove useful to the The chapter next considers brain injury, and the
extent that we already possess good cognitive and likely dysfunction associated with damage to various
brain models. This is not to say that neuroimaging data lobes of the brain. Here we see for the first time issues
are not useful – they can help us discriminate between that will recur later in the chapter. For example, we
models that make different predictions concerning the learn that damage to the occipital lobes, the location
locus and type of cognitive processes involved in cer- of primary visual cortex and of visual maps of the
tain tasks, and they may continue to throw up new data seen world, can cause visual hallucinations. Later in
implying the involvement of processes in tasks that the chapter we learn also that visual hallucinations
were previously unmodelled. Nevertheless, just how occur in Alzheimer’s dementia, and dementia with
important neuroimaging data will prove for under- Lewy bodies.
standing cognition remains to be seen. The remainder of the chapter is devoted to detailed
Chapter 15 by David Okai, Angus Gellatly, and consideration of different disorders, focusing first on
Anthony David introduces the relatively new disci- dementias of varying kinds, as well as the related syn-
pline of cognitive neuropsychiatry. Like its sister disci- drome of Mild Cognitive Impairment. The chapter
pline of cognitive neuropsychology, it attempts to then turns to psychosis, schizophrenia, and delu-
integrate findings from neuroscience with those from sions, and then to depression, disinhibitory disorders
cognitive psychology in seeking a deeper understand- such as obsessive-compulsive disorder and hoarding,
ing of disordered cognition and behaviour. The key impulse control disorders, and finally conversion dis-
difference is that the disorders that are the subject orders, a mysterious set of disorders with no neuro-
matter of this discipline – dementia, Parkinson’s dis- logical cause (once termed hysteria). Throughout the
ease, and obsessive-compulsive disorder, to name just chapter, the authors present an overview of what is
some of those considered in Chapter 15 – are ones tra- known about these disorders, intertwining results
ditionally studied (and treated) by medical science. from detailed neurological study with behavioural
However, as the authors make abundantly clear, suc- and cognitive studies. For example, we learn that in
cessful explanations of these conditions are likely to depression, individuals may show enhanced process-
contain an irreducible psychological or cognitive ing of and attention to ‘sad’ stimuli (e.g. words such as
component. ‘sad’) and that this is related to an enhanced neural
The chapter begins by introducing cognitive neu- response in the dorsolateral prefrontal cortex. We
ropsychiatry. It describes the case of Mr E, a 56-year- learn that the dopamine system is linked to
INTRODUCTION 397
hoarding behaviour in Parkinson’s disease, and it has level as descriptive (see also the similar discussion in
been proposed that dopamine may cause patients to Chapter 20). It is possible, for example, that dopamine
overestimate the intrinsic value of their possessions, may cause overestimation of the value of possessions,
resulting in hoarding. but in theory it is also possible that overestimation
The interweaving of biological and cognitive factors might cause elevated levels of dopamine. To further
in explaining and understanding psychiatric disorders complicate matters, it is possible that both are caused
raises an important issue, which the chapter cannot by some as yet unidentified factor, and that despite
fully resolve. Indeed, we already see some hint of this being correlated they are not causally related. These are
in the preceding discussion of hoarding behaviour. of course theoretical possibilities, and the value of
Where there are both biological and cognitive compo- carefully designed experimental investigations is that
nents to a disorder, it is tempting to think of the bio- they can begin to tease such possibilities apart. At this
logical ones as more basic, as more fundamental, and stage in the development of cognitive neuropsychiatry,
as more likely to be causal. However, there remains the however, as with the other disciplines of neuroscience
possibility that cognitive explanations have a degree of that make contributions to cognitive psychology, we
autonomy – that they cannot be reduced to biological should be careful in how we interpret claims that imply
explanations, and that it is not right to think of the bio- a clearly understood relation between the biological
logical level of explanation as causal, and the cognitive and cognitive realms.
This page intentionally left blank
CHAPTER 13
COGNITIVE
NEUROPSYCHOLOGY
Gianna Cocchini
Understanding the organization of mental activity mental processes by looking directly at their normal
and its relationship with the brain is one of the most functioning, cognitive neuropsychology focuses on
fascinating challenges for science. Our brain con- cases where these processes have broken down, trying
stantly processes stimuli seeking to integrate this to use such evidence to draw conclusions about the
information alongside our pre-existing knowledge of nature of ‘normal’ functioning.
the world, our emotions, and our goals. We may not After an initial introduction to the concept of cog-
be aware of this happening, despite the fact that, to nitive neuropsychology and a brief historical overview
some extent, this information affects our behaviour of this discipline, this chapter will consider a number
and our cognitive functioning. of crucial assumptions and methodological issues in
Cognitive psychology has provided an incredible cognitive neuropsychology. Examples of different syn-
contribution toward its aim of a better understanding dromes and related studies will be used to clarify and
of mental processes. Scientists have formulated theo- illustrate concepts and methods of investigation.
ries, refined methods and assumptions, and experi- These will also allow you to explore different contexts,
mentally investigated their hypotheses with healthy increasing your general knowledge of different syn-
volunteers. Cognitive neuropsychology has a very dromes and their theoretical interpretations. A final
similar aim, but it approaches the general question section will address more pragmatic aspects of neuro-
from a different perspective. Rather than investigating psychological investigations in clinical populations.
cognitive task should be impaired. By carefully observ- other unimpaired (or spared) neural regions that are
ing what happens when a system is damaged, we can connected to the damaged brain area might be altered
understand more about the mechanisms of this sys- after the injury, either because they are deprived of
tem. Let us consider a classic example often used in their neural input or because their normal synaptic
textbooks and lectures. If someone wants to under- connections are modified. For example, damage to
stand how a car works, then one possible way is to some sub-cortical structures, such as the thalamus, or
remove, or damage, some of its components and then damage to fibres that connect brain areas, such as the
observe what happens. Some functions will still work corpus callosum, may reduce or affect input to other
as before, whereas others may not. For example, if you cortical areas, and the deficits may mimic impair-
damage the gear box you may observe that it is still ments observed following damage of these specific
possible to start the engine, all lights and indicators areas. This may contribute to a confusing pattern of
work fine, and if the car is placed on a slope it can still anatomical and cognitive impairment, leading to
be moved and stopped. However, you soon realize that incorrect or simply uninteresting findings as sug-
no gear can be engaged and that the car will not move gested by Marin.
on a flat surface despite the accelerator being pressed We will discuss possible criticisms of the lesion
down. In other words, it is not only important to method and its assumptions later in this chapter.
notice what is wrong but also what is still working, so However, it is important to remember that researchers
that you can infer the normal function of the damaged are not inexperienced scientists with no previous
component, its relationship with other parts of the car knowledge of the brain and cognitive processes.
(for example, the accelerator), and its relative inde- Interpretations of the cognitive symptoms (that is, the
pendence of other components (for example, func- pattern of observable manifestations) are based on
tioning of the lights). Similarly, if we observe a change pre-existing knowledge of the brain and mental pro-
in cognitive performance after a brain lesion, we may cesses, and researchers’ hypotheses and experiments
be able to infer the previous normal function of the are guided by theoretical concepts and cognitive mod-
now damaged structure and its possible relationship els. As suggested by McCloskey (2001), complex sys-
with other mental processes. tems, such as mental processes, ‘can reveal their inner
The lesion method can be quite accurate with non- workings more clearly when they are malfunctioning
human animals as researchers can produce very cir- [as in the example of our car] than when they are run-
cumscribed lesions (setting to one side the ethical ning smoothly’ (p.594). Therefore, the expert scien-
questions raised by such work). However, with brain tific observation of behaviour following brain damage
damage in humans, cognitive neuropsychologists has provided an incredible contribution during the
have to rely on naturally occurring lesions, the extent last two centuries (see the following section on his-
and location of which are outside of the researcher’s torical milestones). While one should be aware of its
control. For this reason, some scientists have been possible limitations, the lesion method remains a valid
quite critical about this method; their view is well and fruitful way to investigate mental processes.
summarized in this quotation by Marin et al. (1976): Neuropsychology and cognitive neuropsychology
‘What can you possibly learn about the way a car are two similar and complementary scientific
works . . . by pounding it with a sledgehammer!’ approaches, both founded on the lesion method, and
(p.868). In some cases this consideration is unfortu- both sharing an interest in pathological functioning of
nately quite right. Some patients suffer from extensive mental processes. However, the aims, methods, and
brain damage or multiple lesions and show very gen- final hypotheses of these two approaches are slightly
eral cognitive impairment. Therefore, little can be different. The neuropsychologist attempts to draw
added to our knowledge of mental processes by conclusions about the function of different brain
observing these cases. Moreover, the functioning of areas, explaining the patterns of impaired and intact
CHAPTER 13 COGNITIVE NEUROPSYCHOLOGY 401
cognitive performance in terms of damage to one or process. Both aspects are clearly of great relevance to
more of the brain areas and cerebral networks. Here, our understanding of human memory; however,
the researcher is focused on the relationship between while the approach of neuropsychology would be
cognitive processes and underlying anatomical sub- more focused on the anatomical relationship between
strates. The cognitive neuropsychologist is more inter- hippocampi and memory, the approach of cognitive
ested in understanding and explaining the patterns of neuropsychology would be focused more on the dif-
impaired and intact cognitive performance in terms of ferent cognitive components of short- and long-term
damage to one or more of the components of a theory memory and the consolidation phases of memory
of cognition, and in turn drawing conclusions about traces. Box 13.1 discusses amnesia in more detail,
normal (healthy) cognitive processes. The final inter- focusing on the fascinating issue of amnesic patients’
est of the cognitive neuropsychologist is to fractionate confabulations or false memories.
a cognitive system and understand the role of each The study of limb apraxia offers another interesting
component of that system and its relationship with example. Limb apraxia is defined as a difficulty in
others (Ellis and Young, 1988; Coltheart, 1986). using objects or performing gestures, despite patients’
Determining which anatomical area underlies a spe- spared ability to move their limbs. According to
cific process per se is of relatively little interest to the Liepmann’s (1900) model, right and left anterior
cognitive neuropsychologist (though of course of (frontal) areas of the brain are involved in the actual
great interest to the neuropsychologist). production of a gesture, whereas the mental represen-
It is important not to overstate the contrast between tation of correct gestures relies on anatomical struc-
the approaches of neuropsychology and cognitive tures located in more posterior areas such as the left
neuropsychology, however. They share and contribute parietal lobe. Based on this model, Heilman et al.
to similar literature, and sometimes it is not easy to (1982) conducted a study to investigate the relation-
distinguish between them. I prefer to consider them as ship between specific brain areas and type of apraxia.
different research approaches, as they are guided by If a lesion occurs in more anterior areas of the brain,
different research questions, which implies some dif- patients should show a difficulty in performing a ges-
ferences in the methods and techniques adopted. ture or using an object (for example, a hammer).
The famous case of HM, the amnesic patient However, their ability to recognize correct panto-
described by Milner (Scoville and Milner, 1957; mime (the miming of tool use, such as miming brush-
Milner et al., 1968), serves as a good example to clar- ing one’s hair) or correct use of an object should
ify the slightly different approaches of neuropsychol- remain preserved, as their ability to mentally repre-
ogy and cognitive neuropsychology. In an attempt to sent a gesture is spared. Conversely, damage in left
treat a severe form of epilepsy, HM’s hippocampi posterior areas should affect representation of ges-
(located in the medial temporal lobes) were surgically tures. The patients should not be able to correctly rec-
removed (see Figure 13.2 for a diagram of some key ognize or associate gestures and objects and, due to
anatomical and functional brain areas). The patient lack of input to the more anterior areas, these patients
was left with profound amnesia. He could not remem- should also fail to correctly reproduce a gesture.
ber new information (anterograde amnesia) and he Based on anatomical lesion (anterior or posterior),
had difficulty recalling events that had occurred in Heilman and colleagues considered two groups of
the last three years before the operation (retrograde patients who were asked to: (i) pantomime gestures
amnesia). This case revealed two fundamental aspects and (ii) identify correct gestures performed by the
of memory. The first was the relationship between the examiner. Patients with posterior lesions failed both
medial temporal lobes and memory; the second was types of task, while patients with anterior damage
that long-term memory is not a unitary cognitive sys- mainly failed the task involving production of the
tem, and that memory traces undergo a consolidation gesture. Their findings were therefore in line with the
402 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
anatomical role of anterior and posterior areas of the model accounting for use of objects and gestures. The
brain suggested by Liepmann. different components of this model do not refer to dif-
Now let us consider the model shown in Figure 13.3 ferent brain areas; thus, understanding of the impaired
(Cubelli et al., 2000), an example of a recent cognitive and normal cognitive functions can only be based on
Some brain-damaged patients show difficulties in controls and amnesic patients (both confabulators
recalling information previously encoded: they are and non-confabulating patients) were asked to per-
amnesics. When questioned about past events, some form a continuous recognition task. The partici-
of these patients may look puzzled, frustrated, or pants were presented with a list of meaningful
confused while they try to retrieve that specific infor- pictures and they had to report whether a picture
mation. However, other amnesic patients may pro- was previously presented in the current trial (recur-
vide florid recollections of false information, although rent picture). Patients were asked to perform the
it is not their intention to lie. For example, if asked same task for three additional trials (one immedi-
about a recent holiday, they may provide detailed ately after the first, one after 5 minutes, and one
descriptions of events that never happened in places after 30 minutes). The recurrent pictures in one
where they have never been. In some cases, their trial were also presented in the following trials, but
confabulations may grow to such an extent that they only once (i.e. as non-recurrent pictures). The
may start to behave in line with their invented stories. authors’ hypothesis was that, since confabulators
In accordance with their beliefs, they may report spe- show a difficulty in suppressing previously acquired
cific events and plans that seem initially to be realistic. information, they would show an increment of false
The mechanisms underlying the phenomenon of positive responses from trial to trial. Therefore,
spontaneous confabulations are still debatable. compared to non-confabulating amnesics, confabu-
Schnider and colleagues (Schnider et al., 1996; lators would falsely recognize targets that had
Schnider and Ptak, 1999; Schnider et al., 2000) have appeared once in a particular trial as recurrent
suggested that a possible explanation may rely on stimuli, because these targets were displayed a few
spontaneous confabulators’ tendency to confuse times previously in preceding trials. In other words,
the time at which information was last encountered. spontaneous confabulators would confuse stimuli
Indeed, it is interesting to note that the content of presented in the current trial with those displayed
these invented events can be quite easily traced in previous trials.
back to some aspects of actual experience. The results showed that both amnesic groups of
According to these authors, patients showing spon- patients performed worse than healthy controls at
taneous confabulations may be unable to success- detecting recurrent stimuli (Figure 13.1a) due to
fully repress old and irrelevant memories, which their memory deficits; however, only spontaneous
then interfere with the recollection. For example, confabulators showed an evident increment of false
after brain damage a patient who used to frequently alarms over the four trials (Figure 13.1b), supporting
travel by plane may believe that he or she is a pilot. the authors’ hypothesis of a time confusion of
In other words, Schnider and colleagues believe that acquired information. Schnider and Ptak’s (1999)
spontaneous confabulators show a temporal confu- interpretation is particularly interesting as it implies
sion as they confuse ongoing reality with the past. that some aspects of amnesia, such as confabula-
To test this hypothesis, Schnider and Ptak (1999) tions, may be linked to activation of too many mem-
devised an interesting paradigm where healthy ory traces and not necessarily to a lack of traces.
CHAPTER 13 COGNITIVE NEUROPSYCHOLOGY 403
Hits
(correct detections of recurrent stimuli)
25
Hits
20
Spontaneous
confabulators
Non-confabulating
Controls
15
1 2 3 4
(a) Trials
False alarms
(incorrect detections of non-recurrent stimuli)
20
18
16
14
False alarms
12
10
8
6
4
2
0
1 2 3 4
(b) Trials
damaged/spared components of the model, not on The important issue for our purposes is to define
damaged/spared brain areas. The authors themselves aims and methods in order to interpret findings within
emphasize that this model is ‘entirely based on cogni- the cognitive neuropsychology approach. Cognitive
tive concepts’ in order to avoid ‘confusion between cog- neuropsychology is interested in patterns of intact and
nitive and anatomical categories within the model’ acquired pathological mental processes, and this
(p.146). In this context, research is not guided by the chapter will investigate its assumptions, methods, and
site of brain lesions but by the potential patterns of cog- techniques.
nitive impairment that could further refine the model.
404 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
Central sulcus
Primary motor Primary
cortex somatosensory cortex
Parietal lobe
Frontal lobe
Broca’s
area
Occipital lobe
Primary visual
cortex
Prefrontal
cortex
Wernicke’s
area
Lateral
sulcus
Temporal
lobe
Pons
Primary auditory
cortex Cerebellum
Medulla
FIGU RE 13. 2 Main anatomical structures and functional areas of human brain.
SUMMARY OF SECTION 1
• Observation of malfunctioning mental processes may facilitate understanding of normal underlying
cognitive mechanisms.
• The lesion method assumes that if a brain area plays a crucial role in a cognitive task, and this area is
damaged, then performance of this cognitive task should be impaired.
• Cognitive neuropsychology is based on the lesion method and its aim is the understanding of normal
(healthy) cognitive processes by observing the patterns of impaired and intact cognitive components
after brain damage.
2 HISTORICAL MILESTONES
Despite the development of cognitive neuropsycho- famous Phineas Gage, who showed a dramatic change
logy having occurred only in the last 40 years or so, it of personality following a traumatic head injury that
is important to consider the historical background damaged a specific portion of the prefrontal lobes.
that led to the birth of this discipline. During the sec- Before the accident Gage was described by friends and
ond half of the 19th century some neurologists started relatives as a highly capable and reliable man; how-
to describe selective cognitive impairments in some ever, after the brain lesion Gage became irritable,
patients who suffered from varying types of brain irreverent, socially inappropriate, and unable to
damage. Harlow (1848) described a patient, the accomplish any plan. A few years later Paul Broca
CHAPTER 13 COGNITIVE NEUROPSYCHOLOGY 405
Phonological
Visual analysis
analysis
Phonological Structural
Action input
input lexicon description
lexicon
system
Action
output
lexicon
Visuo-motor
Gestural conversion
buffer mechanism
Motor response
FIGU RE 13. 3 Cognitive model of limb apraxia. Redrawn from Cubelli et al., 2000.
(1861), in line with previous work by Bouilland cognitive processes and their anatomical relation-
(Selnes, 2001), described a patient showing an impair- ships. These scientists started to represent cognitive
ment of language mainly limited to productive aspects processes with diagrams containing boxes and arrows
of language. Despite relatively preserved verbal com- representing different cognitive processes and the
prehension, his speaking difficulties progressively links between them. The scientists, also known as dia-
deteriorated to such an extent that he could only say gram-makers or mapmakers, were the first to attempt
the word ‘tan’ before his death. A post-mortem exami- to fractionate cognitive processes (i.e. to divide up the
nation revealed damage in the left frontal lobe (see processes into putative component parts). By means
Figure 13.2). In the same period, Wernicke (1874) of their diagrams, they aimed to illustrate sub-compo-
reported a small group of patients showing a lesion in nents of a specific process and their functional con-
the left temporal lobe (see Figure 13.2) whose fluent nections, and by extension, to predict possible
language production contrasted with their poor ver- malfunctions (deficits) of a process. A crucial aspect
bal comprehension (Wernicke’s aphasia). These cases of the diagram-makers’ approach was the anatomical
represented the first attempt to study and interpret correspondence of the sub-components, which later
406 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
became the weakest and most criticized aspect. A clas- Indeed, revisions of anatomical evidence of crucial
sical example is Lichtheim’s (1885) diagram of lan- cases were strongly criticized by several neurologists
guage, initially based on Wernicke’s anatomo-clinical (e.g. Marie, 1906) and, in the absence of supporting
model of language function. One of the earlier evidence, were considered by most of the scientific
versions of Lichtheim’s model is represented in community as mere speculations. Following this
Figure 13.4. In this example, capital letters represented period, studies of groups of patients with batteries of
sub-components (also identified as ‘centres’) and low- psychometric tests were preferred to single-case
ercase letters represented input and output, while observations. The methodological rigours of group
numbers represented points of malfunction resulting studies appeared to be the best way to collect solid
from different types of language impairment. For empirical data, and were considered a robust method
example, considering point 1, a malfunction of M (the of investigation. However, in the 1960s there was a
motor word-representation centre) would result in a resurgence of interest in single-case studies, probably
difficulty in language production (Broca’s aphasia). It because, according to Vallar (1999), researchers real-
is important to note that Lichtheim’s centres were not ized that cognitive architecture is too complex and
identified with single anatomical areas but rather with that group studies should not represent the sole
more distributed neural networks. method of investigation.
However, as mentioned earlier, the anatomical Some case descriptions and analyses of single-case
localization of the cognitive sub-components repre- studies had a profound influence that would result in
sented one of the weakest aspects of these diagrams. a new approach to studying mental processes.
Geshwind (1965) revisited a series of clinical studies
to define his concept of a disconnection syndrome;
Milner (1966) reported the famous case of HM who,
B
as described above in Section 1, showed severe mem-
ory disorders following a lobotomy of the temporal
4 6 lobes to treat a severe form of epilepsy. Luria (1966;
1973) reconsidered the concept of localization of
functions proposed by the diagram-makers, suggest-
ing that some functions are complex and required a
1 2 multifaceted interaction of different brain areas.
M A Marshall and Newcombe (1966) described patient
GR, who showed a pattern of reading impairment
3
mainly characterized by semantic errors. This case
and the debate about new language models repre-
sented a theoretical and empirical context for the
5 7 birth of the modern approach of cognitive neuropsy-
chology. In the preface to the classical book Deep
Dyslexia, considered a milestone of this new
m a
approach, Coltheart and collaborators (1980) empha-
sized that ‘We shall only progress beyond the classical
FIGU RE 13.4 Lichtheim’s diagram of language. “diagram-makers” if we take as seriously as they did
A = auditory word-representation centre; B = concept
the requirement that our conjectures about disor-
elaboration centre; M = motor-word representation
centre; a = auditory input; m = output (speech); numbers dered systems should be expressed sufficiently for-
1–7 represent points of malfunction. Redrawn from mally that counter-examples can be recognised as
Lichtheim, 1885. such’ (Coltheart et al., 1980; p.viii). Within this new
CHAPTER 13 COGNITIVE NEUROPSYCHOLOGY 407
theoretical approach, brain localization of the deficit (induced by nature) suitable for probing specific
was of little (if any) interest, whereas the cognitive hypotheses relevant to normal cognitive processing
impairment became ‘an experimental condition mechanisms’ (Selnes, 2001; p.38).
3ASSUMPTIONS IN COGNITIVE
NEUROPSYCHOLOGY
3.1 Modularity systems devoted to encoding and recognizing incom-
ing information) are modular, while central systems
One of the core assumptions of cognitive neuropsy- (i.e. higher cognitive functions such as fixation of
chology is modularity: a specific assumption about beliefs, expectations) are not modular. Modularity of
how our mind is organized. A detailed description the input system is well represented in the ‘box and
and theoretical discussion of modularity can be found arrow’ cognitive models (as in the one represented in
in Chapter 20. In the present chapter, I summarize the Figure 13.3), where each module (or box) transforms
fundamental aspects for cognitive neuropsychology. information from one stage to the other. But what is a
The development of the modularity concept mainly module, and what are its characteristic features?
derived from philosophers and linguists, such as In The Modularity of Mind, Fodor (1983) detailed
Fodor (1983) and Chomsky (1980), but was also nine features of modules, which are reported in more
informed by the work of psychologists such as David detail in Chapter 20. First, modules are usually domain
Marr (1976). Their work has provided an invaluable specific, meaning that each module can only serve one
contribution to our understanding of how most of our particular type of input. For example, the module pro-
mental processes are organized around cognitive pro- cessing the colour of a stimulus is not involved in pro-
cessors called modules. For each higher cognitive cessing the shape of the same stimulus. Second,
process we should be able to identify a set of simpler modules are usually mandatory, meaning that they are
but independent processes. For example, according to unstoppable and independent from voluntary control.
the model presented in Figure 13.3, a cognitive func- In other words, we cannot avoid processing a noise
tion, such as recognizing a gesture (e.g. clapping that falls within hearing range, or recognizing a visual
hands) and its meaning, will consist of different stages: stimulus. This is an important aspect for Fodor, as
encoding of visual perception; visual analysis of the he considered this feature as the criterion by which
gesture; recognition of the gesture; and finally access we distinguish between input systems (which are mod-
of semantic information to retrieve the meaning of the ular) and central systems (which are not modular). The
gesture. Marr (1976) also added that independence of well-known Stroop effect (see Box 2.2 in Chapter 2)
processes is fundamental, because were the processes occurs because irrelevant information (e.g. meaning of
not designed in this way, a small change in one process the colour word) is automatically processed, despite
would have consequences in many others, making it the task requiring the participant to report the colour
impossible for us to understand the structure of the of the letters forming the word (for example, the word
human mind. ‘RED’ written in green ink). The irrelevant information
However, Fodor himself (2000) warned about the (the word ‘RED’ in our example) interferes with the
intrinsic risks of considering all cognitive processes as relevant information (the colour green in our exam-
modular. He suggested that only input systems (i.e. ple). Good performance depends on participants’
408 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
ability to inhibit the irrelevant information that their to define a cognitive system as modular. Therefore we
brain has processed. The Stroop effect is more evident can still consider a cognitive system as modular even
in some patients with brain damage in prefrontal areas, if it does not possess all nine of these features. For
as they have great difficulties in inhibiting the irrele- example, some modules are involved in acquired cog-
vant information and this seriously interferes with nitive processes, such as reading or writing, and they
their performance (Perret, 1974). are not innate. According to Coltheart, only domain
The third feature of modules described by Fodor is specificity should be considered as a crucial feature for
that they are usually innate and genetically determined. modularity, while for every other feature ‘it is an
Fourth, modules are usually informationally encapsu- empirical question whether or not the proposed mod-
lated, which means that a module carries out its own ule has that feature’ (p.115).
process regardless of what happens in the rest of the In the context of cognitive neuropsychology, the
cognitive system. This is one of the most crucial modularity assumption has represented a powerful
aspects of modularity. Visual illusions are classical way to describe and conceptualize cognitive func-
examples of the concept of informational encapsula- tions. Indeed, since the modularity assumption sug-
tion. Indeed, visual illusions remain vivid even when gests that a cognitive function (e.g. object recognition)
we are well aware of the illusion. The Ponzo illusion can be broken down into simpler components, then
(discussed in Chapter 20) and the well-known Müller– damage to one of these components will selectively
Lyer illusion (see Figure 13.5) are good examples. impair a part of this cognitive process and will result
Despite knowing that the horizontal lines of the in an observable cognitive deficit (e.g. apperceptive
Müller–Lyer illusion are equally long, the one with the agnosia). Note that in this context I am referring to
arrowheads pointing outwards is perceived as longer cognitive, not anatomical, damage. However, as
than the other. Similarly, if you gently push your eye- underlined by Humphreys and colleagues (2006),
ball, you will experience an apparent movement of some manifestations may result from complex under-
your surroundings even if you know that you are vol- lying mechanisms and not from damage to a single,
untarily moving your eyeball. well-defined module. They may result from interac-
The fifth feature is that modules are usually fast. tions between different modules that can be modified
This is linked to the features of being mandatory and by adaptation or by strategies adopted after the brain
automatic. Sixth, modules are usually neurologically lesion has occurred.
wired, which means that modules underlie similar
neural architecture. The other three properties that
Fodor proposed as characteristic of modules are out-
3.2Subtractivity and
lined in Chapter 20. transparency
As clarified by Coltheart (1999), Fodor did not con-
sider any of the above features as necessary conditions Two other important assumptions in cognitive neu-
ropsychology should be considered. These are subtrac-
tivity and transparency. According to the assumption
of subtractivity (or fractionation), an impaired sys-
tem is just the same as a normal one except that cer-
tain modules or processors of that normal system
have been damaged. Therefore it is possible to con-
ceptually ‘fractionate’ normal cognitive systems. For
example, to be able to name an object, we need to per-
FIGU RE 13. 5 Müller-Lyer visual illusion. Despite the form a visual object recognition, then retrieve the
two horizontal lines being identical lengths, the one semantic information associated with this object,
above appears considerably shorter than the one below. then retrieve the phonological information by
CHAPTER 13 COGNITIVE NEUROPSYCHOLOGY 409
accessing the phonological output lexicon and buffer, visual tasks, though they are unaware of having pro-
and finally say the name aloud. A cognitive neu- cessed such visual information. Interpretations of this
ropsychologist will observe different types of errors phenomenon have been quite controversial; however,
depending on which of the above modules is affected some authors (Weiskrantz et al., 1974; Weiskrantz,
by brain damage. 1986) suggested that this phenomenon may depend
The concept of subtractivity is deeply embedded in on the spared sub-cortical visual system. Indeed, a
another important assumption of cognitive neuropsy- small amount (about 10 per cent) of the visual fibres
chology, which is transparency. This assumption do not follow the geniculostriate pathway, instead
implies that the pattern of symptoms observed follow- connecting with sub-cortical structures, such as the
ing a brain lesion reflects underlying damage of spe- superior colliculi (see Figure 13.6), which could
cific components pre-existing the brain injury. This is a mediate some aspects of localization of visual stimuli
fundamental assumption of the lesion method, as cog- in blindsight (Rafal et al., 1990). Under normal con-
nitive neuropsychologists aim to study pathological ditions, this information is of negligible consequence
conditions in order to make inferences about the struc- for our conscious experience of visual stimuli, being
ture of normal cognitive processes. In this context, it is relevant for the regulation of eye movements.
important to establish the actual causal link between However, following particular brain damage of the
the observed symptoms and the brain lesion. In other main cortical pathway, in some patients this pathway
words, a patient may show weak performance in some becomes an important source of information and it
tasks even pre-morbidly (i.e. before brain damage). guides some unconscious responses to visual stimuli.
This possibility of individual variability is something Similarly, the phantom limb phenomenon, which
we will return to in Section 4.2 where we consider pos- occurs after amputation of a portion of a limb, has
sible limitations of single and group studies. been recently interpreted as the result of pre-morbid
Although it is widely accepted that an adult brain is latent brain connections. In these cases the brain is
not capable of considerable functional reorganization not damaged, but somatosensory cortical areas are no
after a brain injury, such damage may lead, to some longer receiving afferent information from the corre-
extent, to the development of more or less conscious sponding part of the amputated limb. Interestingly, if
strategies (which we will discuss in more detail in a tactile stimulus is applied on circumscribed areas of
Section 5.1) that induce brain-damaged patients to the patient’s face, the touch is experienced on their
process information in a different way. In some cases, lost hand (e.g. Ramachandran et al., 1995). Despite
patients’ performance may mimic a neural reorgani- initial suggestions that this was due to new cortical
zation, which may not necessarily reflect the genera- networks developed after the amputation (e.g. Basso
tion of new neural networks but the strengthening and Pizzamiglio, 1999), it has now been suggested
(or reduced inhibition) of previously latent links. that the phantom limb phenomenon may depend on
These cases are still consistent with the assumptions the existence of latent pathways between adjacent
of transparency and subtractivity as they are the areas in the primary somatosensory cortex (as in the
expression of latent, not new, processes. Blindsight case of hands and face) (Ramachandran et al., 1995).
and phantom limb phenomena may offer good exam- These latent connections play a negligible role in
ples. Blindsight is a phenomenon observed in some intact brains, but after brain damage their activity
patients with a blind visual field due to damage of the may be either more evident or strengthened, as pos-
primary visual area or of the geniculostriate pathway sible inhibitory input from the damaged area is now
(the cortical pathway carrying visual information reduced or halted (Gazzaniga et al., 2002). The point
from the lateral geniculate nuclei of the thalamus into here is that some functional reorganization after
the primary visual area; see Figure 13.6). Surprisingly, brain damage may be possible even in adult brains;
given they report blindness in their visual field, blind- however, this may simply be due to a change in
sight patients seem to be able to perform some simple strengthening of pre-existing connections, whereas
410 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
al f ield
visu
Left
Temporal
Nasal
Temporal
Optic chiasm
{ Pulvinar nucleus
Thalamus
Lateral geniculate
nucleus
Superior colliculus
Optic radiation
FIGU RE 13.6 Visual pathways from retina to primary cortex and sub-cortical areas.
regeneration of neuronal connections is still quite refers to a patient’s difficulty with detection of stimuli
unlikely (Della Sala and Bates, 1996). from all modalities presented in the contralesional
For our purposes, these phenomena are interesting (i.e. opposite side to the brain lesion) side of the space
as they illustrate the concept that, despite the limited or of the body. In Figure 13.7, for example, it can be
functional reorganization of mental processes that can seen that the patient suffering from neglect, having
be observed in some circumstances, generally it can experienced right brain damage, experiences diffi-
be reasonably assumed that the pattern of symptoms culty detecting or reproducing objects in their left
observed following a brain lesion reflects damage of visual field.
specific cognitive components that pre-existed that The term ‘syndrome’ is mainly useful for clinicians
brain lesion. and researchers to enable quick communication of
information regarding cognitive, sensory, and motor
impairments, and the likely site of the lesion in a
patient or group of patients. For example, if we refer
3.3Anatomical and functional again to the neglect syndrome, we may expect the
syndromes cognitive impairment described above to be manifest
in association with extinction (which is the inability to
A syndrome is a term used to define a particular detect a contralesional stimulus when presented
recurrent association of a cluster of deficits (also simultaneously with another one in the same side as
called symptoms). For example, neglect syndrome the brain lesion), and anosognosia (lack of awareness
CHAPTER 13 COGNITIVE NEUROPSYCHOLOGY 411
(a) (b)
(c)
FIGU RE 13.7 Examples of a right-brain-damaged patient’s performance on some neglect tests: a) line cancellation
test; b) drawing a clock from memory; c) copy of a drawing.
of illness). We may also predict, with some approxi- there are specific syndromes that can be identified by
mation, that the patients are likely to show a brain a set of specific tests. According to them, patients are
lesion in the right inferior parietal lobe and that they unique, and the use of syndrome terminology is only
are likely to show left weakness or hemiplegia (inabil- useful to facilitate communication, being of little
ity to move one half of the body). Similarly, the clas- interest for theoretical purposes. However, if patients
sification of language disorders, as in Broca’s (difficulty are unique, then replication of findings with other
in verbal expression) or Wernicke’s (mainly difficulties patients and by other research teams would be very
in verbal comprehension) aphasia, has been based on difficult, if not impossible.
associations of specific symptoms. Another group of researchers have considered the
However, even if the concept of a syndrome concept of syndrome from a different point of view. In
appears relatively simple and straightforward, it has 1966, Marshall and Newcombe (see also Marshall and
important implications and its use within the cogni- Newcombe, 1973) described a patient, GR, who has
tive neuropsychology framework has been a subject been the subject of much debate about the definition
of debate over the past 30 years. An obvious problem of deep dyslexia and, more generally, about the con-
is that symptoms in a specific syndrome may be quite cept of syndrome in cognitive neuropsychology.
heterogeneous. This could be due to the fact that a Following left hemisphere brain damage, GR pre-
cognitive process may consist of several sub-systems sented with long-lasting language disorders, mainly
that can be independently ‘lesioned’. If so, we may consisting of (though not limited to) reading impair-
observe great variability in performance across differ- ment. In particular, this patient committed a very high
ent patients, where each patient may show a slightly percentage of semantic errors (for example, he read
different pattern of symptoms. Here, adopting too ‘dinner’ as ‘food’), and he showed an effect of syntactic
stringent a criterion to define a specific syndrome class. GR could not read non-words (such as ‘wep’)
could result in a proliferation of many highly specific and his reading performance was at its worst with
syndromes, a possibility that has led some authors to function words (such as ‘for’; often responding ‘I don’t
stress the risk of ending up with as many syndromes know’), less compromised with verbs (such as ‘play’),
as patients (e.g. Patterson et al., 1985; Caramazza, less again with adjectives (such as ‘tall’), and finally
1986; Ellis, 1987). Partially for this reason, Morton better (though still below 50 per cent) with nouns.
and Patterson (1980) and, with an even more extreme GR’s performance suggested a main impairment of the
point of view, Caramazza (1986) rejected the idea that semantic route of the dual-route model (further
412 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
described in Section 4.1). However, other patients route of this model (which would explain why regular
diagnosed with deep dyslexia have shown additional words could not be read by applying the letter-to-
difficulties, such as reading regular words (e.g. ‘if ’), sound rules). GR also presented with several other
suggesting a further malfunction of the phonological deficits, such as impairment of spontaneous speech,
agrammatism, agraphia, and errors in auditory word- Association of symptoms may therefore have
picture matching. Looking at all of these deficits, it can important functional implications; if so, a specific pat-
be confusing to define the characteristic features of a tern of symptoms can be considered as a prerequisite
syndrome. What then defines a specific syndrome? to define a specific syndrome. However, in some cases
Coltheart (Coltheart, 1980, 2001; see also Marshall a cluster of symptoms may be recurrently associated
and Newcombe, 1973) suggested that, starting from but their co-presence is not functionally and hierar-
the most striking symptom (in the case of deep dys- chically ordered. So, while deep dyslexia can provide
lexia, the most striking symptom would be evidence an example of a functional syndrome, in other cases
of semantic errors), if a cluster of other symptoms are co-occurrence of symptoms may be due to anatomical
recurrently associated, then we should consider this proximity. In these cases, brain damage, especially if
pattern of symptoms as a syndrome, or ‘symptom- relatively large, is likely to impair different cognitive
complex’ (p.23). Within this context, the absence of processes, resulting in a particular association of defi-
some deficits is fundamental; for example, it is funda- cits that do not represent a common underlying func-
mental that deep-dyslexics are still able to name tional mechanism. Deficits may be associated simply
objects (i.e. they are not severely anomic), whereas because the anatomical substrates of different cogni-
other symptoms are irrelevant for the definition of tive processes are physically close or adjacent and the
deep dyslexia. brain damage may encompass all of them. A typical
Other syndromes can be defined in a similar way. example of an anatomical syndrome is Gerstmann’s
Patients showing unilateral inattention (also called syndrome, diagnosed when the following cluster of
neglect; see our earlier discussion) can present with a symptoms are observed: finger agnosia (difficulty in
quite heterogeneous pattern of deficits. Indeed, inat- identifying a finger when touched); acalculia (diffi-
tention can be found in one modality (e.g. for visual culty in performing arithmetic calculations); right-left
stimuli) but not in others (e.g. tactile stimuli); moreo- disorientation; and pure agraphia (difficulty in writ-
ver some, but not all, patients also show visual extinc- ing). Despite some attempts to identify a functional
tion, unawareness, and general depletion of attentional link between these symptoms, such as distortion of
resources. However, the most striking symptom is the body schema (Gerstmann, 1930), it is now gener-
inattention for stimuli placed in the contralesional ally accepted that the association of these symptoms is
hemifield (Figure 13.7) and this, with the pattern of due to the proximity of the anatomical substrates of
deficits recurrently associated, defines this syndrome. different cognitive systems that can be damaged by a
Box 13.2 discusses the fascinating phenomenon of single brain lesion in the left parietal lobe (Poeck and
neglect in more detail. Orgass, 1966).
SUMMARY OF SECTION 3
• Core assumptions of cognitive neuropsychology consist of specific assumptions about how our mind
is organized.
• The main assumptions are that: (i) our mental processes are organized around cognitive processors
called modules, which have specific characteristic features (modularity); (ii) a damaged system is just
the same as a normal one but with certain modules or processing systems damaged; therefore it is
possible to fractionate mental processes (subtractivity); and (iii) the pattern of symptoms observed
following a brain lesion reflects underlying damage of specific cognitive components that existed prior
to the brain damage (transparency).
414 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
• The concept of syndrome is quite controversial. Some authors reject this concept in favour of indi-
vidual description of single patient symptoms. Others consider that it is possible to reasonably iden-
tify a syndrome as a specific pattern of recurrent association of symptoms.
• Associations of symptoms can be due to damage of the same cognitive function (functional syn-
drome). In some cases, association of symptoms can be due to anatomical proximity (anatomical
syndrome).
4METHODS IN COGNITIVE
NEUROPSYCHOLOGY
read irregular words (for example ‘shoe’) as correct
Association, dissociation,
4.1
reading of these words does not rely on the letter-to-
and double dissociation sound rules, and attempts to read irregular words by
the non-lexical route would result in regularization
We discussed in the previous section that some symp- errors (i.e. reading ‘shoe’ rhyming with ‘toe’). It is quite
toms may be commonly associated following specific common to observe patients showing impaired ability
brain damage and that, despite some exceptions, this to read and write irregular words, but spared abilities
fact usually implies some type of functional relation- with non-words and regular words in reading and
ship. Therefore, we might be tempted to conclude that, writing (called surface dyslexia and surface dysgraphia,
if a patient shows symptom A and symptom B, then respectively). Based on this association, we could infer
these two symptoms are the result of damage to a com- that there is a unitary orthographic lexicon for input
mon cognitive process. However, such an association (reading) and output (writing) processes. The hypoth-
can also result from simultaneous damage to different esis of two separated orthographic lexicons, one for
cognitive processes, and any inference of a common input and one for output, would be seen as a ‘non-eco-
cognitive mechanism may be incorrect or misleading. nomical’ redundancy. However, if a second patient, or
Coltheart (2001) offers an example to illustrate this group of patients, shows poor performance on one task
point. The dual-route theory (see Chapter 6) can be (e.g. writing irregular words) but performs normally
used to interpret reading and writing impairments. on another task (e.g. reading irregular words), then the
This theory proposes two possible ways that one can previous hypothesis of a unitary mechanism runs into
read aloud: the first is by applying letter-to-sound rules difficulty. Indeed, a selective failure in writing irregular
to the printed string (non-lexical route), whereas by words would imply a deficit of the output orthographic
the alternative route (the lexical route) the word lexicon, whereas a selective impairment of reading
accesses the orthographic input lexicon where it is rec- irregular words would imply a deficit of the input
ognized and then linked to the correct pronunciation orthographic lexicon. In this scenario, association of
in the phonological lexicon. Should the orthographic deficits may not necessarily imply a unitary cognitive
input lexicon (which is part of the lexical route) be module and, as in the example above, surface dyslexia
impaired, then patients would still be able to read non- and dysgraphia may be due to a concurrent damage of
words (for example ‘choe’) and regular words (for different cognitive modules.
example ‘cup’), as they can do so by applying the letter- Selective impairment in one task, but preserved
to-sound rules. However, the patients would fail to performance in another task, is known as dissociation.
CHAPTER 13 COGNITIVE NEUROPSYCHOLOGY 415
The use of dissociations, rather than associations, rep- showed the expected performance, where more recent
resents a more powerful method for cognitive neu- words were recalled better than earlier words. Amnesic
ropsychology, as the presence of a dissociation suggests patients showed a similar pattern of results for later
the presence of different underlying mechanisms and, words (recency effect). They did also show a primary
in turn, allows us to fractionate a cognitive process. A effect, since at the beginning of the task they seemed to
classical example of dissociation is that between short- have sufficient resources to transfer some information
and long-term memory. Some patients with memory to long-term memory; nevertheless, their performance
impairment show poor performance in tests assessing for earlier words was significantly worse than that of
long-term memory, but show no problems in tasks the controls. These findings, supported by the vast lit-
requiring them to remember a few items for a short erature on memory impairment, represented a clear
period of time (short-term memory). In 1970, dissociation between short- and long-term memory,
Baddeley and Warrington presented a study with and had profound theoretical implications.
patients suffering from memory impairment and a Though dissociation is a crucial method, it is
control group of healthy participants. Participants important to be able to compare opposite patterns of
were asked to perform a serial recall task with a list of dissociations (double dissociations) in order to avoid
ten words. Typically in such tasks, the words presented potentially incorrect interpretations. If a patient shows
in the last three or four positions in the list are recalled a deficit in task A but not in task B, we cannot directly
sooner and with more ease (the recency effect) than infer that these two tasks test different underlying cog-
words presented earlier in the list (the primacy effect). nitive mechanisms. Task A and B may assess the same
Most psychologists agree that the recency effect process, but task A may be placing a higher cognitive
depends on those last words still being present in the demand than task B on the same underlying mecha-
short-term memory storage, or working memory, nism (that is, the comparison may introduce a
whereas the earlier items have already been transferred resource artefact). However, if a second patient shows
to the long-term memory storage (Atkinson and the opposite dissociation, that is, good performance in
Shiffrin, 1971; see also Chapter 9 for a detailed descrip- task A and poor performance in task B, then we have
tion of the multi-store theory of memory). Baddeley a double dissociation (two patients showing opposite
and Warrington’s control group (see Figure 13.8) patterns of data). Here, the previous criticism that
there may be a possible bias due to a resource artefact
100
is no longer valid and we can be more confident in
Amnesics assuming that tasks A and B are assessing two differ-
90 Recency
Controls ent cognitive mechanisms (see also Chapter 20 for a
80
discussion of double dissociations). Despite some
70
% correct responses
Primacy
criticisms (e.g. Charter and Ganis, 1991; Robertson
60
et al., 1993), the double dissociation of single cases is a
50 prevailing method for cognitive neuropsychologists,
40 and findings by these means have greatly enhanced
30 our understanding of cognitive processes. For exam-
20 ple, going back to the memory system, the distinction
10 between short- and long-term memory is accepted,
0
but a strong assumption of the modal model (one of
1 2 3 4 5 6 7 8 9 10 the earlier interpretations of memory functions;
Serial position Atkinson and Shiffrin, 1971) was that information
FIGU RE 13. 8 Controls’ and amnesics’ serial position first entered short-term storage and then was trans-
effect in recalling a list of ten words (Baddeley and ferred into long-term memory storage. In other words,
Warrington, 1970). this theory accounts for a selective impairment of
416 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
long-term memory, as in Baddeley and Warrington’s reading of irregular words, is also at a pathological
(1970) study, but not for the opposite dissociation, level. Phonological patients, on the other hand, seem
that is, a selective impairment of short-term memory. to show the opposite pattern. For example, Job and
When patients showing memory deficits limited to Sartori (1984) described a phonological dyslexic
short-term memory started to be described (e.g. patient, Leonardo, who read 45 per cent of irregular
Warrington and Shallice, 1969) the modal model ran verbs correctly, but only 18 per cent of regular verbs.
into serious difficulties. The convergence of all of these Again, in this case reading of both types of verbs is
studies provided evidence for a double dissociation pathological, but reading of regular verbs is clearly
between short-term and long-term memory, suggest- worse than reading of irregular verbs. Evidence of a
ing a direct (maybe additional) route for long-term strong (rather than a classical) dissociation does not
memory (Ellis et al., 1996). This contributed to the diminish the importance of this dissociation, which
development of new theories that considered different suggests existence of different mechanisms.
links and relationships between different aspects of Similarly, as we have seen, it is quite common that
memory (see Chapter 9). neglect patients omit many, if not all, visual stimuli on
While the use of double dissociations is a valuable the contralesional side (neglect side). But they may
and widely accepted method, it is important to discuss also fail to detect a few stimuli on the ipsilesional side
some issues about dissociations raised by Shallice in (the non-neglected side), whereas healthy control per-
1988 in his now classic book, From Neuropsychology to formance on both sides is at ceiling. This can be due to
Mental Structure. Let us consider the case where task the fact that similar cognitive impairments may have
A is performed in the normal range, while task B is similar symptoms. In this last example of neglect, we
performed very poorly and, if compared with norms, can assume that a patient may suffer from a general
performance is clearly pathological. Shallice called attentional disorder, maybe reduced vigilance, in
this a ‘classical dissociation’. In a double classical dis- addition to the more specific lateralized deficit, neglect
sociation, two patients show opposite performances (Robertson et al., 1994). Here, the more general atten-
in two different tasks. For example, a patient may be tional disorder results in omissions with no particular
unable to pantomime the correct gesture associated spatial organization (i.e. also in the ipsilesional side).
with an object on view, but has no problem in per- We cannot exclude the possibility that some of the
forming the correct gesture if asked verbally (i.e. the contralesional omissions could also be due, to some
name of the object is given), whereas a second patient extent, to the general non-spatial attentional disorder,
may show the opposite dissociation. However, follow- but the considerable difference between ipsilesional
ing brain damage, classical dissociations are quite and contralesional sides strongly supports the hypoth-
unusual, and another type of dissociation, called esis of a lateralized attentional disorder.
‘strong dissociation’, is much more common with clin- However, Shallice (1988) has pointed out a possible
ical samples. In this case, both patients show a patho- risk with strong dissociations. Tests offer an occasion
logical performance on both tasks, but in opposite to ‘measure’ how well a cognitive mechanism is work-
patterns of performance when the two are compared. ing; nevertheless, not all tasks are equally affected by a
For example, patients showing surface dyslexia are brain lesion, and the relationship between perfor-
likely to show greater difficulties in reading irregular mance on specific tasks and the resources necessary to
words (for example, only 40 per cent of the irregular accomplish these tasks may be different. For example,
words are correctly read) than regular words (for an easy task may require relatively little resource to
example, 85 per cent of the regular words are correctly reach ceiling performance, and any further increment
read). However, healthy control performance for both in resources may not result in a further performance
types of words is at ceiling (at or near 100 per cent); improvement. On the other hand, performance on a
therefore in the case of these patients, their reading of more difficult task may benefit from additional incre-
regular words, despite being much better than their ments in resources (see Figure 13.9 for performance/
CHAPTER 13 COGNITIVE NEUROPSYCHOLOGY 417
100%
4.2Group studies versus
P1
single-case studies
P1
Performance
to questions about the incidence and frequency of TAB LE 13.1 Example of potential distortion of overall
specific deficits. Moreover, group studies are generally performance pattern when group data are averaged
(Banich, 2004)
less exposed to criticism such as poor replicability,
which is an important aspect of modern scientific Patient Performance (% accuracy)
research (Popper, 1959), or difficulties in using the
Task 1 Task 2 Task 3
studies to support generalizations. Robertson et al.
(1993) also considered group studies to be a better 1 20 75 70
way to investigate cognitive modularity. Patients’ per- 2 25 70 80
formance is usually compared with that of a group of 3 30 80 75
control participants (usually healthy volunteers or 4 75 25 75
other patients not showing the crucial symptom or 5 80 30 70
specific brain lesion). The control group is usually 6 70 20 80
comparable (similar) to the patient group across a 7 75 80 25
is reported by Baddeley and Warrington (1970) who Average 58.3 58.3 58.3
ACTIVIT Y 13.1
Limb apraxia has been defined as an impairment of route? Identification of this crucial variable will
gesture processing not due to motor impairment guide the main structure of your experiment.
per se. Usually this syndrome is observed following 5 Dependent variable/s and establish how you will
lesions of the left hemisphere. Looking at the cogni- analyse data.
tive model in Figure 13.3, we can identify two possi-
A few guidelines and points for further discussion:
ble routes used to process information and perform
an action. One route (the lexical route) involves • Consider meaningful (e.g. pantomime the use of
accessing the semantic system, whereas the other a hammer) and meaningless gestures and the rel-
route (the non-lexical route) does not access the evance of semantic access.
semantic system. In this second route visual informa- • Consider gesture production versus gesture
tion is processed by means of visuo-motor conver- imitation and when access to the semantic
sion mechanisms that allow imitation. Now, suppose system is crucial.
you want to find evidence for this two-route distinc- • Since the non-lexical route converts visual infor-
tion using the lesion method (that is, testing brain- mation into motor representations, you may
damaged patients). What type of experiment would need to consider visual (rather than verbal) input
you devise? Try to identify: also for the task assessing the lexical route.
• Consider which type of error you may expect
1 Hypotheses and predictions – What type of for malfunction of either ‘box’ or ‘link between
behaviour/deficit would you expect to observe if boxes’ (i.e. the arrows).
either of these routes is impaired? In other • Make sure that associated deficits, such as visual
words, which type of dissociation would you agnosia, will not bias the findings. How will you
expect to observe? control for these possible confounding variables?
2 Inclusion criteria – Would you select a specific Also, note that the two routes converge in the ges-
type of patient based on site of the lesion? tural buffer (which holds information on line and
3 Exclusion criteria – Could any associated deficit translates abstract formats into sequences of motor
(e.g. aphasia, agnosia, etc. . . .) represent a con- commands). A deficit at this level may affect final
founding variable for your experiment? performance of both tasks that depend on process-
4 Crucial tasks and conditions – Which is the cru- ing in the lexical route, and tasks that depend on
cial aspect of the lexical and of the non-lexical processing in the non-lexical route.
by implication, damage to discrete functions, are left perceptual neglect and right representational
pooled together. Also a selection on the basis of the neglect for mental images, may be hidden in the aver-
presence or absence of a clinical syndrome (e.g., Broca’s aged group performance. In this context it is not very
aphasia, or spatial hemineglect) is open to this criti- important whether many patients will show a similar
cism, as patients with non-homogeneous cognitive pattern of symptoms; what is really relevant here is that
disorders might be included.’ (p.121). these findings can further fractionate a cognitive pro-
Caramazza (1986), who has strongly supported the cess and refine a theoretical interpretation. As pointed
use of single-case studies, pointed out that in the out by Ward (2006), the single-case method is not a
attempt to look at global findings, interesting individ- prerogative of cognitive neuropsychology, as it is also
ual results might pass unnoticed. Rare double dissocia- used in other scientific environments, and the rarity of
tions between two patients, or even within the same some single cases does not reduce their scientific rele-
patient, as in Beschin et al.’s (2000) patient who showed vance. For example, Ward noted that the discovery of
420 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
the primate Lucy by Johanson in 1974 has represented and different research teams have reached quite
a crucial case for modern theories about the evolution extreme opinions. However, both methods have pro-
of primates. Before this discovery, scientists believed vided valuable contributions to the understanding of
that, from a phylogenetic point of view, brain enlarge- cognitive processes. Researchers need to be aware of
ment had preceded the ability to walk upright. the criticisms that each method is exposed to, and the
However, Lucy’s skeleton was that of a woman able to related implications. The research goals should then
walk upright despite her relatively small brain, and guide selection of the most appropriate method.
‘Johanson did not have to provide a group of Lucy for Now that you have considered some of the key
his findings to be acceptable to the scientific commu- methodological features of work in cognitive neu-
nity’ (Ward, 2006; p.85). ropsychology, try Activity 13.1 and see how you would
In conclusion, the choice between using single-case design a neuropsychological study.
or group studies has been the subject of great debate
SUMMARY OF SECTION 4
• Association of symptoms can guide definition of syndromes, which may be relevant to facilitate com-
munication amongst researchers and clinicians and to define inclusion criteria in research studies.
However, association of symptoms per se is not a powerful method to investigate cognitive functions.
• Dissociations and double dissociations consist of observing opposite patterns of performance on two
different tasks and allow researchers and theorists to fractionate cognitive processes. Classical dis-
sociation is observed when performance on one of two tasks is within a normal range, while strong
dissociation is observed when performance on both tasks, despite being significantly different, is
pathological.
• Group studies are carried out on relatively large samples and data are compared across participants.
Groups are assumed to be homogeneous according to a specific characteristic crucial for experimen-
tal purposes. This assumption has some limitations, and appropriate selection of participants is one
of the fundamental aspects of group studies.
• Single-case studies are conducted on a single patient showing a peculiar pattern of symptoms. These
studies can offer the possibility of investigating rare and highly interesting cases from a theoretical point
of view. The main limitation is the question of whether such findings generalize to healthy populations.
fluent, but often incomprehensible, verbal communi- instances this assumption may not be valid. A patient
cation. Butterworth noticed that KC’s neologisms were may have shown an atypical organization even before
either produced at the end of a sentence, or followed brain damage for various reasons. This could be due to
longer latencies compared to other words, and that the developmental conditions (e.g. congenital blindness),
same or similar neologisms tended to be recurrent in a psychiatric history, previous neurological diseases, or
conversation. On these bases, it was suggested that simply pre-morbid use of strategies, as seen in Levine
KC’s neologisms should be considered as ‘filler’ mor- and colleagues’ (1982) patient who adopted a method
phemes that the patient was generating to fill anomic of fast reading for years and attained a highly devel-
gaps – locations in speech where KC was unable to oped visual imagery ability, before suffering from a
select the correct noun. Therefore, Butterworth con- brain injury resulting in a peculiar dissociation
cluded that KC’s speech features were mainly the result between speech and reading.
of a more or less conscious strategy adopted by the This is a critical issue in many studies involving epi-
patient in response to his language difficulties. leptic patients. These patients have usually suffered
Compensatory strategies are not just rare occur- from epileptic seizures severe enough to induce
rences in single cases; indeed, some strategies can patients and clinicians to consider neurosurgical inter-
even become a recurrent adaptation for groups of vention to avoid epileptic seizures spreading to other
patients, and may arise from pre-morbid processes parts of the brain. As a result of this, study of these
(that is, processes already in place prior to brain dam- patients has given rise to the emblematic condition of
age). For example, Coltheart (2001) considered disconnection syndrome, known as split-brain (Sperry
patients with pure alexia who have profound reading et al., 1969; Gazzaniga et al., 2002). In these cases, a
impairments, and may only be able to identify a whole portion of the corpus callosum (the main commissural
word after having spelled it out letter-by-letter (so- fibre that connects the same anatomical areas in the
called letter-by-letter reading). This reading proce- two hemispheres) is severed to avoid the spread of the
dure is not normally adopted by healthy adults, but we epileptic seizure from one hemisphere to the other.
cannot assume that it has been introduced by the Clearly these patients represent an incredibly interest-
brain damage. This way of processing information ing opportunity to investigate functions of each hemi-
exists for any healthy person, but it is underused as we sphere (hemispheric asymmetry). However, as the
normally adopt more efficient ways of reading. patients may have suffered from very severe epileptic
However, if a brain lesion impairs the more effective seizures since childhood we cannot rule out the possi-
way of reading, then patients may adopt the ‘under- bility that their cognitive organization before neuro-
used process . . . using the normal functional architec- surgery was atypical. Similarly, epileptic patients have
ture in an abnormal way’ (Coltheart, 2001, p.10). participated in another set of studies using the Wada
test. This test, usually administered during the pre-
surgical phase, consists of injecting a barbiturate into
Pre-morbid pathological
5.2 one of the two carotid arteries to temporarily inactivate
one hemisphere. Again, this has represented an
conditions and previous extremely interesting opportunity for neuropsycholo-
brain damage gists and cognitive neuropsychologists to investigate
hemispheric specialization of particular cognitive pro-
As mentioned at the beginning of this chapter, cogni- cesses, leading to crucial theoretical implications.
tive neuropsychology assumes that the pattern of However, as mentioned above, these patients’ anatomi-
symptoms observed following a brain lesion reflects cal brain organization may be different from an intact
underlying damage to specific cognitive components brain, and cognitive organization may be atypical
that existed prior to the brain damage (assumption of or dissimilar across individuals. If so, it would not
transparency). Although this is often the case, in some be surprising to observe contrasting findings. For
422 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
example, the Wada test has been used in a group of to 89 per cent (Durkin et al., 1994). Despite the unlike-
studies examining hemispheric specialization of aware- lihood that a unique factor may explain these contrast-
ness for motor impairment. During these studies ing findings, we cannot disregard the possibility that
patients showed motor impairment on the side of the such heterogeneous patterns of data may result from
body opposite to the anaesthetized hemisphere, and individual differences in cognitive organization, prob-
were questioned about their motor ability (e.g. ‘Can you ably due to recurrent and long-lasting severe epileptic
move your arm?’) to evaluate whether they were aware seizures in one part of the brain.
of the deficit. Findings, summarized in Table 13.2, show Finally, it is also important to consider that brain
quite a heterogeneous pattern of data (Cocchini et al., damage can affect the pre-existing balance between
2009; Cocchini and Della Sala, 2010). Despite a general different modules and that different brain lesions may
trend towards a crucial role of the right hemisphere in have opposite effects, which can confound even-
becoming aware (i.e. its inactivation would produce tual findings. A dramatic example is reported by
anosognosia – a condition in which patients are una- Vuilleumier and collaborators (1996). The authors
ware of an impairment), the data across the studies are described a patient who, following a first right parieto-
surprisingly heterogeneous. Some studies showed a occipital vascular lesion, showed a severe left neglect
very strong hemispheric effect (Gilmore et al., 1992) syndrome; the patient ignored stimuli presented on
while other studies found no hemispheric difference at the left side. However, ten days after the lesion, the
all (Dywan et al., 1995). Moreover, even within the neglect vanished completely, immediately after a sec-
same hemispheric condition, the frequency of anosog- ond vascular insult occurred in the left frontal lobe.
nosia varied considerably. For example, when the left The authors suggested that the first lesion caused an
hemisphere was anaesthetized the percentage of attentional imbalance, but that equilibrium was
patients showing anosognosia varied considerably restored by the second lesion to a different brain site.
across the studies from 0 per cent (Gilmore et al., 1992) Clearly brain damage does not improve cognitive pro-
cesses; rather this case exemplifies how brain lesions
may not only impair a particular process, but may also
TAB LE 13. 2 Percentage of participants showing
evidence of unawareness following suppression of play an important role in rebalancing and modifying
activity of left and right hemisphere (Wada test). existing relationships between different modules.
Modified from Cocchini and Della Sala, 2010
Hemisphere Number of
anaesthetized participants 5.3Combination of deficits:
RIGHT LEFT the contribution and
Gilmore et al., 1992 100 0 8
Buchtel et al., 1992 92 59 48
interaction of different
Kaplan et al., 1993 100 71 15 deficits
Durkin et al., 1994 95 89 150*
94 86 115* A further complication, especially if patients show
Dywan et al., 1995 66 66 83 multiple lesions due to traumatic brain injuries, is that
Breier et al., 1995 89 49 54 of the combined effect of different cognitive deficits,
Carpenter et al., 1995 87 38 31 which may confuse or blur the clinical picture. For
Lu et al., 1997 80 59 17 example, a few years ago with my collaborators
(Cocchini et al., 2002), we described a patient (NS)
*The larger sample consisted of 150 participants (regardless of
hemisphere dominance for language). The sub-group of 115 suffering from a severe form of anosognosia. Following
participants refers to dextrals with left-hemisphere dominance bilateral brain damage, NS showed hemiplegia (i.e.
for language. paralysis of one side of the body) for his left limbs and
CHAPTER 13 COGNITIVE NEUROPSYCHOLOGY 423
a pattern of cognitive deficits including left personal NS deny his impairment so soon after having acknowl-
neglect (i.e. lack of attention for the side of the body edged it? We interpreted this phenomenon as being
opposite to the brain lesion) and severe anterograde due to his inability to memorize new information
amnesia (difficulty in learning and memorizing infor- (anterograde amnesia), including the recent informa-
mation presented after the brain damage). Despite tion related to his motor impairment. Therefore, we
being confined all day to a wheelchair, NS denied his suggested that NS’s chronic anosognosia was the result
motor impairment (anosognosia for hemiplegia) to of the combined effect of personal neglect (which pre-
such an extent that he recurrently fell to the floor as he vented NS from acknowledging his paralysis) and
attempted to walk. After a series of experiments, we anterograde amnesia (which prevented him from
noticed that NS was able to acknowledge his hemiple- remembering what was just acknowledged). This is
gia when his attention was forced toward the neglected quite a different way of considering chronic anosogno-
side of his body (asking him to attend to stimuli located sia to the traditional view: a chronic inability to become
on his left hand or foot), suggesting that personal aware. Davies and collaborators (2005) pointed out the
neglect may have impeded ‘discovery’ of motor impair- possibility that different mechanisms (and eventually
ment. However, quite surprisingly, the effect was only the malfunction of different modules) may be respon-
temporary, and he would again deny his deficit a few sible for some syndromes such as anosognosia. For this
minutes later. This was interesting as anosognosia had reason, it is important to provide what Shallice (1988)
always been interpreted as a deficit in becoming aware, called ‘the results of standard clinical baseline tests’
not remaining aware. In other words, if you painfully (p.30), otherwise it may be difficult to compare results
discover that your leg has been broken as a conse- from different patients, and results interpreted within
quence of a recent fall, you don’t need to attempt to the framework of a theoretical context may actually
walk each morning in order to remain aware that your reflect an impairment in another domain neglected in
leg is broken; you simply ‘remember’ it. If so, why did our standard assessment.
SUMMARY OF SECTION 5
• Compensatory strategies or adaptation may occur following brain damage, and this may affect the
pattern of symptoms observed.
• The assumption of transparency may not always be valid, as pre-morbid mental organization may
have been atypical in some cases.
• It is not unusual for the pattern of symptoms observed to be the result of a combination of different
deficits, which may blur or complicate the clinical picture. It is important, therefore, to record
patients’ cognitive abilities on a series of tests in order to better identify and understand possible
interactions or alternative explanations for findings.
6MEASURING BEHAVIOUR AL
RESPONSES
The cognitive neuropsychologist is interested in the following brain damage. This pattern of data consists
pattern of spared and impaired cognitive processes of detailed observation of patients’ performance on a
424 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
series of psychometric tests. These are behavioural earlier of the patient failing to reproduce the correct
data that then allow quantitative (test scores) but also gesture when a comb is placed on the table (main
qualitative (e.g. types of error) analyses. task), we may expect to observe different types of
‘Pure’ cases (i.e. those showing a selective cogni- errors depending on the actual cognitive impair-
tive impairment) are very rare and to rely only on ment. For example, if the patient fails the main task
these cases may not be the most efficient approach because he or she does not correctly recognize the
for cognitive neuropsychology. As mentioned earlier, object, then they may perform a pantomime corre-
it is particularly important to define a comprehen- sponding to another object, and may be able to per-
sive profile of a patient’s cognitive capacities, as many form the correct pantomime if the name of the object
different reasons may account for impairment on the is provided. However, if the poor performance is due
task in question. For example, a patient may not be to comprehension difficulties, the patient may not be
able to perform the gesture necessary to use an object able to understand the instruction of the task and we
(e.g. a comb) placed on the table. This failure may be may expect a completely unrelated behaviour (e.g.
interpreted as limb apraxia. However, other reasons the patient may nod or point to the comb, or merely
may account for a failure in performing such a task. seem puzzled).
For example, the patient may be either unable to Some information may already be available to the
actually see the object, which may have been dis- researcher from a preliminary assessment, which can
played in a blind portion of the visual field (as in include psychological, neurological, and radiological
quadrantanopias or hemianopias), or they may have information. This type of information can guide fur-
difficulties in directing attention towards the stimu- ther, more specific investigations. How we collect this
lus (as we have seen in attentional deficits and specific information may vary considerably depend-
neglect). However, it is possible that the patient has ing on whether we are conducting a group study or a
no visual or attentional deficits, but is unable to rec- single-case study (see Section 4.2 above).
ognize the object (agnosia). Finally, he or she may be With group studies, it is quite common to adminis-
unable to perform the task because of severe verbal ter fixed batteries of tests to all patients. A very
comprehension deficits that prevent them under- important issue in these types of studies is that of
standing the task instructions. inclusion/exclusion criteria; in other words, how
A comprehensive battery of tests can provide the patients are selected for the study. For example, a
necessary information to understand whether patients study on apraxia may consider all patients showing:
show associated disorders that may affect their perfor- (i) brain damage in the left hemisphere; and (ii) evi-
mance of a specific task. However, in order to explore dence of difficulties in using objects (inclusion crite-
all possible cognitive impairments, it may be neces- ria). However, all patients showing severe language
sary to use quite extensive and long-lasting batteries of comprehension impairment on a preliminary test
tests. In these cases, the effects of tiredness or sponta- may be excluded from the study, as data may be unre-
neous recovery (if the assessment needs many test ses- liable (exclusion criterion). Selection of participants
sions) may bias the findings. This is a particularly is an extremely important methodological step in
relevant consideration for patients in the acute phase cognitive neuropsychology, as an inaccurate selection
(i.e. soon after the brain damage) when a general may lead to incorrect conclusions.
spontaneous improvement is very likely to be observed For single-case studies the procedure is very differ-
within the first few days or weeks. ent, as in these cases a patient is brought to the
McCloskey (2001) also emphasized the impor- researcher’s attention due to her/his peculiar charac-
tance of qualitative analyses, which address the types teristics. Usually a battery of tests and experiments
of error committed by the patients. Just think about will be tailored around the specific pattern of symp-
the crucial role of semantic errors for the diagnosis toms shown by this patient, and each test will be
of deep dyslexia. Going back to the example reported guided by specific clinical or theoretical questions.
CHAPTER 13 COGNITIVE NEUROPSYCHOLOGY 425
7 CONCLUSIONS
The aim of cognitive neuropsychology is the under- This means that cognitive processes are not isolated,
standing of normal (healthy) cognitive processes by and that the interpretation of findings can be further
observing the patterns of impaired and intact cogni- complicated by a number of crucial and critical issues.
tive components after brain damage. The lesion Indeed, after brain damage, a patient may compensate
method represents one way to fractionate cognitive for the lack of an ability by using other strategies
processes, and to understand the role of specific sub- (albeit more or less consciously), which may blur our
components and their relationships. Concepts such as findings and lead us to misleading conclusions.
modularity, transparency, and subtractivity are the Similarly, some patients may have pre-morbid condi-
core assumptions of cognitive neuropsychology, as tions (such as previous brain damage or a congenital
they represent a sort of guideline for the study of men- disease) that may have affected their cognitive organi-
tal processes. Not only do these concepts guide our zation. This may represent a problem for the impor-
understanding, interpretation, and generalization of tant assumption of transparency and limit the
findings, but they also have profound implications for generalization of related findings. All this does not
the choice of the most appropriate method to investi- necessarily mean that these patients should not be
gate a specific cognitive function. considered. On the contrary, they may still represent
We have considered the advantages, possible limita- an interesting opportunity to investigate cognitive
tions, and criticisms of single-case or group studies. processes. However, the cognitive neuropsychologist
Although group studies are a valuable method of will need to consider these factors and their possible
investigation, we have appreciated how single-case implication in relation to specific findings.
descriptions remain a crucial method for the cognitive Finally, the assessment is a delicate moment of the
neuropsychologist. Indeed, single-case studies are investigation. As I mentioned earlier, syndromes can
usually more appropriate for a detailed investigation be quite heterogeneous and identification of relevant
of a specific pattern of symptoms, and it is of relatively symptoms may be complicated by various associated
little importance whether this occurrence is a rare symptoms. It is important to obtain a general clinical
condition or not, as long as these findings allow and cognitive picture of each patient. Pure cases are
further insight into a cognitive process. For example, not so frequent and often brain-damaged patients pre-
the description of a rare case showing a selective sent a range of cognitive deficits; therefore, it is impor-
deficit of a cognitive component may lead to a further tant to evaluate the implications and possible biases of
fractionation of a cognitive module. The rarity of different cognitive impairments on a cognitive task.
the event does not diminish the relevance of the Indeed, the functional architecture of mental pro-
finding. cesses is extremely complex and performance on a
In this chapter we also discussed the relevance and particular test may require several cognitive func-
limitations of associations and dissociations. Despite tions. Failure on a task may be determined by an
possible pitfalls, dissociations, and in particular impairment of any of the cognitive functions usually
double dissociations, offer the most powerful way to required. Therefore, data need to be considered in a
investigate and fractionate cognitive modules. In wider scenario and possible confounding variables
general, if we observe two patients with opposite must be identified and addressed.
performance on two different tasks, then we can rea- Although cognitive neuropsychology is a relatively
sonably suspect impairment of two different cognitive recent discipline, our understanding of some cogni-
mechanisms. tive functions, such as language, has grown consider-
That being said, the functional architecture of cog- ably over the last few decades and detailed cognitive
nitive processes is complex and highly interactive. models have been developed to explain possible
426 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
FURTHER READING
Shallice, T. (1988) From Neuropsychology to Mental For detailed and critical revisions of the historical phases of the
Structure, Cambridge, Cambridge University Press. This study of cognitive processes following brain damage:
classic book remains key reading for cognitive neuropsycholo- Selnes, O.A. (2001) ‘A historical overview of contributions
gists. In it Shallice covers crucial methodological aspects and from the study of deficits’, in Rapp, B. (ed.) The Handbook of
issues of data interpretation for research with brain-damaged Cognitive Neuropsychology, Hove, Psychology Press.
patients. Shallice, T. (1988) ‘From the diagram-makers to cognitive
Rapp, B. (2001) The Handbook of Cognitive Neuropsychology, neuropsychology’, in Shallice, T. From Neuropsychology to
Hove, Psychology Press. This book contains several chapters that Mental Structure, Cambridge, Cambridge University Press.
critically consider theoretical and methodological issues for cogni- For detailed information on psychometric tests and batteries:
tive neuropsychology and specific syndromes. Lezak, D.M., Howieson, D.B., Loring D.W., and Hannay,
Ward, J. (2006) The Students’ Guide to Cognitive H.J. (2004) Neuropsychological Assessment, 4th edition, Oxford,
Neuroscience, Hove, Psychology Press. Despite addressing the Oxford University Press.
wider field of neuroscience, Chapter 5 of this book covers a num- Strauss, E., Sherman, E.M.S., and Spreen, O. (2006) A
ber of methodological issues overlapping with cognitive neuropsy- Compendium of Neuropsychological Tests: Administration,
chology, while other chapters provide an overview of different Norms, and Commentary, 3rd edition, Oxford, Oxford
cognitive impairments following brain damage. University Press.
REFERENCES
Atkinson, R.C. and Shiffrin, R.M. (1971) ‘The control of short- Breier, J.L, Adair, J.C., Gold, M., Fennell, E.B., Gilmore, R.L.,
term memory’, Scientific American, vol.224, pp.82-90. and Heilman, K.M. (1995) ‘Dissociation of anosognosia for
Baddeley, A.D. and Warrington, E.K. (1970). ‘Amnesia and hemiplegia and aphasia during left-hemisphere anesthesia’,
the distinction between long- and short-term memory’, Journal Neurology, vol.45, pp.65–7.
of Verbal Learning and Verbal Behavior, vol.9, pp.176–189. Broca, P. (1861) ‘Remarques sur le Siège de la Faculté du
Banich, M.T. (2004) Cognitive Neuroscience and Langage Articulé, Suivies d’une Observation d’aphémie
Neuropsychology, Boston, Houghton Mifflin Company. (perte de la parole)’, Bulletin de la Societeé Anatomique, vol.6,
Basso, A. and Pizzamiglio, G. (1999) ‘Recovery of cerebral pp.330–57.
functions’, in Denes, G., and Pizzamiglio, L. (eds.) Handbook of Buchtel, H., Henry, T., and Abou-Khalil, B. (1992) ‘Memory
Clinical and Experimental Neuropsychology, Hove, Psychology for neurological deficits during the intracarotid amytal proce-
Press. dure: a hemispheric difference’, Journal of Clinical Experimental
Beschin, N., Basso, A., and Della Sala, S. (2000) ‘Perceiving Neuropsychology, vol.14, pp.96–7.
left and imaging right: dissociation in neglect’, Cortex, vol.36, Butterworth, B. (1979) ‘Hesitation and the production of
pp.401–14. verbal paraphasias and neologisms in jargon aphasia’, Brain
Beschin, N., Cocchini, G., Della Sala, S., and Logie, R. and Language, vol.8, pp.133–61.
(1997) ‘What the eyes perceive, the brain ignores: a case of pure Caramazza, A. (1986) ‘On drawing inferences about
unilateral representational neglect’, Cortex, vol.33, pp.3–26. the structure of normal cognitive systems from the analysis of
CHAPTER 13 COGNITIVE NEUROPSYCHOLOGY 427
patterns of impaired performance: the case for single-patient Durkin, M.W., Meador, K.J., Nichols, M.E., Lee, G.P., and
studies’, Brain and Cognition, vol.5, pp.41–66. Loring, D.W. (1994) ‘Anosognosia and the intracarotid
Caramazza, A. and Badecker, W. (1989) ‘Patient classifica- amobarbital procedure (Wada Test)’, Neurology, vol.44,
tion in neuropsychological research’, Brain and Cognition, pp.978–9.
vol.10, pp.256–95. Dywan, C., McGlone, J., and Fox, A. (1995) ‘Do intraca-
Carpenter, K., Berti, A., Oxbury, S., Molyneux, A.J., Bisiach, rotid barbiturate injections offer a way to investigate hemi-
E. and Oxbury, J.M. (1995) ‘Awareness of and memory for arm spheric models of anosognosia?’ Journal of Clinical and
weakness during intracarotid sodium amytal testing’, Brain, Experimental Neuropsychology, vol.17, pp.431–8.
vol.118, pp.243–51. Ellis, A.W. (1987) ‘Intimations of modularity, or the modu-
Charter, N. and Ganis, G. (1991) ‘Double dissociation and larity of mind: doing cognitive neuropsychology without syn-
isolable cognitive processes’, in Proceedings of the Thirteenth dromes’, in Coltheart, M., Sartori, G., and Job, R. (eds.) The
Annual Conference of the Cognitive Science Society, Hillsdale, Cognitive Neuropsychology of Language, London, Lawrence
NJ, Erlbaum. Erlbaum.
Chomsky, N. (1980) Rules and Representations, New York, Ellis, A.W. and Young, A.W. (1988) Human Cognitive
Columbia University Press. Neuropsychology, Hove, Lawrence Erlbaum Associates.
Cocchini, G. and Della Sala, S. (2010) ‘Assessing anosogno- Ellis, A.X., Della Sala, S., and Logie, R.H. (1996) ‘The baili-
sia for motor and language impairments’, in Prigatano, G. (ed.) wick of visuo-spatial working memory: evidence from unilat-
Study of Anosognosia, Oxford, Oxford University Press. eral spatial neglect’, Cognitive Brain Research, vol.3, pp.71–8.
Cocchini, G., Beschin, N., Cameron, A., Foutopolou, A., Fodor, J.A. (1983) The Modularity of Mind, Cambridge,
and Della Sala, S. (2009) ‘Anosognosia for motor impairment MIT Press.
following left-brain damage’, Neuropsychology, vol.23, no.2, Fodor, J.A. (2000) The Mind Doesn’t Work That Way: The
pp.223–30. Scope and Limits of Computational Psychology, Cambridge,
Cocchini, G., Beschin, N., and Della Sala, S. (2002) MIT Press.
‘Chronic anosognosia: a case report and theoretical account’, Gazzaniga, M.S., Ivry, R.B., and Mangun, G.R. (2002)
Neuropsychologia, vol.40, no.12, pp.2030–8. Cognitive Neuroscience: The Biology of Mind, New York,
Coltheart, M. (1980) ‘Deep dyslexia: a review of the syn- W.W. Norton & Company.
drome’, in Coltheart, M., Patterson, K., and Marshall, J.C. Gerstmann, J. (1930) ‘Zür symptomatologie der hirnlae-
(eds.) Deep Dyslexia, London, Routledge & Kegan Paul. sionen im ubergangsgebiet der unteren parietal- und mit-
Coltheart, M. (1986) ‘Cognitive neuropsychology’, in telerem occipitalwindung’, Nervenarzt, vol.3, pp.691–5.
Posner, M. and Marin, O.S.M. (eds.) Attention and Performance, Geshwind, N. (1965) ‘Disconnexion syndromes in animals
XI, Hillsdale, NJ, Lawrence Erlbaum Associates Inc. and man’, Brain, vol.88, pp.237–94.
Coltheart, M. (1999) ‘Modularity and cognition’, Trends in Gilmore, R.L., Heilman, K.M., Schmidt, R.P., Fennell, E.M.,
Cognitive Science, vol.3, pp.115–120. and Quisling, R. (1992) ‘Anosognosia during Wada testing’,
Coltheart, M. (2001) ‘Assumptions and methods in cogni- Neurology, vol.42, pp.925–7.
tive neuropsychology’, in Rapp B. (ed.) The Handbook of Harlow, J.M. (1848) ‘Recovery after severe injury to the
Cognitive Neuropsychology, Hove, Psychology Press. head’, Publication of the Massachusetts Medical Society, vol.2,
Coltheart, M., Patterson, K., and Marshall, J.C. (1980) Deep pp.327–46.
Dyslexia, London, Routledge & Kegan Paul. Heilman, K.M., Rothi, L.J., and Valenstein, E. (1982) ‘Two
Cubelli, R., Marchetti, C., Boscolo, G., and Della Sala, S. forms of ideomotor apraxia’, Neurology, vol.32, pp.342–6.
(2000) ‘Cognition in action: testing a model of limb apraxia’, Humphreys, G.W., Heinke, D.G., and Yoon, E.Y. (2006)
Brain and Cognition, vol.44, pp.144–65. ‘Cognitive neuropsychology and computational modelling: the
Davies, M., Davies, A.A., and Coltheart, M. (2005) contribution of computational neuroscience to understanding
‘Anosognosia and the two-factor theory of delusions’, Mind & the mind’ in Senior, C., Russell, T., and Gazzaniga, M.S. (eds.)
Language, vol.20, pp.209–36. Methods in Mind, Cambridge, MIT Press.
Della Sala, S. and Bates, P. (1996) ‘Introduction. Research in Job, R. and Sartori, G. (1984) ‘Morphological decomposi-
cognition: the gateway to a sound rehabilitation’, in Della Sala, tion: evidence from crossed phonological dyslexia’, The
S., Marchetti, C., and Turnbull, O.H. (eds.) An Interdisciplinary Quarterly Journal of Experimental Psychology A: Human
Approach to the Rehabilitation of the Neurological Patient: Experimental Psychology, vol.36A, no.3, pp.435–58.
A cognitive perspective, Pavia, Fondazione S. Maugeri Edizioni Kaplan, R.F., Meadows, M.E., Cohen, R.A., Bromfield, E.B.,
PI-ME Press. and Ehrenberg, B.L. (1993) ‘Awareness of deficit after the
428 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
sodium amobarbital (Wada) test’, Journal of Clinical Perret, E. (1974) ‘The left frontal lobe in man and the
Experimental Neuropsychology, vol.15, p.383. suppression of habitual responses in verbal categorical behav-
Levine, D.N., Calvanio, R., and Popovics, A. (1982) iour’, Neuropsychologia, vol.12, pp.323–30.
‘Language in the absence of inner speech’, Neuropsychologia, Poeck, K. and Orgass, B. (1966) ‘Gerstmann’s syndrome
vol.20, pp.391–409. and aphasia’, Cortex, vol.2, pp.421–7.
Lichtheim, L. (1885) ‘On aphasia’, Brain, vol.7, Popper, K.R. (1959) The Logic of Scientific Discovery,
pp.433–484. London, Hutchinson.
Liepmann, H. (1900) ‘Das krankheitshildder der apraxie Rafal, R., Smith, J., Krantz, J., Cohen, A., and Brennan, C.
(Motorischen/Asymbolie)’, Monatschrift für Psychiatrie und (1990) ‘Extrageniculate vision in hemianoptic humans: sac-
Neurologie, vol.8, pp.15–44, 102–132, 182–197. cade inhibition by signals in the blind field’, Science, vol.250,
Lu, L.H., Barrett, A.M., Schwartz, R.L., Cibula, J.E., Gilmore, pp.118–21.
R.L., Uthman, B.M., and Heilman, K.M. (1997) ‘Anosognosia Ramachandran, V.S., Rogers-Ramachandran, D.C., and
and confabulation during the Wada test’, Neurology, vol.49, Cobbs, S. (1995) ‘Touching the phantom limb’, Nature, vol.377,
pp.1316–22. pp.489–90.
Luria, A.R. (1966) Higher Cortical Functions in Man, Robertson, I.H., Halligan, P.W., Bergego, C., Hömberg, V.,
London, Tavistock. Pizzamiglio, L., Weber, E., et al. (1994) ‘Right neglect follow-
Luria, A.R. (1973) The Working Brain, London, Penguin. ing right hemisphere damage?’ Cortex, vol.30, pp.199–213.
Marie, P. (1906) ‘Révision de la question de l’aphasie: la Robertson, L.C., Knight, R.T., Rafal, R., and Shimamura,
troisième convolution frontale gauche ne joue aucun role spe- A.P. (1993) ‘Cognitive neuropsychology is more than single-
ciale dans la fonction du language’, Semaine Medicale, vol.21, case studies’, Journal of Experimental Psychology: Learning,
pp.241–7. Memory, and Cognition, vol.19, pp.710–17.
Marin, O.S.M., Saffran, E.M., and Schwartz, D.F. (1976) Schnider, A. and Ptak, R. (1999) ‘Spontaneous confabula-
‘Dissociations of language in aphasia: implications for normal tors fail to suppress currently irrelevant memory traces’,
functions’, Annals of the New York Academy of Sciences, vol.280, Nature Neuroscience, vol.2, pp.677–81.
pp.868–84. Schnider, A., Ptak, R., von Däniken, C., and Remonda, L.
Marr, D. (1976) ‘Early processing of visual information’, (2000) ‘Recovery from spontaneous confabulations parallels
Philosophical Transactions of the Royal Society of London B, recovery of temporal conclusion memory’, Neurology, vol.55,
vol.275, pp.483–524. pp.74–83.
Marshall, J.C. and Halligan, P.W. (1988) ‘Blindsight in Schnider, A., von Däniken, C., and Gutbrod, K. (1996) ‘The
visuo-spatial neglect’, Nature, vol.336, pp.766–7. mechanisms of spontaneous and provoked confabulations’,
Marshall, J.C. and Newcombe, F. (1966) ‘Syntactic Brain, vol.119, pp.1365–75.
and semantic errors in paralexia’, Neuropsychologia, vol.4, Scoville, W.B. and Milner, B. (1957) ‘Loss of recent memory
pp.169–76. after bilateral hippocampal lesions’, Journal of Neurology,
Marshall, J.C. and Newcombe, F. (1973) ‘Patterns of Neurosurgery and Psychiatry, vol.20, pp.11–21.
paralexia: a psycholinguistic approach’, Journal of Selnes, O.A. (2001) ‘A historical overview of contributions
Psycholinguistic Research, vol.2, pp.175–99. from the study of deficits’, in Rapp, B. (ed.) The Handbook of
McCloskey, M. (2001) ‘The future of cognitive neuropsy- Cognitive Neuropsychology, Hove, Psychology Press.
chology’, in Rapp, B. (ed.) The Handbook of Cognitive Shallice, T. (1988) From Neuropsychology to Mental
Neuropsychology, Hove, Psychology Press. Structure, Cambridge, Cambridge University Press.
Milner, B. (1966) ‘Amnesia following operations on the Sokol, S.M., McCloskey, M., Cohen, N.J., and Aliminosa, D.
temporal lobes’, in Whitty, C.W.M. and Zangwill, O.L. (eds.) (1991) ‘Cognitive representations and processes in arithmetic:
Amnesia, London, Butterworth. inferences from the performance of brain-damaged subjects,
Milner, B., Corkin, S., and Teuber, H-L. (1968) ‘Further Journal of Experimental Psychology: Learning, Memory, and
analysis of the hippocampal amnesia syndrome: 14 year Cognition, vol.17, pp.355–76.
follow-up study of H.M.’, Neuropsychologia, vol.6, pp.215–34. Sperry, R.W., Gazzaniga, M.S., and Bogen, J.E. (1969)
Morton, J. and Patterson, K. (1980) ‘A new attempt at an ‘Interhemispheric relationships: the neocortical commissures;
interpretation, or, an attempt at a new interpretation’, in syndromes of hemisphere disconnection’, in Vinken, P.J. and
Coltheart, M., Patterson, K., and Marshall, J.C. (eds.) Deep Bruyn, G.W. (eds.) Handbook of Clinical Neurology, Volume 4,
Dyslexia, London, Routledge & Kegan Paul. Amsterdam, North-Holland Publishing Company.
Patterson, K., Marshall, J.C., and Coltheart, M. (1985) Vallar, G. (1999) ‘Methodological foundations of neuropsy-
Surface Dyslexia, London, Lawrence Erlbaum. chology’, in Denes, G. and Pizzamiglio, L. (eds.) Handbook of
CHAPTER 13 COGNITIVE NEUROPSYCHOLOGY 429
Clinical and Experimental Neuropsychology, Hove, Psychology Warrington, E.K. and Shallice, T. (1969) ‘The selective
Press. impairment of auditory verbal short-term memory’, Brain,
Vallar, G., Rusconi, M.L., and Bisiach, E. (1994) ‘Awareness vol.92, pp.885–96.
of contralesional information in unilateral neglect: effects of Weiskrantz, L. (1986) Blindsight: A Case Study and
verbal cueing, tracing, and vestibular stimulation’, in Umilta, C. Implications, Oxford, Oxford University Press.
and Moscovitch, M. (eds.) Attention and Performance XV, Weiskrantz, L., Warrington, E.K., Sanders, M.D., and
Cambridge, MIT Press. Marshall, J. (1974) ‘Visual capacity in the hemianopic field
Vuilleumier, P., Hester, D., Assal, G., and Regli, F. (1996) following a restricted occipital ablation’, Brain, vol.97,
‘Unilateral spatial neglect recovery after sequential strokes’, pp.709–28.
Neurology, vol.19, pp.184–9. Wernicke, C. (1874) Der Aphasische Symptomencomplex:
Ward, J. (2006) The Student’s Guide to Cognitive Neuroscience, Eine Psychologische Studie auf Anatomischer Basis, Breslau,
Hove, Psychology Press. Germany, Cohn & Weigert.
NEU ROIMAGING
Ingrid S. Johnsrude and Olaf Hauk
1 INTRODUCTION
Fifty years ago, almost the only way to relate human transcranial magnetic stimulation (TMS), or, less
behaviour and cognition to the function of parts of the commonly, from positron emission tomography
brain was to look for specific deficits in patients with (PET), single photon emission computerized tomog-
damage confined to a particular region of the brain raphy (SPECT), or near-infrared optical spectroscopy
(acquired through, for example, stroke, injury, or sur- (NIRS).
gery for neurological disease). Identifying the location Most neuroimaging techniques are easy and pain-
of brain damage would often have to wait until after less for volunteers. MEG (shown in Figure 14.2(a))
the patient’s death, since the only way to examine involves sitting in a device that looks rather like an old-
brain structure in living people was the pneumoen- fashioned beauty-salon hairdryer. Inside the headpiece
cephalogram, a low-resolution, poor-contrast x-ray are sensitive devices for measuring the magnetic fields
that was neither painless nor harmless. produced by the brain (see Section 2.1.2). EEG (Figure
Although neuropsychological studies of brain- 14.2(b)) involves putting electrodes, sensitive to the
damaged people (see Chapter 13) remain extremely aggregate activity of large numbers of neurons, on the
valuable, the development of functional imaging scalp with a conductive gel. Often, as is shown here, the
techniques has had an enormous impact on the way electrodes are incorporated into a cap, which makes
we assess human cognition. Detailed anatomical setting up the electrode array less time-consuming. In
images, acquired through techniques such as mag- fMRI (Figure 14.2(c) and (d)), as in PET (e), the volun-
netic resonance imaging (MRI), can now be used to teer is lying comfortably on a bed that slides into the
identify structures in normal individuals (as shown scanner. NIRS (f) measures changes in the brain’s oxy-
in Figure 14.1) and localize damage in patients. gen absorption based on optical properties of haemo-
Furthermore, it is possible to explore normal and globin (blood), using light in the near-infrared range
abnormal brain function by combining detailed ana- (700–1000 nm in wavelength). As with EEG, the detec-
tomical images from normal volunteers and patients tor array is a lightweight net that sits on the scalp, so
with functional information from functional mag- that cortical activity can be assessed while participants
netic resonance imaging (fMRI), electroencephalog- are comfortably seated in an ordinary chair (f), or
raphy (EEG) and magnetoencephalography (MEG), on a parent’s lap (NIRS is often used with infants).
CHAPTER 14 NEUROIMAGING 431
FIGU RE 14. 2 (a) MEG, (b) EEG, (c and d) fMRI, (e) activation PET, (f) NIRS, (g) TMS.
SPECT), and then briefly present transcranial mag- psychology or cognitive neuroscience. It may also help
netic stimulation (TMS) as a tool for inducing ‘revers- you to begin to think creatively about how particular
ible lesions’. The information presented here should questions regarding the relationship between brain
help you to understand papers on topics in cognitive and behaviour might best be addressed.
CHAPTER 14 NEUROIMAGING 433
0
Brain
–1
Dendrite
–6
Synapse –7
–3 –2 –1 0 1 2 3 4 5 6 7
Millisecond Second Minute Hour Day
Temporal resolution (log seconds)
KEY:
EEG: electroencephalography MEG: magnetoencephalography
fMRI: functional magnetic TMS: transcranial magnetic
resonance imaging stimulation
PET: positron emission SPECT: single photon emission
tomography computed tomography
Lesion: behavioural assessment of patients with focal brain lesions
FIGU RE 14. 3 The ranges of temporal and spatial resolution of methods used to study human brain function, based
on performance with typical hardware and commonly used experimental protocols. Shading indicates invasive
techniques. The vertical axis includes references to ‘maps’ (e.g. visual or motor maps of space and the body); ‘columns’
(which are functionally specialized regions within a particular brain region – e.g. orientation columns in the visual
cortex contain neurons that all fire when viewing a line that is angled a particular way); and ‘layers’ (the cortex of the
brain is composed of six layers). Source: adapted from Cohen and Bookheimer, 1994; Churchland and Sejnowski, 1988
1 10 80
02
01
0z
Pz
P4
CP4
P8
C4
Fz
TP8
T8
Cz P7
P3
Pz CP3
CPz
C5 Cz
FC4
FT8
C3
TP7
C3
C4 FCz
Fz
C6 F4
1 1 1 F8
T7
+ + + FT7
FC3
F3
(a) Continuous EEG Fp2
F7
Fp1
0 500 ms
(b) Averaged EEG
Top Front
5∝V Fp1 Fp2
0 500
F7 F8
F3 Fz F4
FT7 FT8
FC6 FC6
T7 C3 Cz C4 T8
P3 Pz P4 TP10
TP9 P7 P8
O1 O2
FIGU RE 14.4 Data pre-processing of event-related EEG and MEG data: (a) Illustration of the average procedure
used in standard event-related potential (ERP) analysis (see Section 2.2.1). (b) Averages consisting of 1, 10, and 80 time
segments, respectively. Note that the pre-stimulus interval (‘baseline’) flattens with increasing number of segments,
while the event-related response becomes less distorted by noise, i.e. the ‘signal-to-noise ratio’ (SNR) increases.
(c) The averaged curves can be plotted for each electrode or sensor location separately. Channels are plotted
according to their relative position on the lead. (d) A continuous topographic plot over the head. Red colour indicates
positive and blue colour negative signals. The picture shows the event-related potential 90 ms after visual presentation
of a word, with two distinct positive peaks over left and right occipital scalp areas, presumably reflecting processing of
visual stimulus features.
CHAPTER 14 NEUROIMAGING 435
intended to be recorded, like heart activity, which participants’ heads, which can be localized within the
would be ‘subtracted in’ by the referencing. Possible MEG system relative to the sensors. Landmarks on
locations for reference electrodes are the ear lobes, the the participants’ heads (e.g. nasion, LPA, RPA; or a
tip of the nose, or the mastoids (i.e. the bones behind distribution of points across the scalp) are also meas-
the ears). It is possible to ‘re-reference’ the data after ured in relation to these coils. These landmarks can
the recording, or ‘off-line’. A common choice for later be aligned to the participants’ structural MRI
multi-channel recordings (e.g. more than 32 chan- images, for example. Via the position of the coils, it is
nels) is the average reference: the average across all then also possible to co-register the locations of the
electrodes is subtracted from each individual elec- MEG sensors to the MRI image.
trode at each time sample.
Source estimation involves trying to infer, on the Basic differences between EEG
2.1.3
phonetic processing, and the plasticity of the soma- This method assumes that the brain response does
tosensory and auditory systems. not markedly change its timing or spatial distribution
The basics of EEG were invented in the 1920s, during the sequence of trials. This averaging procedure
mainly with medical applications in mind. EEG is can be applied to all stimuli present in the study, or for
widely used in clinical diagnostics and research. The subgroups of stimuli that are to be compared to each
first MEG systems (starting with 1-channel!) appeared other. During averaging, any random fluctuations across
in the late 1960s, and the first commercial systems epochs should cancel each other out, since they might
took off in the 1980s. The development was mainly have positive amplitudes in one segment, but negative
driven by engineers and physicists. This, and possibly amplitudes in another. In contrast, any brain response
the fact that MEG is much more expensive than EEG, that is time-locked to the presentation of the stimulus
often makes these two look like very different meth- will add up constructively and be reflected in the average
ods with very different applications. It is important to activity across trials. These averaged data are usually
keep in mind, however, that both techniques measure referred to as the event-related potential (ERP) in the
the same type of brain activity from slightly different case of EEG, and event-related field (ERF) in the case of
angles. As a general rule, EEG ‘sees more’ of the brain, MEG. These have characteristic shapes in time (Figure
but is less able to localize this activity. MEG ‘sees less’ 14.4 (c)) and space (Figure 14.4 (d)), which can be ana-
of the brain, but what it sees it can localize better. As lysed into a series of prototypical deflections (often
we will see, a combination of EEG and MEG is supe- referred to as ‘components’) in their time course. The
rior for localization than either method on its own. If signal at any given time point can be interpolated
localization is not the main focus of a study, EEG may between electrodes or sensors to yield a continuous dis-
often be sufficient, for example in many clinical envi- tribution, or topography, over the whole head. Some
ronments. deflections that exhibit characteristic time courses and
topographies for a particular stimulus type or paradigm
(e.g. always present for auditory stimuli, or for auditory
Basic analysis of EEG
2.2 stimuli that are odd-ones-out in a sequence) are con-
ventionally labelled according to their polarity at the
and MEG data peak – P(ositive) or N(egative) – and the typical latency
of their occurrence. For example, ‘auditory N100’ refers
Computing event-related potentials
2.2.1
to a negative potential at frontal electrode sites, usually
(ERPs) and event-related fields (ERFs) observed 100 ms after the onset of an auditory stimulus
Whereas the continuous EEG can be useful clinically, (e.g. a simple tone, a speech sound, etc.).
the use of EEG and MEG to investigate more specific The strength and pattern of these components can
perceptual or cognitive processes requires more be measured, and their dependence on task require-
sophisticated data processing. Usually, the electrical ments, on stimulus parameters, on degree of attention,
signals resulting from a particular cognitive event (e.g. and so on can be evaluated. Components known to be
hearing a word) are averaged over many trials (see related to perceptual processing in the tactile, visual,
Figure 14.4 (b)): a data epoch of a specified length (e.g. and auditory domains (known as evoked potentials, or
starting 100 ms before word onset, and ending 1 s evoked magnetic fields) can be used by clinicians to
after) is cut out of the data for each stimulus, and then check the connections between the peripheral and cen-
all of these epochs are averaged together. During aver- tral nervous systems, much like an electrician might
aging, every epoch is checked for artefacts (see below), use a voltmeter to diagnose a faulty electrical cable.
e.g. whether the amplitude of the signal is within a For example, the presentation of simple tones is
certain allowed range. Epochs that are likely to con- normally succeeded by specific components in the
tain an artefact (i.e. a large signal not originating from EEG signal. These are classified according to their
the brain) should not be included in the average. time of occurrence into brain-stem responses (until
438 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
approximately 20 ms after stimulus onset), middle guish them from the above-mentioned ‘evoked’ sig-
latency responses (20–50 ms approx. after onset), and nals that are both time- and phase-locked to the
slow or late responses (later than 50 ms approx. after stimulus. In order to extract induced signals from the
onset). It is known that the brain-stem responses orig- data, the frequency power spectrum (i.e. the signal
inate from parts of the brain stem and/or from a cra- amplitude for different frequency bands) has to be
nial nerve (hence their name), while the late responses computed for every epoch separately. The power spec-
are cortical in origin. This information is used in trum only contains information about the amplitude
objective hearing tests. Such measures are used to test of the signal for a certain frequency in a certain latency
the integrity of the auditory system from brain stem to range, but no phase information. If there are consist-
cortex, and to screen for possible congenital deafness ent gamma oscillations between 200 and 300 ms after
in newborns and infants, with whom conventional every picture, the spectral power in the gamma fre-
hearing tests that require a behavioural or verbal quency range should be consistently above baseline
response to sound cannot be used. Finally, such meas- level in this latency range across epochs. This method
ures can also be used in people who are suspected of has been applied to studies on Gestalt perception, as
faking hearing loss for insurance reasons. By detecting illustrated in Figure 14.6. For example, it has been
abnormalities in these components of the EEG signal, found that gamma band activity is usually larger when
the stage at which damage to the auditory system has an incomplete but meaningful pattern is perceived,
occurred can be determined. compared to either meaningless or easily recognizable
patterns.
2.2.2 Evoked and induced brain responses Participants were presented with visual stimuli that
The averaging procedure described above assumes either did not evoke an association with a particular
that there is something like an ‘average brain response’, object (top left of Figure 14.6), or could be interpreted
i.e. a signal with roughly the same time course in every as edges of a triangle (‘Kanizsa’ triangle, bottom left).
epoch for a particular stimulus category. This means A stimulus can generate two types of brain response:
that the EEG response evoked by stimulation happens evoked, i.e. a signal with the same time course after
at the same time, so that the ‘peaks’ and ‘troughs’ of each presentation of the stimulus (‘time-locked and
the evoked waves line up nicely (i.e. they are ‘in phase’, phase-locked’ to stimulus onset), such that across
or ‘phase-locked’). But what if the timing changes epochs the signals average together; and induced, i.e. a
slightly from epoch to epoch? If this jitter across signal that is similar across different presentations of
epochs is small compared to the time-scale of the sig- the stimulus but may move forward and backward in
nal, one does not have to worry. But what if the signal time a bit (‘time-locked but not phase-locked’), such
consists of a rapid sequence of positive and negative that inter-epoch jitter may result in cancellation of sig-
deflections (e.g. an ‘oscillation’)? Then the jitter may nals during the averaging process (illustrated at top
sometimes result in a positive value in some epochs right of Figure 14.6). These types of brain response
and negative values in other epochs. Across epochs, can occur in different frequency ranges, i.e. for signals
this may average out to zero. This could be the case that change with different speed over time. At high
with so-called ‘gamma oscillations’ – a signal in the frequencies, the change occurs very quickly, while at
frequency range above 30 Hz (though definitions dif- low frequencies it is slower. One can visualize the sig-
fer slightly), which has been associated with complex nal strength at a particular frequency against the time
stimulus processing such as Gestalt perception. These measured from stimulus onset in a so-called ‘time-
gamma oscillations may occur time-locked to a stim- frequency plot’. The time-frequency plots in Figure
ulus (e.g. always between 200 and 300 ms after picture 14.6 show the results for the meaningless stimulus
onset). However, the ‘phase’ – the exact occurrence in configuration (top) and the Kanizsa triangle (bottom)
time of peaks and troughs – may vary across epochs. for one electrode (Cz). A peak of ‘gamma band activ-
These signals are called ‘induced’, in order to distin- ity’ first occurred at about 100 ms and around 40 Hz
CHAPTER 14 NEUROIMAGING 439
60
40
averaging
20
–200 0 200 400 ms averaged evoked potential
–20 0 +20 μV 2
100
Hz
+
80
60
40
–16.5 0 +16.5
μV 2/Hz/ms
20
–200 0 200 400 ms
FIGU RE 14.6 Evoked and induced oscillatory brain responses. Source: Based on Tallon-Baudry and Bertrand, 1999,
Figures 1 and 2
(the so-called ‘gamma’ frequency range) for both ing the recording EEG and MEG signals are undergo-
stimulus types. A second peak, around 280 ms in a ing slow shifts over time, such that the average level
similar frequency range, was only present for the illu- might differ considerably across channels, although
sory triangle. Although evoked and induced activity the smaller and faster signal fluctuations are similar.
were combined in this plot to save space, more detailed These signal shifts can be due to slow brain activity, but
analysis revealed that the first peak represented can also be caused by perspiration (in the case of EEG),
evoked, and the second peak induced, brain activity. muscle tension, or other noise sources. Obviously, one
The evoked response is assumed to reflect basic early should attempt to remove anything from the data that
visual processing, while the induced activity is associ- is not related to the processes of interest. The noise
ated with spatial feature-binding processes required to level in the averaged data decreases as the number of
perceive the illusory triangle. The topography of the trials increases (specifically, noise decreases as a func-
induced activity (bottom right, back view) is consist- tion of the square root of the number of trials). This
ent with neural generators in posterior parts of the poses a considerable limitation on the duration of an
brain, such as visual cortex. experiment, and should be carefully considered prior
to setting up a study. A typical number of trials per
2.2.3 Noise and artefacts experimental condition in EEG and MEG studies on
The measured signal not only contains the signal of cognitive processes is approximately 50–100, though
interest, but also noise and artefacts. For example, dur- in some cases this number can be lower or higher.
440 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
A small number of trials can be compensated for, in tematically with the stimulus or task. In many experi-
part, by recording data from more participants. In gen- ments, visual stimuli are therefore presented within a
eral, however, the rule is ‘the more the better’. visual angle of less than 4 degrees (foveal presenta-
Two other standard procedures for reducing noise tion) and very briefly (less than 150 ms, ‘tachisto-
are filtering and baseline correction. Filtering is scopically’) in order to minimize systematic eye
applied to a data set to remove any frequencies that are movements. Eye movements can be monitored using
not part of the signal of interest (i.e. the ERP/ERF EOG (electrooculogram) electrodes placed around
components under investigation). For example, high the eyes. Algorithms can be used to employ this
frequency ranges (>40 Hz) are most prone to contam- information to reduce the amount of eye-related sig-
ination by muscle-related noise activity, or line-noise nal in the data. However, avoiding artefacts is always
from nearby electrical devices. Therefore, low-pass better than dealing with them afterwards. One should
filters are used to attenuate frequencies above a cer- therefore always make the recording environment
tain cut-off frequency (i.e. they ‘let pass’ the lower fre- and experimental procedure as comfortable as possi-
quencies). Analogously, high-pass filters can remove ble (e.g. provide enough breaks and opportunity to
slow signal shifts. A combination of a low-pass and a practise).
high-pass filter is called a band-pass filter. A typical
band-pass filter for ERP/ERF studies would be 0.1–
30 Hz, but this depends on the signal of interest and
the purpose of the study. Estimating neuronal
2.3
In most ERP and ERF studies, a ‘baseline interval’ is
defined as several tens or hundreds of milliseconds
sources: the inverse
before stimulus onset. For each recording channel, the problem
mean signal over this interval is computed, and then
subtracted from the signal at all time points. This pro- The estimation of the sources in the brain that gener-
cedure is usually referred to as baseline correction. It ate the electrical and magnetic activity recorded by
is crucial in ERP and ERF experiments to ensure that EEG or MEG is usually called the inverse problem.
an observed effect (e.g. an amplitude difference What makes this a ‘problem’ is the fact that we are try-
between the components evoked by two sorts of stim- ing to identify the cause of the EEG or MEG signal
uli) is not already present in the signal before the stim- from its effect, and unfortunately many different
uli were presented, since such differences could not causes might lead to the same effect. This inverse
possibly reflect stimulus effects and must therefore be problem is comparable to reconstructing an object
artefactual (i.e. a result due not to changes in the inde- from its shadow on the wall of your room. If you
pendent variable but perhaps to noise, or to the way already know that there are only a few possible objects,
equipment is set up). then the choice might be easy. However, in some cases
A particularly annoying type of noise in both EEG it may be very hard to know what is casting the shadow
and MEG recordings are eye movements and muscle (e.g. if you just see a square shadow, is it a wardrobe or
artefacts (e.g. from face or neck muscles). Muscle a bookshelf?). Furthermore, the more similar the
artefacts can often be avoided by providing a comfort- shapes of the objects in question are, the more difficult
able recording environment for the participants, and it will be to identify which object causes the shadow.
by providing comprehensive instructions. They are In the case of EEG and MEG analysis, the shadow
usually reflected in higher frequency ranges (above represents the data, or more precisely the distribution
30 Hz), and may be reduced using low-pass filters. of the voltage or magnetic field across the sensors.
Eye movements (and eye blinks in particular) are What must the current distribution in the brain look
more difficult to control. In reading or visual search like in order to produce the observed pattern?
tasks, for example, eye movements may occur sys- Unfortunately, there is no unique answer. Even if the
CHAPTER 14 NEUROIMAGING 441
EEG and MEG signals were measured simultaneously source in each hemisphere at roughly symmetrical
at infinitely many points around the head, the infor- positions). The images on the left and right represent
mation would still be insufficient to uniquely compute solutions to the same problem (i.e. the source models
the distribution of currents within the brain that gen- produce the same potential distribution over 148
erated these signals (this is known as the Helmholtz recording channels).
principle, another expression for the inverse problem). If the number of activated brain regions that gener-
ate the recorded signal is assumed to be known, but
Approaches to deal with the inverse
2.3.1
their locations are still to be determined, then so-
problem called dipole models can be applied (Figure 14.7(c),
All is not lost! Researchers can develop models of the left). The locations and orientations of dipoles are sys-
underlying brain activity and test those against the tematically varied until the best fit between the pre-
data in order to reduce the number of plausible solu- dicted and the measured potential is achieved. If the
tions, and figure out the most likely pattern of brain modelling assumptions fit reality well, then the result
activity generating the observed pattern of EEG or can be very accurate (in the millimetre range for MEG
MEG data. One can distinguish two broad strategies: and in the centimetre range for EEG). These methods
are usually applied if perceptual processes and early-
1. Approaches that make specific modelling evoked components are studied (e.g. somatosensory,
assumptions, like the number of distinct activated auditory, and visual processes up to 150–200 ms after
brain regions and their approximate locations (for stimulus onset).
example, that there are two focal sources, one in If there is no information about the number of
the left and the other in the right auditory cortex, sources, methods with less restrictive modelling
80 ms after presentation of a tone). assumptions – so-called distributed source models –
2. Approaches that make as few assumptions as can be used. A large number of dipoles (hundreds or
possible and focus on rough features of the thousands) are distributed across the brain volume or
current distribution (for example, that a language the brain surface. Their strengths are then estimated
task will result in more left-hemispheric activation such that their summed activity explains the meas-
compared with a mental rotation task). ured signal and an additional criterion is fulfilled, e.g.
that the overall source strength is kept minimal (‘min-
Examples of these two approaches, and how the imum norm criterion’). An example for such an esti-
models relate to the neuronal sources, are shown in mate is shown on the right of Figure 14.7(c). At least a
Figure 14.7. In a simulation, two electric sources ‘blurred’ version of the real source distribution can
(dipoles) were placed, one in the left and one in the often be obtained. Peaks in this estimated current dis-
right hemisphere. The electric potential distribution tribution might correspond to centres of activity in
produced by both dipoles together is shown as a the real current distribution. These methods are pre-
contour plot in the left image in Figure 14.7(c). From ferred if modelling assumptions for dipole models
mere visual inspection of the potential distribution cannot be justified, such as in complex cognitive tasks
alone, neither the location of the dipoles nor even or with noisy data.
the number of sources can be deduced. The right No single approach is good for EEG and MEG
image shows a distributed source solution computed source estimation. The choice of correct method
from the same data. It exhibits one peak of activation requires insight into the modelling assumptions of the
in each hemisphere, around the true dipole locations. method, as well as experience.
Though the ‘blurring’ inherent to this method does
not allow precise localization of the sources, it can 2.3.2 EEG and MEG: localization issues
provide information about their number (in our Although the signals of EEG and MEG are generated
example two) and approximate location (here one by the same sources (electrical currents in the brain),
442 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
Tangential Radial
Negative Positive
potential potential
‘Dipole’
(a)
Negative Positive
potential potential
R L R L
(b)
F F
(c)
FIGU RE 14.7 The generation and modelling of EEG/MEG signals: (a) The summed electrical activity within a small
area of cortex can be described by a so-called ‘dipole’. This dipole describes the strength and direction of the current
flow within this area. Each dipole has a positive scalp potential in the direction in which it points, and a negative
potential in the opposite direction. (b) (left) Potential distribution for a tangential dipole (pointing left to right), and
(right) potential distribution for a radial dipole (pointing downwards). The magnetic field of a tangential dipole is
roughly perpendicular to its potential distribution (not shown). (c) Illustration of the ‘inverse problem’ in EEG/MEG
analysis: the images both represent different ways in which the same surface electrical and magnetic activity could be
produced.
they are sensitive to different aspects of these sources everybody has both EEG and MEG available. It is
(as described above). This could be compared to therefore important to decide at the beginning of a
viewing the shadows of the same object from two dif- study: 1) whether localization is required at all; 2)
ferent angles. It should not be surprising then that the whether absolute anatomical localization is required
information from EEG and MEG is complementary, (e.g. in combination with structural MRI images), or
and combining the two in source estimation usually whether relative localization is sufficient (e.g. ‘left
yields more accurate results than using either method more than right’); and 3) whether the sources are most
alone. However, this also means more work, and not visible in EEG, MEG, or both.
CHAPTER 14 NEUROIMAGING 443
FIGU RE 14. 8 Comparison of source estimation among fMRI, EEG, and MEG. Simple visual stimuli were presented in
different visual quadrants. Brain activity was localized using fMRI, MEG alone, EEG alone, and a combination of EEG
and MEG. The images show the peaks (upper 1%) of activation distributions on the inflated (‘flattened’) surface in
posterior cortex. In this experiment, the localization based on a combination of EEG and MEG most closely resembles
the localization in fMRI. Note that this result was obtained using a very simple experimental paradigm, and a
comparison (or combination) of fMRI with EEG/MEG may be much more complicated for cognitively more complex
tasks. Source: Based on Sharon et al., 2007, Figure 2
While for EEG and MEG we can safely assume that visually-evoked responses is compared to fMRI data.
we are measuring the same sources from different If you have not read the section on fMRI yet, don’t
angles, the same cannot be said for fMRI. As you will worry – for the moment, assume that fMRI localizes
learn in a later section, the generators and time reso- brain activity with greater spatial accuracy than EEG/
lution of fMRI signals are very different to those of MEG, and that for these specific examples it can serve
EEG and MEG, and there is still no clear model of as a kind of ‘gold standard’. Simple visual stimuli
how the electrophysiological sources of EEG and (‘Gabor patches’) are shown in the rightmost column;
MEG relate to the metabolic fMRI signal. It cannot be these were flashed in the four quadrants of the visual
generally assumed that activation ‘hot spots’ in fMRI field (upper left, upper right, lower left, lower right). It
are also visible in EEG/MEG, or vice versa. Even if is known that such stimuli activate characteristic
there is some correspondence, brain areas shown as retinotopic areas of limited extent (~1 cm2) in visual
activated in fMRI maps may activate at different time cortex in the occipital lobe (cortical area V1).
points in EEG/MEG. However, some successful com- Changing the stimulus location therefore changes the
binations of EEG/MEG with fMRI have been achieved cortical response location in a predictable way. For
for relatively simple perceptual processes. These are example, visual stimuli presented in the left upper
usually reflected in early EEG/MEG signals, and can visual hemifield will activate V1 in the right lower cor-
be localized to a few focal brain areas. tical hemisphere. This known topography allows for
In the example presented in Figure 14.8, the combi- response patterns to be compared across different
nation of EEG and MEG for the estimation of early localization techniques. The expected pattern of
444 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
activation is clearly present in the fMRI data. This reaches its maximum around 300 ms after stimulus
technique provides millimetre spatial resolution, but onset. It would therefore be reasonable to look for the
does not tell us whether this activation reflects early or largest peak around 300 ms at the electrode called ‘Pz’,
late processes. EEG and MEG show a similar pattern and to extract the amplitudes at this electrode and this
around 74 ms after stimulus onset – this is about the point in time for all stimuli, for all subjects. These val-
time when visual information from the retina first ues would be entered into the ANOVA as the depend-
reaches visual cortex. Localizations for EEG and MEG ent measure. ‘Tone rarity’ would be a single, two-level
separately show approximately the same patterns, factor allowing for a comparison between values
although EEG alone is quite far off in one case. The obtained for the presentation of the rare tones and
combination of EEG and MEG results in a pattern those obtained for the frequent tones. In general, the
that closely matches that obtained using fMRI. This result is that the amplitude of the P300 is larger for
suggests that the fMRI pattern reflects an early rare tones.
processing stage in visual cortex. This is a simple sen- Does only the amplitude change with the tone’s
sory paradigm – the correspondence among imaging rarity, or could there also be a change in the location
modalities may not be so clear for cognitively more of the peak evoked response? In other words, could
complex tasks. the rare tones produce larger amplitudes in either the
left or right hemisphere compared with the frequent
ones? In this case, one would have to extract ampli-
tude values for at least two electrodes, one in the left
Statistical analysis of
2.4
and one in the right hemisphere (e.g. P5 and P6, left
EEG/MEG data and right of Pz). The ANOVA now has two factors:
‘tone rarity’ (rare and frequent) and ‘laterality’ (left
The statistical analysis of EEG/MEG data is as yet not and right). If the laterality changes with tone rarity,
fully standardized, and the strategies researchers one should obtain an interaction between rarity and
employ can vary considerably depending on their laterality. In the case of simple tones, such an interac-
hypotheses. The most frequent approach is ‘analysis of tion is generally not found, although it might be
variance’ or ANOVA. The signal amplitudes for differ- expected for more complex (e.g. language-related)
ent electrodes, sensors, or dipoles are considered as stimuli. From our discussion on source estimation,
dependent variables, and recorded for each subject however, it should be clear that the distributions of
(just as we might measure mean reaction times or the electric potentials or magnetic fields around the
error rates per subject in behavioural experiments). head do not allow clear inferences about the sources
Imagine a so-called oddball experiment (the ‘odd- in the brain. If hypotheses about brain areas (e.g.
ball paradigm’ is discussed in Section 2.5), in which about lateralization) are important, then source esti-
subjects are presented with two different tones: one mation, or a different imaging method, should be
tone of 600 Hz, occurring 90 per cent of the time, and employed.
another tone of 1000 Hz, occurring only 10 per cent of
the time. Subjects are required to press different but-
tons in response to the frequent and rare tones. Does
the maximum amplitude of the ERP in a certain time
The auditory oddball
2.5
range change as a function of the probability of the paradigm
tone? In this case, one would first have to decide which
time range to analyse. In this kind of oddball experi- The oddball paradigm, in which subjects are exposed to
ment, it is known that rare tones produce a so-called a stream of ‘standard’ stimuli occasionally interrupted
P300 component, i.e. a positive deflection of the ERP by ‘deviant’ stimuli, is one of the most widely used para-
around centro-parietal electrode sites, which usually digms in cognitive electrophysiology. This paradigm is
CHAPTER 14 NEUROIMAGING 445
easily tolerated even by severely impaired patients, and blocks, in which 16 low and 8 high tones were pre-
the corresponding ERP (to a lesser extent ERF) effects sented. This design was chosen in order to run the
have been studied intensively during the last decades. same experimental paradigm both with EEG and
Two major components are usually observed in ERP fMRI. In different runs, subjects were either told not
and ERF studies using oddball paradigms: to attend to the stimuli, but to watch a cartoon video
instead (‘unattend’ condition), or to silently count the
1. The mismatch negativity or MMN: an early high tones (‘attend’ condition).
component (between approximately 100 and The detection of a change within a sequence of
200 ms) that is observed even when the stimuli elicits an MMN shortly after 100 ms, indepen-
participant is attending elsewhere (e.g. they are dently of where attention is directed. Dipole model-
watching a silent movie), and is generally ling, where the position of the dipoles is based on the
interpreted as a ‘pre-attentive change detection position of activations observed in the companion
mechanism’. fMRI experiment, suggests that the sources of this
2. The P300: a component peaking around 300 ms MMN component are localized in left and right
that is generally larger when target stimuli (e.g. superior temporal gyri (STG). The later P300 is
deviants) have to be actively detected in a stream elicited when the deviant stimuli are relevant to the
of standards. performance of a task, and the generators were esti-
mated in left and right transverse temporal gyri
The data presented in Figure 14.9 are taken from Opitz (TTG). It should be noted, however, that the relation-
et al. (1999). The same 16 subjects participated in EEG ship between EEG/MEG sources and fMRI/PET
as well as in a functional magnetic resonance imaging activity is still not clearly understood. It is generally
(fMRI) experiment. ERPs were recorded from 120 not straightforward to constrain EEG/MEG source
electrode sites. The stimulus set consisted of two localization by fMRI/PET results. The development of
200 ms tones (600 Hz and 1000 Hz). The experiment corresponding methods and their empirical evalua-
was divided into 12 ‘standard’ blocks, in which only tion is currently one of the most exciting areas in the
the low tone was presented 24 times, and 12 ‘deviant’ field of neuroimaging.
SUMMARY OF SECTION 2
• EEG and MEG record the electrical signals of the brain millisecond by millisecond, and are therefore
sensitive to changes in the temporal pattern of perceptual and cognitive processes.
• They do this only indirectly, which means that the active location in the brain can only be estimated.
• Data are usually analysed by computing ‘event-related potentials/fields’ (ERPs/ERFs): data segments
are averaged across a large number of trials belonging to the same stimulus category. Differences
between different averages may reveal the signals that are specific to a certain cognitive process.
• The same averaging procedure can be applied to frequency power spectra, which may reveal evoked
and induced oscillatory activity.
• EEG and MEG signals are, in principle, generated by the same sources inside the brain, but the two
imaging methods show different patterns of sensitivity. EEG ‘sees more’ than MEG, but MEG localizes
better what it can see.
• Because of their very different time-scales, and the very different sources of the signal, a combination
of EEG/MEG and fMRI neuroimaging modalities must be considered with great care, and may only be
possible in very specific cases where the neuronal sources are already well known.
446 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
F3 Fz F4
Data
C3 −10 μV C4
P3 Pz P4
Model
Solid: ‘attend’ Dashed: ‘unattend’ MMN P300
(a) (b)
L R
L R
MMN P300
(c)
FIGU RE 14.9 The auditory oddball paradigm: a continuous sequence of ‘standard’ stimuli (e.g. ‘. . . beep-beep-beep . . .’)
is occasionally interrupted by a ‘deviant’ stimulus (‘. . . beep-boop-beep . . .’). This deviant stimulus evokes two distinct
components in the ERP signal: the early ‘mismatch negativity’ (MMN) and the later P300. The P300 is usually bigger (or
only present) when participants are required to actively attend to the stimuli (and for example respond to them, rather
than just passively listen). The study presented here measured brain activity using ERPs and fMRI in the same group of
16 participants. (a) ERP difference waveforms (‘standards’ (low tones) minus ‘deviants’ (high tones)) averaged across
subjects. The mismatch negativity (MMN) is reflected in a negative-going signal at frontal electrode sites (e.g. at
electrode Fz around 150 ms) in both conditions, and the P300 as a large positive-going signal in the ‘attend’ condition
only at posterior electrode sites (e.g. at Pz after 300 ms). (b) Topography of the MMN (left) and P300 components
(right). Both the original data (top) and the prediction of the dipole models (bottom) are shown. (c) Two dipoles fitted
to the ERP data explained up to 95 per cent of the data for both the MMN and P300. Dipole locations (as indicated by
arrows) were consistent with fMRI activation clusters. STG: superior temporal gyrus; SMG: supramarginal gyrus. Source:
Based on Opitz et al., 1999, Figures 1–5
CHAPTER 14 NEUROIMAGING 447
3TECHNIQUES BASED ON
METABOLISM AND BLOOD SUPPLY
The brain requires a nearly constant supply of oxygen larly for fMRI, by far the most common metabolic
and glucose in order to function properly. Both glucose technique in cognitive neuroscience), before explaining
and oxygen are carried to the brain in the blood supply, how the dependent measure in these designs (signal
via an array of arterial vessels. Although the brain derived from blood flow, blood oxygenation, or other
accounts for only about 2 per cent of the body’s mass, it metabolic activity) is obtained in fMRI, PET, SPECT,
consumes about 20 per cent of the body’s glucose and and NIRS.
oxygen, and receives about 20 per cent of its blood sup-
ply. Although the relationship is still not completely
understood, activity in neurons is closely linked to glu- 3.1 Experimental design
cose consumption, oxygen consumption, and blood
flow. Blood in the brain goes to where it is needed: as a Neuroimaging experiments are designed to assess
local group of neurons becomes active, blood flow in relative changes in brain activity (for example, indexed
that region increases, as does the amount of oxygen in by regional changes in blood oxygenation in fMRI)
the blood in that region (blood oxygenation). Thus, consequent upon changes in stimulus characteristics
imaging techniques that are sensitive to blood flow and or task demands. The two most commonly used
blood oxygenation can be used to study ‘the brain at approaches are subtractive designs and correlational
work’. Functional magnetic resonance imaging (fMRI) is (or parametric) designs.
used by psychologists to measure how the concentra-
tion of oxygen in the blood changes in different parts of 3.1.1 Subtractive designs
the brain as cognitive state changes. Positron emission In 1969, the Dutch physiologist Franciscus C. Donders
tomography (PET) can also be used as a tool to measure proposed a general method to measure thought pro-
how blood flow in different parts of the brain changes as cesses based on the assumption that tasks can be bro-
a function of cognitive state. Before the advent of fMRI ken down into component processes (Donders, 1969).
in 1992, PET was the main way to measure patterns of One comparison Donders made was between the reac-
oxygen metabolism in the human brain. With the tion time to one stimulus presented by itself (simple
growth of fMRI, this type of PET study has become less reaction time) and the reaction time needed to identify
popular due to the (albeit small) dose of ionizing radia- a stimulus before responding. Donders believed that
tion required, and its generally poorer temporal and the subtraction of the simple reaction time from the
spatial resolution compared to fMRI. It is still an impor- identification reaction time would yield the time
tant method for studying the metabolism of com- required for stimulus identification itself. Figure 14.10
pounds other than oxygen in the brain (for example, gives a similar example in which the time taken to press
compounds related to neurotransmitters). Single- a key in response (R) to a light coming on (the stimulus,
photon emission computed tomography is much like S) (Task 1) can be subtracted from the time needed to
PET, with even poorer spatial resolution. Finally, near- press the key only when a light of a particular colour is
infrared spectroscopy uses long-wavelength light to illuminated (Task 2). Assuming that the identification
study the oxygenation state of blood in the brain, and is component in Task 2 can be ‘slotted in’ between the two
commonly used with infants due to its ease of use and components in Task 1, with these other components
safety. We first discuss some of the most common remaining the same, then the subtraction reveals how
designs used in neuroimaging experiments (particu- long the process of identification takes.
448 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
Stimulus Response
S detection planning R
FIGU RE 14.10 Cognitive subtraction. Task 1 involves responding to the detection of a light; Task 2 involves
responding to the detection of a light of a particular colour.
The same subtractive logic is often used in the word, as discussed in Box 14.1, would activate regions
design of neuroimaging experiments. That is, if two involved in semantic search and word retrieval, in addi-
conditions, A and B, are identical except that A tion to areas involved in hearing and repeating words.
requires a particular cognitive function f while B does Another elaboration of the subtractive approach is
not, then one can identify those cortical regions that the factorial design, such as that used in behavioural
are involved in f by subtracting the pattern of regional research. We have already encountered a simple facto-
cerebral blood flow (rCBF) observed during B from rial design in the English/French PET study of Klein
that during A. This approach is essentially an exten- et al. (1995) (see Box 14.1). If we take the two condi-
sion of Donders’s method (Raichle, 1998). tions of repetition, and the two conditions of synonym
In general, the conditions that are being compared generation, we have described two levels of two fac-
will differ in one of two ways. The stimuli presented tors: Task (repetition or generation) and Language
during the two conditions may be identical but the (English or French). As in a conventional behavioural
participants may be required to perform different experiment with a 2 × 2 factorial design, the data can
tasks, or the participants may be presented with be analysed to address questions about both main
different kinds of stimuli in each condition but the effects (what brain areas are active whenever French is
task that they are required to perform may be identi- used compared with English, across both tasks? What
cal. Box 14.1 gives examples of these two approaches. brain areas are more active during synonym genera-
An elaboration of the idea of cognitive subtraction is tion than repetition, regardless of language?) and
the hierarchical subtractive design. In studies of this interactions (are there areas in which the activation
type, conditions are successively ‘built up’ from cogni- difference between synonym generation and repeti-
tive or perceptual components that are assumed to be tion is greater for French?). Factorial designs are pow-
additive. For example, in a study of speech perception erful because the experimenter can look at two or
(see Figure 14.11), rest (lying quietly) could be com- more independent variables simultaneously, and also
pared with listening to noise bursts, which would acti- assess whether or not interdependencies exist between
vate the auditory system but not the language system. these variables.
Listening to words and listening to noise bursts would
both activate the auditory system, but words would also 3.1.2 Correlational/parametric designs
activate parts of the brain involved in perceiving and Correlational/parametric designs are used to examine
understanding language. Repeating words would acti- the relationship between a stimulus parameter (such as
vate all these regions, and in addition regions involved word presentation rate) or a behavioural response (such
in speech output. Generating synonyms to a heard as reaction time) and brain activity. Correlational designs
CHAPTER 14 NEUROIMAGING 449
Klein and colleagues (1995) were interested in tasks, subjects heard single words, which they sim-
whether different brain areas are recruited when ply repeated in one condition, and to which they
volunteers use a language they are proficient in but generated synonyms in the other. In both English
acquired relatively late in life (in this case, French) and French, this comparison revealed activation in
compared with their native language (English). prefrontal cortex, indicating the importance of this
Participants heard words in English and French and region in the processing of word meaning and in
were asked either to simply repeat what they had response selection.
heard, or to generate synonyms of the words they Comparing word repetition in the two languages is
had heard (in both languages). This latter task, in an example of the ‘different stimuli, same task’
addition to recruiting areas involved with speech approach. A small area in the left basal ganglia was
perception and production (as in the repetition observed to be significantly more active when volun-
tasks) would also recruit areas involved in semantic teers repeated French compared with English words.
association and word retrieval and selection (as vol- This is interesting, since the basal ganglia are known
unteers ‘look for’ and select a suitable synonym). to be involved in skilled motor action, including artic-
Comparing synonym generation to word repeti- ulation of words. Perhaps even when English speak-
tion, within each language, is an example of the ers are proficient in French, their motor apparatus
‘same stimuli, different task’ approach. In both has to work ‘harder’ to pronounce French words.
are elegant because they avoid many of the complexities nal change in one point in the brain can be used to pre-
of interpretation intrinsic to subtractive designs, includ- dict activity elsewhere in the brain. If two areas show
ing uncertainty about the assumption of additivity of correlated activity, it is likely that these areas are con-
cognitive processes (see Friston et al., 1996). Correlation nected in some way (directly or via another region). As
can also be used to assess brain connectivity and how it cognitive state changes, so can connections among areas,
changes as a function of cognitive state. For example, sig- reflecting recruitment of different functional networks.
FIGU RE 14.11 Example of an fMRI experiment (a study of verb generation) employing a hierarchical subtractive
design. In the 8-second gap before each 2-second whole-brain scan, volunteers see a cue on the screen (one of ‘rest’,
‘listen’, ‘repeat’, or ‘generate’) and then: hear nothing (in condition 1); hear a noise burst (in condition 2); or hear a
word (in conditions 3–5). If the instruction is ‘rest’ or ‘listen’, volunteers lie quietly; if the instruction is ‘repeat’ they
repeat the word that they heard; if the instruction is ‘generate’ they produce a synonym for the word that they heard.
Each condition is performed 20 times in a pseudorandom order, so that each occurs ten times in the first half of the
experiment and ten times in the second half.
450 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
We now turn our attention to the fMRI technique – energy is applied, the protons suddenly become syn-
what its advantages and disadvantages are, and how chronized in their movements, but because they all
data are processed and analysed – before turning to precess at different rates, they drift out of synchrony
the other, less common, imaging methods of PET, again quite soon. However, as this happens they
SPECT, NIRS, and finally TMS. release energy. The frequency of the energy they
release depends on the field strength they experience;
that is, their position in the head. Sensors just outside
the head detect the frequency of these energies, and a
3.2fMRI: functional magnetic computer can be used to reconstruct an image of the
resonance imaging distribution of protons, and with it, different tissues in
the brain (e.g. grey matter, white matter, blood, cere-
MRI is the general name for a broad class of techniques brospinal fluid). This tissue contrast is coded in grey-
that use magnetic fields and radio waves to image the scale in the images.
structure, organization, and function of biological Functional MRI (fMRI) relies on the different mag-
systems without injecting radioactive tracers. Two of netic properties of oxygenated and deoxygenated
these techniques are used commonly in psychology blood, and allows scientists to observe how the rela-
and cognitive neuroscience. Structural MRI reveals the tive concentrations of oxygenated and deoxygenated
anatomical structure of the brain (see Figure 14.1), blood change with cognitive state. Oxygen is carried
whereas functional MRI (fMRI) measures regional lev- to the brain in haemoglobin molecules in red blood
els of blood oxygenation, which are assumed to reflect cells. The bright red blood in the arterial supply relin-
the volunteer’s cognitive state. Since its discovery in quishes its oxygen to brain tissue in capillary beds
1992, fMRI has become a very popular tool for study- (where oxyhaemoglobin is converted into deoxyhae-
ing the ‘brain at work’. moglobin). Purplish deoxygenated blood flows away
from capillary beds in the draining venules and veins.
3.2.1 How MRI works As neural activity increases in a part of the brain, more
If you have ever played with magnets, you will know oxygen is extracted from the blood, but blood flow
that magnetic fields are not stopped by materials that and blood volume in that part also increase. The blood
are electrically insulating. For example, a magnet volume increases more than is necessary – it overcom-
under a thin wooden table will move a paperclip on its pensates for the increase in oxygen consumption.
surface; similarly, magnetic fields pass easily through
the skull. A large cylindrical magnet around a volun- H+
teer’s head and upper body creates a strong magnetic
field, with a direction that is parallel to the volunteer’s
Magnetic field direction
(Imagine every fire engine in London arriving on the protons during scanning. This effect is known as blood
doorstep of a chip-pan fire in Notting Hill!) More oxy- oxygen-level dependent (BOLD) contrast. Thus the
genated blood is supplied than is needed, which has fMRI signal is only a secondary consequence of neural
the effect of decreasing the concentration of deoxy- activity and does not measure neural activity directly.
haemoglobin in the system of venules and veins drain- The haemodynamic response, which is the change in
ing the patch of active tissue (see Figure 14.13(a)). BOLD that occurs with a change in neural activity in a
Since deoxyhaemoglobin and oxyhaemoglobin have particular brain region, happens much more slowly
different magnetic properties, this change in concen- than activity in neurons does. It takes 4–5 seconds to
tration alters the magnetic field strength in the region, develop after neural activity increases, and takes as
which is reflected in the patterns of energy released by long again to decay after neural activity stops (see
Normal flow
Increased flow
Deoxyhaemoglobin
Oxyhaemoglobin
(a)
0.4
BOLD response %
0.2
0.2
0 5 10 15 20 25 30
(b) Time (sec)
FIGU RE 14.13 Blood oxygen-level dependent (BOLD) contrast and the haemodynamic response function.
(a) Functional MRI scans are exquisitely sensitive to subtle fluctuations in magnetic field strength. Oxyhaemoglobin,
found in arterial blood, and deoxyhaemoglobin, found in venous blood, have different magnetic properties. When
their relative proportions in the blood change, as happens when a patch of neural tissue becomes active, the resulting
change in the local magnetic field can be detected. (b) The metabolic change described in (a) is not instantaneous: it
takes several seconds to develop (haemodynamic lag) and equally long to settle back to baseline. The example here
sketches, for a point in auditory cortex, what the percentage change in BOLD (from a resting level) might be as a
function of time since hearing someone snap their fingers (at time 0). This is called the haemodynamic response
function (HRF). Source: (a) Adapted from P. Jezzard, http://www.fmrib.ox.ac.uk/fmri_intro/brief.html
452 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
Figure 14.13(b)). Thus, when the experimental condi- signal change is actually involved in the cognitive pro-
tion changes, BOLD response takes 4–5 seconds to cess being studied (the real activated tissue may be up
change also. This is called the haemodynamic lag. This to a centimetre or more ‘upstream’). There are several
sluggish response limits our ability to know exactly ways of getting around this problem. First, more pow-
when a bit of brain tissue actually became active after erful magnets, or different imaging protocols, can be
stimulus presentation, but since the lag is relatively used to improve signal strength in venules and capil-
constant, the timing of two or more events relative to laries. Second, MRI can also be used to make maps of
each other can be measured with greater precision; blood vessel distribution (angiograms) in each indi-
potentially within a few hundreds of milliseconds vidual: these maps can be compared to patterns of acti-
(Menon and Kim, 1999). vation to identify and eliminate activation in vessels.
The spatial resolution of fMRI is mostly limited by Several other limitations of the fMRI technique are
the strength of the magnet used to generate the main based on the physics of the BOLD signal. BOLD is a
magnetic field: the stronger the magnet, the finer the special case of a subtle fluctuation in local magnetic
potential resolution. This is for two closely related rea- field strength, which can be detected with specialized
sons. First, stronger magnets are just more sensitive, imaging protocols. Such imaging protocols are neces-
so small signal changes (small areas of activated tis- sarily sensitive to all subtle changes in local field
sue) can be detected more easily, and two such small strength, including those caused by the brain’s struc-
regions of activation can be more easily distinguished. ture itself, not just by the state of the local blood sup-
Second, more sensitivity means that instead of picking ply. For example, air-filled pockets in the head (like
up signals in veins (which produce large signal the sinuses) have a very different effect on local mag-
changes), signals in small venules and in the capillary netic field strength than do brain tissues; thus the
bed can be detected. Since venules and capillaries are magnetic field changes quite dramatically at the front
much closer to the active neural tissue than veins of the head where the sinuses are. Because fMRI actu-
are – veins can be several millimetres away from actu- ally requires a quite uniform magnetic field, these rel-
ally active tissue – spatial resolution is improved. The atively dramatic changes in field strength produce
fact that signals in veins can be mistaken for signals in decreased signal (and sometimes no signal at all) in
brain tissue, unless precautions are taken, is one limi- affected regions. For this reason, inferior frontal and
tation of fMRI. Further limitations and advantages are temporal cortex, close to such air pockets, can be hard
detailed in the next sections. to image. Unfortunately these regions are interesting
to psychologists since they are implicated in decision-
3.2.2 Limitations making behaviour, the sense of smell (orbitofrontal
fMRI is sensitive to changes in the local blood supply cortex), emotion (amygdala), memory (hippocam-
when a population of neurons becomes active. It is only pus), and language (lateral temporal cortex). An ina-
an indirect measure of neural activity, and since changes bility to ‘see’ these areas properly using fMRI makes it
in blood supply happen slowly, temporal resolution is difficult (but not impossible; again, strategies to mini-
limited, and is not as good as with EEG and MEG. mize this problem are in quite common use) to use as
We have already explained how, since large BOLD a research tool in these areas.
changes can occur in veins, apparent activation can be Fluctuations in field strength (field inhomogenei-
located at some distance ‘downstream’ from brain tis- ties) can also produce geometric distortion in images,
sue that is actually active. Without knowing where apparently ‘stretching’ some parts and ‘squashing’ oth-
veins are located in each subject (like brain anatomy, ers, resulting in an image that is quite a different shape
the organization of blood vessels, particularly on the from the real brain. A popular way to ‘correct’ images
venous side, can be very different from person to per- for this problem is to explicitly measure the magnetic
son), venous activation can be mistaken for tissue acti- field inhomogeneities in each volunteer, and then
vation. This obviously makes it difficult to infer use this information to compensate for the geometric
confidently that the tissue in a region of significant distortions.
CHAPTER 14 NEUROIMAGING 453
Other limitations of fMRI are purely practical. spatial resolution, and these both continue to improve
First, the strong magnetic field means that volunteers as techniques are refined.
with ferromagnetic implants (such as pacemakers, An fMRI scan can produce an image of BOLD sig-
pins to repair broken bones, or most types of cochlear nal, covering most or all of the brain, as fast as every
implant) cannot be scanned safely. It also makes for a second. If an experiment is targeted at a particular
difficult experimental situation, since totally magnet- brain area (the auditory cortex, for example), then a
compatible stimulus-delivery systems (video projec- small brain volume consisting mostly of the area of
tors, headphones, response boxes) must be used. interest can be scanned, and acquisition time (the time
However, most fMRI systems are now equipped with a required to take one scan) can be reduced even fur-
video projector that can present a picture (usually the ther. In principle, fMRI can produce an image that
screen of the computer controlling the stimulus deliv- distinguishes structures less than a millimetre apart,
ery), headphones through which sounds can be pre- and this potential is being realized. For example, in
sented, and response devices such as a button box or visual cortex, cells that respond preferentially to lines
joystick. of a given orientation are arranged into columns,
When the scanner is acquiring data it is very noisy – which in the cat are half a millimetre wide and approx-
noise levels up to 110 dB are common. This is loud imately 1 mm apart. Kim and colleagues (2000) were
enough to damage unprotected ears. This noise is able to use fMRI to map such orientation columns in
unpleasant, and even when partially blocked with ear- the visual cortex of the cat.
plugs it can be distracting. Given this high level of In summary, fMRI is an increasingly common tool
background noise, special care must be taken when that psychologists use to determine how different
designing studies using sound. The most common parts of the brain are specialized for different cogni-
approach is to scan intermittently, not continuously, tive processes. Although there are several limitations
alternating several seconds of sound presentation with to the technique, it is a field that is growing and devel-
1 or 2 seconds of scanning (see Figure 14.11). In this oping rapidly. We shall now discuss how imaging data
way, sounds are presented in a quiet background, and must be processed before they can be analysed (the
the delay in the haemodynamic response (see Figure treatment of functional PET and SPECT data is quite
14.13(b)) means that a scan taken 4–6 seconds after similar).
stimulus presentation will optimally detect elevated
signal due to that stimulus. 3.2.4 Processing and analysis of fMRI images
The data quality of fMRI is seriously compromised The analysis of imaging data is a multi-stage process
by subject movement, so subjects must stay perfectly (see Figure 14.14). First, the scans must be recon-
still during scanning. This also means that they cannot structed. The raw data collected in PET, SPECT, and
speak, so a task requiring speech or other movements fMRI do not resemble an image. A mathematical
of the head is not practical. Most fMRI tasks involve transform, such as Fourier analysis, is required to turn
either key press or joystick responses. The restriction the data into a set of images: the image time series
on movement means that patient groups with move- (the sequence of images acquired over time).
ment disorders can be difficult to scan. Finally, some Additional steps are then often required for fMRI data
subjects cannot tolerate the confined space of the MRI to correct for artefact and distortion. We now review
scanner. the most important processing steps required for
reconstructed images to be prepared for the stage of
3.2.3 Advantages processing that is closest to the researcher’s heart – the
fMRI can be repeated within subjects, so it can be statistical analysis that reveals where significant acti-
used to study processes that change over time, for vation related to experimental variables occurred.
example as a function of development, or as an indi- First, although movement of the head is generally
vidual recovers from injury or stroke, or as they restrained in some way (by lying in a moulded helmet,
acquire a new skill. It has quite good temporal and or with a headpiece), some movement is nevertheless
454 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
Smoothing
Template function
Reconstructed
time series
Spatial Spatial
normalization smoothing
Realignment
1 2 3
Time
Temporal 4
filtering
6 5
Parameter
estimates
Statistics
thresholding Data analysis
Model Paradigm
Creating
on
on
on
off
off
off
model
Time
8 6 4 2 0
Activation image
HRF
FIGU RE 14.14 Typical steps of image processing and analysis of fMRI data. Processing of PET and SPECT data is very
similar up to the analysis stage. Because images are not acquired as quickly with PET and SPECT as with fMRI, the
analysis of such data does not need to take the haemodynamic response function (see Section 3.2.1) into account.
inevitable over the course of a scanning session (sev- three axes intersect, or pass through the origin, at the
eral minutes to a few hours). Any movement means AC. These axes define the standardized stereotaxic
that the position of the brain within the images will coordinate system, sometimes called the Talairach
vary over time. Thus, the images need to be realigned, coordinate system after an influential brain atlas
bringing them all back into registration and correct- (Talairach and Tournoux, 1988). Any location in the
ing for head movement. brain can be indexed by values of these three coordi-
One concept that is almost universally used in func- nates, using units that are approximately a millimetre
tional imaging is that of a standard space – a standard (Figure 14.15(c)).
space provides a way to locate positions in the head (in Spatial normalization (see Figure 14.14) refers to
three dimensions) and allows comparison among dif- the process by which brain volumes are changed in
ferent brains (see Figure 14.15). First, an imaginary shape, size, and orientation so they approximately
line is drawn between the anterior commissure (AC) match that of a template, in standard space. A tem-
and the posterior commissure (PC) – two small brain plate is usually an average of many representative indi-
structures that are in very similar positions from per- vidual brain volumes. This is done so that brains of
son to person. This is the y-axis, and it defines front– different subjects (who will have brains of different
back (see Figure 14.15(a) and (b)). Another axis, x, is shapes and sizes) can be easily compared, and so data
perpendicular to y, also goes through the AC, and can be averaged across subjects. It also allows a
defines left–right (Figure 14.15(b)). A final axis, z, is researcher to match up low-resolution functional data
perpendicular to the first two, also intersects the AC, with a high-resolution anatomical image, so activa-
and defines up–down (Figure 14.15(a) and (b)). All tions can be precisely located with respect to brain
CHAPTER 14 NEUROIMAGING 455
z
z
y
(b)
PC AC
(a)
(c) x
FIGU RE 14.15 Standardized stereotaxic coordinate system, with perpendicular x-, y-, and z-axes (see (a) and (b)).
The star in (c) is in the location (x, y, z) –45, +15, +10. This is approximately 4.5 cm left of the mid-line, 1.5 cm in front
of the anterior commissure, and 1 cm above the AC-PC line. This point always falls in the left inferior frontal gyrus in
normalized brains.
cortical anatomy. Anatomical landmarks, such as the After normalization, data are usually spatially
anterior commissure, the Sylvian fissure, and the smoothed, meaning that the activation at each point is
interhemispheric fissure, will be in an (almost) identi- replaced by a weighted average of the activation meas-
cal position in all normalized brains. (Brains are all ured not just at that point, but at all neighbouring
very different, however, and even after spatial normal- points. This has three benefits. First, it improves
ization some anatomical variability remains.) power, making activations easier to detect. Second, it
When brains are spatially normalized, a particular ensures that the data conform to the assumptions of
set of stereotaxic coordinates refers to the same brain the statistical model that will be used to determine the
region in everyone (see Figure 14.15(c)). This permits significance of the activations. Third, it compensates
the researcher to use reference atlases, which are in for the fact that the same activation might be in
the same space as the template and which give, for slightly different places across individuals, since struc-
each set of x, y, z coordinates, detailed information tural and functional anatomy will not be identical
about the brain at that point. For instance, atlases can even after spatial normalization.
provide information about the likely tissue type, ana- The disadvantage of spatial smoothing is that it
tomical structure, and what other brain regions might reduces spatial resolution, since the signal is ‘smeared
be connected. out’ over adjacent regions. This effect is generally
It should be noted that sometimes researchers are greater in PET data than in fMRI data: in PET data,
interested in knowing more about what is different in two activations up to 2 cm apart can be smeared
the anatomy and pattern of activation across individu- together to appear as one, whereas in fMRI, once acti-
als, and are not so interested in what is common. In vations are more than 1 cm apart, they usually appear
such cases, spatial normalization would remove some as separate. The experimenter can change the amount
of the differences that interest the researcher, and so of smoothing in order to examine whether what is
probably would not be used. apparently a single blob after smoothing might
456 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
actually arise from two or more discrete but neigh- is indexed by parameter estimates. The larger the
bouring locations. parameter estimate at a given point in the brain, the
The final step before data analysis is temporal filter- better the model fits at that point.
ing. As with EEG and MEG data (see Section 2.2.3), Statistical tests are carried out at each of several
noise in fMRI data can be removed by filtering. For thousand points in the brain, independently (200 000
example, it is common to use a high-pass filter in points would not be unusual). If we set the signifi-
order to remove slowly varying components in the cance threshold to 0.05, which is conventional for sin-
time series, which may be due to physiological effects gle statistical tests, then it will be practically guaranteed
or to scanner-related drifts in baseline signal. Once that one of the tests will reach significance by chance
this is done, the data are (finally!) ready for statistical alone (i.e. it will generate a false positive or Type I
analysis. error). Indeed, with so many tests, there are likely to
be many Type I errors. How can we distinguish
3.2.5 Data analysis between these false positives and those comparisons
Predicting how signal will change over time, where the signal was truly elevated for experimental
and testing such models reasons? We must correct for the fact that so many
The most common way to analyse imaging data is to tests are being carried out: we need a multiple-com-
set up a model that predicts how the signal in the parisons correction. This can be done in several ways,
brain will change over scans if it is related to stimulus but such statistical thresholding always has the effect
presentation or task performance. For the example in of increasing the statistical threshold at which some-
Figure 14.11 regions of the brain that are uniquely thing is judged to be significant. The activation image
involved in synonym generation would be expected to (see Figure 14.14) shows which points in the brain are
show greater signal in scans 2 and 10 (when subjects activated at a particular (specified) level of signifi-
were performing the synonym generation task) than cance, usually p < 0.05 corrected for multiple com-
in scans 3 and 6 (when they were repeating words, a parisons.
condition that is closely matched in its other cognitive Sometimes researchers have predictions about
demands to synonym generation). Each point in the where in the brain they are expecting to find activa-
brain is tested separately; that is, at each point in the tion. In such cases, they do not need to correct for
brain, paired t-tests (over subjects) would indicate tests conducted over the whole brain, just for the tests
whether the signal is higher during synonym genera- conducted in the region in which they are interested.
tion than during word repetition. The statistical criterion for significance is therefore
In fMRI, since scans are usually taken every 1–4 sec- lower than if a correction had been applied based on
onds, the haemodynamic response function (HRF) tests over the whole brain. The smaller the region they
(see Section 3.2.1 and Figure 14.13(b)) must be taken are interested in, based on their hypotheses and on
into account when predicting how measured activa- previous work, the smaller the correction needs to be.
tion will change over time, as a function of stimulus or It is usually helpful in imaging studies to have anatom-
task. The data analysis stage in Figure 14.14 shows a ical hypotheses, based on existing literature, about
block design in which sound alternates between being where activation is likely to be observed when per-
‘on’ for several seconds and ‘off ’ for an equal period of ceiving a particular kind of stimulus or performing a
time. Because of the HRF, the BOLD signal that would particular task.
be predicted from this design would not increase until
a few seconds into the ‘on’ periods, and then would stay Functional connectivity analysis
elevated for a few seconds after the sound has been The traditional approach to the analysis of fMRI (and
turned off. At each point in the brain, regression equa- earlier PET) studies developed naturally from neu-
tions are used to test how well the model fits the ropsychology (see Chapter 13). Neuropsychologists
observed signal change over scans. The goodness of fit are able, by studying patients with brain damage
CHAPTER 14 NEUROIMAGING 457
restricted to one part of the brain, to infer the func- extensive interconnected set of brain regions often
tional specialization of that damaged area. Similarly, called the ‘default network’, which is thought to be
traditional approaches to imaging data analysis were important for internally generated cognition – for
focused on evaluating the functional specialization of reflecting on the past, for planning the future, for
discrete brain regions. However, since imaging managing social interactions, and for engaging in
data sets contain information about the moment-to- mental simulations relevant to one’s life. Alterations in
moment signal levels across the whole brain, they can the default network have been noted with ageing and
also be analysed to reveal how signal in different areas in a number of neurological disorders.
is coupled; for example, how signal levels across mul-
tiple areas rise and fall in concert, from moment to Pattern classification and ‘representational similarity’
moment (i.e. activity is correlated across regions, even Another way to analyse imaging data is to interpret
within a particular condition). This is called ‘func- the spatial pattern of activity associated with a partic-
tional connectivity’ and analyses of such correlations ular stimulus or condition (across the whole brain or
are more and more popular since regions that show across a specific region) as a representation of that
coupled activity probably belong to the same func- stimulus or condition. Then researchers can ask
tional network. One of the most popular ways to whether the patterns associated with other stimuli or
measure such connectivity is in the resting state – to conditions are similar to that pattern, or different. In
see how function is coupled across the brain when other words, whether there is representational simi-
people are being scanned just at rest. This reveals an larity (see Figure 14.16). For example, Kriegeskorte
… … …
FIGU RE 14.16 Whereas typical fMRI data analysis will tell you if a region is sensitive to a given type of stimulus,
pattern-information analysis indicates how the region is involved, in a voxel-specific way. A specific ROI, here in
inferotemporal cortex, can show similar sensitivity to two different classes of stimuli (here, body parts and fruit) but
this same activation level results from two different patterns across the 16 voxels of the ROI. Pattern information
analysis, or representational similarity analysis, assesses these multi-voxel spatial patterns, not the average activation
revealed in a typical analysis. Source: Based on the results of Kriegeskorte et al., 2008, and a diagram in Mur et al., 2009)
458 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
and colleagues (2008) performed a study in which gamma rays (high-energy light particles) that are emit-
they examined whether monkeys and humans catego- ted at 180 degrees from each other. These photons eas-
rize objects in a similar way. They used electrophysiol- ily escape from the human body, and can be recorded
ogy in monkeys, and fMRI with representational by a ring of radiation detectors: the PET scanner (see
similarity analysis, to show that in fact, inferotempo- Figure 14.17). By recording the detection of these
ral cortex (IT) of the monkey and the human both photons it is possible to monitor the distribution of
exhibit similar response patterns. The IT cortex exhib- neurochemicals, without disturbing their physiologi-
its different patterns for animate and inanimate cal behaviour, with a temporal resolution ranging
objects, and within these, patterns differ for different from several seconds to several minutes, and with a
sub-categories (e.g. faces vs body parts; manmade spatial resolution of several millimetres.
objects vs fruit). Like connectivity analysis, this
approach exploits the fact that imaging data sets con- 3.3.2 Different kinds of PET study
tain information about multiple brain regions at every
time point. These classification methods are based on PET is often used to study resting metabolism, that is
the observation that, if the experimental conditions to say, brain activity in the absence of any particular
(which give rise to the mental representations of inter- cognitive task. After being injected with the tracer
est) can be classified at better-than-chance levels solely compound, patients are scanned while lying quietly in
on the basis of the distribution of activity in the brain,
then this activity pattern must carry appreciable infor-
mation about the experimental conditions. This
approach has been referred to as ‘decoding’ or even A
‘brain reading’ (Cox and Savoy, 2003), and holds great
promise for studying the nature of mental representa-
tions via fMRI.
the scanner. Such metabolic scans are useful for public. In the UK, the annual dose to members of the
diagnosing brain disease: in some diseases, affected public is limited to 5 milliSieverts (mSv), comparable
brain tissue is often less metabolically active than to a year of exposure to natural background radiation.
healthy tissue, appearing as ‘dark areas’ on the result- Thus, in a typical activation PET study, a participant
ing images. may experience 8–12 scans, and the total exposure
When psychologists use PET, however, they are across all of these must not exceed 5 mSv per year.
generally interested in knowing where activity More scans than this are not feasible, since the cam-
increases in the brain as a function of a particular era’s sensitivity to blood flow depends on the size of
cognitive task. These are called activation PET stud- dose given in any particular scan. If more scans were
ies. Most activation PET studies use oxygen-15-la- taken, then dose per scan would be even smaller. If too
belled water as a tracer, since: (a) this isotope decays little isotope is given, then the camera does not detect
quickly and so disappears rapidly from the body; (b) gamma rays related to local accumulation of labelled
blood is mostly composed of water; and (c) water blood.
crosses the blood-brain barrier easily. Labelled water Regulations in most countries also stipulate that
is injected into the bloodstream of the volunteer or PET cannot be used as a research tool with children
patient, usually in the arm, and diffuses rapidly or, in the UK, with women of childbearing age, and
throughout the blood supply as the volunteer per- radiation dose limits make it difficult to repeat tests
forms a particular task (listening to a series of words, with individuals. This limits PET as a tool for investi-
for example). As brain areas become active (such as gating processes that occur over a period of time, such
auditory cortex, in response to spoken words), blood as patterns of brain activity before and after learning a
flow to those areas increases, and this is reflected in skill.
an increased concentration of the isotope in that PET is also expensive. In order to create the iso-
region. Many gamma rays emanate from the region of topes that are used as tracers, and to incorporate these
concentrated isotope and are detected by the PET into biologically important compounds, an array of
camera. Thus, activation PET, using labelled water, sophisticated equipment is required. This equipment
measures regional cerebral blood flow (rCBF). In is expensive to both operate and maintain. Because
most activation PET studies, 8–12 scans are taken, most of the isotopes that are used in PET decay
each approximately a minute long, with a 7–10 quickly, they have to be made in a cyclotron adjacent
minute interval between scans; this is long enough for to the camera, and as soon as needed.
the tracer to disappear from the body before the next
injection is given. 3.3.4 Advantages of PET
PET is a quiet imaging technique, and high-fidelity
3.3.3 Limitations of PET sound delivery can be easily used with it, making it a
The most obvious limitation of activation PET is valuable tool in auditory research. Unlike fMRI, PET
shared with fMRI (see Section 3.2.2): blood flow is is compatible with the metallic and magnetic compo-
only an indirect measure of neuronal activity, which nents contained in many implants, such as pacemak-
is what researchers are really interested in. And ers and cochlear implants. Furthermore, unlike most
changes in blood supply happen several seconds after fMRI systems, PET permits the researcher to be in
the population of neurons under study has become close contact with the patient or volunteer: the volun-
active. teer is scanned for at most two minutes at a time, pre-
Furthermore, compared with fMRI, activation PET ceded and followed by contact with the researcher or
has many disadvantages that explain its lack of popu- radiographer. Also, PET scanners only encircle the
larity in the last decade. Most countries, including the head, leaving the body mostly open to the room, and
UK, have strict rules regarding the administration of are consequently less likely than MR scanners to pro-
ionizing radiation to ensure the safety of the general voke claustrophobic reactions.
460 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
light (long wavelength, such as is used by warming used to examine the function of a restricted region of
lamps) to image the surface of the brain. This is a non- cortex, and only near the surface of the brain, since the
invasive technique because the light source passes light does not penetrate far beyond the surface. This
through the scalp and skull, is reflected off the cortex, technique is non-invasive and safe, highly portable,
and the reflected light is picked up by a detector near requires (in comparison to other imaging techniques)
the light source on the head’s surface. Because blood relatively little equipment (see Figure 14.2(f)) and is
flow and blood oxygenation alter the reflectivity of the relatively inexpensive. Furthermore, due to the rela-
cortex, brain activity is ‘reflected in’ (excuse the pun!) tively thin skulls of infants and children (compared to
a change in the detected reflected light. NIRS does adults), which permit more light to pass, this tech-
not, like fMRI and PET, have the ability to examine all nique is particularly well suited for use with younger
regions of the brain at the same time, but can only be participants.
SUMMARY OF SECTION 3
• fMRI is sensitive to changes in regional blood flow and blood oxygenation, indirect measures of neu-
ral activity that develop over 4–6 seconds.
• fMRI can be used to study regional brain activity but also, increasingly, how regions of the brain work
together to represent stimuli or perform tasks.
• PET requires the use of ionizing radiation, but is an appropriate technique for anyone with metallic or
magnetic implants (such as pacemakers or cochlear implants) who cannot undergo fMRI.
• PET can also be used to examine activity within specific neurochemical pathways in the brain, so that
neurochemically specific changes as a function of cognitive state can be assessed.
• SPECT is very similar to PET in the way that it works. It has generally poorer spatial and temporal
resolution, but is much cheaper to use.
• NIRS is a non-invasive technique that uses light to image the cortex nearest the skull. It is particularly
useful for imaging brain activity in babies and children.
• Imaging data must be extensively processed before they can be analysed. Data processing steps
include realignment, spatial normalization, spatial smoothing, and temporal filtering.
• Data analysis is usually conducted independently at every point in the brain. Models that predict sig-
nal change over scans are tested against observed values. If all points in the brain are tested, signifi-
cance thresholds must be adjusted to control for Type I errors (or false positives). Alternatively,
researchers can restrict their analyses to the part of the brain they are interested in, thereby reducing
the multiple-comparisons problem and permitting use of lower statistical thresholds.
The shape of the coil determines the properties and Because the field is created on the surface of the
size of the field: a figure-8 coil, which produces a very head, there is a trade-off between the size of the brain
strong and focused field at the brain location that is area that is stimulated and the depth to which the
deep relative to the crossing in the ‘8’, is the most pop- stimulation can reach. Even the strongest and most
ular. The induced current in the brain then renders the focused fields cannot penetrate very much further
local tissue more or less active, depending on the TMS than the surface of the cortex, so that only surface
technique that is employed. TMS is non-invasive, is locations (including motor cortex and other frontal
apparently free of serious side-effects (if used prop- areas) are suitable for study. Also, the temporalis mus-
erly; see BioMag Laboratory, 2008: http://www.bio- cle, which lies between the scalp and the skull over the
mag.hus.fi/tms/safety.html), and has considerable temporal lobe, can be caused to contract quite pain-
potential as a research, diagnostic, and even therapeu- fully with TMS stimulation, and so TMS is not often
tic tool. used over the temporal lobe.
As a research tool for exploring the mapping of cog- TMS, like neuropsychology, provides information
nitive functions in the brain, TMS is used to temporar- about what parts of the brain are critical for particular
ily and reversibly disrupt normal brain function in cognitive functions. This is unlike fMRI and PET,
healthy subjects. This approach is conceptually similar which cannot differentiate between areas showing
to classic neuropsychology, in which patients with activity that is merely correlated with a particular cog-
focal brain damage are carefully assessed for evidence nitive function, and areas that are essential to the
of cognitive deficits. Any impaired cognitive function function.
is assumed to relate to the damaged bit of brain. In TMS is used diagnostically to evaluate the patency
TMS, activity in an area thought to be necessary for the of connections between the brain and the muscles in
performance of a particular function can be temporar- disorders like stroke and multiple sclerosis. TMS also
ily interrupted, and then performance on tasks relevant appears to be a useful treatment of a number of psy-
to that function can be assessed. Normal function chiatric disorders, including depression, anxiety, and
resumes within a few minutes after actual stimulation some of the symptoms of schizophrenia (Slotema
has stopped, and so tests are usually administered at et al., 2010).
the same time as the TMS pulses, or shortly thereafter.
SUMMARY OF SECTION 4
• TMS can be used to disrupt brain function temporarily. When used properly, it is a safe way to induce
a ‘reversible lesion’ in a particular region of the brain, to determine whether that region is critically
involved in the performance of a given task.
• It is only suitable for use with regions on the surface of the brain, and cannot easily be used to study
function in the temporal lobe.
5 CHOOSING A TECHNIQUE
In general, choosing which neuroimaging technique to consider a number of different factors. Try
to use for a particular purpose requires researchers Activity 14.1.
CHAPTER 14 NEUROIMAGING 463
ACTIVIT Y 14.1
B
fingers
B e kle knee hip
to an trunk
wrist
shoulder
han
elbow
rin
d
g l
m ittle
thu idd
mb le
bro n ind
A w eck ex
faceeyelid
lips an
voc al izat ion
de
yeb
all
jaw gue win g
salivat
n
to wa llo
ma
s
stic
ion
ati
on
lateral medial
FIGU RE 14.18 The ‘motor homunculus’. The primary motor region (A–B) represents different parts of the
body in an orderly way. The part of the motor cortex involved in mouth and tongue movements (and so speech
production) is found at the lower end, near the Sylvian fissure (blue dotted line).
464 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
uses non-speech sounds matched to the speech comprehension of the stimulus. This could be com-
sounds on duration (as in the hierarchical subtraction pared to TMS over other regions of the brain (not
fMRI example, Figure 14.11). The analysis would expected to be involved in speech perception) while
either look for regions that correlated with the para- the volunteer hears speech. Any stimulus recall, rec-
metric factor (in the case of a parametric design) or ognition, or comprehension test, administered after
regions in which activation during experimental con- the speech stimulus (and TMS pulse), could be the
ditions was higher than during control conditions. dependent measure. Changes in performance on
Since a region of interest is included in the hypothe- the task would be examined as a function of brain
sis, the problem of multiple comparisons can be less- area stimulated: if the inferior motor region is neces-
ened, and the significance threshold used can be sary for speech perception, performance will be
more liberal than if tests were conducted over the impaired after TMS stimulation there. If the motor
whole brain. region is either involved but not critical or is not
A TMS experiment would involve delivering TMS involved at all, task performance will not change as a
over the inferior motor region while the volunteer function of stimulation site.
hears speech, and then testing their perception or
TAB LE 14.1 A summary of methods used to study the relationship between brain and
behaviour in normal volunteers
EEG >10 mm* 1 ms or less Summed electrical activity over large groups of
neurons
MEG >5 mm* 1 ms or less Summed magnetic fields produced by large
groups of active neurons
fMRI <5 mm 200 ms–1 sec ‡ Magnetic field fluctuations produced by local
changes in the proportions of oxyhaemoglobin
and deoxyhaemoglobin in blood
PET 5–20 mm† 10 sec– minutes† Radioactive decay occurring where a labelled
compound (water in blood, neurochemical) has
accumulated
SPECT 20 mm minutes Radioactive decay occurring where a labelled
compound (neurochemical) has accumulated
NIRS 30 mm 100 ms The vascular system’s reflection/absorption
characteristics change as a function of blood
flow/oxygenation; changes in transmitted
near-infrared light and received light are
measured
TMS 5–10 mm <0.5 sec Strong focal magnetic field transiently disrupts
activity in large groups of neurons
* A general reliable figure cannot be given, since for both EEG and MEG spatial resolution depends on several
factors such as modelling assumptions, number of sensors, or signal-to-noise ratio.
† Spatial and temporal resolution in PET depend on the compound that is used. Compounds that act
specifically within particular neurotransmitter systems can take longer to accumulate detectable signal but can
be localized with greater precision (since we know where these neurotransmitter systems are found) than
labelled water.
‡ The lower bound of this range refers specifically to when the timings of two events are measured relative to
each other within the same brain area of the same subject.
FURTHER READING
Hansen, P., Kringelbach, M., and Salmelin, R. (eds.) (2010) Neuroimage, vol.42, no.3, pp.1069–77. This methodological
MEG: An Introduction to Methods, New York, Oxford University study describes the benefit that can be gained by combining EEG
Press. Neuroimaging is a fast-moving and relatively young disci- and MEG.
pline and, as a consequence, it is difficult to find accessible text- Picton, T.W., Bentin, S., Berg, P., Donchin, E., Hillyard, S.A.,
book treatments of the core issues. Accessible chapters on EEG Johnson, R. Jr., et al. (2000) ‘Guidelines for using human event-
and, in particular, MEG are rare but here at least there is a recent related potentials to study cognition: recording standards and
textbook, albeit somewhat advanced. publication criteria’, Psychophysiology, vol.37, no.2, pp.127–52.
Other readings are suggested according to the kind of neuro- Guidelines for the analysis of ERPs. Also discusses basics of exper-
imaging technique on which they focus. imental design and provides an overview of standard analysis tech-
Molins, A., Stufflebeam, S.M., Brown, E.N., and Hamalainen, niques. Not only useful for publishing papers, but also for their
M.S. (2008) ‘Quantification of the benefit from integrating evaluation.
MEG and EEG data in minimum l2-norm estimation’,
466 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
Naatanen, R. (2001) ‘The perception of speech sounds by the Huettel, S.A., Song, A.W., and McCarthy, G. (2009) Functional
human brain as reflected by the mismatch negativity (MMN) Magnetic Resonance Imaging, 2nd edition, Sunderland, MA,
and its magnetic equivalent (MMNm)’, Psychophysiology, Sinauer. Comprehensive textbook covering all aspects of func-
vol.38, no.1, pp.1–21. Overview of one of the most common tional magnetic resonance imaging, including experimental design,
paradigms in ERP research (‘passive oddball paradigm’) and the signal acquisition, data processing, and analysis.
associated ‘mismatch negativity’ (MMN) component in EEG and Henson, R. (2005) ‘What can functional neuroimaging tell
MEG. It describes basic concepts of ERP/ERF analysis, visualiza- the experimental psychologist?’ Quarterly Journal of
tion, and data interpretation. Experimental Psychology Section A, vol.58, no.2, pp.193 –233.
Sharon, D., Hamalainen, M.S., Tootell, R.B., Halgren, E., A thought-provoking review of the application of fMRI to psychology.
and Belliveau, J.W. (2007) ‘The advantage of combining MEG Lloyd-Fox, S., Blasi, A., and Elwell, C.E. (2010) ‘Illuminating
and EEG: comparison to fMRI in focally stimulated visual the developing brain: the past, present and future of functional
cortex’, Neuroimage, vol.36, no.4, pp.1225–35. Study compar- near infrared spectroscopy’, Neuroscience and Biobehavioral
ing simple visually-evoked brain responses among EEG, MEG, Reviews, vol.34, no.3, pp.269–84. (Epub 24 July 2009) A review
combined EEG and MEG, and fMRI. Discusses differences of NIRS as a technique for asking questions about functional brain
between techniques, different source estimation procedures for development.
EEG/MEG, and the benefit of combining EEG and MEG for George, M.S. (2003) ‘Stimulating the brain’, Scientific
source estimation. American, vol.289, no.3, pp.67–73. An accessible review of TMS.
REFERENCES
BioMag Laboratory, Helsinki University Central Hospital P.M. (1998) ‘Evidence for striatal dopamine release during a
(2008) Safety of TMS, www.biomag.hus.fi/tms/safety.html video game’, Nature, vol.393, pp.266–8.
(accessed 15 Feb 2011). Kriegeskorte, N., Mur, M., Ruff, D., Kiani, R., Bodurka, J.,
Churchland, P.S. and Sejnowski, T.J. (1988) ‘Perspectives Esteky, H., et al. (2008) ‘Matching categorical object represen-
on cognitive neuroscience’, Science, vol.242, pp.741–5. tations in inferior temporal cortex of man and monkey’,
Cohen, M.S. and Bookheimer, S.Y. (1994) ‘Localization of Neuron, vol.60, no.6, pp.1126–41.
brain function using magnetic resonance imaging’, Trends in McArthur, C., Jampana, R., Patterson, J., and Hadley, D.
Neurosciences, vol.17, pp.268–77. (2011) ‘Applications of cerebral SPECT’, Clinical Radiology,
Cox, D.D. and Savoy, R.L. (2003) ‘Functional magnetic vol.66, no.7, pp.651–61.
resonance imaging (fMRI) “brain reading”: detecting and Menon, R.S. and Kim, S.G. (1999) ‘Spatial and temporal
classifying distributed patterns of fMRI activity in human limits in cognitive neuroimaging with fMR’, Trends in Cognitive
visual cortex’, Neuroimage, vol.19, pp.261–70. Sciences, vol.3, pp.207–16.
Donders, F. (1969) ‘On the speed of mental processes’, in Mur, M., Bandettini, P.A., and Kriegeskorte, N. (2009)
Koster, W.G. (ed.) Acta Psychologica, Attention and ‘Revealing representational content with pattern-information
Performance II, Amsterdam, North-Holland Publishing. fMRI: an introductory guide’, Social Cognitive and Affective
Friston, K.J., Price, C.J., Fletcher, P., Moore, C., Frackowiak, Neuroscience, vol.4, no.1, pp.101–9. (Epub 17 Jan 2009)
R.S., and Dolan, R.J. (1996) ‘The trouble with cognitive sub- Opitz, B., Mecklinger, A., Von Cramon, D.Y., and Kruggel,
traction’, Neuroimage, vol.4, pp.97–104. F. (1999) ‘Combining electrophysiological and hemodynamic
Kim, D.S., Duong, T.Q., and Kim, S.G. (2000) ‘High- measures of the auditory oddball’, Psychophysiology, vol.36,
resolution mapping of isoorientation columns by fMRI’, pp.142–7.
Nature Neuroscience, vol.3, pp.164–9. Raichle, M.E. (1998) ‘Behind the scenes of functional brain
Klein, D., Milner, B., Zatorre, R.J., Meyer, E., and Evans, imaging: a historical and physiological perspective’, Proceedings of
A.C. (1995) ‘The neural substrates underlying word genera- the National Academy of Sciences of the USA, vol.95, pp.765–72.
tion: a bilingual functional-imaging study’, Proceedings of the Sharon, D., Hamalainen, M.S., Tootell, R.B., Halgren, E.,
National Academy of Sciences of the USA, vol.92, pp.2899–903. and Belliveau, J.W. (2007) ‘The advantage of combining MEG
Koepp, M.J., Gunn, R.N., Lawrence, A.D., Cunningham, and EEG: comparison to fMRI in focally stimulated visual
V.J., Dagher, A., Jones, T., Brooks, D.J., Bench, C.J., and Grasby, cortex’, Neuroimage, vol.36, no.4, 1225–35.
CHAPTER 14 NEUROIMAGING 467
Slotema, C.W., Blom, J.D., Hoek, H.W., and Sommer, I.E.C. Talairach, J. and Tournoux, P. (1988) Co-planar Stereotaxic
(2010) ‘Should we expand the toolbox of psychiatric treatment Atlas of the Human Brain. 3-Dimensional Proportional System:
methods to include repetitive transcranial magnetic stimula- An Approach to Cerebral Imaging, New York, Thieme.
tion (rTMS)? A meta-analysis of the efficacy of rTMS in Tallon-Baudry, C. and Bertrand, O. (1999) ‘Oscillatory
psychiatric disorders’, Journal of Clinical Psychiatry, vol.71, gamma activity in humans and its role in object representa-
no.7, pp.873–84. tion’, Trends in Cognitive Science, vol.3, no.4, pp.151–62.
COGNITIVE
NEUROPSYCHIATRY
David Okai, Angus Gellatly, and Anthony David
1 INTRODUCTION
Cognitive neuropsychiatry is, in relative terms, a new the integration of discrete, or focal, brain pathology
discipline that attempts to draw upon the success of its with assessment and understanding of pre-illness psy-
sister disciplines, cognitive psychology and cognitive chosocial history, allowing for a formulation of illness
neuropsychology, to explain the symptoms of (neuro-) based on cognitive and personal understanding of the
psychiatric disorders, such as dementia or schizophre- individual. See, for example, Box 15.1.
nia. It represents a systematic and empirically driven Patients seen by clinicians tend to fall into three
approach to explaining clinical psychopathologies in main types: (1) those who suffer with a neurological
terms of deficits in normal cognitive processes, and disorder and have cognitive, behavioural, or psychiat-
illustrates a rapprochement between cognitive neu- ric symptoms; (2) those who have medically unex-
ropsychology, clinical medicine, and the neuro- plained neurological symptoms; and (3) those who
sciences in addressing common questions about have a mental illness with a possible organic aetiology.
disorders of mind and brain. Cognitive neuropsychiatry adopts a theory-driven
There is a reciprocal relationship between the neu- approach, using patterns of impaired and intact cogni-
rological components of medicine and psychology. tive performance observed in patients to revise cur-
Neuropsychology seeks to determine the relevance of rent models of normal cognitive functioning. By
brain damage or disorder to changes in behaviour. definition and necessity its scope is broad. It encom-
Conversely, the neuropsychiatrist studies manifesta- passes disorders such as schizophrenia and dementia
tions of disturbed behaviour or cognitive deficits in due to its phenomenological interest in symptoms
order to aid in diagnosis. such as delusions, hallucinations, and misidentifica-
What marks the cognitive neuropsychiatry approach tion phenomena, although it maintains a focus on
as different from the rest of the medical specialties is symptoms (and occasionally symptom clusters) rather
CHAPTER 15 COGNITIVE NEUROPSYCHIATRY 469
At the time of assessment, Mr E was a 56-year-old a Porsche, that he was working with the police
left-handed man. He was born in northern Italy and doing chemical analysis, that he sold bags at Grand
moved to southern Africa aged 11. He was an elec- Prix events, and that he had two sons, the older of
tronic engineer and a successful businessman. He whom owned a motorcycle. His wife and brother
was recently remarried and had a young daughter. reported that all these ‘memories’ were without
His wife described him as a highly active and knowl- foundation, and in reality his only child was his
edgeable person, one who likes ‘to chat to people daughter.
and have control over situations’. He had no psychi- Where true autobiographical memories are sim-
atric history. ply displaced in time, they are known as ‘momen-
Mr E was referred to the neuropsychiatrist fol- tary confabulations’. Where, as in the above
lowing an operation for a meningioma. On waking examples, stories are wholly without foundation,
from surgery, Mr E was severely disoriented and they are known as ‘fantastic’ or ‘severe’ confabula-
confused, a condition that continued for the next tions, and these tend to be associated more with
month. Thereafter, there was a gradual improve- severe memory deficits.
ment until he reached a stage where he was able to Mr E’s confabulations were typically accompa-
cope relatively independently at home. However, nied by denial that he suffered from an unusual
his memory abilities remained markedly and dispro- memory deficit (anosognosia). Although aware of
portionately impaired, and he was diagnosed with a some of the consequences of his poor memory, he
Korsakoff-like amnesia. He was often not aware attributed these to other factors, such as his own
that he was married, nor did he know the names of unwillingness to try to remember things or his age.
his relatives, and his orientation in time and place For example:
was poor. A gross reduction in motivation was also
(1) Examiner: ‘Your memory is failing you?’
reported. His expressive output was confabulatory
Mr E: ‘It is. More than failing is that I am not inter-
and incoherent, and he lacked any insight into his
ested in helping it along.’
memory deficit.
(2) Examiner: ‘And how about your memory?’
Mr E’s confabulations often seemed to contain
Mr E: ‘Old age. Everyone would like to have a
real events from his past misplaced in time or loca-
better [memory], but we get to a certain age in life,
tion. However, he also sometimes produced ‘mem-
which you have to accept.’
ories’ with no relation to the realities of his life. In
Adapted from Fotopoulou et al. (2004).
different sessions he claimed to own a Maserati and
than specific diagnoses. As such it moves beyond include belief formation, willed action, the concept of
diagnosis and a classification system towards a method self, and the concept of others. The aim of this chapter
that applies a cognitive analysis of symptoms regard- is to illustrate the convergence between cognitive neu-
less of whether they are due to recognized ‘discrete’ or roscience and clinical psychiatry and to demonstrate
generalized brain pathology. how this has already begun to add to our understand-
It is clear that a complex interplay of neural systems ing of psychiatric conditions.
underlies most psychological processes, but cognitive We first look at the effects of lesions in the various
neuropsychiatry attempts to draw from neuropsycho- major sub-divisions of the brain. Then, the following
logical accounts of how the brain is thought to ‘work’ section examines the ‘dementias’, as they can serve as a
(see, for example, Chapter 13) and extend them to useful heuristic tool to illustrate neurobiological,
470 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
neuroanatomical, and cognitive neuropsychological disorder), impulse control disorders, and so-called
contributions to understanding clinical manifesta- conversion disorders will follow. This chapter is not
tions of illness. Theoretical assumptions relating to intended to be an exhaustive review of all the condi-
psychosis (e.g. schizophrenia), affective disorders (e.g. tions relevant to neuropsychiatry (for that, see sugges-
depression), disinhibition (e.g. obsessive-compulsive tions in the ‘Further reading’ section).
fine motor skill loss). Finally there may be topograph- amnesia). There is additionally progressive loss of mem-
ical disorientation (often manifesting in day-to-day ories prior to the damage (retrograde amnesia). Recent
life with patients being found ‘wandering’ as a result, memories are felt to be affected more than distant mem-
or getting lost on previously familiar streets while try- ories, which may reflect a progressive dissociation from
ing to find their way home) and dressing dyspraxia the hippocampus as memory becomes increasingly con-
(the patient may put their clothes on the wrong way solidated (Piefke et al., 2003). Secondly, temporal lobe
round or inside out). epilepsy may produce a psychosis in between epileptic
attacks that is indistinguishable from the pattern of
symptoms seen in schizophrenia (Toone, 1991). Finally,
2.3 Temporal lobes in schizophrenia, lesions in the temporal lobe have been
identified in the planum temporale and Heschl’s gyrus,
Dysfunction associated with temporal lobe damage areas that play a role in language and auditory process-
can be divided into four main types: defects in audi- ing. Some researchers have gone on to suggest that hal-
tory, visual, and memory function, and change in per- lucinatory and cognitive deficits are associated with
sonality. More rarely there may be an association with such abnormalities (Shenton et al., 2001).
a psychotic presentation.
Lesions of the dominant temporal lobe, especially in
the anterior region (known as Wernicke’s area), result 2.4 Occipital lobe
in what is now termed a fluent dysphasia with rapid,
nonsensical speech production. This may resemble the Deficits associated with occipital lobe damage may be
suite of language problems described in patients with in the form of visual impairment, such as cortical
schizophrenia as thought disorder (see also Section blindness. Very rarely, there is associated denial of this
4.2). Non-dominant side lesions have on occasion blindness (Anton’s syndrome). The patient often
been shown to impair a patient’s perception of music, voices a confabulatory account of (unlikely) reasons to
faces, and drawings. Unilateral lesions usually have lit- explain their current visual impairment consistent
tle if any effect on memory function, presumably due with an anosognosia. The converse is the phenome-
to the other hemisphere compensating for the loss. non of blindsight (see Chapter 13), where a patient
However, dominant side lesions may impact on verbal who is phenomenally blind is able to process visual
memory, and non-dominant side lesions on non-ver- information that is not consciously represented (i.e.
bal (spatial) memory. Bilateral lesions result in a global unconscious vision). With the majority of occipital
amnesia, usually with preservation of working mem- lesions, however, sight is preserved but there may be
ory. Personality changes that occur are often those of disturbances of high level perception (visual cogni-
emotional lability, aggression, and change (either a tion). One such condition is alexia without agraphia,
decrease or an increase) in sexual activity. where there is a preservation of letter recognition but
Three types of pathology bear special mention in rela- whole words (including words written by the sufferer)
tion to the temporal lobes. Firstly, Alzheimer’s disease cannot be read. Another example is where the indi-
involves atrophy of the medial temporal lobe (specifi- vidual sees non-complex visual hallucinations, for
cally the hippocampal region and related structures). example of geometrical shapes (ffytche et al., 1998).
This is one of the first brain regions to be affected in
Alzheimer’s disease and in mild cognitive impairment
Brain stem and
2.5
(Braak and Braak, 1997; Müller et al., 2005).
Neuroimaging and behavioural studies suggest a critical cerebellum
role for the hippocampus in encoding and recall of epi-
sodic memories, with damage resulting in a reduced Lesions here produce symptoms akin to frontal lobe
ability to acquire new episodic memory (anterograde impairment, due to the strong frontal projections
CHAPTER 15 COGNITIVE NEUROPSYCHIATRY 473
from these structures. Problems with initiation, plan- involvement. A ‘cerebellar affective syndrome’ has
ning, and mental set shifting (adapting one’s prepara- been described (Schmahmann and Sherman, 1998),
tory adjustment for performing a task when the task although it is difficult to exclude additional cerebral
changes) are particularly common. The hallmark dis- lesions, especially when the cause of cerebellar dam-
ease of this condition is Parkinson’s disease (PD), age may affect other parts of the brain, as is commonly
which has many associated neuropsychiatric co-mor- the case in, for example, stroke. Finally, damage to
bidities. Additionally Korsakoff ’s amnesia, with a these structures can affect intelligence or a patient’s
characteristic neuropsychological profile of intact level of arousal, or may produce appetite disturbance
working memory but pronounced anterograde and (such as overeating) and unpredictable swings in
retrograde amnesia, is a condition with brain-stem emotion (Trimble and Cummings, 1981).
SUMMARY OF SECTION 2
• Frontal lobe dysfunction is associated with disorders of conduct, with lesions being described as
‘pseudodepressive’ or ‘pseudopsychopathic’ in nature.
• Parietal lobe dysfunction can result in a disturbed sense of awareness, inattention, or language and
calculation problems.
• The temporal lobes are associated with dysphasia, memory impairment (especially if there is bilateral
temporal lobe damage), and personality change.
• Occipital lobes are associated with visual impairment including blindness and visual hallucinations.
The hallucinations are associated with varying degrees of insight.
• Brain stem pathology mirrors that of frontal lobe pathology due to strong interconnections. It may
also be associated with impaired control of actions and emotions.
3 DEMENTIA
Dementia is a non-aetiologically specific term applied by at least one other symptom from the list in Table
to a range of neurodegenerative disorders that involve 15.1. Factors such as personality change and social
progressive loss of higher intellectual functioning (see conduct are also important in diagnosis.
DSM-IV of the American Psychiatric Association, Neurodegeneration is the main reason for progres-
2000). The deficits must represent a decline from a sive deterioration in neuropsychological function in
previous level of functioning in order to meet the def- dementia and may result in generalized presentation
inition of the term dementia, and they must be of such of symptoms, with a clinical profile characteristic of
severity as to impact on the sufferer’s work or social many of the deficits described in Section 2, due to
functioning. A central component is amnesia or many brain regions being affected. The most common
memory impairment, with individuals becoming example of this is Alzheimer’s dementia. Alternatively,
impaired in their ability to learn new information or a patient may present with a relatively specific cogni-
showing greater forgetting of previously learned infor- tive profile that ultimately becomes more generalized
mation. The memory disorder must be accompanied as the condition progresses (e.g. Parkinson’s disease).
474 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
TAB LE 15.1 Clinical profile of deficits in dementia thereafter and, importantly, all the nuns agreed to
brain donation at point of death. The study allowed
Deficit Cognitive dysfunction
examination of a wide range of dementing illnesses –
Aphasia Deterioration in language function from severe Alzheimer’s and vascular dementia,
Impaired ability to perform motor through to participants with little or no cognitive
Apraxia
activities despite intact motor ability
impairment. Clinical assessment included tests such
Failure to recognize or identify objects
Agnosia as the Mini-Mental State Examination (MMSE) and
despite preserved sensory function
delayed word recall (a test of short-term memory
from a list of ten words). However, it is important to
A useful clinical division resides in differentiation recognize that core to a diagnosis of dementia is
between the dementia syndromes that mainly affect impairment in activities of daily living (for instance,
the ‘cerebral’ cortex – primarily temporal, parietal, using the telephone or correct calculation of change in
and occipital lobes, which as we have seen result shopping activities). These were also assessed. Clinical
mainly in aphasia, apraxia, and agnosias – and those findings could then be compared with neuropathol-
that impact mostly on ‘sub-cortical’ structures (the ogy and included a positive correlation between the
area of the brain immediately below the cortex), with severity of dementia and the degree of neuropathol-
a predominant effect on the functioning of pre-frontal ogy present in the brain. On the whole, however, a
areas and the basal ganglia. The clinical manifesta- sizeable proportion of participants with high levels of
tions of these latter sub-cortical forms of dementia are Alzheimer’s pathology appeared free of clinical
executive dysfunction, slowed motor and processing expression of symptoms, including 8 per cent of those
speed with relative inflexibility of thought, and per- with the most severe pathology. The process of resist-
sonality change. The following sections will outline ance to disease appeared mediated by higher levels of
the neuropsychological presentation of specific education and intelligence, indicating that this group
dementia syndromes. had higher levels of cognitive reserve (namely the
brain’s, or the individual’s, ability to adapt to or com-
pensate for the presence of pathology).
3.1 Alzheimer’s disease This study had several strengths. Firstly, because of
the brain donations it allowed for histological confir-
Alzheimer’s disease (AD) is a cortical dementia and mation of clinical diagnosis (i.e. through study of cell
the most common neurodegenerative disease. It structures). The majority of studies employ criteria
affects 4 per cent of those aged over 65 and whilst age that allow at best a ‘probable’ diagnosis of a specific
is the most important risk factor, the disorder is not dementia (e.g. Alzheimer’s, or vascular, or fronto-tem-
simply a condition of accelerated ageing. Common poral), as histological confirmation is usually not pos-
neuropsychiatric consequences include depressive sible. Additionally, the study allowed for elimination
symptoms, paranoid delusions (particularly of theft), of many factors that confound epidemiological
visual hallucinations, and personality change. The research, due to the relative homogeneity of the sisters’
aetiology is unknown but likely to be multi-factorial, environment and lifestyle. Unfortunately, this to some
with post-mortem studies indicating a direct correla- extent also limits the generalizability of the findings.
tion between extent of brain pathology and extent of Nevertheless, the wide range of function and health
cognitive impairment. among the participants allowed a unique opportunity
A unique longitudinal study by Snowdon and col- to understand the biological and social substrates of
leagues (n = 678) examined nuns, who were members illness and health. It currently remains unclear how
of a single congregation and aged between 75 and 102 upbringing or environmental factors can contribute
at initial study contact (Snowdon et al., 1996). to a process of resistance to dementia, warranting fur-
Neuropsychometric tests were performed annually ther research on the subject.
CHAPTER 15 COGNITIVE NEUROPSYCHIATRY 475
Some causes of earlier onset of Alzheimer’s disease did not necessarily meet clinical criteria for vascular
have also been identified, which are rare but have a dementia, as despite there being demonstrable strokes
clear-cut genetic link, being passed down from parent on post-mortem examination, these may not necessar-
to child. These tend to have higher levels of demon- ily result in focal clinical neurological signs. In truth, a
strable neuropathology (scoring more highly on neu- significant proportion of patients who have MRI head
ropathological scales of severity of illness) and investigation demonstrate changes in the brain consist-
clinically are rapid in onset with more aphasia and ent with multiple strokes but may be clinically asympto-
fronto-temporal distribution. Importantly, by far the matic. The role of the neuropsychiatrist may be to
majority of cases of Alzheimer’s are multi-factorial, comment on whether they feel these changes are inci-
and therefore there is no indication that, should one dental or indeed related to a specific neuropsychiatric
family member develop the disorder, a sibling or child condition.
will also develop the condition. Most common neuropsychiatric features of VascD
manifest as depression and emotional lability, espe-
cially in those with deficits in executive function.
3.2 Vascular dementia Staekenborg and colleagues (n = 484) compared the
relative severity and frequency of disease in those who
Vascular dementia (VascD) is a dementia syndrome fulfilled criteria for VascD (Staekenborg et al., 2009).
cause by impaired blood supply (and therefore Apathy, depression, and irritability were the most
reduced oxygen) to the brain. It is the second most common complaints on screening/severity question-
common form of dementia. It typically results from naires, with sub-cortical disease more likely to present
the occurrence of multiple strokes of varying sizes with apathy and cortical disease more likely to present
over time, causing a relatively abrupt onset of demen- with agitation/aggression.
tia with a progressive, stepwise decline. In the major-
ity of cases, neuropathology consists of recurrent
lesions in the sub-cortical areas of the brain. However,
DSM-IV requires additional evidence of cortical
Dementia with Lewy
3.3
pathology (see above) of a severity to produce ‘hard’ bodies (DLB)
or focal neurological signs, i.e. identifiable neurologi-
cal symptoms that can be associated with a region of This is the third most common form of dementia,
the brain consistent with the origin of the stroke. An often co-occurring with Alzheimer’s disease pathol-
example might be weakness of the right side of the ogy. Diagnostic criteria in addition to amnesia include
body (known as hemiplegia) due to a stroke in the left two of three core symptoms (McKeith et al., 2000):
frontal part of the brain known as the motor cortex.
The cognitive profile of a vascular dementia is typi- 1. tremor, rigidity (stiffness), and bradykinesia
cally idiosyncratic with patients often showing a ‘patchy’ (slowed thought and action)
distribution of deficits, in contrast to the more global 2. hallucinations
picture typically seen in Alzheimer’s disease. However, 3. fluctuating confusional state.
the divide between the two conditions is difficult to
draw due to the large overlap in risk factors for both These symptoms are also classically found in
conditions (such as high blood pressure, history of Parkinson’s disease but are seen in a range of other
smoking, and age). Indeed, Snowdon’s study of nuns conditions (such as in some patterns of vascular
described earlier found an interaction in pathology, dementia where the strokes happen to be distributed
with those individuals showing more evidence of mul- in the same part of the brain that is usually responsible
tiple strokes also being more likely to succumb to for causing Parkinson’s disease, or following certain
Alzheimer’s pathology (Snowdon, 2003). These patients medications). In these occurrences they are referred
476 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
to as parkinsonian symptoms. Lewy bodies them- preservation of comprehension in the early to middle
selves, from which the dementia is derived, are abnor- stages of the disease. Semantic dementia is the term
mal, insoluble complexes formed within neurons used when the temporal lobe component to this condi-
when attempting to eliminate damaged protein struc- tion is predominant. Patients present with preserva-
tures from within the cell. They are found in both the tion of episodic memory but loss of memory for words,
brain stem and the cerebral cortex and do not occur in with marked deficits in naming of defined lists, and
normal ageing. The pathology is said to be present in additional loss of general knowledge. Speech remains
both Alzheimer’s disease and DLB. Historically, a dis- fluent, although the patient may make paraphrasic
tinction has been made between DLB and Parkinson’s errors (e.g. saying dog instead of cat, or clock instead of
disease, with the suggestion that a classification of watch) or use circumlocutions to compensate for miss-
DLB should be made if amnesia occurs within a year ing words. There may also be a reversal of the usual
of the onset of Parkinsonism, whilst a classification of temporal gradient, with preservation of recent com-
Parkinson’s dementia is presumed if amnesia occurs pared with distant memories.
after this time period. Recent work has failed to sup-
port this arbitrary cut-off, instead suggesting that DLB
and Parkinson’s dementia lie along a spectrum of dis- 3.5 Mild cognitive impairment
ease pathology (Ballard et al., 2006). The cognitive
profile is sub-cortical, with neuropsychiatric condi- Much has been made of the impact of impairment on
tions including delusions and depression, as well as social or occupational functioning in the definition of
characteristic well-formed visual hallucinations (e.g. and criteria for dementia. What then of ‘subsyndro-
the patient having the sensation of perceiving a child mal’ forms of any of the conditions above?
or perhaps an animal), which are more likely to persist For example, a barrister may score just above the
than in Alzheimer’s dementia (Ala et al., 1997). threshold for diagnosis on a dementia screening tool
such as the CAMCOG (a brief neuropsychological
battery designed to assess the range of cognitive func-
tions required for a diagnosis of dementia and to
Fronto-temporal
3.4
detect mild degrees of cognitive impairment).
dementia However, the same individual may be otherwise
unimpaired in their activities of daily living. This case
Fronto-temporal dementia (FTD) is a collective term example would not meet the criteria for dementia;
for a range of dementias associated with varying however, given the evidence of apparent decline in
underlying neuropathological findings. As such it is cognitive function, the neuropsychiatrist may be
purely a clinical diagnosis, although its presence may inclined to re-refer the patient for neuropsychological
warrant further investigation relating to contributing assessment in a year’s time to see if there is any change
pathology. in their cognitive score. The neuropsychiatrist may
Three main types have been described: frontal vari- also prescribe medication in order to decrease the rate
ant FTD (fvFTD); progressive non-fluent aphasia; and of cognitive decline, which may slow the progress of
semantic dementia. fvFTD presents with a syndrome the disease on average by 6 to 12 months (Burns et al.,
most reminiscent of the dorsolateral conditions 2000).
described above (see Section 2.1), with disinhibition Conditions such as this are increasingly adopted
and repetitive and/or antisocial behaviour. Memory is into the term mild cognitive impairment (MCI)
relatively spared but there is poor performance on tests (Petersen et al., 2001). Research focus on this pre-dis-
of executive function. There may be a progressive dys- ease state is increasing, with the hope that it may lead
phasia (difficulty with speech) marked by decline in to better predictions of who will go on to develop full-
language, with disintegration of grammar but usually blown dementia, study of biological disease markers
CHAPTER 15 COGNITIVE NEUROPSYCHIATRY 477
that may affect such a development, and prospective sufficient to meet diagnosis) becomes condition (e.g.
treatments that may prevent conversion (i.e. treat- Alzheimer’s disease). However, debate still continues
ments given in the early stages of MCI before demen- as to how to accurately define MCI; for example, what
tia development). Current conversion rates from MCI would constitute a deviation in cognitive or intelli-
to dementia are estimated at somewhere between 2 gence score from age-adjusted norms sufficient to
and 30 per cent per year (Bruscoli and Lovestone, warrant a diagnosis of MCI? These questions are
2004). Variation in the estimate is likely due to incon- important in that the prognosis for individuals with
sistencies and variability in the criteria used in selec- MCI appears to be worse than for the general popula-
tion of the populations that have been studied. It has tion – an increased rate of mortality has been sug-
been suggested that a ‘critical mass’ of pathology has gested (Gussekloo et al., 1997).
to be reached before prodrome (early symptoms not
SUMMARY OF SECTION 3
• Dementia is a syndrome involving the ‘four A’s’, namely amnesia, aphasia, apraxia, and agnosia.
• The clinical and cognitive profiles differ for cortical and sub-cortical dementias.
• Alzheimer’s disease is associated with a global cognitive decline.
• Vascular dementia is associated with a ‘patchy’ distribution of cognitive deficits.
• Dementia with Lewy bodies appears to lie along a spectrum of disease states with similar cognitive
deficits.
• Fronto-temporal dementia presents with a relative sparing of memory, but patients may manifest
language or semantic deficits.
• Mild cognitive impairment is a term used where there appears to be a decline in cognitive function
that is not of a sufficient level to be classified as dementia. Increasing research is being conducted into
this condition.
4 PSYCHOTIC ILLNESSES
The German psychiatrist Kraepelin popularized the is an association between schizophrenia and neuro-
concept of dementia praecox, which in time would logical abnormality, with a higher frequency of neuro-
become what many consider to be the archetypal psy- logical signs in schizophrenia patients and their
chotic illness, schizophrenia (Kraepelin, 1919). Whilst relatives than in other primary psychiatric compari-
he would later downplay the prognosis of the condi- son groups. In contrast to the focal, or hard, neuro-
tion, he maintained that at its heart was a cognitive logical signs described in Section 3.2, these have been
profile that manifests as ‘Verblödung’ (deterioration), labelled ‘soft signs’ as they are not readily localizable to
‘Schwachsinn’ (mental weakness), or ‘Defekt’ (defect). a specific part of the brain. Examples include impaired
Since this time more empirical work has supported motor coordination or the abnormal preservation of
Kraepelin’s initial observations, namely of cognitive neonatal reflexes commonly lost at 6 months of age,
deficits in patients with psychosis. It is clear that there such as the tendency to grasp objects placed in the
478 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
hand. It seems a logical assumption that the underly- clear risk factor for those later diagnosed with schizo-
ing neuropsychological deficits are equally complex. phrenia. This finding has been replicated in further
Of further interest are the neurological conditions studies, with schizophrenia groups appearing on aver-
that present with an increased likelihood of psychosis age to have IQ scores of 4–8 points less than the nor-
(e.g. Parkinson’s disease and epilepsy). This section mal cohort average (Reichenberg et al., 2002).
will consider the neurocognitive profiles differentiat- However, given this is the average value, the findings
ing psychotic illness (usually schizophrenia) from the indicate that a substantial proportion of the general
normal population. This will be followed by a discus- population will have IQ scores lower than those of the
sion of what is known of cognitive dysfunction associ- schizophrenia group. Similarly, not all patients with
ated with the range of symptoms under the umbrella schizophrenia have low IQ.
term psychosis. We will then consider more demon- There are two main possible implications of this
strably organic conditions and how what is known of that relate to our consideration of psychosis. Firstly,
their pathology can aid this discussion. there may be a causal link. For example, low IQ may
compromise abilities such as conceptual reasoning,
resulting in psychosis (or, in other words, high IQ is
4.1 Normal condition protective). Secondly, there may be a confounding fac-
tor, i.e. brain abnormality may lead to both low IQ and
Schizophrenia in the general population is known to schizophrenia. Regarding the latter, evidence indi-
be associated with cognitive deficits. David et al. cates that obstetric-related cerebral damage does not
(1997) were able to study such effects in a group of account for the association between psychosis and
50 000 males conscripted into the Swedish army intellectual functioning (Gunnell et al., 2002).
between 1969 and 1970. Tests of verbal and visuo- Additionally, there appears to be no overt association
spatial abilities, general and mechanical knowledge, between cognitive impairment and brain structure as
and background data such as age were recorded at revealed by MRI when comparing patients with schiz-
conscription. These tests had previously been stand- ophrenia who are cognitively impaired with those
ardized against an entire conscript cohort from a pre- who are unimpaired (Ortiz-Gil et al., 2011).
vious year. In later life, 195 of the sample subjects were What is known is that additional decline occurs
admitted to hospital with schizophrenia. Low IQ, and within the first few years of psychotic illness, but not in
in particular poor performance on a verbal task and all groups (see Table 15.2; Weickert et al., 2000).
the mechanical knowledge test, even following correc- Functioning then usually remains stable, with the
tion for general intellectual functioning, emerged as a exception of groups who are chronically hospitalised
TAB LE 15. 2 Cognitive impairments in patients with schizophrenia. Adapted from Weickert et al., 2000
where it may deteriorate further in old age (Palmer (reduced blood flow to the frontal region). However,
et al., 2009). The majority of people with schizophrenia Weinberger’s explanation has yet to be consistently
appear to have had satisfactory levels of functioning at supported.
school, although not necessarily at the level of their
peers (or siblings). It may be that deficits of attention Correlation between psychotic
4.1.1
and executive functioning may be central features of symptoms and cognitive deficits
schizophrenia independent of variations in IQ. Schizophrenia is not a unitary construct and the het-
The cognitive deficits outlined above manifest in erogeneity (group differences) may contribute to the
tasks such as the Wisconsin card sorting and Stroop observed variability in cognitive performance tasks.
tests. However, it is unsurprising that those with a Liddle and Barnes (1990) first pointed towards this
condition that affects general intelligence may do heterogeneity in a group of patients with chronic schiz-
worse at specific tests of cognition, in that, with wors- ophrenia using a battery of neuropsychological tests.
ening cognitive function, it becomes increasingly dif- Factor analysis is a method used to group a number
ficult to separate the contributions of specific vs of variables (in this case symptoms) into clusters based
general impairments. The deficits appear to apply to on correlations or levels of agreement between the
established as well as to drug-naive and first-episode variables. These groups, or underlying dimensions,
cases of schizophrenia illness, with a relative sparing are called ‘factors’. Analysis of neuropsychological test
of visuo-spatial function. scores in patients with schizophrenia identified three
Recent literature on schizophrenia has looked at the factors or syndromes: reality distortion (delusions/
role of the COMT enzyme (responsible for dopamine hallucinations); disorganization (positive thought dis-
breakdown; dopamine is known to have a role in the order, inappropriate affect, disorganized/bizarre
cause of the condition) in cognitive functioning. One behaviour); and psychomotor poverty (negative
variation of the gene responsible for the expression of symptoms), with an associated neuropsychological
this enzyme appears to have a greater effect on execu- profile for each, as shown in Table 15.3 (Liddle and
tive function and IQ than the other. Subjects with this Morris, 1991).
genetic variation appear to perform worse on working Schizophrenia is often described in terms of nega-
memory tasks (Goldberg et al., 2003) and make more tive and positive symptoms, with negative symptoms
perseverative errors on the Wisconsin card sort (Egan being those that represent deficits in relation to normal
et al., 2001). The suggestion is that abnormalities in functioning (e.g. flat affect), and positive symptoms
dopamine breakdown impair the cognitive functions being those that are not normally experienced (e.g.
of the prefrontal cortex and additionally increase the hallucinations). Subsequent work has shown that ‘neg-
risk of schizophrenia. ative symptoms’ such as social withdrawal/isolation,
However, neuroimaging studies (mainly fMRI; see apathy, and poverty of speech are linked to memory
Chapter 14) that have examined blood flow in the deficits. However, ‘positive symptoms’ (hallucinations,
frontal cortex of patients with schizophrenia in rela- delusions) are felt to have less of a clear link with neu-
tion to working memory tasks have yielded inconsist- ropsychological functioning or impairment. We will
ent results. Weinberger and colleagues explain this by discuss each in turn.
postulating reduced efficiency of prefrontal cortical
processing in schizophrenics (Weinberger et al.,
2001). This causes them to have more activation than 4.2 Hallucinations
healthy controls (i.e. hyperfrontal, or showing
increased blood flow in frontal regions) at low task Hallucinations are defined as perceptions that arise in
demands, as they work harder to ‘keep up’. As task the absence of an external stimulus. Studies demon-
demands increase, they begin to perform inadequately strate a tendency for patients with auditory verbal hal-
and have a drop in activation, becoming hypofrontal lucinations (‘hearing voices’) to perceive meaningless
480 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
TAB LE 15. 3 Syndromes of chronic schizophrenia. From Clinically, auditory hallucinations are often in the
Liddle and Barnes, 1990 form of a voice speaking about the person (e.g. ‘he’s a
bad person, look at him sitting there by himself ’).
Symptoms in each Impaired
syndrome neuropsychological They often manifest in conditions such as schizophre-
function in each nia, and indeed make up part of its diagnostic basis
syndrome (anatomical regions for this have already been sug-
Psychomotor poverty syndrome gested; see Section 2.3). By contrast, visual hallucina-
tions appear much more commonly in organic
Poverty of speech Conceptual reasoning
Decreased spontaneous
conditions such as dementia. It is particularly com-
Long-term memory mon in dementia with Lewy bodies (see Section 3.3).
movement
Unchanging facial expression Object naming Brugger et al. (1996) described ‘autoscopic’ hallucina-
Paucity of expression tions, namely perception of oneself as an external object,
gesture which can lead to the delusion that one has a double (or
Affective non-response doppelganger). This has been tentatively associated with
Lack of vocal inflection occipital temporal lesions (usually stroke or neoplasm),
Disorganization syndrome although the condition has also been linked to
Inappropriate affect Concentration Parkinson’s disease sufferers and to schizophrenia.
Poverty of content of
New learning
speech
Tangentiality 4.3 Formal thought disorder
Derailment
Pressure of speech Formal thought disorder (FTD) is most closely tied
Distractibility with the disorganization cluster or syndrome. It has
Reality distortion syndrome been likened to a fluent aphasia following lesions to
Voices speak to the patient Figure-ground perception Wernicke’s area, and clinicians have been shown to
Delusions of persecution have difficulty (when unaware of a patient’s formal
Delusions of reference diagnosis) in differentiating between the two condi-
tions. In schizophrenia, FTD is manifested by a deficit
sounds as meaningful speech, to have problems inter- in two areas: (1) a failure of the ‘pragmatics’ of speech
preting speech in the background of noise, and to mis- resulting in difficulty appreciating the conversational
perceive speech that has reduced phonetic clarity. needs of the listener, which has been likened to a defi-
Additionally, Frith (1992) has suggested that auditory cit in theory of mind; and (2) a deficit in semantic
hallucinations may be internally generated verbal dis- memory. See Box 15.2.
course (inner speech) misidentified by the patient as
arising from an external speaker. Indeed, brain imag-
ing studies have shown that when performing tasks 4.4 Negative symptoms
that require the generation of inner speech, those who
have experienced auditory hallucinations fail to acti- Negative symptoms that represent a decline or loss of
vate the medial temporal gyrus and supplementary function, such as lowered motivation, motor slowing,
motor areas. The result is that thoughts or actions are lack of initiative, and affective flattening, relate more
experienced as dissociated from a sense of will and are consistently to cognitive abnormality (particularly
perceived as hallucinations (in the case of speech) or deficits in executive function and memory) than do the
experienced as being under external control (the other psychotic syndromes described above.
patient believes someone is controlling their body) in Additionally, unlike other domains identified by Liddle
the case of motor activity (Frith, 1992). and colleagues (which have no prognostic implications),
CHAPTER 15 COGNITIVE NEUROPSYCHIATRY 481
Priming refers to a stimulus exposure directly influ- word, e.g. lemon–sweet (mediating word sour) or
encing the response to a later stimulus. In semantic black–chalk (mediating word white). Schizophrenia
priming the ‘prime’ and ‘target’ are associated (e.g. patients with FTD show enhanced indirect semantic
blue–sky) and may belong to the same category and priming when compared to healthy controls
share certain features. For example, ‘dog’ would be (Pomarol-Clotet et al., 2008). However, it is unclear
a semantic prime for the target ‘wolf’. Priming is whether this differentiates them from other schizo-
hypothesized to work due to spreading activation phrenia patients without thought disorders.
within neural networks.
In indirect priming the target words are only indi-
rectly related to the prime, usually via a mediating
negative symptoms demonstrate considerable stability of evidence before coming to a strong conclusion
over time. Using fMRI, Dolan and colleagues found that (for example, deciding a purse has been lost if it is
in both schizophrenia and depression, patients with not in its usual place, without making any attempt
negative symptoms, such as poverty of speech, showed to look for it in alternative places).
reduced left prefrontal cortical neural activity (Dolan 2. Attributional bias: deviances in attribution with a
et al., 1993). Negative symptoms are also often seen in tendency to externalize, i.e. to view others rather
neurological patients with frontostriatal dysfunction, than themselves as to blame in a predicament (see
such as Parkinson’s disease; indeed, it is of note that the also the related discussion of attributional bias in
clinical profile of Parkinson’s disease has much in com- Chapter 16).
mon with that of the negative symptoms.
3. Theory of mind deficits: deficits in understanding
the thoughts, desires, and beliefs of others (Sprong
et al., 2007).
4.5 Delusions
4. Bias against disconfirmatory evidence: patients
In contrast to the negative symptoms, positive symp- appear less able to disengage from their initial
toms are those that show a presence of abnormal men- interpretations of data, even when these are shown
tal function such as abnormal beliefs (delusions) and over the course of testing to become increasingly
abnormal perception (hallucinations). The cognitive improbable (Moritz and Woodward, 2007).
abnormalities subserving delusions are now thought
to have a direct bearing on the design of psychological Many of these concepts can be best understood in
interventions such as cognitive behavioural therapy. neurobiological terms by relation to a state of ‘hyper-
This is in contrast to an earlier view that delusions salience’ or ‘hyperimportance’. This means more
were not amenable to understanding and, by exten- importance is given to certain aspects of the environ-
sion, treatment by talking therapies. Four main cogni- ment than is justifiable (Kapur, 2003). Dopamine in
tive mechanisms have been identified relating to particular is felt to have a role in the salience distor-
delusional pathology: tion and the pathophysiology of psychosis. For exam-
ple, abnormal dopamine levels may cause the patient
1. Jumping to conclusions: namely a specific with schizophrenia to believe the television or news-
data-gathering bias, leading patients to terminate paper may have special salience or meaning. A sec-
data collection early on with insufficient weighing ondary inference may then form to make some sense
482 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
‘Mrs A’, a 100-year-old Caucasian woman, was home aides, whom she seemed unable to recog-
referred to the neuropsychiatric clinic by her gen- nize. When Mrs A’s granddaughter arrived at the
eral practitioner for evaluation of auditory halluci- house with her husband, Mrs A accused her grand-
nations and persecutory delusions. According to daughter’s husband of 20 years of being an impos-
Mrs A, she had begun hearing male voices some 10 tor. Mrs A then became combative and said there
months before, shortly after her 100th birthday. was a conspiracy against her. The granddaughter
The voices, which she attributed to ‘the Imps of called the patient’s doctor, and Mrs A was brought
Satan’, sang and cursed. Mrs A was convinced that to the Emergency Department.
other people could hear the ‘Imps’ and became Mrs A scored 27/30 on a repeat MMSE. More
angry with her daughter when the latter said she extensive neuropsychological testing of this patient
could not hear them. demonstrated numerous deficits (including poor
According to Mrs A’s family, in the 3 weeks before performance on the Wisconsin card sorting test
admission, the patient became increasingly preoc- and tests of verbal fluency (e.g. naming as many
cupied with the ‘Imps’ and increasingly suspicious words as possible in a minute), as well as in multiple
and fearful. On the day before admission, Mrs A other cognitive domains.
frantically telephoned her granddaughter to say that Adapted from Harrington (2007) and Cervantes
people in her house were trying to kill her. In reality, et al. (2006)
the only people in the house were Mrs A’s long-time
CHAPTER 15 COGNITIVE NEUROPSYCHIATRY 483
(who may not even be present); (3) mirrored-self behaviour (Coltheart, 2007). For him the mirror was
delusion, in which an individual, again typically with not a reflecting surface but a window onto external
right hemisphere impairment, reports that the person space. Since the image of his own face appeared to be
they see in the mirror is not them but a very similar- located in that external space, it would be a reasonable
looking stranger. inference that it could not possibly be his own face.
The term ‘cognitive neuropsychiatry’ was actually A problem for explaining delusions as rational
coined by neuropsychologist Hadyn Ellis in 1991 inferences (conscious or unconscious) is why the indi-
(Coltheart, 2007) in relation to ideas about Capgras vidual does not abandon their delusional belief given
delusion first developed by Ellis and Young (1990). how unlikely it is to be true and how many other peo-
William James (1890/1950) had suggested that in ple assure them of its falsity. To make the problem
many cases the delusions of the ‘insane’ were ‘. . . cer- even more acute, not everyone who lacks a discrimi-
tainly theories which the patients invent . . .’ to account natory autonomic response to familiar and unfamiliar
for abnormal experiences they suffered. As described faces develops a Capgras delusion; the majority of
in Chapter 4, Ellis and Young (1990) hypothesized people with left hemiplegia do not develop a
that patients with Capgras delusion may have a ‘mir- somatoparaphrenic delusion; and mirror agnosia does
ror image’ of prosopagnosia, in that although their not necessarily result in a mirrored-self delusion
conscious ability to recognize faces using the ventral (Coltheart et al., 2011). To buttress a cognitive account
visual pathway is intact, they may have damage to the of delusion formation, it is necessary to suppose that
dorsal pathway that produces the automatic emo- sufferers have an additional deficit in evaluating the
tional arousal to familiar faces. This would lead to the likelihood of their beliefs. This ‘two-deficit account’
experience of recognizing someone while feeling has been promoted especially by Coltheart and col-
something was not ‘quite right’ about them because leagues (e.g. Coltheart, 2007; Coltheart et al., 2011).
the usual emotional response to them was lacking. The proposal is that, in addition to what we may call
Attempting to make sense of this strange experience their ‘primary’ lesion, deluded individuals also have a
could result – in an almost rational way – in the delu- second impairment of the right hemisphere, possibly
sion that the person is actually an impostor. Support involving the lateral prefrontal cortex. If the hypothe-
for the Ellis and Young hypothesis came from studies sized deficit in belief evaluation is provisionally
showing that, as predicted, Capgras sufferers do not accepted, then an explanation is required for why it
show differential autonomic responses to famous results only in a monothematic delusion rather than
faces and unfamiliar faces (Ellis et al., 1997; Hirstein generating a proliferation of bizarre beliefs. Coltheart
and Ramachandran, 1997) or to pictures of family et al. (2011) suggest that this is so for two reasons.
members and strangers (Brighetti et al., 2007). First, the belief evaluation system is not abolished but
A somatoparaphrenic delusion could arise in a sim- only impaired. A somatoparaphrenic delusion can be
ilar fashion. The patient cannot feel or move the limbs temporarily eliminated by introducing cold water into
in question, therefore they cannot be theirs, and must the left auditory canal of the sufferer, a stimulus known
belong either to someone else in the vicinity or to to increase right hemisphere activation, so possibly
someone with similar-looking limbs, such as a parent. serving to ‘rev up’ the impaired belief evaluation sys-
Along the same lines, a patient with a mirrored-self tem located there. Secondly, this impaired evaluation
delusion was found also to suffer from ‘mirror agno- system is adequate for rejecting most bizarre ideas
sia’, or loss of knowledge about how mirrors work. that might suggest themselves to a person, but it fails
Asked to grasp an object held up behind him to reflect when there is continuously or repeatedly present data
in the mirror facing him, this patient reached for- to support a bizarre idea. A somatoparaphrenic delu-
wards to the mirror instead of back behind him, and sion is continually supported by the inability to feel or
despite repeated attempts was unable to correct this move the paralysed limbs, and a Capgras delusion is
484 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
repeatedly reinforced by encounters with the spouse support remains to be seen. It serves, however, as a
who does not elicit a normal autonomic response. good example of what a cognitive neuropsychiatric
The extent to which the two-deficit theory of account of a ‘psychotic’ symptom can look like.
monothematic delusions will find further empirical
SUMMARY OF SECTION 4
• Psychosis is not a unitary construct, and has a large overlap with cognitive dysfunction.
• Whilst the literature gives a good indication of where cognitive deficits lie in psychosis (e.g. IQ), it is
clear that there are also cases of schizophrenia and psychosis that do not demonstrably display cogni-
tive impairment.
• Experiential distortions in schizophrenia have been described in cognitive terms, for instance ‘jump-
ing to conclusions reasoning’; however, notions such as hypersalience and disconnectivity syndrome
both hold a degree of usefulness for conceptualizing schizophrenia.
• The clinical manifestations reflect the observation that delusions and other psychotic phenomena
arise in part from attempts by the sufferer to make sense of a seemingly disorganized ‘hypersalient’
world with reduced or disturbed cognitive capacity to address these extra demands.
• Monothematic delusions have proved to be an important ‘test-bed’ for the notion of a cognitive
account of a psychiatric symptom.
5 DEPRESSION
The essential feature of a depressive disorder is a the occurrence of the disorder in different organic
period of at least 2 weeks during which there is either conditions. On a pragmatic level, many organic condi-
depressed mood and/or reduction in capacity for tions labelled as ‘depression’ appear to respond to
enjoyment (anhedonia) (DSM-IV; American treatment (both pharmacological and psychological)
Psychiatric Association, 2000). The individual must regardless of aetiology. However, depression is a het-
also experience at least four other symptoms drawn erogeneous condition. The variability of organic
from a list that includes, amongst others, feelings of pathology in conditions that contribute to depression
guilt, difficulty thinking, concentrating, or making adds to problems in the study of the depression
decisions, and reduction or decrease in energy or syndrome.
activity levels (anergia). The symptoms must persist
for most of the day nearly every day and be accompa-
nied by clinically significant distress and impairment 5.1 Emotion
in social or occupational functioning. It is of note that,
by virtue of these two core symptoms, the definition of The loss of a job is a classic example of an event that
‘depression’ allows for a diagnosis in the absence of has the potential to cause considerable variability in
alteration of mood. This may be both beneficial and emotion. The interpretation of such events is crucial,
potentially problematic in terms of consideration of as they may be ‘depressogenic’ to one individual but
CHAPTER 15 COGNITIVE NEUROPSYCHIATRY 485
have the completely different effect of inspiring ‘hap- contribute to emotional feeling. Patients with amyg-
piness’ in another. In cognitive terms, this may be dala damage do not differ in their phenomenological
explained by one individual taking the view that job experience of events but may attach less emotional
loss is bad news and developing subsequent negative significance to them (Vuilleumier et al., 2004).
thoughts relating to their self-esteem and future.
However, another person may see it as an opportunity
for a fresh start, and take an optimistic view (you will
find a similar discussion of the importance of cogni-
Neuroanatomical
5.2
tive appraisal in the generation of emotion in correlates of depression
Chapter 16). Important cognitive factors relevant to
this process include consideration of how negative One of the seminal papers looking at the functional
affect may be suppressed. Studies have employed fMRI neuroanatomy of the emotional modulation of cogni-
imaging in the context of cognitive ‘reframing’ of tive processing in depressed patients is described in
events. Converging evidence points towards ventral- Box 15.4.
frontal areas of the brain being involved in changes in Neuroimaging studies implicate the areas of pre-
affect, as well as in the capacity to regulate emotion frontal, cingulate, and limbic structures (Dolan et al.,
and cope with distress (Taylor et al., 2003). In addi- 1994; Drevets et al., 1997) in depression, with most
tion, voluntary suppression of negative emotion in consistent findings for ventromedial abnormalities.
healthy individuals has been found to recruit limbic These areas intercommunicate with structures involved
and paralimbic brain regions including the amygdala in emotion and autonomic responses to psychological
and prefrontal cortex (Phan et al., 2005). Of note is a insult, which play a central role in associating emo-
possible dissociation between anatomical regions tional experiences with decision making. However,
involved in ‘feeling’ versus ‘evaluating’ emotional studies investigating the specific brain regions involved
events. The hypothalamus, cingula, and insula are have yielded mixed results. Meta-analysis of fMRI
thought to ‘feel’ emotional events and process emo- studies has revealed that patterns of abnormality are
tion-laden states. Other structures, usually the amyg- not necessarily consistent and few studies have com-
dala (Damasio, 1999) are thought to ‘index’ the bined neuropsychological and functional imaging
occurrence of an emotional event but not necessarily paradigms to investigate the correlation between brain
Elliott and colleagues took 10 depressed patients compared to healthy controls. The dorsolateral
and 11 healthy volunteers. They performed an emo- prefrontal cortex is known to be involved in higher
tional go/no-go task whilst undergoing functional cognitive functions, such as working memory, epi-
magnetic resonance imaging (fMRI). In separate sodic memory retrieval, attentional set shifting, and
blocks of trials, they pressed a button in response to planning. The increased response to sad targets
one of happy, sad, or neutral words but did not suggests a distinct system for the processing of
respond to words in the other two emotional cate- mood and a preference for the processing of mate-
gories. The task allowed comparisons of the neural rial whose content is in keeping with a depressed
responses to happy, sad, and neutral words. patient’s emotional state. In other words, a
In a region of the brain known to be associated depressed person appears to be better able to
with depression (the dorsolateral prefrontal cor- attend and process sad material. You will find a
tex), fMRI findings indicated that depressed patients similar discussion of such cognitive biases in
showed an enhanced neural response to sad words Chapter 16.
486 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
areas and prefrontal functioning (Rogers et al., 2004). (Giovannoni et al., 2000), a condition whereby
There may be a number of reasons for these inconsist- Parkinson’s individuals self-administer medication in
ent results, ranging from methodological variability excess of levels prescribed by their physician, in fact
among the studies themselves to clinical heterogeneity reflects patients’ attempts to treat their low mood
of the depressive groups. Perhaps most likely is the rather than achieve an elevation of mood (Okai et al.,
possibility that depression is not the result of abnor- 2011).
mality within a single brain area, but the result of mul-
tiple system processes affecting discrete but functionally 5.3.3 Anergia
interlinked pathways. Energy levels are less easily linked to a pathological
state. A framework has been suggested that involves
an integrated evaluation of expected rewards and
energetic costs associated with continued perfor-
Depression phenotype
5.3
mance (Boksem and Tops 2008), implying an over-
and how it relates to lap with the frameworks suggested for both low
mood (attentional bias causing a tendency to focus
cognition on costs) and an undervalued expectation and
experience of reward. This results in reduction in
What, then, of depression clinically? How does one
motivation.
relate the concept of a dimensional approach often
adopted in neuropsychology with the categorical
approach afforded by a diagnosis of major depression
in psychiatry?
5.4 Stroke
The prevalence of depression is high following stroke
5.3.1 Mood (30 per cent), especially in the first few weeks after the
In cognitive terms, Elliott et al.’s (2002) study, along event (Robinson et al., 1984). Additionally, and unsur-
with others, demonstrates an enhanced neural prisingly, rates of cognitive impairment are high fol-
response to sad stimuli in depressed individuals. The lowing stroke (Hackett and Anderson, 2005; Hackett
observation of a greater capacity for depressed indi- et al., 2005).
viduals to ‘capture’ sad material is consistent with a Studies relating stroke, depression, and cognitive
theory of depression in which depressed people find it impairment have generated mixed results. Some have
increasingly difficult to ‘exit’ a vicious spiral. Emotional shown such an association (Bolla-Wilson et al., 1989;
disturbance leads to an attentional bias towards sad Desmond et al., 2003; Robinson et al., 1986; Spalletta
events, which leads to increased salience of negative et al., 2002), whilst other studies have failed to do so
material compared to healthy controls. See also (Dam, 2001; Madureira et al., 2001). Still others have
Chapter 16 for a similar discussion of cognitive biases. suggested left hemisphere-damaged patients with
major depression are more likely to exhibit cognitive
5.3.2 Anhedonia deficits (Narushima et al., 2003; Spalletta et al., 2002).
Regarding anhedonia, there is increasing recognition Cognition is usually assessed by a score on the Mini-
of the role of the mesolimbic dopamine system in Mental State Examination (MMSE). However, Bolla-
depression, given the role of anhedonia or altered Wilson et al. (1989) administered a variety of tests of
reward processing as a central feature of the condi- executive function, language, and temporal orienta-
tion. Dopaminergic mechanisms in the ventral teg- tion, and again demonstrated a cognitive deficit in
mental area and nucleus accumbens are thought to those with major depression and left lesions, in com-
play a role in the mediation of natural rewards, and parison to those with left lesion alone. Furthermore,
indeed it has been suggested that the phenomenon social factors such as living alone, place of residence,
of hedonic homeostatic dysregulation syndrome social support, and social isolation appear consistently
CHAPTER 15 COGNITIVE NEUROPSYCHIATRY 487
associated with depression following stroke, but A study by the same group prospectively followed up
factors such as prior history of depression have not a large number (n = 217) of patients aged over 60 with
been shown to be. This lack of an association may be major depression (Sheline et al. 2010). Using fMRI,
partly accounted for by the low number of studies that they found that an increase in the number and severity
record this as a variable in data collection and analysis of vascular changes (distributed across the cortex and
(Hackett and Anderson, 2005). sub-cortex) was associated with depression severity (as
The profile described above relates to single vascu- assessed by the Montgomery-Asberg Depression
lar events. Evidence of vascular change from MRI and Rating Scale) and cognitive deficit (namely processing
post-mortem investigations has contributed to the speed, executive function, and language skills). The
idea of a ‘vascular depression’ (Taylor et al., 2004). amount of vascular change apparent on imaging also
This proposes a depression that appears to have some appeared to predict antidepressant treatment response.
phenomenological differences from ‘non-vascular’ It was hypothesized that the vascular contribution is an
depression, being characterized by less depressive ide- effect on frontal white matter integrity, which then
ation (i.e. guilt) but more psychomotor retardation, results in deficits in neuropsychological functioning
apathy, lack of insight, and functional disability and mood regulation, i.e. the same aetiological mecha-
(Alexopoulos et al., 1997). However, repeated ischemic nism may account for both sets of findings.
(involving restricted blood supply) events are also
known to be relevant to the aetiology of vascular What about depression in other
5.4.1
TAB LE 15.4 Depression subtypes in Parkinson’s disease address the cognitive (and depressive) component of
their illness.
Clusters Common Uncommon
symptoms symptoms
Group I
(anxious-
As Group II, but
also:
• Anhedonia
5.5 Traumatic brain injury
depressed) • Prominent
n = 44 worry Greater attention has been focused on the relationship
• Tension/ between lesion location and depression in stroke than
restlessness
in traumatic brain injury (TBI). This is perhaps related
• Irritability
• General to the difficulty in localizing anatomical regions dam-
anxiety/panic aged by TBI.
• Fear However, Jorge and colleagues prospectively fol-
• Autonomic
symptoms lowed up a group of patients (n = 91) with traumatic
Group II • Sad/empty • Anhedonia brain injury, along with a group (n = 27) who had mul-
(depressed) mood • Worthlessness tiple trauma without evidence of central nervous sys-
n = 46 • Loss of interest • Hopelessness tem involvement (Jorge et al., 2004). All patients were
• Slow thinking • Guilt
followed up at 3, 6, and 12 months. The two groups had
• Loss of
confidence comparable traumatic injuries and functional impair-
• Lack of energy ment (using validated scales of injury and functional
• Poor independence). Significantly more brain injury
concentration
patients (33 per cent) developed symptoms consistent
Group III • Prominent • Depressive
(anxious) worry symptoms
with major depression during the first year than did
n = 113 • Tension/ non-brain injured patients (7.4 per cent). Depressed
restlessness individuals also had significantly worse executive
• Moderate functioning as measured by the numbers of preserva-
probability of
severe anxiety- tive errors in the Wisconsin card sorting test and the
related symptoms completion times for the Trail making tests. In addi-
Group IV • No prominent • No symptoms tion, those with history of ‘mood disorder’ were found
(healthy) symptoms to be more likely to develop depression.
n = 310
A further feature of TBI is an indication that depres-
sion following traumatic injury may be related to
depressive symptoms. There may be two potential rea- insight or awareness of disability such that those with
sons for such a finding in Group III. The first is that poor insight have less depression (Amador et al., 1994;
this group had a higher degree of cortical pathology in David, 1990; Prigatano and Schacter, 1991). Ponsford
addition to the more usual sub-cortical changes seen in and colleagues report on a longitudinal sample of
Parkinson’s disease (the conditions can also affect cor- closed head injury patients, demonstrating that an
tical areas, and some have argued that the amount of improvement in insight coincides with onset of a dys-
cortical involvement defines where along the spectrum phoric mood state (depression, anxiety, and reduced
from Parkinson’s dementia – more sub-cortical – to self-esteem) (Ponsford et al., 1995). These results
dementia with Lewy bodies – more cortical – an indi- appear to indicate that as the individual becomes
vidual may lie). The second reason may be based on more self-aware their mood worsens. However, there
the observation that this group had a higher levodopa are inconsistencies in how deficits of insight are
load than many of the other groups. Levodopa is pre- associated with neuropsychological and injury varia-
scribed by the neurologist in order to treat the motor bles (Bogod et al., 2003; Prigatano and Schacter, 1991).
component of the illness. Perhaps this group needs a So what are the links between brain injury, cognitive
higher dose of dopaminergic stimulation in order to impairment, and mood? They are often non-specific,
CHAPTER 15 COGNITIVE NEUROPSYCHIATRY 489
such as in the example in Box 15.5, where the brain Furthermore, it remains unclear whether emotional
injury was thought to have occurred because of an disturbances such as depression and anxiety in their
obstruction in one of the arteries that supply oxygen to own right impair neuropsychological test perfor-
the brain. However, there may be direct or indirect rela- mance, or whether brain injury predisposes an indi-
tionships between the conditions. For instance, those vidual to emotional disturbance. If so, why do so many
with a history of depression may be more likely to sus- patients suffering anxiety disorders without brain
tain brain injury (for example, due to self-injury) and injury tend to perform normally on cognitive testing?
therefore develop cognitive impairment. Additionally, Does neuropsychological impairment cause emo-
those with cognitive impairment may reflect an associ- tional disorder, and does emotional distress influence
ation between low mood and brain injury (for example, performance on neuropsychological testing?
motor vehicle accident associated with alcohol abuse Various methods can be used to address these ques-
and co-morbid depression). Finally, there may be con- tions. One is to examine cognitive deficits before and
founding variables that contribute to both conditions after antidepressant treatment for depression. For
(for example, alcohol misuse may lead to an increased example, Fann et al. (2001) used this method in exam-
propensity for cognitive impairment, but alcohol ining cognitive deficits in patients with mild traumatic
misuse is also often co-morbid with low mood). In such brain injury (n = 15). Of these, 66 per cent had full
cases the traumatic injury would be incidental. Whilst remission of their depressive symptoms and were found
difficult to prove, research should aim to tease out and to have improvements in psychomotor speed and
verify which are the direct associations and which are short-term verbal and visual memory. Another method
confounds. would be to compare individuals with both major
BOX 15.5 CASE STUDY Adapted from Trimble and Cummings (1981)
A 58-year-old male barrister was admitted to hos- des-cribed lethargy and depressive and persecu-
pital after being found unconscious at work. On tory feelings with suicidal ideation. His speech
examination he was lethargic with occasional peri- was slow and deliberate, but there was no dys-
ods of arousal. phasia.
He gradually recovered and was discharged from MRI demonstrated recent strokes in the sub-
the hospital. At home, a marked change in his behav- cortical region. Formal neuropsychological evalua-
iour compared to his pre-morbid activity was noted. tion revealed slowness and difficulty in sustaining
He was often unresponsive, lacked motivation, and attention. He had a verbal/performance discrep-
spent much of his time lying down or sleeping. He ancy of 38 points on the Wechsler Adult Intelligence
tended to overeat, put on weight, and occasionally Scale (WAIS), and memory for visual and verbal
wet himself. There was a change in mood with labil- material was poor.
ity and tearfulness, and his partner reported that he He responded well to an antidepressant but medi-
was often low in mood and this was not amenable to cation for his delusional belief caused him to sleep
reassurance. even more. It was therefore stopped. He was
Although during the war the patient had been dis- referred to a day centre where he was able to under-
charged from the army with a label of ‘nervous take planned daily activities under supervision.
breakdown’, he had no further psychiatric problems Although this is not an obvious case of traumatic
after leaving the service, and had been steadily brain injury, because the injury was caused by an
employed in his profession. arterial obstruction not an external force, it does
On examination 6 months after discharge show the non-specific connections between brain
from the hospital, he was emotionally labile and injury and behavioural symptoms.
490 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
depression and TBI with those having lesser severities memory impairment (rather than the low mood). This
of depression and TBI. It would then be possible to look group of patients may show inconsistent performance
for cognitive differences among the groups. Rapoport on cognitive tests, often because they become anxious
et al. (2005) conducted such a comparison and found when asked to perform tests they perceive as difficult.
no difference in severity of injury between groups but Factors suggestive of pseudodementia are a past his-
poorer cognitive functioning on measures of working tory of depression and abrupt onset of illness, and the
memory, processing speed, and verbal memory patient tends to highlight the memory deficit and typ-
amongst the more depressed group. Subjects with ically responds with ‘I don’t know’ when asked ques-
major depression were also found to have more perse- tions designed to test their memory (the patient with
verative errors. These findings remained after control- severe Alzheimer’s dementia will often quite freely
ling for past history of depression and age. give a wrong answer). The ‘dementia’ component often
manifests itself in deficits in attention, free recall,
motor speed, word fluency, and syntactic complexity
5.6 Pseudodementia (Emery and Oxman, 1992). Patients appear to recover
seemingly full cognitive capability when the depres-
Finally, a proportion of elderly individuals with sive episode subsides, even when it has been untreated.
depression present a syndrome of dementia that sub- However, a follow-up study by Alexopoulos et al.
sides on resolution of the depressive symptoms. This (1993) of elderly individuals with pseudodementia
group are said to be suffering from pseudodementia. found that over the course of 3 years the pseudode-
In general terms, they are a group with objective low mentia group were almost five times more likely to
mood, but their subjective complaint is usually of develop an irreversible dementia.
SUMMARY OF SECTION 5
• Neuroimaging studies in patients with primary depression have found structural and metabolic
abnormalities in regions of the prefrontal cortex.
• These brain regions appear related to the cognitive biases that patients with depression experience,
for instance an enhanced ability to notice sad words.
• Depression following brain injury is most likely a ‘multi-brain-system’ process.
• The occurrence of depression in stroke, and in particular the observation that it is more likely to
occur in the early stages of stroke, may support the idea that (akin to the process of physical recovery
of limb weakness following stroke) there may be an initial failure of brain mechanisms to maintain
homeostatic emotional control in a period of brain insult.
• A relatively non-specific link with cognition appears to be emerging from the literature, which likely
reflects the fact that several distinct but interconnected systems regulate mood, such as affect, cogni-
tion, sleep, appetite, psychomotor activity, emotional regulation, and homeostatic drives.
• When these systems are perturbed, whilst the most obvious manifestation may be a ‘mood disor-
der’, there is an association with other neuropsychological functions.
• Social influences (for example work stress) may result in failure of the remaining system to maintain
homeostatic emotional control in times of increased cognitive demand, with more research needed
in relation to directional influences or the cause-and-effect relationship between cognition and affect.
• The aetiologies of mood disorder may be diverse, but the neural dysfunctions underlying the clinical
manifestations are felt to be similar. This conceptualization of brain systems involved in mood disor-
ders may prove useful for research and testing.
CHAPTER 15 COGNITIVE NEUROPSYCHIATRY 491
6DISINHIBITORY
PSYCHOPATHOLOGIES
This section deals with neuropsychological profiles in Rauch, 2000) have been interpreted as ‘compulsive’ in
obsessive–compulsive disorder (OCD), hoarding, and their behavioural phenotype. Additionally, the devel-
impulse control disorders (ICDs) in those with brain opment of obsessive–compulsive behaviours has been
disease. Investigation into phenomenological differ- noted following traumatic brain injury in sufferers
ences between these conditions and their association with no history of OCD prior to the injury (Stengler-
with discrete pathologies can potentially add to our Wenzke et al., 2003). There is an association with
understanding of them. Tourette’s syndrome, other tic disorders, and possibly
These disorders are included together in this sec- Huntington’s disease (Cummings and Cunningham,
tion because they all appear to have at their core a less- 1992; Mell et al., 2005). Finally, there is evidence of a
ened control over response inclinations. Nevertheless, causal association between OCD symptoms and a
there are some important differences between the dis- bacterial infection resulting in what is known as the
orders. In some, patients appear driven by the pursuit ‘paediatric autoimmune neuropsychiatric disorder’
of pleasure or gratification (ICDs) whilst in others (PANDAS) (Snider and Swedo, 2004). PANDAS suf-
they appear driven by an effort to avoid anxiety (e.g. ferers have been reported to display writhing, and
OCD). It would seem that these characteristics (which jerky and wriggling movements, which has led to
can be conceptualized as deficits in decision making) speculation that basal ganglia are implicated in the
may be well fitted to a neuropsychological framework disorder, since this is the part of the brain that is linked
and to our understanding of cognition. with the initiation and suppression of movements.
OCD has high co-morbidity with many other disor-
ders, such as depression, other anxiety disorders like
body dysmorphic disorder, and trichotillomania (a
6.1Obsessive–compulsive compulsive disorder marked by repeated pulling out of
disorder one’s hair). Some have proposed that disinhibition may
underlie both thought and behaviour in OCD, with the
Obsessive–compulsive disorder (OCD) consists of cognitive symptoms (such as intrusive thoughts and
two core features: intrusive distressing thoughts that mental rituals) and the behavioural symptoms (such as
are recognized as one’s own, and repetitive, compul- washing and checking rituals) both involving a failure
sive acts that usually arise in an attempt to neutralize to inhibit or shift attention away from these repetitive
the thoughts (see DSM-IV, American Psychiatric phenomena (Tolin et al., 2002).
Association, 2000). It has a prevalence of some 2–3 per Neuroimaging findings in OCD are perhaps the
cent of the population, yet has been relatively under- most replicated in the psychiatric literature and reveal
studied in comparison to many other neuropsychiat- physical and functional abnormalities in sub-cortical
ric conditions. In this section we aim to bring together structures. Mataix-Col and colleagues (2004) have
what is known of the cognitive and biological compo- contributed a body of work on this condition indicat-
nents of the disorder. ing different symptom domains in OCD that have dif-
There is much to lend support to the concept of fering and distinct neural correlates. The putamen,
‘organicity’ of this condition. In animal models, repet- globus pallidus, and thalamus are involved in check-
itive, stereotyped behaviours (e.g. circular pacing) fol- ing symptoms; the bilateral ventromedial prefrontal
lowing the administration of dopamine (Graybiel and cortex and right caudate are implicated in washing
492 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
symptoms; and the left pre-central gyrus and orbito- therefore learned less than controls. When external
frontal cortex play a part in hoarding behaviour organization was employed (semantically cued recall
(Mataix-Cols et al., 2004). PANDAS individuals also on a verbal learning task), there was an improvement
appear to have MRI changes in the basal ganglia. The in this apparent frontostriatal deficit. Savage et al.
possible involvement of the basal ganglia, and the speculated that the failure in encoding relevant infor-
observation that impaired inhibitory processes seem mation could lead to fragmented memory for repeti-
to be central to the symptoms and neuropsychology of tive episodes, instances of which are difficult to
OCD, suggest that there is clear merit in investigating differentiate. So the OCD individual might think, ‘Did
whether inhibitory failures contribute to any aspects I lock the door?’, ‘Was that today or yesterday?’, and
of cognitive deficit in OCD, specifically with consid- ‘How can I be sure which?’. Purcell and colleagues
eration as to whether the process is implicated in obtained similar findings using the Cambridge
thoughts or actions, or indeed both. Neuropsychological Test Automated Battery (Purcell
Veale et al. (1996) looked for evidence of slowness et al., 1998; Robbins et al., 1994), purported to be dis-
of thought and impaired executive functioning in criminatory between the cognitive profile of early sub-
OCD sufferers, akin to similar symptoms demon- cortical and cortical disease. In addition, apparent
strated in sub-cortical organic conditions (see Section spatial working memory deficits have also been dis-
2.5). They used the attentional set shifting task and the covered (Van Der Wee et al., 2003). The findings
Tower of London test (see Chapter 10), with OCD appear to reflect the clinical phenotype of OCD,
subjects being matched in relation to IQ with healthy namely that of doubting one’s own memory and men-
controls. No specific memory deficits were detected tal slowness (due to internal errors and perseveration,
compared to controls. In the Tower of London test, which is reminiscent of a sub-cortical profile).
whilst no differences were found in the total number A minority of patients with OCD do not respond to
of errors, differences were found for time spent in cor- any medical or psychological treatments (known as
rection of such errors. OCD sufferers seemed to have treatment-resistive OCD). If their distress is of suffi-
a deficit in generating alternative strategies when they cient severity, they may be judged to warrant what is
had made a mistake. They also appeared impaired in known as psychosurgery. This usually involves removal
their ability to learn from errors in the set shifting of a frontal part of the brain. One study compared
task. Overall, this may suggest that OCD patients OCD sufferers following surgery with unoperated-on
encode important information more poorly than con- controls. The psychosurgery group were highly hetero-
trols and encode too much irrelevant information, geneous in terms of anatomical region of brain oper-
leading them to become more distractible and to show ated on. The study found mixed improvement in OCD
increased perseveration with (repetition of) incorrect symptoms following surgery and preserved neuropsy-
strategies. In other words, the findings reflect atten- chological functioning on the whole (Hay et al., 1993).
tional problems in these individuals and/or a failure to Those with involvement of ventral striatum and ven-
appropriately encode information relevant to the self- tromedial frontal areas did poorly on the Wisconsin
selection of actions. Savage et al. (2000) used the Rey- card sort task; those with dorsolateral lesions did
Osterrieth Complex Figure Test (requiring subjects to poorly on Performance IQ.
draw a complex interlinked figure and then redraw it However, there are several limitations to the work
following a period of delay to assess ‘non-verbal’ on neuropsychological functioning in the OCD group.
recall; Rey, 1941) to look at non-verbal memory in Many studies have failed to control for co-morbidity,
OCD individuals. Their findings appeared to suggest a failed to match IQ in subjects, and failed to take into
failure to encode the most relevant information, but consideration the varying degrees of duration and
what was encoded stayed in memory and was severity of the OCD condition. Conclusions were also
retrieved. However, patients appeared to use less sys- drawn that at times could more plausibly be applied to
tematic organizational strategies during encoding and the fact that many OCD individuals also suffer from
CHAPTER 15 COGNITIVE NEUROPSYCHIATRY 493
depression. Additionally, there has long been a discus- show the involvement of sub-cortical regions
sion of the ecological validity of many of the tests used (Anderson et al., 2005; Volle et al., 2002). A report on
(in particular, those of executive functioning). It is a number of cases by Anderson et al. (2005) found no
apparent that OCD sufferers, even where there is a difference between hoarding (n = 9) and non-hoard-
clear association with neurological illness, do not ing participants (54 brain injury controls) in terms of
appear to suffer hugely from cognitive deficits, whilst verbal and non-verbal intelligence, but trends towards
at the same time still being very functionally impaired. significance in the Tower of Hanoi task and memory
What is unclear is how much the disability is associ- tasks. The implication may be that there are two main
ated with the illness and how much it is due to second- reasons for the clinical manifestations of hoarding: 1)
ary factors such as specific, cognitive deficits. an executive planning deficit that may result in a fail-
ure to discard objects; and 2) a memory deficit that
may contribute to excessive acquisition of objects.
6.2 Hoarding These results will, however, need to be replicated in a
larger sample.
Collecting and saving possessions is a basic animal Recently, an association between hoarding and
instinct that may have some evolutionary function. dopaminergic medication use has been demonstrated
Like other behaviours classified under the term ‘neu- in Parkinson’s disease (O’Sullivan et al., 2010), a con-
rosis’, hoarding behaviours are part of a spectrum of dition that is often associated with other repetitive
behaviours that includes ‘the norm’; such behaviours behaviours (e.g. pathological gambling, hypersexual-
only become defined as pathological when they impair ity). The authors propose that the dopaminergic med-
social or occupational functioning. Hoarding does not ication causes patients to overestimate the intrinsic
have a formal identification in the DSM-IV and has value of the items in their possession and thus retain
classically been subsumed within the category of and accumulate them.
OCD. It is, however, seen in a wide range of psychiat-
ric and neurological conditions such as dementia,
OCD, schizophrenia, autism, and following traumatic 6.3 Impulse control disorders
brain injury. It is also becoming increasingly clear that
pathological hoarding can occur in its own right as an Impulse control disorders (ICDs) constitute a group
independent condition (Mataix-Cols et al., 2011). of conditions that have at their core a failure to resist a
Hoarding lends itself well to study in animal models drive or temptation to perform an act that is harmful
as it is a naturally displayed form of behaviour (e.g. (see DSM-IV; American Psychiatric Association,
found in birds, rodents, and primates). The ventrome- 2000). Examples include pathological gambling and
dial prefrontal cortex and sub-cortical limbic structures trichotillomania (compulsion to pull one’s hair out).
have been implicated. Indeed, hoarding behaviour has There appears to be a disruption of active inhibitory
been induced in rats by stimulation of the lateral hypo- processes regulating rewarding behaviour. In other
thalamus (a region that also promotes control of food words, disinhibition is a process where the ‘cap’ is
intake and sexual behaviour; see Section 6.3 on ICD removed from certain drives and motivations and
below). Similarly, the dopaminergic system has been they have ‘free rein’. It has been associated with ventral
implicated in hoarding behaviour, with disappearance sub-cortical structures (Cummings, 1995).
of hoarding behaviour being observed with induced In the preparation of the upcoming fifth edition of
lesions of the mesolimbic dopamine neurons in rats, DSM, there has been consideration of whether to
and restoration of such behaviour to control levels by group ICDs under the obsessive–compulsive disorders
treatment with dopamine (Kelly and Iversen, 1976). (OCDs) or in a parallel category of behavioural addic-
In humans, studies of those who began hoarding tions (Hollander and Allen, 2006). Both categories are
following traumatic or vascular lesions predominantly manifest by an inability to refrain from repetitive acts
494 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
when presented with immediate reinforcement, eating (natural rewards). An intriguing study by Bódi
despite long-term negative consequences. The key dif- and colleagues assessed novelty seeking in newly diag-
ference between the two groups is the function of the nosed PD sufferers before and after dopaminergic
repetitive behaviours. Behavioural addictions are treatment (Bódi et al., 2009). Novelty seeking was
driven by the pursuit of pleasure, arousal, or gratifica- found to be significantly lower in the pre-treatment PD
tion, whereas in OCDs they are driven by an effort to patients compared to healthy controls. After 12 weeks
avoid anxiety. Marks likened the contrast between the of dopaminergic treatment it was found to be signifi-
two as a ‘push versus pull’ effect, with addictions indi- cantly higher compared to healthy controls and also in
cating an attraction towards a certain state and com- comparison to the pre-treatment scores. This is in
pulsions denoting avoidance of discomfort (Marks, keeping with reports that suggest there is generally a
1990). lower level of risk-taking behaviour in PD patients, for
As mentioned above, the lessened control of instance a lower propensity to smoke or drink caffeine.
response inhibition also impacts on long-term goals. One potential model to account for impulse control
This has been termed a ‘myopia (visual short-sighted- disorders may relate to the observation of several dif-
ness) for the future’ (Bechara et al., 2000). It is unsur- fering dopaminergic pathways in the brain. Braak has
prising that the frontal lobes and associated structures suggested that neurodegeneration in PD follows sev-
are implicated given their involvement in willed inten- eral stages, from initial PD stages of rigidity, tremor,
tional action, inhibition of pre-potent tendencies, rea- and akinesia to later stages of apathy and dementia
soning, and self-awareness. (Braak et al., 2003). The motor cortex degenerates rela-
Cloninger (1987) subsumes impulsivity into one of tively early, with associated movement disability.
four dimensions that he considers make up the person- However, other dopaminergic pathways (such as
ality trait of ‘novelty seeking’ (the others being explora- reward pathways) are relatively intact at this early
tory excitability, disorganization, and extravagance). It stage. The medication aimed at treating the movement
is contrasted with another temperamental trait of disability also acts on the reward pathways, essentially
‘harm avoidance’ (Cloninger, 1987). If ICDs are con- causing a relative ‘overdose’ of reward activation and
ceptualized as a myopia for the future, harm avoidance increasing the chances of becoming addicted to
sufferers have the opposite problem – a hyperopia (or reward-based behaviours. Blood oxygen level-depend-
overly focused viewpoint) of the future, manifest in ent fMRI (see Chapter 14) suggests a phasic firing of
over-anticipation of long-term problems. This has dopamine pathways in relation to reward-based stim-
been associated with serotonergic function, highlight- uli (Bayer and Glimcher, 2005; Schultz et al., 1997).
ing the reciprocal relationship between dopamine and There is increased firing to unexpectedly large rewards
serotonin. Barrett has identified three factors felt to and decreased activity to unexpectedly small rewards.
contribute to impulsivity, namely inattention, motor In PD patients exhibiting pathological gambling
impulsivity, and a non-planning impulsivity, i.e. failure related to dopaminergic medication, a gambling task
to consider the future. paradigm with both win and loss outcomes is known
to increase ventral striatal dopamine releases to a
6.3.1 ICDs in Parkinson’s disease greater extent than in PD controls (Steeves et al., 2009).
As a term, ICD has been adopted for use in a range of Voon and colleagues used a computational model
organic conditions, such as Parkinson’s disease, and is aimed at allowing a comparison between actual and
felt to be related to the use of dopaminergic medication expected outcomes to look at prediction error in the
to treat the movement disorder problems (termed PD-ICD group (Voon et al., 2010b) in a study where
PD-ICDs; see Box 15.6 for an example). It affects 14 patients had pathological gambling,14 were PD
14 per cent of sufferers (Weintraub et al., 2010), and controls, and 16 were healthy non-PD volunteers.
includes pathological gambling, compulsive shopping They used a probability paradigm in a learning task
(learned rewards), hypersexuality, and compulsive and found dopaminergic medication to be associated
CHAPTER 15 COGNITIVE NEUROPSYCHIATRY 495
Mr X was a 56-year-old with a 4-year history of associated with this compulsive gambling (such as
Parkinson’s disease. He had been retired due to his compulsive shopping, involving a learned reward, or
Parkinson’s for 2 years. He was referred to the psy- hypersexuality or compulsive eating, involving natu-
chiatrist after reading in the newspaper of a potential ral rewards).
link between his medication and gambling. He men- Treatment consisted of a change in his Parkinson’s
tioned he had always ‘liked a bet’ but since his diagno- medication to medication that was thought to be
sis and treatment for his Parkinson’s disease it had got less likely to cause this condition. He was referred
increasingly out of hand. He was now £12 000 in debt for psychological work, which involved motivating
and his wife had recently moved out of the family him to pursue activities he used to enjoy, and intro-
home saying she felt the trust had gone from their rela- ducing strategies to help manage the gambling urges.
tionship; he had not told her about the debt until they Additionally, he and his wife met with the neuropsy-
were threatened with eviction from the family home. chiatrist, who gave them a talk on the fact that this
Mr X’s score on the MMSE was 30/30, and formal condition seems to occur in approximately 14 per
neuropsychometry (an out-patient test of cognition cent of Parkinson’s patients. This led to his wife
administered by a neuropsychiatrist or neuropsy- reconsidering the issues of trust (‘It wasn’t him, it
chologist) was within the normal range, with was the medication, I can see that now.’). However,
impaired performance shown only on the trails B she continued to complain of him being poorly moti-
test (a kind of ‘join the dots’ task where the dots are vated at home and not being properly responsive to
presented consecutively). Additionally, there was no her needs. She appeared to take some comfort in an
evidence of other behaviours known often to be explanation of her husband’s executive difficulties.
with faster learning from gain outcomes along with greater than normal tendency to repeat occasionally
greater ventral striatal dopaminergic release. This was rewarded behaviours (variable reinforcement) and a
not seen in the PD controls and the effect was lessened reduced tendency towards extinction of these behav-
when the patients were off their medication. iours when they are unrewarded. The study indicates
Additionally, the PD patients with pathological gam- that PD-ICD patients have at their core a dissociation
bling had fewer fMRI changes in relation to loss, indi- of decision-making processes. It remains unclear what
cating less of an ability to learn from negative feedback. cognitive processes contribute to a vulnerability to
The clinical implications are clear in relation to these behaviours, and it would be of interest to iden-
these findings. Individuals with PD-ICD have a tify what factors confer such a cognitive dysfunction.
SUMMARY OF SECTION 6
• There is an emerging literature suggesting that OCD may be associated with neuropsychological
deficits in comparison to healthy controls.
• There is evidence to suggest only an indirect association with memory deficit and more of an asso-
ciation with cognitive and behavioural inhibitory processes, as well as attentional processes.
• It is possible that the apparent memory deficits could be attributed to association with poor organiza-
tional strategies, which may be a reflection of the patient’s clinical presentation – they often present
with rigid and inflexible rules for life and may be less willing to adopt new strategies to deal with novel
problems.
496 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
7 CONVERSION DISORDER
Conversion disorder is defined as a condition where to habituate to unconditioned stimuli (Horvath et al.,
neurological signs and symptoms, such as abnormal 1980). The authors of this study suggest that the failure
movements, seizures, or sensory symptoms, are unre- to habituate may be a risk factor for development of the
lated to an underlying neurological or medical disor- condition, or that the patients had higher arousal levels
der. They are the neuropsychiatrist’s ‘bread and butter’, in the first instance. Additionally, conversion patients
taking up a large proportion of their workload. In have been shown to have a greater vigilance or atten-
neurology clinics, symptoms that do not fit with an tional bias towards threat stimuli in an emotional
explainable neurological pathology (in other words Stroop test. Preliminary data from neuroimaging stud-
‘unexplained’ neurological illness) account for 30 per ies implicate a potential link with limbic, amygdala,
cent of cases seen. They are often a source of distress to and motor regions in patients with conversion paraly-
the patients and are associated with prominent disa- sis. The amygdala is critical for fear conditioning, a
bility. It is important to note that on the whole the suf- form of classical conditioning in which an initially
ferer is not feigning these symptoms, but generally neutral stimulus is presented together with a fear-
believes that their motor function is impaired. An inducing unconditioned stimulus (e.g. an electric
example is described in Box 15.7. Indeed, it is impor- shock). As a result, the neutral stimulus comes to elicit
tant to note that if the patient is shown to be deliber- the fear response. Patients with amygdala ‘damage’ do
ately feigning their symptoms (e.g. witnessed walking not acquire conditioned fear responses despite retain-
around the room when they believe themselves to be ing explicit knowledge of the relationship between the
unobserved), then they do not fulfil the criteria for unconditioned stimulus and the conditioned stimulus.
conversion disorder. One hypothesis about the causes Voon and colleagues compared healthy volunteers and
of conversion disorder suggests that the loss of func- conversion disorder patients while controlling for
tion, or paralysis, results from an impairment in the depressive and anxiety symptoms. Using fMRI, they
‘generation’ of intentions to move, or from impair- found that whereas healthy volunteers had greater
ment in the ‘execution’ of movement (Spence et al., right amygdala activity in response to fearful versus
2000). The individual says and thinks, ‘I cannot’; to an neutral stimuli (compared with happy versus neutral),
observer it may look like ‘I will not’, but the reality may there was no difference in amygdala activity in patients
be ‘I cannot will’. with conversion disorder, suggesting impaired amyg-
Whilst there is no specific evidence for cognitive dala habituation (Voon et al., 2010a). When compared
deficits in such a group, there are certain features that with the volunteers, conversion patients also showed
are of relevance. Firstly, patients with conversion disor- greater functional connection between the amygdala
der symptoms in remission have demonstrated failure and motor cortex during fearful versus neutral stimuli.
Mr H suddenly developed leg weakness and became his wife, but strangely seemed relatively unconcerned
unable to walk. The onset was a few months after the about this sudden-onset disability. He believed the
death of his mother, who had been bed-bound in the cause to be a stroke and wondered if he had inher-
last few months of her life. He is now looked after by ited a predisposition to stroke from his mother.
CHAPTER 15 COGNITIVE NEUROPSYCHIATRY 497
SUMMARY OF SECTION 7
There may be a link between the conversion symptoms and arousal that potentially plays a role in
modulating motor networks, so resulting in abnormal motor symptoms.
8 SUMMARY
Despite advances in psychiatric research methods, on empirical findings from patients with different
traditional psychiatric frameworks have offered little types of psychopathology, in a way similar to the
towards psychological mechanisms underlying neu- underlying aims of cognitive neuropsychology (see
ropsychiatric conditions such as delusions and hallu- Chapter 13).
cinations. Cognitive neuropsychiatry attempts to Despite the potential advantages of a symptom-
address this deficit by mapping out the relationship based approach in attempting to understand psycho-
between psychiatric disorders and human cognitive pathology, research must avoid making inappropriate
functioning. It also attempts to understand and char- assumptions of normality or universality in this field.
acterize the cognitive and psychiatric functions of That is, care is needed in assuming that it is clear what
brain structures and their pathology. a patient ‘would have been expected to do’ were it not
Well-described and reliable psychiatric symptoms for their brain injury. Similarly, it cannot straightfor-
can increasingly be interpreted in terms of disturbance wardly be assumed that the patient’s cognitive appara-
to normal information-processing systems such as tus is representative of all other cognitive systems, or
attention, perception, learning, and memory, and be that their deficits reveal a stable underlying process
linked to separate but interconnected neural systems. and not a unique and haphazard reorganization of
Theoretical accounts of the structure of normal cogni- damaged brain systems (Newcombe and Marshall,
tive processes can, in turn, be refined and revised based 1996).
FURTHER READING
David, A., Fleminger, S., Kopelman, M., Lovestone, S., and text offers a concise and comprehensive introduction to descrip-
Mellers, J. (2009) Lishman’s Organic Psychiatry: A Textbook of tive psychopathology, providing in-depth knowledge of the signs
Neuropsychiatry, Oxford, Wiley-Blackwell. This text provides a and symptoms of behavioural disorders.
comprehensive overview of neuropsychiatry, containing all of the Hodges, J.R. (2007) Cognitive Assessment for Clinicians,
essential material for those interested in the subject. Oxford, Oxford University Press. This book incorporates
Sims, A.C.P. (1995) Symptoms in the Mind: An Introduction advances in recent theory into clinical practice and provides a
to Descriptive Psychopathology, London, Saunders Ltd. This practical approach to the cognitive evaluation of patients.
REFERENCES
Ala, T.A., Yang, K.H., Sung, J.H., and Frey, W.H. (1997) with Alzheimer’s disease at presentation: a clinicopathological
‘Hallucinations and signs of parkinsonism help distinguish study’, Journal of Neurology, Neurosurgery & Psychiatry, vol.62,
patients with dementia and cortical Lewy bodies from patients no.1, p.16.
498 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
Alexander, G.E. and Crutcher, M.D. (1990) ‘Functional Braak, H. and Braak, E. (1997) ‘Frequency of stages of
architecture of basal ganglia circuits: neural substrates of par- Alzheimer-related lesions in different age categories’,
allel processing’, Trends in Neurosciences, vol.13, no.7, pp. Neurobiology of Aging, vol.18, no.4, pp.351–7.
266–271. Braak, H., Del Tredici, K., Rüb, U., de Vos, R.A.I., Jansen
Alexopoulos, G.S., Barnett, S., Meyers, R.C., Young, S., Steur, E.N.H., and Braak, E. (2003) ‘Staging of brain pathology
Campbell, D., Silbersweig, and Charlson, M. (1997) ‘Vascular related to sporadic Parkinson’s disease’, Neurobiology of Aging,
depression hypothesis’, Archives of General Psychiatry, vol.54, vol.24, no.2, pp.197–211.
no.10, pp.915–22. Brighetti, G., Bonifacci, P., Borlimi, R., and Ottaviani, C.
Alexopoulos, G.S., Meyers, B.S., Young, R.C., Mattis, S., (2007) ‘Far from the heart, far from the eye: evidence from the
and Kakuma, T. (1993) ‘The course of geriatric depression Capgras delusion’, Cognitive Neuropsychiatry, vol.12, pp.
with “reversible dementia”: a controlled study’, American 189–97.
Journal of Psychiatry, vol.150, no.11, p.1693. Broca, P. (1861) ‘Perte de la parole, ramollissement chro-
Amador, X.F., Flaum, M., Andreasen, N.C., Strauss, D.H., nique et destruction partielle du lobe antérieur gauche du cer-
Yale, S.A., Clark, S.C., and Gorman, J.M. (1994) ‘Awareness of veau’, Bulletin de la Société Anthropologique, vol.2, pp.235–8.
illness in schizophrenia and schizoaffective and mood disor- Brown, R.G., Landau, S., Hindle, J.V., Playfer, J., Samuel,
ders’, Archives of General Psychiatry, vol.51, no.10, p.826. M., Wilson, K.C., et al. (2011) ‘Depression and anxiety related
American Psychiatric Association (2000) Diagnostic and subtypes in Parkinson’s disease’, Journal of Neurology,
Statistical Manual of Mental Disorders: DSM-IV-TR, Neurosurgery & Psychiatry, vol.82, no.7, p.803.
Washington, DC, American Psychiatric Publishing, Inc. Brugger, P., Regard, M., and Landis, T. (1996) ‘Unilaterally
Anderson, S.W., Damasio, H., and Damasio, A.R. (2005) ‘A felt presences: the neuropsychiatry of one’s invisible doppel-
neural basis for collecting behaviour in humans’, Brain, ganger’, Cognitive and Behavioral Neurology, vol.9, no.2, p.114.
vol.128, no.1, p.201. Bruscoli, M. and Lovestone, S. (2004) ‘Is MCI really just
Ballard, C., Ziabreva, I., Perry, R., Larsen, J.P., O’Brien, J., early dementia? A systematic review of conversion studies’,
McKeith, I., et al. (2006) ‘Differences in neuropathologic char- International Psychogeriatrics, vol.16, no.2, p.129–40.
acteristics across the Lewy body dementia spectrum’, Burns, A., Rossor, M., Hecker, J., Gauthier, S., Petit, H.,
Neurology, vol.67, no.11, pp.1931–34. Möller, H.J., et al. (2000) ‘The effects of donepezil in Alzheimer’s
Bayer, H.M. and Glimcher, P.W. (2005) ‘Midbrain dopa- disease – results from a multinational trial’, Dementia and
mine neurons encode a quantitative reward prediction error Geriatric Cognitive Disorders, vol.10, no.3, pp.237–44.
signal’, Neuron, vol.47, no.1, pp.129–41. Cervantes, A.N., Rabins, P.V., and Slavney, P.R. (2006)
Bechara, A., Damasio, H., and Damasio, A.R. (2000) ‘Onset of schizophrenia at age 100’, Psychosomatics, vol.47,
‘Emotion, decision making and the orbitofrontal cortex’, no.4, pp.356–9.
Cerebral Cortex, vol.10, no.3, pp.295–307. Cloninger, C.R. (1987) ‘Neurogenetic adaptive mecha-
Blumer, D. and Benson, D.F. (1975) ‘Personality changes nisms in alcoholism’, Science, vol.236, no.4800, pp.410–16.
with frontal and temporal lobe lesions’, Psychiatric Aspects of Coltheart, M. (2007) ‘The 33rd Bartlett Lecture: Cognitive
Neurologic Disease, vol.1, pp.151–70. neuropsychiatry and delusional belief ’, Quarterly Journal of
Bódi, N., Kéri, S., Nagy, H., Moustafa, A., Myers, C.E., Daw, Experimental Psychology, vol.60, pp.1041–62.
N., et al. (2009) ‘Reward-learning and the novelty-seeking Coltheart, M., Langdon, R., and McKay, R. (2011)
personality: a between- and within-subjects study of the ‘Delusional belief ’, Annual Review of Psychology, vol.62,
effects of dopamine agonists on young Parkinson’s patients’, pp.271–98.
Brain, vol.132, no.9, p.2385. Cummings, J.L. (1995) ‘Anatomic and behavioral aspects of
Bogod, N.M., Mateer, C.A., and Macdonald, S.W.S. (2003) frontal subcortical circuits’, Annals of the New York Academy of
‘Self-awareness after traumatic brain injury: a comparison of Sciences, vol.769, no.1, pp.1–14.
measures and their relationship to executive functions’, Journal Cummings, J.L. and Cunningham, K. (1992) ‘Obsessive-
of the International Neuropsychological Society, vol.9, no.3, compulsive disorder in Huntington’s disease: 1’, Biological
pp.450–8. Psychiatry, vol.31, no.3, pp.263–70.
Boksem, M.A.S. and Tops, M. (2008) ‘Mental fatigue: costs Dam, H. (2001) ‘Depression in stroke patients 7 years fol-
and benefits’, Brain Research Reviews, vol.59, no.1, pp.125–39. lowing stroke’, Acta Psychiatrica Scandinavica, vol.103, no.4,
Bolla-Wilson, K., Robinson, R.G., Starkstein, S.E., Boston, pp.287–93.
J., and Price, T.R. (1989) ‘Lateralization of dementia of depres- Damasio, A.R. (ed.) (1999) The Feeling of What Happens:
sion in stroke patients’, American Journal of Psychiatry, vol.146, Body and Emotion in the Making of Consciousness, New York,
no.5, p.627. Heinemann.
CHAPTER 15 COGNITIVE NEUROPSYCHIATRY 499
David, A.S. (1990) ‘Insight and psychosis’, The British Forette, F., Seux, M.L., Staessen, J.A., Thijs, L., Birkenhäger,
Journal of Psychiatry, vol.156, no.6, pp.798–808. W.H., Babarskiene, M.R., et al. (1998) ‘Prevention of dementia
David, A.S., Malmberg, A., Brandt, L., Allebeck, P., and Lewis, in randomised double-blind placebo-controlled Systolic
G. (1997) ‘IQ and risk for schizophrenia: a population-based Hypertension in Europe (Syst-Eur) trial’, The Lancet, vol.352,
cohort study’, Psychological Medicine, vol.27, no.6, pp.1311–23. no.9137, pp.1347–51.
Desmond, D.W., Remien, R.H., Moroney, J.T., Stern, Y., Fotopoulou, A., Solms, M., and Turnbull, O. (2004)
Sano, M., and Williams, J.B.W. (2003) ‘Ischemic stroke and ‘Wishful reality distortions in confabulation: a case report 1’,
depression’, Journal of the International Neuropsychological Neuropsychologia, vol.42, no.6, pp.727–44.
Society, vol.9, no.3, pp.429–39. Frith, C.D. (1992) The Cognitive Neuropsychology of
Dolan, R.J., Bench, C.J., Brown, R.G., Scott, L.C., and Schizophrenia, Hove, Psychology Press.
Frackowiak, R.S.J. (1994) ‘Neuropsychological dysfunction in Giovannoni, G., O’Sullivan, J.D., Turner, K., Manson, A.J.,
depression: the relationship to regional cerebral blood flow’, and Lees, A.J.L. (2000) ‘Hedonistic homeostatic dysregulation
Psychological Medicine, vol.24, no.4, pp.849–57. in patients with Parkinson’s disease on dopamine replacement
Dolan, R.J., Bench, C.J., Liddle, P.F., Friston, K.J., Frith, therapies’, Journal of Neurology, Neurosurgery, and Psychiatry,
C.D., Grasby, P.M., and Frackowiak, R.S. (1993) ‘Dorsolateral vol.68, no.4, pp.423–8.
prefrontal cortex dysfunction in the major psychoses; symp- Goldberg, T.E., Egan, M.F., Gscheidle, T., Coppola, R.,
tom or disease specificity?’ Journal of Neurology, Neurosurgery Weickert, T., Kolachana, B.S., et al. (2003) ‘Executive subproc-
& Psychiatry, vol.56, no.12, pp.1290–4. esses in working memory: relationship to catechol-O-methyl-
Drevets, W.C., Price, J.L., Simpson, J.R., Todd, R.D., Reich, transferase Val158Met genotype and schizophrenia’, Archives
T., Vannier, M., and Raichle, M.E. (1997) ‘Subgenual prefron- of General Psychiatry, vol.60, no.9, p.889.
tal cortex abnormalities in mood disorders’, Nature, vol.386, Grace, J., Malloy, P., and Psychological Assessment
no.6627, pp.824–7. Resources (2001) FrSBe, Frontal Systems Behavior Scale:
Egan, M.F., Goldberg, T.E., Kolachana, B.S., Callicott, J.H., Professional Manual, Lutz, FL, Psychological Assessment
Mazzanti, C.M., Straub, R.E., et al. (2001) ‘Effect of COMT Resources.
Val108/158 Met genotype on frontal lobe function and risk for Graybiel, A.M. and Rauch, S.L. (2000) ‘Toward a neurobi-
schizophrenia’, Proceedings of the National Academy of ology of obsessive-compulsive disorder’, Neuron, vol.28, no.2,
Sciences, vol.98, no.12, p.6917. p.343–7.
Elliott, R. (2003) ‘Executive functions and their disorders’, Gunnell, D., Harrison, G., Rasmussen, F., Fouskakis, D.,
British Medical Bulletin, vol.65, no.1, p.49. and Tynelius, P.E.R. (2002) ‘Associations between premorbid
Elliott, R., Rubinsztein, J.S., Sahakian, B.J., and Dolan, R.J. intellectual performance, early-life exposures and early-onset
(2002) ‘The neural basis of mood-congruent processing biases schizophrenia’, The British Journal of Psychiatry, vol.181, no.4,
in depression’, Archives of General Psychiatry, vol.59, no.7, pp.298–305.
pp.597–604. Gussekloo, J., Westendorp, R.G.J., Remarque, E.J., Lagaay,
Ellis, H.D. and Young, A.W. (1990) ‘Accounting for delu- A.M., Heeren, T. J., and Knook, D.L. (1997) ‘Impact of mild
sional misidentifications’, British Journal of Psychiatry, vol.157, cognitive impairment on survival in very elderly people:
pp.239–48. cohort study’, BMJ, vol.315, no.7115, pp.1053–4.
Ellis, H.D., Young, A.W., Quayle, A.H., and De Pauw, K.W. Hackett, M.L. and Anderson, C.S. (2005) ‘Predictors of
(1997) ‘Reduced autonomic responses to faces in Capgras depression after stroke’, Stroke, vol.36, no.10, pp.2296–301.
delusion’, Proceedings of the Royal Society of London, Series B: Hackett, M.L., Yapa, C., Parag, V., and Anderson, C.S.
Biological Sciences, vol.264, no.1384, p.1085. (2005) ‘Frequency of depression after stroke’, Stroke, vol.36,
Emery, V.O. and Oxman, T.E. (1992) ‘Update on the no.6, pp.1330–40.
dementia spectrum of depression’, American Journal of Harrington, C. (2007) ‘Onset of schizophrenia at age 100 –
Psychiatry, vol.149, no.3, p.305. or psychosis as the presenting symptom of a cognitive disor-
Fann, J.R., Uomoto, J.M., and Katon, W.J. (2001) ‘Cognitive der?’ Psychosomatics, vol.48, no.4, pp.360–1.
improvement with treatment of depression following mild Hay, P., Sachdev, P., Cumming, S., Smith, J.S., Lee, T.,
traumatic brain injury’, Psychosomatics, vol.42, no.1, pp.48–54. Kitchener, P., and Matheson, J. (1993) ‘Treatment of obsessive
ffytche, D.H., Howard, R.J., Brammer, M.J., David, A., compulsive disorder by psychosurgery’, Acta Psychiatrica
Woodruff, P., and Williams, S. (1998) ‘The anatomy of con- Scandinavica, vol.87, no.3, pp.197–207.
scious vision: an fMRI study of visual hallucinations’, Nature Hebb, D.O. (1949) The Organisation of Behaviour, New
Neuroscience, vol.1, no.8, p.738. York, Wiley.
500 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
Hirstein, W.S. and Ramachandran, V.S. (1997) ‘Capgras dimensions in obsessive-compulsive disorder’, Archives of
syndrome: a novel probe for understanding the neural repre- General Psychiatry, vol.61, no.6, p.564.
sentation of the identity and familiarity of persons’, Proceedings McKeith, I.G., Ballard, C.G., Perry, R.H., Ince, P.G.,
of the Royal Society of London B, vol.264, pp.437–44. O’Brien, J.T., Neill, D., et al. (2000) ‘Prospective validation of
Hodges, J.R. (2001) ‘Frontotemporal dementia (Pick’s dis- consensus criteria for the diagnosis of dementia with Lewy
ease): clinical features and assessment’, Neurology, vol.56, bodies’, Neurology, vol.54, no.5, p.1050.
suppl.4, pp.S6–S10. Mell, L.K., Davis, R.L., and Owens, D. (2005) ‘Association
Hollander, E. and Allen, A. (2006) ‘Is compulsive buying a between streptococcal infection and obsessive-compulsive
real disorder, and is it really compulsive?’ The American disorder, Tourette’s syndrome, and tic disorder’, Pediatrics,
Journal of Psychiatry, vol.163, no.10, pp.1670–2. vol.116, no.1, p.56.
Horvath, T., Friedman, J., and Meares, R. (1980) ‘Attention Moritz, S. and Woodward, T.S. (2007) ‘Metacognitive train-
in hysteria: a study of Janet’s hypothesis by means of habitua- ing in schizophrenia: from basic research to knowledge trans-
tion and arousal measures’, American Journal of Psychiatry, lation and intervention’, Current Opinion in Psychiatry, vol.20,
vol.137, no.2, p.217. no.6, p.619–25.
James, W. (1950) Principles of psychology, Vol. 2, New York, Müller, M.J., Greverus, D., Dellani, P.R., Weibrich, C.,
Henry Holt & Co. (original work published 1890). Wille, P.R., Scheurich, A., et al. (2005) ‘Functional impli-
Jorge, R.E., Robinson, R.G., Moser, D., Tateno, A., Crespo- cations of hippocampal volume and diffusivity in mild
Facorro, B., and Arndt, S. (2004) ‘Major depression following cognitive impairment’, Neuroimage, vol.28, no.4,
traumatic brain injury’, Archives of General Psychiatry, vol.61, pp.1033–42.
no.1, p.42. Narushima, K., Kosier, J.T., and Robinson, R.G. (2003) ‘A
Kapur, S. (2003) ‘Psychosis as a state of aberrant salience: a reappraisal of poststroke depression, intra- and inter-hemi-
framework linking biology, phenomenology, and pharmacol- spheric lesion location using meta-analysis’, Journal of
ogy in schizophrenia’, American Journal of Psychiatry, vol.160, Neuropsychiatry and Clinical Neurosciences, vol.15, no.4,
no.1, pp.13–23. p.422.
Kelly, P.H. and Iversen, S.D. (1976) ‘Selective 60HDA- Newcombe, F. and Marshall, J.C. (1996) ‘Idealisation meets
induced destruction of mesolimbic dopamine neurons: psychometrics: the case for the right groups and the right indi-
abolition of psychostimulant-induced locomotor activity viduals’, Human Cognitive Neuropsychology: A Textbook with
in rats’, European Journal of Pharmacology, vol.40, no.1, Readings, 351.
pp.45–56. Okai, D., Samuel, M., Askey-Jones, S., David, A.S., and
Kopelman, M.D. (2002) ‘Disorders of memory’, Brain, Brown, R.G. (2011) ‘Impulse control disorders and dopamine
vol.125, no.10, p.2152. dysregulation in Parkinson’s disease: a broader conceptual
Kraepelin, E. (1919) Dementia Praecox and Paraphrenia, framework’, European Journal of Neurology, vol.1–5.
Edinburgh, Livingstone. Ortiz-Gil, J., Pomarol-Clotet, E., Salvador, R., Canales-
Liddle, P.F. and Barnes, T. R. (1990) ‘Syndromes of chronic Rodreguez, E.J., Sarra, S., Gomar, J.J., et al. (2011) ‘Neural cor-
schizophrenia’, The British Journal of Psychiatry, vol.157, no.4, relates of cognitive impairment in schizophrenia’, The British
pp.558–61. Journal of Psychiatry.
Liddle, P.F. and Morris, D. L. (1991) ‘Schizophrenic syn- O’Sullivan, S.S., Djamshidian, A., Evans, A.H., Loane,
dromes and frontal lobe performance’, The British Journal of C.M., Lees, A.J., and Lawrence, A.D. (2010) ‘Excessive hoard-
Psychiatry, vol.158, no.3, pp.340–5. ing in Parkinson’s disease’, Movement Disorders, vol.25, no.8,
Madureira, S., Guerreiro, M., and Ferro, J.M. (2001) pp.1026–33.
‘Dementia and cognitive impairment three months after Palmer, B., Dawes, S., and Heaton, R. (2009) ‘What do we
stroke’, European Journal of Neurology, vol.8, no.6, pp.621–7. know about neuropsychological aspects of schizophrenia?’
Marks, I. (1990) ‘Behavioural (non-chemical) addictions’, Neuropsychology Review, vol.19, no.3, pp.365–84.
British Journal of Addiction, vol.85, no.11, pp.1389–94. Patton, J.H., Stanford, M.S., and Barratt, E.S. (1995) ‘Factor
Mataix-Cols, D., Pertusa, A., and Snowdon, J. (2011) structure of the Barratt impulsiveness scale’, Journal of Clinical
‘Neuropsychological and neural correlates of hoarding: a Psychology, vol.51, no.6, pp.768–74.
practice friendly review’, Journal of Clinical Psychology. Petersen, R.C., Doody, R., Kurz, A., Mohs, R.C., Morris,
Mataix-Cols, D., Wooderson, S., Lawrence, N., Brammer, J.C., Rabins, P.V., et al. (2001) ‘Current concepts in mild
M.J., Speckens, A., and Phillips, M.L. (2004) ‘Distinct neural cognitive impairment’, Archives of Neurology, vol.58, no.12,
correlates of washing, checking, and hoarding symptom pp.1985–92.
CHAPTER 15 COGNITIVE NEUROPSYCHIATRY 501
Phan, K.L., Fitzgerald, D.A., Nathan, P.J., Moore, G.J., Uhde, Rogers, M.A., Kasai, K., Koji, M., Fukuda, R., Iwanami, A.,
T.W., and Tancer, M.E. (2005) ‘Neural substrates for voluntary Nakagome, K., et al. (2004) ‘Executive and prefrontal dysfunc-
suppression of negative affect: a functional magnetic resonance tion in unipolar depression: a review of neuropsychological
imaging study’, Biological Psychiatry, vol.57, no.3, pp.210–19. and imaging evidence’, Neuroscience Research, vol.50, no.1,
Piefke, M., Weiss, P.H., Zilles, K., Markowitsch, H.J., and pp.1–11.
Fink, G.R. (2003) ‘Differential remoteness and emotional tone Savage, C.R., Deckersbach, T., Wilhelm, S., Rauch, S.L.,
modulate the neural correlates of autobiographical memory’, Baer, L., Reid, T., and Jenike, M.A. (2000) ‘Strategic processing
Brain, vol.126, no.3, pp.650–68. and episodic memory impairment in obsessive compulsive
Pomarol-Clotet, E., Oh, T.M.S.S., Laws, K.R., and McKenna, disorder’, Neuropsychology, vol.14, no.1, p.141.
P.J. (2008) ‘Semantic priming in schizophrenia: systematic Schmahmann, J.D. and Sherman, J.C. (1998) ‘The cerebel-
review and meta-analysis’, The British Journal of Psychiatry, lar cognitive affective syndrome’, Brain, vol.121, no.4, p.561.
vol.192, no.2, pp.92–7. Schultz, W., Dayan, P., and Read Montague, P. (1997) ‘A
Ponsford, J., Sloan, S., and Snow, P. (1995) Traumatic Brain neural substrate of prediction and reward’, Science, vol.275,
Injury: Rehabilitation for Everyday Adaptive Living, Hove, no.5306, pp.1593–9.
Psychology Press. Shallice, T.I.M. and Burgess, P.W. (1991) ‘Deficits in strat-
Prigatano, G.P. and Schacter, D. L. (1991) Awareness of egy application following frontal lobe damage in man’, Brain,
Deficit After Brain Injury: Clinical and Theoretical Issues, New vol.114, no.2, pp.727–41.
York, Oxford University Press. Sheline, Y.I., Barch, D.M., Garcia, K., Gersing, K., Pieper,
Purcell, R., Maruff, P., Kyrios, M., and Pantelis, C. (1998) C., Welsh-Bohmer, K., et al. (2006) ‘Cognitive function in late
‘Cognitive deficits in obsessive-compulsive disorder on tests life depression: relationships to depression severity, cerebro-
of frontal-striatal function’, Biological Psychiatry, vol.43, no.5, vascular risk factors and processing speed’, Biological
pp.348–57. Psychiatry, vol.60, no.1, pp.58–65.
Rapoport, M.J., McCullagh, S., Shammi, P., and Feinstein, Sheline, Y.I., Pieper, C.F., Barch, D.M., Welsh-Boehmer, K.,
A. (2005) ‘Cognitive impairment associated with major McKinstry, R.C., MacFall, J.R., et al. (2010) ‘Support for the
depression following mild and moderate traumatic brain vascular depression hypothesis in late-life depression: results
injury’, Journal of Neuropsychiatry and Clinical Neurosciences, of a 2-site, prospective, antidepressant treatment trial’, Archives
vol.17, no.1, p.61. of General Psychiatry, vol.67, no.3, pp.277–85.
Reichenberg, A., Weiser, M., Rabinowitz, J., Caspi, A., Shenton, M.E., Dickey, C.C., Frumin, M., and McCarley,
Schmeidler, J., Mark, M., et al. (2002) ‘A population-based R.W. (2001) ‘A review of MRI findings in schizophrenia’,
cohort study of premorbid intellectual, language, and behavio- Schizophrenia Research, vol.49, no.1–2, pp.1–52.
ral functioning in patients with schizophrenia, schizoaffective Snider, L.A. and Swedo, S.E. (2004) ‘PANDAS: current sta-
disorder, and nonpsychotic bipolar disorder’, American tus and directions for research’, Molecular Psychiatry, vol.9,
Journal of Psychiatry, vol.159, no.12, pp.2027–35. no.10, pp.900–07.
Rey, A. (1941) ‘L’examen psychologique dans les cas Snowdon, D.A. (2003) ‘Healthy aging and dementia: find-
d’encéphalopathie traumatique. (Les problems.)’, Archives de ings from the Nun Study’, Annals of Internal Medicine, vol.139,
Psychologie. no.5, part 2, p.450.
Robbins, T.W., James, M., Owen, A.M., Sahakian, B.J., Snowdon, D.A., Kemper, S.J., Mortimer, J.A., Greiner, L.H.,
McInnes, L., and Rabbitt, P. (1994) ‘Cambridge Neuro- Wekstein, D.R., and Markesbery, W.R. (1996) ‘Linguistic abil-
psychological Test Automated Battery (CANTAB): a factor ity in early life and cognitive function and Alzheimer’s disease
analytic study of a large sample of normal elderly volunteers’, in late life’, JAMA: The Journal of the American Medical
Dementia and Geriatric Cognitive Disorders, vol.5, no.5, Association, vol.275, no.7, p.528.
pp.266–81. Spalletta, G., Guida, G., De Angelis, D., and Caltagirone, C.
Robinson, R.G., Bolla-Wilson, K., Kaplan, E., Lipsey, J.R., (2002) ‘Predictors of cognitive level and depression severity
and Price, T.R. (1986) ‘Depression influences intellectual are different in patients with left and right hemispheric stroke
impairment in stroke patients’, The British Journal of Psychiatry, within the first year of illness’, Journal of Neurology, vol.249,
vol.148, no.5, pp.541–7. no.11, pp.1541–51.
Robinson, R.G., Starr, L.B., and Price, T.R. (1984) ‘A two Spence, S.A., Crimlisk, H.L., Cope, H., Ron, M.A., and
year longitudinal study of mood disorders following stroke. Grasby, P.M. (2000) ‘Discrete neurophysiological correlates in
Prevalence and duration at six months follow-up’, The British prefrontal cortex during hysterical and feigned disorder of
Journal of Psychiatry, vol.144, no.3, pp.256–62. movement’, The Lancet, vol.355, no.9211, pp.1243–4.
502 PART 5 CONTRIBUTIONS FROM THE COGNITIVE NEUROSCIENCES
Sprong, M., Schothorst, P., Vos, E., Hox, J., and Van of the medial frontal cortex’, Neuroimage, vol.20, no.4,
Engeland, H. (2007) ‘Theory of mind in schizophrenia: meta- pp.2271–80.
analysis’, The British Journal of Psychiatry, vol.191, no.1, p.5. Veale, D.M., Sahakian, B.J., Owen, A.M., and Marks, I.M.
Staekenborg, S.S., Su, T., van Straaten, E.C.W., Lane, R., (1996) ‘Specific cognitive deficits in tests sensitive to frontal
Scheltens, P., Barkhof, F., and van der Flier, W.M. (2009) lobe dysfunction in obsessive-compulsive disorder’,
‘Behavioural and psychological symptoms in vascular dementia; Psychological Medicine, vol.26, no.6, pp.1261–70.
differences between small- and large-vessel disease’, Journal of Volle, E., Beato, R., Levy, R., and Dubois, B. (2002) ‘Forced
Neurology, Neurosurgery & Psychiatry, vol.81, no.5, pp.547–51. collectionism after orbitofrontal damage’, Neurology, vol.58,
Steeves, T.D.L., Miyasaki, J., Zurowski, M., Lang, A.E., no.3, pp.488–90.
Pellecchia, G., Van Eimeren, T., et al. (2009) ‘Increased striatal Voon, V., Brezing, C., Gallea, C., Ameli, R., Roelofs, K.,
dopamine release in Parkinsonian patients with pathological LaFrance, W.C., and Hallett, M. (2010a) ‘Emotional stimuli
gambling: a [11C] raclopride PET study’, Brain, vol.132, no.5, and motor conversion disorder’, Brain, vol.133, no.5,
pp.1376–85. pp.1526–36.
Stengler-Wenzke, K., Müller, U., and Matthes-von- Voon, V., Pessiglione, M., Brezing, C., Gallea, C., Fernandez,
Cramon, G. (2003) ‘Compulsive-obsessive disorder after H.H., Dolan, R.J., and Hallett, M. (2010b) ‘Mechanisms
severe head trauma: diagnosis and treatment’, Psychiatrische underlying dopamine-mediated reward bias in compulsive
Praxis, vol.30, no.1, p.37. behaviors’, Neuron, vol.65, no.1, pp.135–42.
Taylor, S.F., Luan Phan, K., Decker, L.R., and Liberzon, I. Vuilleumier, P., Richardson, M.P., Armony, J.L., Driver, J.,
(2003) ‘Subjective rating of emotionally salient stimuli modu- and Dolan, R.J. (2004) ‘Distant influences of amygdala lesion
lates neural activity’, Neuroimage, vol.18, no.3, pp.650–9. on visual cortical activation during emotional face processing’,
Taylor, W.D., MacFall, J.R., Payne, M.E., McQuoid, D.R., Nature Neuroscience, vol.7, no.11, pp.1271–8.
Provenzale, J.M., Steffens, D.C., and Ranga Rama Krishnan, K. Weickert, T.W., Goldberg, T.E., Gold, J.M., Bigelow, L.B.,
(2004) ‘Late-life depression and microstructural abnormali- Egan, M.F., and Weinberger, D.R. (2000) ‘Cognitive impair-
ties in dorsolateral prefrontal cortex white matter’, American ments in patients with schizophrenia displaying preserved
Journal of Psychiatry, vol.161, no.7, pp.1293–6. and compromised intellect’, Archives of General Psychiatry,
Tolin, D.F., Abramowitz, J.S., Przeworski, A., and Foa, E.B. vol.57, no.9, pp.907–13.
(2002) ‘Thought suppression in obsessive-compulsive Weinberger, D.R., Egan, M.F., Bertolino, A., Callicott, J.H.,
disorder’, Behaviour Research and Therapy, vol.40, no.11, Mattay, V.S., Lipska, B.K., et al. (2001) ‘Prefrontal neurons and
pp.1255–74. the genetics of schizophrenia’, Biological Psychiatry, vol.50,
Toone, B.K. (1991) ‘The psychoses of epilepsy’, Journal of no.11, pp.825–44.
the Royal Society of Medicine, vol.84, no.8, p.457. Weintraub, D., Koester, J., Potenza, M.N., Siderowf, A.D.,
Trimble, M.R. and Cummings, J.L. (1981) ‘Neuropsychiatric Stacy, M., Voon, V., et al. (2010) ‘Impulse control disorders in
disturbances following brainstem lesions’, The British Journal Parkinson disease: a cross-sectional study of 3090 patients’,
of Psychiatry, vol.138, no.1, pp.56–9. Archives of Neurology, vol.67, no.5, pp.589–95.
Van Der Wee, N.J.A., Ramsey, N.F., Jansma, J.M., Denys, Wilson, B.A., Evans, J.J., Alderman, N., Burgess, P.W., and
D.A., Van Megen, H.J.G.M., Westenberg, H.M.G., and Kahn, Emslie, H. (1997) ‘Behavioural assessment of the dysexecutive
R.S. (2003) ‘Spatial working memory deficits in obsessive syndrome’, Methodology of Frontal and Executive Function,
compulsive disorder are associated with excessive engagement pp.239–50.
CHALLENG ES ,
THEMES , AND
I S S U ES
Introduction
18 Consciousness
Jackie Andrade
INTRODUCTION
The first four parts of this book help address the ques- pursued in cognitive psychology, a theme that has also
tion ‘What is cognitive psychology?’, a question that developed in the preceding chapters. Chapter 19
we first took up in Chapter 1. Just as someone can focuses explicitly on cognitive modelling and cogni-
answer the question ‘What is a cat?’ by pointing to tive architecture, the role that models play in theories
examples of cats, so we can gain an understanding of of cognition, and criteria for their evaluation. As the
cognitive psychology by considering different topics authors demonstrate, a number of researchers have
in cognition. As well as introducing substantive focused their attention on unifying theories of cogni-
research areas, the chapters in the first four parts illus- tion, ones that are successful in accounting for evi-
trated some of the breadth and depth of the cognitive dence from all areas of cognitive psychology, including
approach, its assumptions and commitments, its perception, attention, memory, language, and reason-
methods, and its successes. ing. In Chapter 20, where the authors adopt a more
The emphasis changed somewhat in Part 5, which philosophical approach, we then turn to engage more
focused on contributions to cognitive psychology fully with some of the ongoing debates about cogni-
made by work within the neurosciences – neuropsy- tive psychology and the nature of the mind. The chap-
chology, neuroimaging, and neuropsychiatry. The ter discusses several key theoretical issues within
chapters in that part of the book discussed key fea- cognitive psychology that are helping to shape our
tures of work in those three areas, some of its meth- understanding of the nature of cognition.
odological flavour, and some of the assumptions that In Chapter 16, Jenny Yiend, Bundy Mackintosh,
are made in order to draw lessons for our understand- and George Savulich examine the relationship
ing of cognition. Already you may feel that some of between cognition and emotion, aspects of the mind
those assumptions could be contested, and that doing that Western thought has traditionally viewed as
so would engender much debate. It is to some of these opposed to one another. Early in their chapter, the
debates that we now begin to turn. authors distinguish three components of emotions.
First, however, armed with an understanding of key There is a physiological or bodily response, such as
examples of cognitive psychology, this final part of the heart rate (and the sweatiness of hands!) increasing at
book considers two different kinds of question. The the sight of a loved one. There are emotional behav-
first concerns how widely the cognitive approach may iours, in this example perhaps smiling broadly and, if
be successfully applied. Many research topics, such as the social context allows it, touching. And, third, there
emotion, the self, and consciousness, have been con- are emotional feelings, a glow of affection or, possibly,
sidered at various times to lie outside the purview of an intense rapture. The last of these components, the
cognitive psychology. Yet cognitive psychologists have emotional feelings, are a large part of what many peo-
begun to apply their approach to these problems. The ple think of when reflecting on their normal conscious
difficulties in so doing, as well as the successes that experience. The ‘affective tone’ of a particular experi-
arise, are discussed in Chapters 16 to 18. What ential episode, its positivity or negativity, is often one
becomes clear in these chapters is that consciousness, of its most salient features. Indeed, the authors of this
an aspect of mind also discussed in Chapter 1, has chapter go on to look at evidence showing that people
become a theme for many chapters in this book. In are better able to retain information that is congruent
Chapters 16 and 17, conscious experience plays an with their current mood than information that is not.
ever more important role until, in Chapter 18, it That is, they remember happy information if it is pre-
becomes the focus of our enquiry. The second type of sented to them while they are happy, and gloomy
question concerns the kinds of explanation that are information presented to them when they are gloomy.
INTRODUCTION 505
In addition, retrieval of information is best when that), perception of objects and words (how you
mood at encoding matches mood at retrieval. You are become conscious of this object or this word), recog-
better able to recall what you heard in a cheerful mood nition, and categorization (what you consciously
when you are again in a cheerful mood. experience this object as or that piece of discourse as
The relationship between cognition and emotion meaning). And, as just indicated, the affective tone of
provides strong links between Chapters 16 and 17. experience is also a prominent feature of Chapters 16
Affective tone is again a prominent feature of autobio- and 17. In all these chapters, however, consciousness
graphical memories, which is the topic of Chapter 17. has played a supporting role whilst some other aspect
Clare Rathbone, Martin Conway, Emily Holmes, and of cognition has played the lead. In Chapter 18, how-
Chris Moulin are interested in the relationship ever, consciousness comes out of the shadows to take
between autobiographical memory and the self, and centre stage. Jackie Andrade goes head-on with this
their chapter has strong links also to the memory most difficult and elusive of concepts. She outlines
chapters in Part 3, with, for example, the episodic/ philosophical approaches to the vexed issue of con-
semantic distinction of Chapter 8 making a reappear- sciousness and offers an analysis of the place of con-
ance. However, research into autobiographical memo- sciousness within cognitive psychology. She then goes
ries cannot rely on the same kinds of laboratory-based, on to examine a range of empirical cognitive research
experimental methods used to investigate other types into the nature of consciousness. She starts by revisit-
of memory – think of the difficulties of running a ing the topic of implicit memory that was discussed in
memory experiment where participants will be tested Chapter 8, and goes on to extend this into a discussion
for recall decades later! Research in this area tends to of implicit learning. The evidence for learning without
rely on particular distinctive methods aimed at elicit- conscious awareness is difficult to interpret conclu-
ing memories of actual episodes from our past, and sively. Certainly, some implicit learning seems possi-
the chapter activities invite you to take part in some of ble, but as far as the modern dream of effortless sleep
these procedures. learning is concerned, the news is entirely negative.
As with the emotional feelings discussed in Chapter Jackie Andrade looks into controlled versus automatic
16, autobiographical memory also has a self-evident processing of information and then considers what
bearing on consciousness: much of the stream of con- neuropsychological evidence can tell us about the pos-
sciousness features episodes of autobiographical sible modularity of consciousness. Following this, she
memory or is derived from such episodes and from presents an analysis of what the function of conscious-
one’s sense of self. The authors of Chapter 17 develop ness might be, and this links back to ideas rehearsed in
ideas about how autobiographical memory relates to Chapter 16.
what they call the ‘working self ’. This notion is mod- Chapters 16 to 18 thus present the results of apply-
elled on the concept of working memory, the topic of ing the cognitive approach to difficult research ques-
Chapter 9, and which, because it refers to a person’s tions that at one time were thought to be beyond the
current cognitive activity (what the person has in purview of cognitive psychology. As the authors
mind), is itself about consciousness. The working self themselves imply, cognitive psychology has succeeded
is conceived as a hierarchy of interconnected goals, in approaching these topics partly by identifying those
some but not all of which can enter consciousness. aspects that might be amenable to the cognitive
The chapter also examines the disruptive effects of approach, and analysing them separately. It follows
affectively charged trauma memories that, in condi- that there are aspects to emotion, the self, and con-
tions such as post-traumatic stress syndrome, fre- sciousness – for example, emotional feelings, aspects
quently intrude upon consciousness. of identity, phenomenal consciousness – that as yet
Consciousness has been a pervasive presence in remain recalcitrant, and may, for all we know, con-
many of the chapters in earlier parts, such as those on tinue to elude our best attempts at explanation.
attention (why you are conscious of this rather than Nevertheless, as the chapters indicate, the application
506 PART 6 CHALLENGES, THEMES, AND ISSUES
of the cognitive approach has yielded some significant They revisit the contrast between rule-based and con-
insights and numerous positive results, and interest in nectionist (or PDP) models that you will already have
these research areas is likely only to increase. encountered in Chapters 1 and 19, and give a detailed
As mentioned at the outset of this introduction, evaluation of the two types of cognitive architecture
Chapters 19 and 20 then address a somewhat different within the context of the now famous past-tense
set of questions. For example, both chapters focus upon debate. They demonstrate that the argument turns
the relationship between computation and cognition, upon such complex matters as what it means for a rule
picking up on a theme first introduced in Chapter 1. to be explicitly or implicitly represented, and what it
Paul Mulholland and Stuart Watt’s Chapter 19 has the means for a representation to be compositional. The
slightly daunting title of ‘Cognitive modelling and cog- second theoretical issue Tony Stone and Martin Davies
nitive architectures’. However, the authors do a fine job focus on concerns the modularity, or otherwise, of the
of rendering this austere-sounding topic comprehensi- mind. The notion of cognitive modules, or systems,
ble! The topic of cognitive modelling has been broached has cropped up repeatedly since its first mention in
in many earlier chapters, such as Graham Hitch’s Chapter 1 – for example in Chapter 8 on memory and
Chapter 9 on working memory. In Chapter 19, the topic Chapter 18 on consciousness. In Chapter 20, Fodor’s
is illustrated and illuminated through an informative theory of modularity is described and evaluated
contrast between parallel distributed processing (PDP, within the context of the philosophy of science.
or connectionist) models and rule-based systems. This Modularity turns out to be another complex topic that
leads the reader to the concept of a ‘cognitive architec- continues to undergo theoretical refinement. The final
ture’, a concept that is needed to ensure a clear distinc- theoretical issue considered in Chapter 20 is the rela-
tion between cognitive models and the computers on tionship between cognitive psychology and the brain.
which they run. The notion of cognitive architecture is Most if not all of the preceding chapters have included
developed and elaborated by means of a careful over- at least some appeal to neuropsychological evidence,
view of the ACT-R architecture. The authors go on to but what is the status of such evidence? How does it
explain how ACT-R accounts for a range of phenomena bear upon cognitive theory? The discussion is related
found in the study of human memory. They then con- to Marr’s three levels of explanation, a further con-
sider how ACT-R models the acquisition of skills of necting loop back to Chapter 1. Finally, the authors
arithmetic and of mobile phone texting. Finally, they examine whether cognitive and neurobiological theo-
offer a comparison of rule-based and PDP architec- ries co-evolve or whether the former will eventually be
tures, followed by an analysis of the criteria against reduced to the latter. Such theoretical questions as
which the performance of a model should be judged. these, difficult as they are to resolve, help to provide an
In Chapter 20, Tony Stone and Martin Davies pro- overarching conception of cognition: what it is, how
vide a theoretical overview of cognitive psychology we might model and theorize about it, and how such
with reference to three issues, each of which has been theories ‘fit’ in the wider picture of scientific enquiry.
encountered a number of times in previous chapters.
CHAPTER 16
COG NITION
AND EMOTION
Jenny Yiend, Bundy Mackintosh, and George Savulich
1 INTRODUCTION
This chapter is concerned not just with cognition but One reason is undoubtedly the behaviourist legacy.
with how emotions influence, and are influenced by, Behaviourists such as John B. Watson (1878–1958)
cognitive processes. Emotions are such a familiar and and Burrhus Frederick Skinner (1904–1990) recog-
fundamental aspect of everyday life, and it is often this nized the need for scientific rigour and objective, veri-
very ability to experience and express emotion that is fiable measurement and were therefore exclusively
seen as a crucial distinction between the behaviour of concerned with the overt behaviours displayed by an
humans and (possibly imaginary) high functioning organism – those that could be directly observed and
computers or robots. As you have seen in previous measured. For behaviourists, reference to unseen
chapters, it is possible for a computer to solve success- mental processes was taboo. Their emphasis on objec-
fully many difficult tasks and so mimic human tivity and empiricism continues to be an important
achievements. However, one very salient distinction influence in cognitive psychology today. This histori-
between the performance of computer and human is cal bias for a long time deterred study of emotion, in
that the computer won’t show pleasure when reaching which the main component – feelings – can only be
its goal or frustration if it fails, let alone empathy with accessed through introspection. Undoubtedly, another
its human operator. We shall consider whether this is factor has been the attitude towards emotions often
really an advance later in the chapter. expressed in Western, European societies, among oth-
Emotions seem such an important part of our lives ers. At least since Plato (375 BC), emotions have been
that it might come as a surprise that despite the rapid viewed as impediments to rational thought. Darwin
development of psychology as a discrete scientific dis- thought of them as childish or immature responses, a
cipline since the mid-1800s, the study of emotion residual hangover from our evolutionary past that no
has largely taken a back seat. Why should this be so? longer had useful functions for the mature adult.
508 PART 6 CHALLENGES, THEMES, AND ISSUES
ACTIVIT Y 16.1
Stop for a moment and reflect on one recent epi- when I was alone at home a special delivery van stopped
sode when you experienced emotion. Try to jot at our house looking for an address nearby. I stepped out-
down three or more aspects that characterized this side to point out directions, the front door blew in the wind,
occasion as being emotional. and it locked behind me. ‘No problem,’ I thought, and went
to the usual hiding place to retrieve the spare key. It was
COM M ENT
missing. Now I felt anger, frustration, and regret. Why
This is often a hard task, since one common feature of
wasn’t the key in its usual place? I blamed others for not
emotional situations is that it is sometimes difficult to
replacing it. Why had I been so stupid as to let the door
put into words what is happening! However, you may
slam? I swore and banged my fist. I went back to the door
have noted your feelings and perhaps what or who
and rattled the handle. I was taking deep breaths and felt
you considered was the cause of the emotion. Did
my heart beating fast with annoyance. I paced rapidly up
you include a description of how you behaved or a
and down whilst I tried to work out what to do next. . .
change in body sensations?
One example could go something like this (note
the different elements of this description): One day
However, the study of emotion and how it interacts quiet, withdrawn, and slow when you are sad. Facial
with cognition has enjoyed a resurgence of interest. expressions that are characteristic of different emo-
This is largely because of the development of objective, tions are also examples of behavioural responses. As
quantifiable ways of measuring the concomitants of these are all observable phenomena, they can be easier
emotion, such as psychophysiological techniques and to study empirically than internal feelings. However,
brain imaging, and a shift in attitude towards the they cannot generally be used to infer emotions
importance and function of emotions in everyday life. directly since, unlike most of the bodily (physiologi-
cal) responses associated with emotion, emotional
expressions can be brought under some degree of con-
1.1 Components of emotion trol. You can suppress your smile, make a special effort
to appear cheerful when feeling sad, feign interest in
From the example in Activity 16.1 it is clear that there order to be polite, and curb angry behaviour if it might
are different aspects to any emotional response. jeopardize your well-being. Still more problematic for
Traditionally, psychologists have identified at least research, various cultures and social groups differ in
three characteristics that are embodied within an their code of conduct with respect to emotional
emotional episode. These are: expressions. For example, in some cultures, such as in
many Arabian countries, public grieving involves
• behaviours overt crying, moaning, and beating of the chest, which
• bodily responses (physiology) are seen as appropriate expressions of respect for the
dead in assembled company, whereas in others, for
• feelings.
instance in Japan, a polite smile and tight emotional
control are expected.
1.1.1 Emotional behaviour and expression Unlike the very individual feeling of emotion and the
Many of the behaviours associated with emotion will internal bodily response to it, emotional behaviours,
be familiar to you. Some simple examples include: including emotion expressions, are visible to others;
laughing when you are happy; withdrawing from that is, they can communicate (albeit imperfectly) the
something you find disgusting; becoming agitated and individual’s emotional status. In any form of communi-
raising your voice when you are angry; and becoming cation, understanding the mechanism fully requires
CHAPTER 16 COGNITION AND EMOTION 509
researching both the recognition and the production of an animal’s body will respond to this kind of threat by
the appropriate signals (as discussed in Chapters 6 diverting the blood flow away from less vital regions,
and 7). So far, much more research effort has been such as the gut (digesting lunch is suddenly less impor-
directed towards recognition than production of behav- tant than ensuring you don’t become someone else’s).
ioural correlates of emotion. Facial expressions, rather The extra blood, and therefore energy, is supplied to
than other emotion behaviour such as ‘body language’, the major muscle blocks and the brain (rapid process-
have attracted most research attention. ing of information is needed or energy could be wasted
running in the wrong direction). The contents of the
1.1.2 Bodily responses blood are altered, boosting ‘fuel’ in the form of blood
The bodily responses associated with emotions are the glucose and cholesterol, and increasing clotting agent
physiological reactions such as sweating when you feel (which serves to stem blood loss in case of wounds),
anxious, or your heart racing when you feel agitated or and so on. This physiological reaction stands us in
excited. These reactions have been refined during evo- good stead when physical action is required to ensure
lution and are vital to survival. For example, if a lion survival.
attacks then there must be little delay before escape Many of these bodily responses are controlled by the
(‘flight’), or maybe aggression (‘fight’), begins. Typically autonomic nervous system (ANS) (see Figure 16.1), a
PARASYMPATHETIC SYMPATHETIC
ANS ANS
(dominant during (arousal function)
restful periods)
constricts pupil
dilates pupil
medulla
stimulates flow of saliva oblongata
constricts bronchi
dilates bronchi
solar plexus
inhibits peristalsis
lumbar
stimulates peristalsis
and secretion
and secretion
secretion of adrenalin
and noradrenalin
stimulates release
sacral
FIGU RE 16 .1 The autonomic nervous system (ANS) and physiological responses associated with emotions, showing
sympathetic and parasympathetic sections. Source: Reber, 1995, p.76
510 PART 6 CHALLENGES, THEMES, AND ISSUES
network of nerve fibres throughout the body that trans- gland near the kidneys. Adrenalin release initiates and
mits signals to the various organs, muscles, and glands. enhances sympathetic activity leading to changes such
The ANS is divided into two sections. The sympathetic as accelerating heart rate, vasoconstriction (constric-
ANS produces effects associated with arousal. These tion of the blood vessels), increased respiration (breath-
include secretion of the hormone adrenalin from a ing) rate and depth, and reduced gastrointestinal (gut)
activity. The intricate pattern of changes in hormone wise cognitive psychologists have concentrated less on
levels, breathing, redirection of blood flow and pressure feeling states than on exploration of the cognitive pro-
and changes in its constituents, and the many other cessing associated with emotions and emotional
changes occurring under stress all prepare the body for information.
physical exertion (the ‘flight or fight’ response described Now try Activity 16.2.
above). This is a physiological pattern fine-tuned by One issue that researchers face when trying to study
evolution and shared by other mammals, with only any of the components of emotion described above is
relatively minor details differing between species. In how to elicit realistic effects in the laboratory. In real
contrast, the parasympathetic ANS tends to dominate life, emotions are usually stronger than those seen in
during periods of rest, having broadly opposing effects the laboratory, so we have to be cautious when gener-
on the body. alizing from the results of any given study. There are at
Box 16.1 discusses techniques for measuring physi- least two reasons why it is difficult to study the behav-
ological responses that investigate this component of iours, physiology, and feelings associated with strong
emotion. emotions:
ACTIVIT Y 16.2
Thinking back to what you’ve learned so far about to bodily responses and feelings. The behavioural com-
cognition, would you say that emotions may also ponent of emotions includes face perception, which
have a cognitive component, as well as the compo- will be familiar from Chapter 4, though in emotion
nents we have just discussed (behaviour, bodily research it is the emotional expression and not identity
responses, and feelings)? If so, we would be able to that is of interest. However, as we proceed you will see
study the cognitive side of emotions using the tech- that many of the tools developed by cognitive scientists
niques and paradigms familiar to cognitive scientists. can be widely adapted to the study of emotions. Not
only do cognitive processes interact with emotions, but
COM M ENT
many psychologists believe that they are an integral
Looking only at the three components of emotion dis-
part of producing the emotions themselves.
cussed above, you might well answer ‘no’ with regard
512 PART 6 CHALLENGES, THEMES, AND ISSUES
SUMMARY OF SECTION 1
• Although the study of emotions from a cognitive point of view has historically been neglected, the
advent of new techniques and new ideas about the significance and function of emotions has brought
a resurgence of interest in the study of emotion and how it interacts with cognition.
• There are thought to be three main components of emotions:
– emotional behaviour and expression (e.g. emotional facial expressions)
– bodily responses (e.g. galvanic skin response)
– feelings.
2 DIFFERENT EMOTIONS
You should now have some idea of what is meant by At the core of basic emotion research is the concept
the term ‘emotion’ in psychology. Next we shall con- that emotions are a product of evolution. This belief
sider how one might classify and explain the huge maintains that a categorical set of emotions are bio-
variety of different emotions that individuals typically logically based and are therefore characteristic of
report. Psychologists usually take one of two humans and many other species. Paul Ekman, one of
approaches to dealing with the task of accounting for the most influential psychologists in this tradition,
different emotional experiences. Some refer to basic first used the term emotion family (1992) to describe
emotions, a categorical set thought to be of biological sets of emotions related to each other when consider-
origin. Others take a dimensional view, which consid- ing ‘theme’ (characteristics unique to a particular
ers the full range of emotional experience and the emotion family) and ‘variations’ (differences within
dimensions used to describe them. each theme). Sad expressions, for example, can be dis-
tinguished by narrowing of the eyes and crinkling of
the forehead that vary depending on the intensity of
2.1 Basic emotions the sadness experienced. However, themes character-
istic of sadness are fundamentally different from
One approach has been to assume that underlying the themes characteristic of other emotions (such as
richness of emotion experience there are a small num- tightly-pressed lips expressing anger or upward-
ber of discrete emotions – ones considered to be the turned corners of the mouth expressing happiness).
most fundamental or important. This idea is analo- The basic emotions approach argues that these are
gous to the processing of colour by the visual system, natural phenomena, and that emotion families should
where the whole range and subtlety of our colour be approached from biological and evolutionary per-
experience is achieved through stimulation of just spectives. Izard (2007) proposes that basic emotions
three different types of cones in the retina. Likewise, it are motivated by neural, bodily, and feeling compo-
is argued that different combinations of ‘basic emo- nents that activate evolved neurobiological substrates.
tions’ can produce all the other emotions. For exam- These substrates change with development and are
ple, a mixture of joy and acceptance produces thought to influence the feeling states of basic emo-
friendliness according to Plutchik (1991), a prominent tions. Despite growing evidence from brain imaging
basic emotions theorist. techniques that show specific associations between
CHAPTER 16 COGNITION AND EMOTION 513
patterns of neural activation and some of the basic by Darwin in The Expression of the Emotions in Man
emotions, there are several distinct challenges. One is and Animals (1998, first published in 1872), has col-
to provide evidence for the existence of a small num- lected a formidable body of information from cross-
ber of discrete emotion states; another is to decide cultural studies to support the fundamental status and
how many emotions should be called basic and which importance of these five emotions. He was impressed
ones they are. The idea of basic emotions has consid- by the observation that wherever he travelled people
erable general support but few agree exactly on the displayed broadly similar emotions, and that he had
appropriate number and type of emotions that should no difficulty in interpreting them despite language
be included. This point is illustrated by Table 16.1. barriers. For more systematic research his main
Despite these widely differing views there are five method was to show pictures of facial expressions,
emotions, sometimes called the Big Five, that appear such as those in Figure 16.3(a), and determine whether
to represent a broad consensus among basic emotion people from different cultures consistently selected
psychologists. These are anger, fear, sadness, disgust, the same emotion label to describe each one.
and happiness. Ekman, building on research described Figure 16.3(b) shows some typical results for six
emotions – the Big Five plus surprise. Although there
TAB LE 16 .1 Basic emotion theorists and the emotions is some variation, particularly within isolated non-lit-
they propose
erate cultures, there is always agreement above what
Emotion theorist Fundamental emotion
would be expected if people were just guessing (the
‘chance’ level, shown by the white bars). Ekman also
Arnold Anger, aversion, courage,
provided evidence for basic emotions in the produc-
dejection, desire, despair,
fear, hate, hope, love, tion as well as in the recognition of expressions. He
sadness visited a visually isolated non-literate group in New
Ekman, Friesen, and Anger, disgust, fear, joy, Guinea (people who had not previously met or seen
Ellsworth sadness, surprise pictures of anyone from outside their own cultural
Frijda Desire, happiness, interest, group) and asked them to show him what their face
surprise, wonder, sorrow
would look like if they were sad, happy, and so on. He
Gray Rage and terror, anxiety, joy
then took videos of their expressions and played them
Izard Anger, contempt, disgust,
distress, fear, guilt, interest, back to American students, who had to decide which
joy, shame, surprise emotion was being displayed by the New Guineans.
James Fear, grief, love, rage The American judges had no problem in identifying
McDougall Anger, disgust, elation, fear, the different emotions according to the (translated)
subjection, tender-emotion, labels to which the New Guineans had been respond-
wonder
ing, which further supports the notion of pancultural
Mowrer Pain, pleasure
or universal emotions (Ekman et al., 1969; Ekman,
Oatley and Johnson-Laird Anger, disgust, anxiety,
happiness, sadness
1999, provides a review of all his work).
Panksepp Expectancy, fear, rage, panic
In support of the basic emotions approach, Ekman
Plutchik Acceptance, anger, provides extensive evidence from cross-cultural work
anticipation, disgust, joy, such as ratings of spontaneous displays of emotion
fear, sadness, surprise across different cultures. More convincingly, he has
Tomkins Anger, interest, contempt, used objective measurements of facial behaviour (how
disgust, distress, fear, joy,
much different parts of the face move) and compared
shame, surprise
these across cultures and countries – for instance, by
Watson Fear, love, rage
testing participants from Japan and the USA (Ekman,
Weiner and Graham Happiness, sadness
1973). His studies have also extended to infants from
Source: Power and Dalgleish, 1997 different cultures (Ekman and Oster, 1979). You may
514 PART 6 CHALLENGES, THEMES, AND ISSUES
(a)
100
Expression
Happiness
Surprise
Anger
80
Sadness
Fear
Disgust
60
% agreement
40
20
0
Western literate Non-Western literate Isolated non-literate
(20 groups) (11 groups) (3 groups)
(b) Observers from different cultures
FIGU RE 16 . 3 (a) Some of the photos of facial expressions used by Ekman, showing (left to right from top) anger,
fear, disgust, surprise, happiness, and sadness. (b) Results from cross-cultural studies showing differences in recognizing
facial expressions of six emotions. Source: (a) Ekman and Friesen, 2003; (b) Rosenzweig et al., 1999, Figure 15.3, p.414
CHAPTER 16 COGNITION AND EMOTION 515
wonder why Ekman chose to look particularly at notion of basic emotions. For these researchers it fol-
infants’ facial expressions rather than those of adults. lows that such emotions arise from sub-cortical
If a characteristic or ability is present in infants, who brain mechanisms that we still share with many
have had little opportunity to be influenced by their other species (e.g. Panksepp, 1989; Panksepp et al.,
culture or upbringing, then that is additional evidence 1991; LeDoux, 1989). Debate is still active concern-
for that characteristic being largely genetic rather than ing whether and which emotions are basic, or
learned. The spontaneous facial expressions of blind whether it is clusters of related emotions that should
children (Medicus et al., 1994; Eibl Eibesfeldt, 1988) be considered together. However, many believe that
also support the idea that there may be basic emo- the development of the brain systems underlying
tions, and further that they may have biological rather something approximating to the basic emotions
than social origins. Other theorists, such as Plutchik seems to have arisen far back in our evolutionary
and Frijda (Plutchik and Landau, 1973; Frijda, 2001; past before the separation of mammals, reptiles, and
Frijda and Tcherkassof, 1997), rely not only on facial birds. Box 16.2 discusses how technology for imag-
expressions but on whole body movements – what is ing the brain has begun to shed light on the relation-
often called ‘body language’. ship between specific emotions and particular brain
Ekman’s assumption about the inheritance of structures.
emotion is shared by many others promoting the
take into account stimulus predictability or allow processing of all types of emotion and is particularly
assessment of brain changes occurring within individ- strongly activated in response to fear stimuli.
ual trials. It is these latter effects that are often of most Similarly, two areas are implicated in recognizing
interest to psychologists. The more recent onset of disgust: the insula, an area of cortex (the convoluted
event-related designs addresses these issues by rand- outer layer of the brain) and the basal ganglia (an
omized presentation of trials and averaging of neural evolutionarily old area in the brain stem). This has
activity across trials of the same type. Importantly, been corroborated by data from a patient who has
event-related designs allow researchers to analyse damage to these areas and is particularly poor at
their data based on the participant’s performance recognizing disgust in others (Calder et al., 2000).
(e.g. correct responses only) and eliminate the poten- Figure 16.4 shows the areas of the brain where
tial confounding effects of habituation (a decreased different studies have reported activation resulting
neural response to the stimulus presented). from either the processing of fearful faces (green
Overall, block and event-related designs are two squares) or learning about fear (red circles). As the
approaches used for evidencing associations between figure shows, the activation triggered by processing
neural activation and distinct emotions, and have fearful faces tends to involve the left amygdala,
already revealed some very interesting results. whereas learning about fear seems to produce
more bilateral (i.e. left and right) activation.
Neural substrates and emotion Figure 16.5 shows the areas where studies have
Many studies using the brain imaging techniques found brain responses to disgust. As with Figure
such as those discussed above have now shown that 16.4, the two images depict different slices through
a structure called the amygdala is involved in the the brain. The insula activations are shown in blue
FIGU RE 16 .4 Amygdala activations in response to the processing of fearful faces (green squares) or learning
about fear (red circles). The image on the left is a horizontal ‘slice’ through the brain, with the eyes at the top end
and the back of the head at the bottom. The image on the right is the same sort of slice but taken higher up,
more towards the top of the head. There is a tendency for the activation triggered by processing fearful faces to
involve the left amygdala, whereas learning about fear seems to produce more bilateral activation. Source: Calder
et al., 2001, Figure 3, p.357
CHAPTER 16 COGNITION AND EMOTION 517
and basal ganglia activations in red. The basal ganglia Section 1.1.3). As we said earlier, feelings have been
signals are mainly in the right hemisphere, whereas notoriously hard to study in psychology because the
the insula signals are more evenly distributed across only way to measure them was to rely on people’s
both hemispheres. subjective self-reports of their own internal state –
Another feature of these new brain-imaging tech- the much-scorned ‘introspection’. Now, though, we
niques is that as well as the cognitive processing of can investigate how brain activity changes according
emotion described above, they can give us an objec- to the strength and nature of our feelings, and this is
tive measure of the ‘feelings’ side of emotion (see a possibility that is only just starting to be exploited.
FIGU RE 16 . 5 Insula and basal ganglia activations in response to disgust. The two images depict different slices
through the brain. The insula activations are shown in blue and basal ganglia activations in red. The basal ganglia
signals are mainly in the right hemisphere, whereas the insula signals are more evenly distributed across the two
hemispheres. Source: Calder et al., 2001, Figure 4, p.357
2.2 Verbal labels to identify which emotion they thought was being
expressed. An overall accuracy of 66 per cent was
The fact that very similar verbal labels for emotions found for correct identification of anger, sadness,
are used across widely differing languages and cul- fear, joy, and neutral portrayals. Interestingly, com-
tures is sometimes used as evidence in support of parisons between countries revealed that accuracy
the existence of a discrete set of basic emotions cor- decreased as the native language of the participant
responding to those labels. Scherer and colleagues resembled German less, and that patterns of errors
(2001) have studied vocalizations – the sounds we were highly consistent. These data support the idea
use to communicate – to address whether the recog- that emotional vocalizations are recognized across
nition of basic emotions is universal. ‘Simulated’ cultures but that differences in language have an
vocal expressions were obtained by asking German effect. In other work by Scherer and colleagues
actors to record multiple nonsensical phrases in an (e.g. Scherer and Wallbott, 1994a, b; Wallbott and
emotional tone. Participants from nine countries Scherer, 1988), verbal labels were compared for
then listened to these recordings and were instructed seven emotions (anger, fear, sadness, joy, disgust,
518 PART 6 CHALLENGES, THEMES, AND ISSUES
shame, and guilt) by translating the English terms agree on the exact criteria that define them. Ortony
into the languages of 37 countries. If all languages and Turner (1990) have asked why, if basic emotions
include words to describe the so-called basic emo- are so basic, there is so much disagreement about
tions, and these emotions can be recognized cross- which count as basic, with some contenders (e.g.
culturally, then that gives reason for believing in the interest and desire) sometimes not even being consid-
universality of the concepts for the basic emotions. ered as emotions at all. An alternative dimensional
What about all the other emotion words; where approach, as the name implies, assumes that the full
do they fit into the idea of basic emotions? Scherer range of emotional experience can be explained by
and others introduced the idea of ‘modal emotions’; identifying a few key dimensions. If there are only two
that is, the idea that a number of these other emo- key dimensions, then all emotions could be identified
tion words may cluster together under a common as being located in a two-dimensional space specify-
‘theme’, and that the specific clustering of emotion ing the relative contribution provided by each of the
words betrays the underlying emotion concepts of two dimensions. An example of this approach is
the individual (recall discussions about concepts in shown in Figure 16.6.
Chapter 5). To complicate matters, different lan- The ‘affect grid’ in Figure 16.6 is taken from work
guages and cultures do seem to differ in the number by Peter Lang and colleagues (Bradley et al., 1999),
and categorization of their emotion terms. It is not who concentrated on studying our physiological
surprising to find that the range of situations that responses to emotional material. There are two
trigger emotions varies across cultures, but in addi- dimensions, arousal and valence (valence refers to
tion, different emotions are either elaborated or the positive/pleasant or negative/unpleasant quali-
downgraded in emphasis. There appears to be a set ties of something). The figure shows people’s ratings
of universals – for instance, loss of a loved one lead- of how ‘aroused’ and how ‘positive or negative’ they
ing to sadness, and attack to fear or anger – as well feel about a variety of different pictures. Other, sepa-
as a multitude of cultural specifics, such as whether rate dimensions, such as ‘dominance’, have also been
looking directly at a woman’s face evokes sensations proposed, producing a more complex three-dimen-
of polite interaction, flattery, or insult. Whilst debate sional space (dominance reflects a quality related to
continues about whether there are a small number how dominated vs in control the participant feels
of basic emotions and whether these are necessarily when considering this emotion or emotional infor-
inherited, it is clear that there are many cultural dif- mation). This dimensional approach circumvents
ferences in emotions. Thus, there are cross-cultural some of the problems associated with basic emo-
differences in: tions. It has the advantage of suggesting how the dif-
ferent emotions relate to one another and makes it
• the number and type of complex emotions easy to understand how different languages could
• the triggers for many emotions have developed different words to describe subtly
different mixes of emotion experience. However,
• the socially acceptable rules governing display of
some emotions appear to combine attributes that the
emotions in certain contexts.
dimensional model assumes should be at opposite
ends of a single continuum. For instance, nostalgia
seems to combine attributes of positive valence (the
2.3 The dimensional approach positive value of past experiences) with negative
valence (sadness or regret at their passing). Similarly,
The concept of ‘basic emotions’ is not without chal- the excitement of extreme sports or roller-coaster
lenges. Theorists such as Barrett (2006) note that even rides combines pleasure (positive valence) with fear
though humans describe their experiences using a (negative valence) to create the characteristic exhila-
discrete set of emotions, psychologists have yet to ration and excitement. Furthermore, it is still
CHAPTER 16 COGNITION AND EMOTION 519
VALENCE
Positive (pleasant)
Bunnies
Nature Erotica
Ski jump
Aroused
Basket
Calm
AROUSAL
Snake
Auto exhaust
Attacking
human
Cemetery
Mutilated
face
Negative (unpleasant)
FIGU RE 16 .6 The affect grid and example pictures (the ratings on the grid are for pictures similar to those shown).
Source: Dawson et al., 1999, Figure 8.2, p.161
ACTIVIT Y 16. 3
You might like to consider how you would map the excitement or energy. But notice too that the grid
different discrete emotions onto the affect grid. allows for a lot more variation between items. You
Where would you place sadness, contentment, fear, may also notice that the distribution has a ‘C’ shape to
and excitement, for example? it. It appears that there are plenty of things that we
consider to be neutral (neither pleasant nor unpleas-
COM M ENT
ant) and not particularly arousing, but very few arous-
You have probably opted for bottom left, top left,
ing neutral items! Putting it another way, if something
bottom right, and top right for sadness, contentment,
is arousing we tend to find it either really good or
fear, and excitement respectively. Sadness, for exam-
really bad (or as already noted, maybe both together).
ple, could be considered as fairly unpleasant with little
520 PART 6 CHALLENGES, THEMES, AND ISSUES
necessary to determine the dimensions, and how (if at all) to the evidence suggesting the existence of
many should be used, and to decide how these relate basic emotions (see Activity 16.3).
SUMMARY OF SECTION 2
• Some psychologists classify different emotions by identifying discrete or basic emotions.
• The Big Five basic emotions are widely recognized by many psychologists and there is reasonable
evidence to support this classification.
• The use of similar verbal labels, and production and recognition of emotional expressions across dif-
ferent cultures, further supports the notion of basic emotions.
• An alternative approach is to use a small number of continuously varying dimensions to describe the
range of emotional experience.
ACTIVIT Y 16.4
Can you think of any aspect of emotions already to a frightening event, rapid physiological changes take
touched upon in this chapter that might bestow a place that prepare the body for ‘fight or flight’.
useful advantage on animals (including humans)? Undoubtedly the rapid mobilization of the body’s
resources in this way provides a potentially life-saving
COM M ENT
advantage.
Think (or look) back to Section 1.1.2 on physiological
responses to emotion. You will recall that, in response
CHAPTER 16 COGNITION AND EMOTION 521
TAB LE 16 . 2 Summary of emotions and their associated action is required. Often in modern life, however, an
goals according to Oatley and Johnson-Laird emotional threat requires not more physical exertion,
but less. One example is the threat of a pending exam-
Emotion Juncture of Behaviour/
current plan response ination, which requires long hours sitting still at a
desk to revise rather than any physical exertion of the
Happiness Sub-goals being Continue with
achieved plan, modifying as body. Similarly, most of us have experienced the fear
necessary of a near accident while driving, but all our bodies
Sadness Failure of major Do nothing/ actually need to do to avoid the danger is perform
plan or loss of search for new minimal, albeit rapid, movements of the hands on the
active goal plan
steering wheel and the feet on the brakes.
Anxiety Self-preservation Stop and attend
Does this mean that many emotional reactions,
goal threatened vigilantly to
environment especially fear responses, no longer have useful func-
and/or escape tions? No. There are still many occasions when rapid
Anger Active plan Try harder, and/ physical responses avert death or injury. Even before
frustrated or aggress an exam, when you won’t be fighting or fleeing (even
Disgust Gustatory goal Reject substance if you feel you’d like to), the increased adrenalin and
frustrated and/or withdraw
physiological arousal will provide an energizing effect
Source: Oatley and Jenkins, 1996, Table 9.1, p.256 that can improve performance, if maintained at an
optimal level. However, too much anxiety impairs
However, the exact mechanisms are not spelled out. performance as the anxiety itself interferes with cog-
Unlike the physiological changes that we discuss next, nitive function and the physiological reaction makes it
the mechanism behind changes in cognitive process- hard to relax and sit still. At the other end of the spec-
ing in response to emotions is much less well under- trum, not enough arousal – in other words boredom
stood. Later in the chapter (Sections 4.2 and 4.3) we or disinterest – also impairs performance.
touch on some aspects of attentional deployment and This finding, expressed formally by Yerkes and
memory in emotion, but there is still a considerable Dodson (1908), is known as the Yerkes–Dodson law,
shortfall in our understanding of how internal emo- and is shown in Figure 16.7. Notice that, for an easier
tional status influences cognition and how processing task, higher levels of arousal are needed to attain the
of emotional information is prioritized and influences optimal level of performance compared with a hard
cognitive function. task. The Yerkes–Dodson law seems reasonable and
suggests that appropriate levels of emotion can indeed
be useful, while both too much and too little emo-
Emotions mobilize
3.2
tional arousal can put an organism at a disadvantage.
physiological resources
It is relatively easy to see how the physiological
changes involved in emotions are part and parcel of
Emotional expressions as
3.3
the need to readjust goals, sometimes with great rapid- communication
ity. It is vital that if your life is threatened, then your
body is ready to respond in the best possible way to What function might emotional expressions fulfil and
ensure your survival. In Section 1.1.2 we described can we see evidence of them in other animals? Charles
some of the bodily responses associated with emo- Darwin formalized the evolutionary view of the emo-
tions such as fear and gave an example of how these tions in one of his later works entitled The Expression
assist in ensuring survival. The physiological reactions of the Emotions in Man and Animals (1998, first pub-
described there stand us in good stead when physical lished in 1872). As well as acknowledging the more
522 PART 6 CHALLENGES, THEMES, AND ISSUES
100
High
Hard
Performance level
task Easy
task
Low
Low High
Level of arousal or anxiety
FIGU RE 16 .7 Yerkes–Dodson law. Source: Eysenck and Keane, 1996, Figure 18.8, p.454
obvious evolutionary advantage of physiological have already considered that display rules for expres-
changes during emotions (such as preparation for sions differ from culture to culture. For this difference
fight or flight), he highlighted how expressions of to occur, then of course we need to control the expres-
emotion serve to communicate the emotional status of sion displayed (at least to some extent). This also
an animal to others of their species (so-called conspe- means that humans are capable of deceiving with their
cifics). However, it has to be said that Darwin felt that expressions – we can lie about our emotional feelings.
emotions and emotion expressions in humans were Thus, emotional expressions serve multiple functions
no longer functional, but merely a relic from our evo- for humans: they can be honest signals of emotional
lutionary past – much as our appendix is seen to be status, as in other animals, or they can be part of the
superfluous to digestion. He drew parallels between impression management, polite interaction, or social
the expressions of animals and their functions, such as manipulation of the sender.
the snarl of a dog communicating a readiness to bite,
and the sneer of a human, which presumably has the
same origin but no longer sends the same message 3.4 Emotions as information
(normally!) (see Figure 16.8).
Darwin might have been partially correct in his To illustrate the idea of emotions as information, let us
feeling that emotion expressions no longer have the return to the Capgras delusion first mentioned in
function in humans that they do for other animals. We Chapter 4 (Section 6, Box 4.2). To remind you of the
FIGU RE 16 . 8 Darwin’s comparison between the sneer of a woman and the snarl of a dog. Source: Darwin, 1998,
Figures 14 and 22, pp.117 and 246
CHAPTER 16 COGNITION AND EMOTION 523
delusion (or syndrome) we will illustrate it with the rule is not hard and fast and so is not generally very
case of an individual whom we will call Alan. Alan obvious as you play. Playing the ‘good decks’ is the best
was in a car accident with his wife and sustained an strategy; you win a little and lose a little, but overall
injury to his head. His wife, Christine, was also injured your winnings start to add up. Damasio has developed
and taken to hospital but later recovered. However, a theory to explain how people come to operate this
Alan refused to believe that Christine was still alive. strategy successfully, and make other similar decisions
He recognized her face but remained convinced that in life, when they are acting on hunches rather than
this was not really her, but a sinister impostor. full understanding.
Remember that in this rare syndrome the sufferer According to Damasio, the emotional responses to
believes that a family member, or someone close, has winning and losing produce physiological changes
been replaced by aliens or impostors. In such cases it that he calls somatic markers. Over time, through a
is believed that although facial recognition is intact, a process of conditioning, the decks come to evoke dif-
parallel system for registering the emotional meaning ferent physiological responses in the player, essentially
of the face has been damaged. Indeed, when Alan’s representing the accumulated positive emotions of
palms were tested for SC changes (skin conductance wins together with negative emotions of losses. After
– see Box 16.1) when viewing pictures of Christine’s extended experience, as the player considers making a
face, these responses were absent. SC changes, signal- selection from each deck, the physiological response
ling an emotional response, would normally occur for conditioned to this deck will be initiated and this acts
any of us if viewing either emotional expressions or as a marker capable of guiding choice. Damasio sug-
the face of someone we knew. Their absence signals a gested that somatic markers represent the ‘gut feelings’
lack of emotional resonance; no sense of affiliation. It that we often use to guide our decisions, even though
would appear that Alan’s brain interpreted this lack of we may never become consciously aware of why we
physiological feedback as evidence that this was not have a gut feeling about a particular choice. The func-
someone close. However, since the perceptual quali- tion of emotion, for Damasio, is therefore centred
ties of the face matched those of his wife, it must be around information and future actions.
someone who looked just like Christine, an impostor,
a frightening and distressing situation for all.
The idea that emotions provide information to
guide decision making is fundamental to the theories
What is the function of
3.5
of Damasio (1996). His views are best explained by emotional feelings?
describing the task most associated with him, the so-
called Iowa gambling task. You are given four decks of Although we have only touched on the topic, it is rela-
playing cards and asked to select from one and turn tively easy to propose evolutionary advantages con-
the card over. For reasons that are not explained, you ferred by emotional behaviours and physiological
are either rewarded or fined as a result of your selec- responses to emotions. The same is not true of the
tion. Your task is to attempt to maximize your win- function of emotional feelings. Take fear, the example
nings. After playing for a while you are likely to find we have used the most. The physiological response to
yourself making more selections from two out of the a fearful situation can provide the physical resources
four decks, but you probably won’t be able to say to escape danger or stand and fight. Our behaviour,
exactly why. This task is arranged so that two decks including expressions, functions to communicate our
(the ‘good decks’) give less spectacular wins but also fear to others. But why do we need to experience the
less punishing losses. Choosing from these two over a unpleasant feeling of fear, or anticipated fear (anxiety)
period of time achieves a modest gain. The other two when we expect a frightening experience?
‘bad decks’ sometimes deliver large wins, but also Feelings are part of our conscious experience. The
large losses resulting in an overall loss on average. The functions of consciousness, as you will consider in
524 PART 6 CHALLENGES, THEMES, AND ISSUES
Chapter 18, are by no means uncontroversial, but one such as when suppressing the tendency to respond in
facet that is fairly regularly acknowledged is the notion anger at a socially inappropriate moment. However,
that consciousness is necessary for performing new whilst these examples invoke the need for conscious-
tasks or trying to override habits without relying simply ness, they still do not explain the necessity to feel the
on mechanisms of conditioning. This would also apply emotions of fear or anger. As the psychology of emotion
to learning new responses to an emotional situation, continues to develop, future theories and research are
such as when soldiers continue to advance into battle likely to give us greater insight into the possible func-
despite a strong urge to flee, or in overriding habits, tion of the feelings associated with emotion.
SUMMARY OF SECTION 3
• Following Darwin, many psychologists believe that emotions have evolutionary functions, including
the mobilization of physiological resources, which remain valid today.
• Oatley and Johnson-Laird maintain that the purpose of emotions is to interrupt current behaviour in
order to change priorities and goals in the light of new information.
• Damasio has formulated a somatic marker account of the function of emotions, in which their pri-
mary purpose is to provide information, via bodily feedback, which guides future decision making.
• The functions of ‘feeling’ emotion are still speculative.
4EMOTION INFLUENCES
COGNITION
4.1 Some important concepts measured by self-report (asking participants to intro-
spect and describe how they feel), they also relate
Before we start to discuss how cognition and emotion directly to the behaviours and physiology discussed
interact with each other, there are some important above and can be measured in the same way.
terms that you need to become familiar with. The first In contrast, trait emotion refers to more stable per-
of these is the distinction between state and trait sonality characteristics or ‘what kind of person’ you are.
emotion. For example, some individuals may be prone to angry
outbursts, or have a tendency to worry about things, or
4.1.1 State and trait emotion be optimistic and always looking on the bright side.
State emotion (also called mood or affect) refers to how Psychologists have directed much effort into trying to
you feel right now. As you will be aware, this can change capture theoretically these ideas about stable personal-
from minute to minute, day to day. State emotion is a ity characteristics. Thus, traits are theoretical constructs
very transient and variable entity. It is a construct that relating to aspects that are more enduring and charac-
allows us to acknowledge the fact that momentary teristic of a person, and describe how one person may
feelings may be quite different from the way an indi- differ from others. Some common traits that have been
vidual usually feels. Although state emotions are usually proposed and are frequently measured (again by
CHAPTER 16 COGNITION AND EMOTION 525
self-report) include: anxiety; depression; social desira- experiment one might present participants with lists
bility (how much you adapt your behaviour in order to of negative emotional words (e.g. cancer, attack, evil)
gain the approval of others); anger; impulsivity; and mixed with neutral words (e.g. number, unusual,
emotional sensitivity. round) and ask for later recall in a surprise memory
A trait tends to make a person more prone to expe- test. The emotional aspect in the task is the valence
riencing the associated mood state. For example, a (pleasantness/unpleasantness) of the words, which is
high trait anxious individual will tend to feel more the independent variable. The cognitive measure
anxious for more of the time than a low trait anxious (dependent variable) is how many words of each type
person. This is why certain traits, like anxiety or are recalled in the memory recall test. You might be
depression (sadness), are useful to psychologists inter- interested to know that while most people will remem-
ested in emotions – they are a more permanent indi- ber more positive than negative words (a very com-
cator of who tends to have more or less of the relevant mon ‘positive bias’ in emotion processing), individuals
state emotion. with clinical depression tend to remember more of the
negative words. Box 16.3 in Section 4.2.1 discusses
Processing vs manifestation of
4.1.2
this further.
emotion As we mentioned above, things can become more
Another important distinction is between the mani- complicated when hot and cold emotions occur simul-
festation of emotion itself and the processing of emo- taneously. In the psychology of cognition and emotion
tional material. The manifestation of emotion is we are interested not just in how people process emo-
exactly what we were discussing in Section 1. Thus, by tional material, but also in how this processing is
‘manifestation’ we mean both the experience of emo- affected by emotional states and traits. For example,
tion, the feeling state, and the expression of that expe- does the processing of sad words change when some-
rience through bodily changes and behaviours. This is one is actually feeling sad at the time? Similarly, we
also often known as the ‘hot’ component to emotion. might want to know whether people who are vulner-
In contrast, the ‘cold’ component is the processing of able to anxiety (i.e. high on trait anxiety) process
emotional material but without emotion being actu- threatening words any differently from those who are
ally experienced. This isn’t always an easy distinction not. These more complex questions are what cogni-
to make. It is a bit like the difference between describ- tion and emotion psychologists are mostly concerned
ing an emotional event in a detached way (relating a with. Section 4.2 delves deeper into these issues.
series of facts) compared with describing it in emo-
tional terms. Obviously the two types of process regu- 4.1.3 Cognitive biases
larly co-occur – the memory of the facts of an event A final term that is important to this section is cogni-
often brings back the feelings as well – and in this case tive bias, defined as the selective processing of pathol-
the manifestation/processing distinction may seem ogy-congruent information. In other words, cognitive
blurred. However, in psychology we often use stimuli processes are biased if an individual selectively prior-
such as words or pictures as a way of studying how we itizes information that reinforces a pathological state.
process emotional material, although these stimuli This then leads to a self-perpetuating cycle of cause
rarely elicit a strong experience of emotion in partici- and effect, in which the information processed is
pants. It is important to grasp, then, that studying cog- thought to contribute to the cause and maintenance of
nitive processing in emotion can be quite distinct a psychopathology. There is some evidence already
from studying the manifestation of emotion. consistent with this. Laboratory-based experiments
Already you may have realized that the processing have developed ‘training’ programmes in an effort to
of emotional material is our first example of an inter- modify the cognitive biases potentially contributing to
action between cognition and emotion. In a typical emotional disorders. These programmes use cognitive
526 PART 6 CHALLENGES, THEMES, AND ISSUES
We start our examination of the interactions between FIGU RE 16 .9 Results from Bower’s (1981) mood
cognition and emotion by considering the ways in congruent memory experiment. Source: Eysenck and
which emotional states affect memory for emotional Keane, 1996, Figure 18.4, p.446
material.
4.2.1 Mood congruent memory As you can see, more was recalled from the story
What happens to memory processes when the content that matched the mood of the participant as they were
of material being encoded matches the mood state of reading. For example, sad participants recalled more
the participant doing that encoding? For example, if facts about the sad story than about the happy one.
you are feeling sad and then happen to watch a sad The phenomenon of mood congruent memory has
film, how does this influence your later memory of the proved very robust. It has also sparked a whole field of
film? This scenario could produce an example of research into the effects of emotional disorders on
mood congruent memory (MCM). Bower and col- cognitive processing, such as the relationship between
leagues’ classic experiments (e.g. Bower, 1981) sparked clinical depression and memory processes (see
a great deal of interest in this phenomenon. In a typi- Activity 16.5).
cal example, participants are put in either a happy or Interestingly, work on mood congruency has
sad mood by hypnosis and then read both a happy and alerted us to the finding that even ‘normal’ individu-
a sad story (you may like to consider the ethical impli- als, in no particular mood, seem to have a positive and
cations of such a study). Participants are then given a potentially adaptive bias towards memory for positive
surprise recall test to see how much of each story they information. Some suggest that this helps us to keep a
can recall. The results are shown in Figure 16.9. positive outlook on life, in the face of all the problems
ACTIVIT Y 16. 5
You might like to think about what you would pre- ing in mind that one of the hallmarks of clinical
dict if you tested a clinically depressed person on depression is chronic low, or sad, mood. After you
memory for negative and neutral information, bear- have considered this, look at Box 16.3.
CHAPTER 16 COGNITION AND EMOTION 527
BOX 16.3
Typically, individuals with clinical depression and turn will make them feel even more depressed. You
those who are not diagnosed but still report feeling can see that a vicious cycle could be set up, where
constantly low in mood (sub-clinical depression) all the memory bias contributes to the mood, which
show mood congruent memory (MCM) effects, enhances the memory bias and so on. Teasdale and
sometimes called a ‘bias’, for negative material. Many others have spent a lifetime of research trying to
different types of experiments have been used to devise methods of breaking this cycle and coming up
verify this finding, using positive and negative word with new cognitive treatments for depression, such
lists, self-descriptive adjectives, sentences, and whole as a procedure called mindfulness-based cognitive
scripts (Matt et al., 1992 offer a meta-analysis). The therapy (Segal et al., 2002).
effect appears to be stronger when participants are Joormann and colleagues (2009) have used sup-
aware of the relationship between their mood and pression training in individuals with major depres-
the material, and also, not surprisingly, when the sive disorder (MDD) to induce forgetting of negative
negative nature of the material is stronger (e.g. ‘evil’ information. Depressed and non-depressed partici-
vs ‘bad’). The bias also includes recall of autobio- pants first learned to associate neutral cue words
graphical memories (see Chapter 17). Although this with positive and negative target words. Participants
method might seem inconclusive (maybe depressed in the training condition were then instructed to
people really have had more negative experiences suppress negative target words by learning to asso-
anyway), experiments using mood induction really ciate positive or negative ‘substitute’ words with the
do suggest that mood affects the valence of the per- original cue words. It was found that depressed par-
sonal memories that are brought to mind. ticipants successfully forgot negative words in both
These findings are of more than just theoretical the positive and negative substitute conditions but
interest. It has been suggested that MCM may con- did not in the unaided (no training) condition. This
tribute to keeping someone in a depressed mood study demonstrates that suppression training
and that if we change this cognitive processing bias, reduces recall of negative information in depressed
then that might help the mood to lift. Teasdale individuals and that thought substitutes are useful
(1988) has developed this idea, as shown in Figure tools for inducing cognitive change. Suppression
16.10. The suggestion is that patients’ bias towards training is therefore an appropriate method for
recalling more negative mood congruent informa- modifying memory congruent bias and will be
tion means that their world will seem to contain important to further investigation of the effects of
more negative things than is really the case. This in forgetting on depressed mood.
DEPRESSED MOOD
biases memory towards
emotionally negative items
(increases probability of recalling
negative memories and information)
PREPONDERANCE OF
NEGATIVE MEMORIES
AND INFORMATION
increases depressed mood
FIGU RE 16 .10 It is thought that the mood congruent memory effect contributes to a vicious cycle in which
depressed mood enhances the accessibility of negative memories. In turn, having more negative memories in
mind is likely to exacerbate depressed mood. Source: based on Teasdale, 1988
528 PART 6 CHALLENGES, THEMES, AND ISSUES
% retention
dependent recall, is a well-known but controversial 60
phenomenon. It can be seen as a specific case of the
influence of context on memory that was described in
Chapter 8. The idea is that your memory for a particu- 50
lar stimulus or event will be better if there is a match 4
3
between your mood at the time you experienced it
40
and your mood when you try to recall it. For example, Sad Happy
Recall mood
imagine you have a heated argument with a friend.
Mood dependent memory would suggest that you will FIGU RE 16 .11 Percentage retention of words
remember more of what was actually said if you are in according to the match between learning mood (happy
an angry state again than if you are not. or sad) and recall mood. Source: Based on Bower, 1981,
Figure 2, p.132
In the laboratory this hypothesis has been tested
using the following type of experiment. Participants are
put into particular moods (mood induction) by one of mood at recall was different from mood at learning
several techniques such as hypnosis, listening to appro- (points 3 and 4 in Figure 16.11). You should be able to
priate music, or reading appropriate passages of text. see from the figure that when learning and test moods
Then they are asked to learn a list of arbitrary, neutral were the same, participants were indeed better at
words while in the induced mood. Participants are later remembering list A, compared with participants who
put back into either the same or a different mood and tried to recall the same list in a different mood from
asked to free recall the words (‘remember as many as the one they were in when they learned it.
you can’; no cues or prompts are given). If this second Perhaps you are wondering what was the point of
induced mood matches the one they were in when they the second list B? The reason for using two lists was
learned the first list, then recall should be higher. simply that learning list B in a contrasting mood acted
A classic experiment of this type is that by Bower as an interference task, which made the experiment
(1981) who used happy and sad mood induction by more sensitive to the beneficial or detrimental effects
hypnosis. Figure 16.11 shows some typical results of the mood manipulations.
from the experiment. In this design participants Bower (1981) went on to propose an influential
learned two lists of words, list A and list B, one after semantic network theory to explain these mood and
the other, but only recall for the first list, list A, was memory effects. The theory is shown in Figure 16.12.
tested. As usual, participants were put into either a Bower suggested that emotions could be represented as
happy or sad mood before learning took place, one nodes in a network, having numerous connections to
mood for each list. Thus those who learned list A in a related semantic items (words, concepts, etc.), other
happy mood then learned list B in a sad mood, and emotion nodes, and outputs such as behaviour and
vice versa. Then, after both lists had been learned, they autonomic responses. Material such as memories and
were tested on their recall for the first list only. The knowledge is stored in the network and may be con-
mood of participants during the test (using a third nected to some emotion nodes. Nodes become activated
mood induction) either matched or contrasted with by external or internal stimuli and when this happens
the mood at the time of learning list A. So for some that activation selectively spreads across the network via
participants mood at recall matched mood at learning the links to other units, a bit like ripples across a pond.
(points 1 and 2 in Figure 16.11), whereas for others Notice that some connections are inhibitory, so that
CHAPTER 16 COGNITION AND EMOTION 529
Expressive Autonomic
behaviours patterns
Internal
or Sadness (inhibition) Happiness
external emotion node emotion node
input
FIGU RE 16 .12 An example semantic network theory of emotion. Source: Power and Dalgleish, 1997, Figure 3.2, p.71
activation of the sadness node, for example, would sup- recalled (e.g. recall using real-life autobiographical
press any activation in the opposite happiness node. events produces better results). However, in a review
When nodes are activated above a certain threshold, of the work on mood dependent memory Eich and
then the content of those nodes enters conscious aware- Metcalfe (1989) concluded that the phenomenon itself
ness leading to the corresponding feelings and thoughts. was genuine, and that the problems lay with the meth-
You can perhaps start to see how this theory fits with ods used to detect and measure it. There is no doubt
the results of mood dependent memory experiments. that Bower’s findings and theory have been remarka-
When participants learn a word list in one mood, links bly fruitful in their influence on the thinking and
are created between the relevant emotion node and the direction of emotion research.
memory representations of those words. Thus when Before we move on, it is worth stopping to think
participants try to recall the same words this can be what the key difference is between mood dependent
made easier if they are in the same mood thanks to the memory experiments and those we discussed in
spreading activation from the associated emotion Section 4.2.1 under the heading mood congruent
node. Conversely, in a different mood there will be no memory. Here we have been concerned merely with
advantage from such activation, and indeed it is the effect of mood on recall, irrespective of what it was
assumed that inhibition of the word representations that was actually being remembered. With mood con-
from the incongruent emotion node might result. gruent effects, however, there is always a match – or
Since Bower’s original experiment there have been congruity – between the emotional material being
many attempts to replicate his finding, but these have recalled and the mood of the individual when encod-
met with varied success. It seems that mood depend- ing that material. Congruity means a match between
ent memory is not a very robust effect. It is much mood at encoding and material being encoded (see
influenced by factors such as the strength of the mood Activity 16.6); dependency refers to a match between
state that is induced and the nature of the items to be mood at encoding and mood at retrieval.
ACTIVIT Y 16.6
Can you think of examples where congruent or separate aspects of a situation are matched or not.
incongruent stimuli (rather than mood states) might For example, in tasks demonstrating the flanker effect
influence cognition? (see Chapter 2, Section 3.3) you may remember that
performance depends on how closely matched the
COM M ENT
targets and the distractors are. The Stroop effect, dis-
It has regularly been shown that an individual’s
cussed in Section 4.3 below, is another such example.
performance is influenced by whether or not two
530 PART 6 CHALLENGES, THEMES, AND ISSUES
4.3 Attention that from the neutral words, compared with the same
difference when observed in non-anxious individuals.
In the same way that memory for emotional material As performance on the Stroop task is generally taken
can be biased in a direction consistent with one’s to be a measure of attention towards the word mean-
mood, so can attention. A classic example of this is the ings (although the precise mechanisms behind the
‘emotional Stroop’. effect are still not fully understood), then this is an
In the standard Stroop task (Stroop, 1935) (see example of an anxiety-related attentional bias.
Chapter 2, Section 3.3, Box 2.2), participants are asked In an attempt to demonstrate more clearly the
to name out loud, as fast as they can, the colour of the nature of this attentional bias, MacLeod et al. (1986)
ink in which colour words are written. When the ink published a now classic paper using an innovative new
colour is different from the meaning of the word itself method of testing attention allocation. Their design,
(e.g. ‘blue’ written in red ink) participants are slowed now known as the dot probe or ‘attentional probe’
down compared with stimuli where the word meaning task, is shown in Figure 16.14.
and ink colour are matched. The effect arises because The task is to respond as rapidly as possible to the
of the different amounts of interference between con- presentation of a dot (termed a ‘probe’ because it is
gruent ink colour and word meaning compared with a probing where attention is located). This is, therefore,
competing or incongruent ink colour and word mean- a reaction time (RT) task. On some trials (catch trials)
ing. The emotional Stroop differs in that, instead of there is no dot, to make sure participants are really
colour words, emotional and neutral words are used, looking for it and not just responding as soon as the
still printed in different colours. Examples of both words disappear. As you can see, before the dot a pair
types of Stroop task are shown in Figure 16.13. of word stimuli are displayed, one threatening and one
When the emotional Stroop is given, for example, to neutral. If a participant is consistently faster to find
high-trait anxious individuals, then the interference the dot whenever it appears where the threatening
from the anxiety-relevant words is usually greater than item was, then we can reasonably assume that they
Fixation (eyes fixed Stimuli are presented, Task: detect the dot
on the cross) ensures simultaneously but at (probe) as quickly as
attention is centrally different locations, possible. The dot appears
located at first usually for ½ second either on the left or the right
must have been attending to that item rather than to different types of material including words, pictures,
the neutral item. The original results of MacLeod et al. and faces, but is most prominent when the material
(1986) are shown in Figure 16.15. matches the current concerns of the individual. For
The figure shows that control (not anxious) partici- example, snake phobics will show a stronger atten-
pants were just slightly faster when probes appeared in tional bias towards pictures of snakes than towards
the neutral rather than the threat areas of the display pictures of snarling dogs. This type of bias, with suit-
(another example of the normal ‘positive bias’). able materials, has been shown with patients suffering
Anxious patients were the other way round – faster for a variety of anxiety disorders, such as those with pho-
probes appearing where threat words had been than bias, generalized anxiety, and post-traumatic stress
for probes appearing where neutral words had been. disorder. It is also apparent, although less reliably so,
This strongly suggested that anxious individuals allo- in non-clinical individuals who have high state anxi-
cate their attention to threat words rather than to neu- ety or high trait anxiety, or both.
tral words, whereas controls do not. Thus, consistent Look again at Figure 16.10, where it is suggested
with the emotional Stroop results, MacLeod et al. that depression could be exacerbated by a vicious
found an attentional bias for threat in their anxious cycle of mood congruent memories contributing to
patients. These results sparked over a decade of con- sad mood. Could a similar mechanism be involved in
tinuing research into this so-called attentional bias for attentional processing? Mathews (1990) proposed that
threat. We now know that the bias is seen with many just such a vicious cycle could operate to maintain
anxious mood and attention to threat. Imagine that
700 your anxiety makes you pick out and pay more atten-
tion to potential threats in the environment. This bias
Mean probe detection latencies (ms)
650 Current may well make it seem as if your surroundings are full
anxious
of threats and this would, unsurprisingly, make you
600 feel more anxious, which would perpetuate your
attentional bias and so on. You would end up in a
550 Control hyper-vigilant state, anxious about, and on the look
participants
out for, threats of relevance to you. This idea that anx-
500 ious people are constantly in a vigilant, checking mode
is popular in current theorizing about clinical anxiety.
How could you test whether an attentional bias
Threat Neutral might cause anxiety or be caused by anxiety (or both),
area area
and can anything be done to reverse its effects? Mathews
FIGU RE 16 .15 Results from MacLeod et al. (1986). and MacLeod (2002) set themselves such a task by
Source: Eysenck and Keane, 1996, Figure 18.6, p.450 devising methods of directly inducing a positive or
532 PART 6 CHALLENGES, THEMES, AND ISSUES
negative bias in non-anxious volunteers using special- Another similarity between attentional bias and the
ized training procedures, and then assessing its effects memory biases we discussed in Section 4.2 above is
on anxiety levels. Possessing an induced positive bias the performance of ‘normal’, non-anxious controls. As
reduced anxiety levels when exposed to a moderately before, it seems that most of us have an adaptive or
stressful situation just after training, whilst a negative protective bias in the opposite direction to that of
bias increased anxiety levels. These results certainly emotionally disordered patients. Look at Figure 16.15
confirm that the attentional bias has a causal effect on again. Controls are faster in neutral areas than in
anxiety levels, and interestingly that training proce- threat areas, and this has also been found in several
dures have been found that directly modify the bias, subsequent studies. It may be that this represents
and can thereby reduce (or increase) anxiety. Such active avoidance of minor, insignificant threats, such
training procedures have since expanded to the devel- as words and pictures. It would clearly be adaptive to
opment of cognitive bias modification programmes avoid the many distractions of minor threats and sin-
that are specifically designed to induce attentional bias gle out only serious threats for particular attention.
toward non-threatening stimuli (Cognitive Bias Now try Activity 16.7.
Modification for Attention, or CBM-A). Amir and col- Although we have mostly mentioned anxious
leagues (2009) implemented an eight-session CBMA patients so far, biases favouring attention to threat can
programme, designed to reduce attentional bias toward also be found in high trait anxious participants,
threat and decrease anxiety, in a population character- although less reliably. Moreover, these biases tend to
ized by generalized anxiety disorder (GAD). This was be stronger when high state anxious mood and high
achieved using the dot probe task by training partici- trait anxiety occur together. Anxious patients tend to
pants to attend to non-threatening words on 66 per have relatively high levels of state anxiety much of the
cent of the trials and then testing training-congruent time so it is unsurprising that attentional biases are
effects on a new set of materials. Self-report and inter- more robust in this group.
view measures were also used to assess index of bias
and state-anxiety before and after training. Importantly,
this study shows that experimental modification of 4.4 Semantic interpretation
attentional bias to threatening information reduces
anxiety using laboratory methods independent of a Semantic interpretation (see Chapter 6) is another
therapist. cognitive process known to be influenced by emotion.
ACTIVIT Y 16.7
Can you think of a situation where you paid atten- people have a bias to attend to things that match
tion to negative cues in your environment because their special interests. Temporary biases are also
of a fear that you have? If you haven’t noticed this common, and can, for instance, occur when you
negative bias in yourself, have you ever noticed have acquired something new such as when you pur-
another, non-negative, attentional bias towards fea- chase a new car. For a while you may find yourself
tures in the environment? noticing many examples of this same model, which
previously you ignored. This might give you a feel for
COM M ENT
what it could be like for an anxious individual,
Anyone who is very afraid of spiders might recog-
although for them it is unpleasant items that just
nize this characteristic in themselves. Almost invari-
constantly catch their attention without any inten-
ably they will notice any spider in the surroundings
tion on their part.
well before their non-phobic companions. Most
CHAPTER 16 COGNITION AND EMOTION 533
If you see a word such as ‘batter’, do you think of pan- described in Chapter 2, Section 1.3). This task involves
cakes or do you think of an assault on an innocent vic- simply identifying, as rapidly as possible, whether the
tim? It is surprising how many situations in life can be second of two sequentially presented items is a real
ambiguous and therefore open to biases of interpreta- word or a meaningless letter string (a non-word).
tion. In this section we shall consider interpretation of From the participant’s point of view the first item that
ambiguous linguistic information, but be aware that appears is just to be ignored. However, this first word
the same processes apply in many situations. Assessing is actually a prime. As described in Chapter 2, if the
the nature of the shadow in the path ahead on a dark prime is related in meaning to the second word (the
night, or guessing the meaning of the probing look of target), as in cat–dog or nurse–doctor, then lexical
the interviewer when you apply for a job, are just two decisions are expected to be speeded compared to
other such examples. primes and targets that bear no semantic relation (e.g.
The earliest work on interpretation and emotion cat–doctor, nurse–dog).
used homophones. These are words like ‘pane’ and We can use this logic to infer how participants
‘pain’ or ‘die’ and ‘dye’, which sound the same but have interpreted the homograph primes. For example, if
different spellings associated with different meanings. lexical decisions for trials like batter–assault were
Eysenck et al. (1987) asked both high and low trait- faster than for trials like batter–pancake, this would
anxious individuals to write down the homophones imply that the participant interpreted batter as ‘assault’
as they heard them. All the homophones had both a rather than ‘pancake’. The results of the Richards and
threatening/unpleasant and a non-threatening or French study, as well as other similar studies, suggest
neutral meaning. This simple technique revealed that high anxious participants show a negative bias in
which interpretation had been made by the spelling interpretation – that is, there is a greater priming
the participants chose. Eysenck et al. found that the effect for target words related to the negative meaning
higher the participant’s trait anxiety, the more threat of the homograph than the neutral meaning. For non-
spellings they produced. This indicated that trait anx- anxious participants there is, once again, the familiar
iety was linked to a tendency to assume the negative positive bias towards the more positive or non-threat-
interpretation of an ambiguous stimulus – i.e. an ening meaning. Further studies have extended this
interpretative bias. research by using ambiguous sentences or even pas-
However, this method soon fell foul of criticism. sages of text, for example:
For example, it is possible that participants were aware
of and had access to both spellings, but just chose to ‘The doctor examined little Emily’s growth’ (her
write down the negative one. This matters because, if height or her tumour?)
true, it would mean that there was no bias in the actual
‘The two men watched as the chest was opened’ (a
interpretation of the words – both interpretations were
gruesome operation or an exciting find?)
made. Instead the bias would be at the stage of making
the response, which then says little about the cognitive ‘Your friend asks you to give a speech at her wedding
processing involved in making interpretations. This reception. You prepare some remarks and when the
tendency to report (and not truly interpret) emotional time comes you get to your feet. As you speak, you
information is called response bias. notice some people in the audience start to laugh’
Later work used an alternative method to avoid this (appreciatively or rudely?)
and other problems. For example, in their classic study
Richards and French (1992) used homographs instead Two types of technique used successfully to date are
of homophones. These are words that have dual mean- homographs and ambiguous passages of text. Grey
ings, despite having the same spelling, such as ‘batter’, and Mathews (2000) repeatedly trained volunteers
‘punch’, and ‘stalk’. They used these words in a priming using a cognitive bias modification of interpretations
experiment involving a lexical decision task (a task programme (CBM-I) to interpret the threatening
534 PART 6 CHALLENGES, THEMES, AND ISSUES
meanings of homographs. They found faster comple- or fail your driving test you might say ‘I’m terribly
tions of word fragments and lexical decisions when sorry but the train times have changed and I couldn’t
stimuli reflected threatening meanings. Mathews and help being late’ or ‘I had such an unreasonable exam-
Mackintosh (2000) used ambiguous passages of text to iner’ or ‘My instructor gave me inadequate prepara-
train participants in either a positive or negative direc- tion’. If you are early or pass your test first time, you
tion. For example, the ambiguous scenario ‘. . . as you might well congratulate yourself on your efficient
finish your presentation your employer looks up . . .’ organization and planning, or excellent driving skills.
would be induced to be either positive (. . . approv- You may have come across this described elsewhere as
ingly) or negative (. . . disapprovingly). Participants the self-serving attribution bias (see Activity 16.8).
later presented with novel ambiguous information are Although these self-serving biases might seem an
then found to spontaneously interpret new material irrational way of thinking, the evidence repeatedly
consistent with induction direction. Importantly, it supports their existence and, as with other positive
has been reported that interpretative biases are spon- biases, they may have protective properties. Moreover,
taneously deployed at least 24 hours later (Yiend in emotional disorders, particularly in depression or
et al., 2005); that induction training survives environ- anxiety, we know that this self-serving bias can be lost
mental and contextual changes (Mackintosh et al., or even reversed. Such people might think passing the
2006); and that positive interpretation induction pro- driving test was just luck, or the examiner being leni-
duces lasting reductions in both trait anxiety levels ent, whereas failing was yet more evidence of their
(Mathews et al., 2007) and vulnerability to an external own worthlessness and lack of skill. In some situations
stressor (Hoppitt et al., 2010). it can be shown that by lacking the positive bias, the
The concept of protective processing styles such as depressed person’s attribution of their own perfor-
these has been described formally in a theory known mance can be more accurate than for non-depressed
as attribution theory. A common observation is that controls, so-called ‘depressive realism’.
we attribute good things internally, as something It should be noted that, although the various posi-
within our control, whereas bad things are attributed tive biases that we have described are thought to be
externally to others or to circumstances. This reflects a quite normal and have protective qualities (such as
tendency to accept the credit for good outcomes and helping to maintain good mood and a positive self-
blame something or someone else for bad outcomes. image), it is equally true that, taken to their limits,
For example, if you are late for an important meeting they would be maladaptive.
ACTIVIT Y 16.8
When you are next chatting with family or friends, make. Does this go along with the attribution the-
or watching conversations on the television, see if ory? Do you notice any examples of the self-serving
you can identify some of the attributions people attribution bias?
SUMMARY OF SECTION 4
• State emotion refers to the feelings of the moment whereas traits refer to more enduring personality
characteristics of an individual.
• The manifestation of emotion is distinct from the processing of emotional material. The former refers
to feelings, behaviours, and bodily responses. The latter refers to the emotional content of the external
stimuli upon which the cognitive system acts.
CHAPTER 16 COGNITION AND EMOTION 535
• The field of cognition and emotion is primarily concerned with the conjunction between state or trait
emotions and the processing of emotional material.
• Mood congruent memory (MCM) refers to enhanced memory for material that matches present
mood. The phenomenon is particularly apparent in depression and may contribute to the clinical
disorder.
• Mood dependent memory (MDM) occurs when recall is enhanced by a match between mood at the
time of learning and mood at the time of testing. However, the effect is not very robust. Bower’s
semantic network theory provides one explanation of MDM and MCM.
• Biases in attention and in semantic interpretation are associated with both trait and state anxiety, and
again may contribute to chronic anxiety and clinical anxiety disorders.
• Cognitive bias modification procedures experimentally induce biases relevant to pathology-congruent
information. Beneficial effects of these procedures include reducing maladaptive biases and improv-
ing mood.
General autonomic
arousal
(e.g. heart races)
Simultaneous bodily
Stimulus Sensory
response and
(Bang!) perception
emotional experience
Particular
emotion
(b) Cannon–Bard theory experienced
Context,
previous
experience,
prior
(c) Schachter’s cognitive theory knowledge
FIGU RE 16 .16 Comparing the theories. Source: Based on Rosenzweig et al., 1999, Figure 15.1, p.412
for at least anger, fear, disgust, and perhaps sadness in Section 1.1.2). Some participants were told that there
(Ekman et al., 1983; Levenson et al., 2001). For exam- would be no effect of this injection, while others were
ple, Ekman claims that skin conductance (discussed in told that it would make their heart race. The latter group
Box 16.1) is higher during sadness than the other emo- did not report any emotional experience, while the for-
tions, and heart rate decelerates during disgust. mer group did. What does this result say about the
However, John Cacioppo, a renowned psychophysi- James–Lange theory of emotion? The fact that those
ologist, disagrees. Having reviewed all the available expecting no effect of injection did actually experience
data he concluded (Cacioppo et al., 2000) that the evi- emotion is consistent with James–Lange – the physiol-
dence for emotion-specific physiology is far more ogy directly led to an emotional experience. However,
uncertain and suggests that discrete emotions cannot the other result is inconsistent with that theory. Those
be differentiated by autonomic activity alone. able to attribute the bodily sensations to the injection
However, he does agree that there may be a consistent failed to experience emotion. The James–Lange theory
distinction between the positive and negative emo- makes no allowance for such cognitions to influence
tions in general. He proposes that negative emotions emotional experience in this way. It would predict that,
are associated with greater motivational output than despite this knowledge, the physiological arousal should
positive emotions and therefore show generally directly give rise to an emotional experience.
greater levels of autonomic activation. In a further aspect of the above experiment, partici-
pants were put in a room with a ‘stooge’ who was party
5.1.3 Schachter–Singer to the experiment and who acted either in an extremely
When cognitive psychology began to take hold in the happy or very angry manner. The behaviour of the
1960s, Stanley Schachter and Jerome Singer proposed stooge directly influenced the feelings of those partici-
an alternative to both the earlier James–Lange and pants who reported experiencing emotion (i.e. those
Cannon–Bard views. Like James they held that physio- with no foreknowledge of the effects of the injection).
logical mechanisms were crucial, but like Cannon they Those with the happy stooge reported experiencing hap-
also believed that these responses were non-specific piness, whereas those with the angry stooge reported
and could not distinguish the different emotions. anger. This demonstrates a strong influence of context
Instead they thought differentiation was achieved by on the specific emotion experienced. How does this
the individual’s particular interpretations or attribu- second finding fit with the James–Lange theory? It is
tions about why those bodily responses were occurring. clearly inconsistent with that theory because the same
These ambiguous messages from the body were inter- physiological reactions were being experienced differ-
preted by taking into account things like the situational ently according to context.
context, previous experience of when certain emotions Schachter and Singer used the results of this experi-
occur, expectations, and intellectual knowledge of the ment to support their theory. The non-specific physi-
world. Physiological arousal may be responsible for ological arousal interacted with the social and physical
feeling emotion but cognitive interpretations, or cogni- context that participants experienced to determine
tive appraisals, were what distinguished one emotion the precise emotion that was felt. They had succeeded
from another (see Figure 16.16(c)). in showing that identical physiological states could be
The Schachter–Singer theory predicts that it should subjectively experienced as different emotions accord-
be possible to change our experience of emotion by ing to how the individual appraised their circum-
changing the cognitive appraisals we make, even if the stances. Similarly, subjective emotional experience
physiological signs remain the same. To test this they could be eliminated by telling participants the true
performed a now famous experiment (Schachter and source of their bodily sensations. This convincingly
Singer, 1962). Participants were injected with epineph- showed that cognitive attributions were crucial in
rine (adrenalin), which is a hormone that stimulates whether or not emotions were experienced in their
activity in the sympathetic nervous system (discussed fullest sense.
538 PART 6 CHALLENGES, THEMES, AND ISSUES
The Schachter–Singer theory has been criticized. TAB LE 16 . 3 Scherer’s appraisal criteria and profiles for
For example, we now know, because we can measure different emotions
them, that physiological responses associated with dif-
ferent emotions are not in fact identical (and their Stimulus Anger/ Fear/ Sadness
evaluation checks rage panic
results have not always been replicated; e.g. Reisenzein,
1983). However, the lasting contribution of this theory Novelty
was the notion of cognitive appraisal being critically • Suddenness High High Low
involved in the generation of emotion. The acceptance • Familiarity Low Various Low
of this possibility spawned a whole generation of • Predictability Low Low Various
appraisal theorists. Intrinsic pleasantness Various Various Various
Goal significance
5.1.4 Appraisal theories today • Concern relevance Order Body Various
The central idea of appraisal theories is that emotions • Outcome probability Very high High Very high
are elicited and differentiated on the basis of the indi- • Expectation Dissonant Dissonant Various
vidual’s subjective evaluation of the external situation • Conduciveness Obstruct Obstruct Obstruct
or event combined with their own physiological state. • Urgency High Very high Low
entiate between emotions, it simultaneously raises • Cause: agent Other Other/ Various
nature
others. How are these appraisals made – using what
• Cause: motive Intent Various Chance/
yardstick, measuring tool, or criteria? neg.
Each different appraisal theory tends to suggest dif- • Control High Various Very low
ferent dimensions that we use when making apprais- • Power High Very low Very low
als. For example, Klaus Scherer (1999) proposes • Adjustment High Low Medium
specific fixed sets of criteria that we supposedly apply Comparability with standards
to any situation that comes our way. For example, one • External Low Various Various
criterion is the intrinsic qualities of the event, such as • Internal Low Various Various
how novel or agreeable it is. Another is how signifi-
cant the event is in terms of our own personal goals or Note: ‘Various’ = different appraisal results are compatible with the
needs. Clearly an event that is neutral in terms of our respective emotion.
Source: Dalgleish and Power, 1999, Table 30.2, p.639
goals or needs is unlikely to generate emotion. To get
an idea of how his criteria can distinguish one emo-
tion from another, look at Table 16.3.
For example, in the table, items under the fear/ sofa for a spider phobic. This is a sudden event, but
panic category suggest that this emotion results from spiders are familiar (although disliked); they behave
an event (stimulus) that is judged to be ‘high’ on nov- unpredictably; their intrinsic pleasantness is ‘various’
elty/suddenness and ‘low’ on novelty/predictability. It (that is, some people find them pleasant, although a
is of concern to the body’s status (goal significance/ spider phobic certainly would not); the ability to cope
concern relevance), urgency is very high, coping is perceived as low, and so on. You may feel that it
potential/power is very low, and so on. For a number would be impossible to evaluate an event on all these
of the appraisals involving fear/panic there can be various things before feeling the emotion; there surely
various options; for instance, under novelty/familiar- would not be enough time? This is a fair criticism and
ity it is possible to be afraid of something either famil- one that has been made by opponents of appraisal
iar or unfamiliar, so that this is not a defining feature theory. However, the counter-argument to this is that
for that emotion. To give a concrete example, imagine appraisals do not have to be conscious serial processes;
the consequence of a spider emerging from under the they may well occur in parallel, automatically.
CHAPTER 16 COGNITION AND EMOTION 539
The evidence in support of appraisal theory relies occurs before the emotional experience itself. This
entirely on subjective self-report and for this reason question of whether emotion precedes cognition,
these theories have been heavily criticized. Typically, or the other way round, is known as the primacy
participants are either asked to remember personal debate.
events, or are exposed to experimental manipulations
designed to induce an emotion. They are then asked to The following quotation summarizes Zajonc’s position
report, either verbally or using questionnaires, the very well: ‘Affect [meaning mood or state emotion]
types of appraisals they engaged in. You may have and cognition are separate and partially independent
spotted another problem with this. By definition, par- systems and . . . although they ordinarily function
ticipants will not be able to report on any appraisals conjointly, affect could be generated without a prior
made unconsciously, and this is a second major criti- cognitive process’ (Zajonc, 1984, p.117).
cism of the evidence for appraisal theory. As yet, How is this issue of primacy different from William
appraisal theorists have only been able to counter this James’s question? Do we laugh because we’re happy or
by stating that no alternative to self-report exists. It are we happy because we laugh? James was concerned
will be interesting to see whether appraisal theorists with the relationship between the conscious feeling of
will be able to find ways of accessing automatic evalu- experiencing an emotion and the physiological and
ations (perhaps using brain-imaging technologies). behavioural expression of that emotion (see Sections
1.1.1 and 1.1.2). The concept of cognitive appraisal
had not yet been articulated. The primacy debate con-
trasts the cognitive appraisal of an emotion with all its
A clash of minds: the
5.2
other aspects (feeling, physiology, and behaviour).
cognition/emotion debate In support of his argument Zajonc described an
experiment that used the famous mere exposure
No discussion of cognition and emotion would be effect. Mere exposure refers to the finding that people
complete without considering one famous example of tend to prefer items to which they have previously
the different approaches psychologists can take. The been exposed over comparable novel ones. Simple
two main protagonists in the debate were Richard familiarity with something creates a preference for
Lazarus and Robert Zajonc (pronounced zy-unce, to that item. This is presumably one reason for the suc-
rhyme with once). cess of the advertising industry. Zajonc took the mere
exposure method and adapted it so that items were
5.2.1 Zajonc’s view presented subliminally (below the level of conscious
Zajonc disagreed with appraisal theory’s contention awareness) while participants were engaged in
that emotions are produced by cognitive processes. He another, primary task. His results revealed that while
challenged the appraisal theorists directly (Zajonc, participants showed no recognition of the subliminal
1980) making two key assertions: items, they nevertheless gave them higher preference
ratings than novel items!
1. Appraisal is not necessary for emotion to be Zajonc argued that these results showed that cogni-
experienced. Emotions could arise directly tion was not necessary in order to have affective expe-
without the need for cognitions at all. (This is rience. He was assuming, first, that stimuli were not
similar to the James–Lange idea in that cognition being processed ‘cognitively’ because they were pre-
plays no part in the process of eliciting emotion.) sented subliminally. Second, he was assuming that
2. The experience of emotion always precedes one’s preference ratings were tantamount to emotional
cognitive processing of that emotion. This experience. Both these assumptions have since been
stronger claim adds to the first by saying that not challenged. Today the details of non-conscious pro-
only is appraisal not necessary, in fact it never cessing (outside awareness) are controversial, but few
540 PART 6 CHALLENGES, THEMES, AND ISSUES
would challenge its existence (see Chapter 18). acknowledged the view that the existence of non-con-
Certainly, it is unlikely that many psychologists now scious appraisal was a key question, and Lazarus con-
accept Zajonc’s implicit assumption that all cognitive ceded that although appraisal might influence emotion
processing must be conscious. Likewise, equating this did not mean it was an essential component. Both
preference judgements with affect or emotion is prob- agreed that, as Zajonc puts it: ‘It is a critical question
ably a step too far. Surely only very limited emotion is for cognitive theory and for theories of emotion to
involved in rating how much you like something that determine just what is the minimal information pro-
has no particular meaning or relevance to you? cess that is required for emotion. Can untransformed
pure sensory input directly generate emotional reac-
5.2.2 Lazarus’s view tions?’ (Zajonc, 1984).
Richard Lazarus, on the other hand, argued that cog- Interestingly, further work by Joseph LeDoux
nitive appraisal was essential for the experience of (LeDoux, 1989; LeDoux, 1996) has thrown further
emotion: ‘Cognitive appraisal (of meaning or signifi- light on the issue of primacy, suggesting that Zajonc
cance) underlies and is an integral feature of all emo- may be right after all. These studies used lesioned ani-
tional states’ (Lazarus, 1982, p.1021). In support of his mals in which specific neural pathways within the ani-
position he undertook several studies. Typically, emo- mals’ brains were deliberately severed by the
tions would be elicited by showing participants anxi- experimenter. Doing this allows an experimenter to
ety-provoking films. For example, one was a Stone deduce the function of the damaged pathways or
Age circumcision ritual; another showed someone regions by giving the animal various tasks to perform
involved in a gruesome industrial accident (it is and establishing which of these are impaired. You may
unlikely that this type of material would obtain ethical wish to think about the ethical issues such procedures
approval for use today!). Cognitive appraisal was manip- raise, though we do not have room to consider them
ulated by playing one of two soundtracks while par- here.
ticipants watched the films. A ‘denial’ soundtrack Using a variety of tasks manipulating emotions,
included statements indicating that one was a safety especially fear, LeDoux has shown that certain brain
film, the people in the film were actors, and the ritual structures such as the thalamus and the amygdala play
in the film was not actually painful. An ‘intellectual- different roles in the generation of emotion (see Figure
ization’ soundtrack emphasized an anthropological 16.17). Anatomical work has shown that these areas
perspective and advocated, for example, considering
the ritual as a strange native custom. A control condi- Globulus pallidus Thalamus
tion had no soundtrack. Physiological measures such
as GSR (galvanic skin response) and heart rate were Putamen
taken throughout viewing and suggested that the
appraisals produced by the soundtracks did indeed
reduce emotional responses significantly compared
with the control condition. Although impressive,
these results did not prove that cognition necessarily
precedes affect, but rather that cognitive appraisal can
convincingly alter emotional response.
measured either by self-report or physiological adaptive functioning in which most individuals seek to
response. Emotion regulation could be a key aspect of up-regulate pleasure-related emotional responses.
SUMMARY OF SECTION 5
• A question that has always concerned psychologists is whether emotions arise before or after the
cognitive processing of the stimuli and situation that elicits them. This is sometimes known as the
primacy debate.
• Zajonc argued that emotions do not require prior cognition, whereas Lazarus maintained that cogni-
tive appraisal was an integral part of the production of emotion.
• Recent neuroanatomical and lesion studies suggest that both may have been right after all. LeDoux
argues for a ‘quick and dirty’ neural pathway enabling immediate response to potentially emotional
stimuli, without the need for prior cognitive processing. He also proposes a slower cortical route
enabling learning and modulation of emotional responses according to the outcome of cognitive
appraisals.
• Emotion regulation is the process by which we manage our emotions using self-regulatory strategies.
These strategies differ between individuals and can be assessed using self-report and physiological
measures.
6 GENER AL SUMMARY
In this chapter we began by noting that emotions from non-emotional material. In memory, attention,
comprise at least three components: feelings that can and semantic interpretation we saw how biases in pro-
only be reported through introspection; behaviours cessing usually operate to favour the processing of
that can be observed; and bodily responses, some of emotionally significant information. This is a particu-
which can be precisely measured using psychophysi- larly important topic because psychologists believe
ological techniques. We discussed two different such biases contribute to emotional disorders such as
approaches to classifying emotions: that of dividing anxiety and depression. Second, we saw how cognitive
emotional experience up into separate ‘basic’ emo- appraisals can influence the experience of emotion,
tions, and that of using two or more dimensions to and several theoretical variations on this basic idea
describe a continuum of experience. We briefly were described.
explored what some of the functions of emotions Emotion and its interaction with cognition is
might be, such as their use for survival, to enhance becoming an increasingly popular area of psychology,
performance, or as information signals to tell us how helped in part by the availability of new brain-imaging
to behave (the somatic marker hypothesis). technologies. Armed with the knowledge you have
For the rest of the chapter we considered the inter- gleaned from this chapter you will be in an excellent
action between emotions and cognition, first by look- position to follow the progress of this exciting area of
ing at how emotional material is processed differently psychology.
CHAPTER 16 COGNITION AND EMOTION 543
FURTHER READING
Blanchette, I. and Richards, A. (2010) ‘The influence of affect tional disorders that covers both cognitive and neuroscientific
on higher level cognition: a review of research on interpreta- techniques.
tion, judgement, decision making and reasoning’, Cognition LeDoux, J.E. (1996) The Emotional Brain, New York, Simon
and Emotion, vol.24, no.4, pp.561–95. A critical examination of and Schuster. A succinct and readable summary of the author’s
individual differences in higher level cognitive processes. theory, illustrating the integration of bottom-up and top-down
Dalgleish, T. and Power, M.J. (1999) Handbook of Cognition approaches to explaining the effects of fear.
and Emotion, Chichester, Wiley. A comprehensive review of Williams, J.M.G., Watts, F.N., MacLeod, C., and Mathews,
theories of emotion and their clinical application. Systematically A. (1997) Cognitive Psychology and Emotional Disorders, 2nd
covers each of the Big Five emotions. edition, Chichester, Wiley. The classic text on cognitive biases
Fox, E. (2008) Emotion Science, New York, Palgrave and their significance for clinical disorders.
Macmillan. An interdisciplinary approach to emotions and emo-
REFERENCES
Amir, N., Beard, C., Burns, M., and Bomyea, J. (2009) Darwin, C. (1998, first published 1872) The Expression of
‘Attention modification program in individuals with general- the Emotions in Man and Animals, 3rd edition, London, Harper
ized anxiety disorder’, Journal of Abnormal Psychology, vol.118, Collins.
no.1, pp.28–33. Dawson, M.E., Schell, A.M., and Bohmelt, A.H. (eds.) (1999)
Barrett, L. (2006) ‘Solving the emotion paradox: categoriza- Startle Modification, Cambridge, Cambridge University Press.
tion and the experience of emotion’, Personality and Social Eibl Eibesfeldt, I. (1988) ‘Social interactions in an ethologi-
Psychology Review, vol.10, no.1, pp.20–46. cal, cross-cultural perspective’, in Poyatos, F. (ed.) Cross
Bower, G.H. (1981) ‘Mood and memory’, American Cultural Perspectives in Nonverbal Communication, Kirkland,
Psychologist, vol.36, pp.129–48. WA, Hogrefe & Huber Publishers.
Bradley, M.M., Cuthbert, B.N., and Lang, P.J. (1999) ‘Affect Eich, E. and Metcalfe, J. (1989) ‘Mood dependent memory for
and the startle reflex’, in Dawson, M. E., Schell, A., and internal versus external events’, Journal of Experimental
Boehmelt, A. (eds.) Startle Modification: Implications for Psychology: Learning, Memory and Cognition, vol.15, pp.443–55.
Neuroscience, Cognitive Science and Clinical Science, New Ekman, P. (1973) ‘Universal facial expressions in emotion’,
York, Cambridge University Press. Studia Psychologica, vol.15, pp.140–7.
Cacioppo, J.T., Bernston, G.G., Larsen, J.T., Poehlmann, Ekman, P. (1992) ‘An argument for basic emotions’,
K.M., and Ito, T.A. (2000) ‘The psychophysiology of emotion’, Cognition and Emotion, vol.6, pp.169–200.
in Lewis, M. and Haviland-Jones, J.M. (eds.) Handbook of Ekman, P. (1999) ‘Facial expressions’, in Dalgleish, T. and
Emotions, 2nd edition, London, The Guilford Press. Power, M.J. (eds.) Handbook of Cognition and Emotion, New
Calder, A.J., Keane, J., Manes, F., Antoun, N., and Young, York, John Wiley & Sons Ltd.
A.W. (2000) ‘Impaired recognition and experience of disgust Ekman, P. and Friesen, W.V. (2003) Unmasking the Face: A
following brain injury’, Nature Neuroscience, vol.3, pp.1077–8. Guide to Recognizing Emotions from Facial Clues, Cambridge,
Calder, A.J., Lawrence, A.D., and Young, A.W. (2001) MA, Malor Books.
‘Neuropsychology of fear and loathing’, Nature Reviews Ekman, P. and Oster, H. (1979) ‘Facial expressions of emo-
Neuroscience, vol.2, no.5, pp.352–63. tion’, Annual Review of Psychology, vol.30, pp.527–54.
Dalgleish, T. and Power, M.J. (1999) Handbook of Cognition Ekman, P., Levenson, R.W., and Friesen, W. (1983) ‘Auto-
and Emotion, Chichester, Wiley. nomic nervous system activity distinguishes among emotions’,
Damasio, A.R. (1996) ‘The somatic marker hypothesis and Science, vol.221, pp.1208–10.
the possible functions of the prefrontal cortex’, Philosophical Ekman, P., Sorenson, E.R., and Friesen, W.V. (1969) ‘Pan-
Transactions of the Royal Society of London, Series B, vol.351, cultural elements in facial displays of emotion’, Science,
pp.1413–20. vol.164, pp.86–8.
544 PART 6 CHALLENGES, THEMES, AND ISSUES
Eysenck, M. and Keane, M.T. (1996) Cognitive Psychology: MacLeod, C., Mathews, A., and Tata, P. (1986) ‘Attentional
A Student’s Handbook, 3rd edition, Hove, Psychology Press. bias in emotional disorders’, Journal of Abnormal Psychology,
Eysenck, M.W., MacLeod, C., and Mathews, A.M. (1987) vol.95, no.1, pp.15–20.
‘Cognitive functioning in anxiety’, Psychological Research, Mathews, A. (1990) ‘Why worry? The cognitive function
vol.49, pp.189–95. of anxiety’, Behaviour Research and Therapy, vol.28, no.6,
Frijda, N.H. (2001) ‘The self and emotions’, in Bosma, H.A. pp.455–68.
(ed.) Identity and Emotion: Development Through Self Mathews, A. and Mackintosh, B. (2000) ‘Induced emo-
Organization, Studies in Emotion and Social Interaction, New tional interpretation bias and anxiety’, Journal of Abnormal
York, Cambridge University Press. Psychology, vol.109, no.4, pp.602–15.
Frijda, N.H. and Tcherkassof, A. (1997) ‘Facial expressions Mathews, A. and MacLeod, C. (2002) ‘Induced processing
as modes of action readiness’, in Russell, J.A. and Fernández biases have causal effects on anxiety’, Cognition and Emotion,
Dols, J.M. (eds.) The Psychology of Facial Expression, Studies in vol.16, no.2, pp.331–54.
Emotion and Social Interaction, Second Series, New York, Mathews, A., Ridgeway, V., Cook, E., and Yiend, J. (2007)
Cambridge University Press. ‘Inducing a benign interpretational bias reduces trait anxiety’,
Grey, S. and Mathews, A. (2000) ‘Effects of training on Journal of Behaviour Therapy and Experimental Psychiatry,
interpretation of emotional ambiguity’, Quarterly Journal of vol.38, no.2, pp.225–36.
Experimental Psychology, vol.53, no.4, pp.1143–62. Matt, G.E., Vacquez, C., and Campbell, W.K. (1992) ‘Mood-
Gross, J.J. (2007) Handbook of Emotion Regulation. New congruent recall of affectively toned stimuli: a meta-analytic
York, Guilford Press. review’, Clinical Psychological Review, vol.12, pp.227–55.
Gross, J.J. and Thompson, R.A. (2007) ‘Emotion regulation: Medicus, G., Schleidt, M., and Eibl Eibesfeldt, I. (1994)
conceptual foundations’, in Gross, J.J. (ed.) Handbook of ‘Universelle Zeitkonstante bei Bewegungen taubblinder
Emotion Regulation, New York, Guilford Press. Kinder’ (‘Universal time constancy in movements of deaf-
Hoppitt, L., Mathews, A., Yiend, J., and Mackintosh, B. blind children’), Nervenarzt, vol.65, no.9, pp.598–601.
(2010) ‘Cognitive mechanisms underlying the emotional Oatley, K. and Jenkins, J.M. (1996) Understanding Emotions,
effects of bias modification’, Applied Cognitive Psychology, Oxford, Blackwell Publishers Ltd.
vol.24, pp.312–25. Oatley, K. and Johnson-Laird, P.N. (1987) ‘Towards a cog-
Izard, C.E. (2007) ‘Basic emotions, natural kinds, emotion nitive theory of emotions’, Cognition and Emotion, vol.1,
schemas, and a new paradigm’, Perspectives in Psychological pp.29–50.
Science, vol.2, no.3, pp.260–80. Ortony, A. and Turner, T.J. (1990) ‘What’s basic about basic
Joorman, J., Hertel, P., LeMoult, J., and Gotlib, H. (2009) emotions?’ Psychological Review, vol.97, no.3, pp.315–31.
‘Training forgetting of negative material in attention’, Journal Panksepp, J. (1989) ‘The neurobiology of emotions: of ani-
of Abnormal Psychology, vol.118, no.1, pp.34–43. mal brains and human feelings’, in Wagner, H. and Manstead,
Koole, S. (2010) ‘The psychology of emotion regulation: an A. (eds.) Handbook of Social Psychophysiology, Wiley
integrative review’, in De Houwer, J. and Hermans, D. (eds.) Handbooks of Psychophysiology, Oxford, John Wiley and Sons.
Cognition and Emotion, East Sussex, Psychology Press. Panksepp, J., Sacks, D.S., Crepeau, L.J., and Abbott, B.B.
Lazarus, R.S. (1982) ‘Thoughts on the relations between (1991) ‘The psycho- and neurobiology of fear systems in the
emotion and cognition’, American Psychologist, vol.37, brain’, in Denny, M.R. (ed.) Fear, Avoidance, and Phobias: A
pp.1019–24. Fundamental Analysis, Hillsdale, NJ, Lawrence Erlbaum
LeDoux, J.E. (1989) ‘Cognitive-emotional interactions in Associates Inc.
the brain’, Cognition and Emotion, vol.3, pp.267–89. Plutchik, R. (1991) The Emotions, New York, University
LeDoux, J.E. (1996) The Emotional Brain, New York, Simon Press of America.
and Schuster. Plutchik, R. and Landau, H. (1973) ‘Perceived dominance
Levenson, R.W., Cacioppo, J.T., Davidson, R.J., Lang, P., and emotional states in small groups’, Psychotherapy: Theory,
Ohman, A., and Stemmler, G. (2001) ‘Psychophysiology of Research and Practice, vol.10, pp.341–2.
emotion: a decade and a half later’, Psychophysiology, vol.38, Power, M.J. and Dalgleish, T. (1997) Cognition and Emotion:
Supplement S4. From Order to Disorder, Hove, Psychology Press.
Mackintosh, B., Mathews, A., Yiend, J., Ridgeway, V., and Reber, A.S. (1995) The Penguin Dictionary of Psychology,
Cook, E. (2006) ‘Induced biases in emotional interpretation 2nd edition, Harmondsworth, Penguin.
influence stress vulnerability and endure despite changes in Reisenzein, R. (1983) ‘The Schachter theory of emotions:
context’, Behaviour Therapy, vol.37, no.3, pp.209–22. two decades later’, Psychological Bulletin, vol.94, pp.239–64.
CHAPTER 16 COGNITION AND EMOTION 545
Richards, A. and French, C.C. (1992) ‘An anxiety-related Stroop, J.R. (1935) ‘Studies of interference in serial verbal
bias in semantic activation when processing threat/neutral reactions’, Journal of Experimental Psychology, vol.18,
homographs’, Quarterly Journal of Experimental Psychology, pp.643–62.
vol.45, pp.503–25. Teasdale, J.D. (1988) ‘Cognitive vulnerability to persistent
Rosenzweig, M.R., Leiman, A.L., and Breedlove, S.M. depression’, Cognition and Emotion, vol.2, no.3, pp.247–74.
(1999) Biological Psychology: An Introduction to Behavioural, Wallbott, H.G. and Scherer, K.R. (1988, first published
Cognitive and Clinical Neuroscience, 2nd edition, Sunderland, 1986) ‘How universal and specific is emotional experience?
MA, Sinauer Associates Inc. Evidence from 27 countries on five continents’, in Scherer,
Schachter, S. and Singer, J. (1962) ‘Cognitive, social and K.R. (ed.) Facets of Emotion: Recent Research, Hillsdale, NJ,
physiological determinants of emotional state’, Psychological Lawrence Erlbaum Associates Inc. (First published in Social
Review, vol.69, pp.379–99. Science Information (Sur les sciences sociales), vol.25, no.4,
Scherer, K.R. (1999) ‘Appraisal theories’, in Dalgleish, T. pp.763–95.)
and Power, M. (eds.) Handbook of Cognition and Emotion, Wilson, E., MacLeod, C., Mathews, A., and Rutherford, E.
Chichester, Wiley. (2006) ‘The causal role of interpretative bias in anxiety reac-
Scherer, K.R. and Wallbott, H.G. (1994a) ‘Evidence for uni- tivity’, Journal of Abnormal Psychology, vol.115, no.1,
versality and cultural variation of differential emotion pp.103–11.
response patterning’, Journal of Personality and Social Yerkes, R.M. and Dodson, J.D. (1908) ‘The relation of
Psychology, vol.66, no.2, pp.310–28. strength of stimulus to rapidity of habit-formation’, Journal of
Scherer, K.R. and Wallbott, H.G. (1994b) ‘Evidence for uni- Comparative Neurology and Psychology, vol.18, pp.459–82.
versality and cultural variation of differential emotion Yiend, J., Mackintosh, B., and Mathews, A. (2005)
response patterning: correction’, Journal of Personality and ‘Enduring consequences of experimentally induced biases in
Social Psychology, vol.67, no.1, pp.55. interpretation’, Behaviour Research and Therapy, vol.43, no.6,
Scherer, K.R., Banse, R., and Wallbott, H. (2001) ‘Emotion pp.779–97.
inferences from vocal expression correlate across languages Zajonc, R.B. (1980) ‘Feeling and thinking: preferences need
and cultures’, Journal of Cross-Cultural Psychology, vol.32, no inferences’, American Psychologist, vol.35, pp.151–75.
no.1, pp.76–92. Zajonc, R.B. (1984) ‘On the primacy of affect’, American
Segal, Z.V., Williams, J.M.G., and Teasdale, J.D. (2002) Psychologist, vol.39, pp.117–23.
Mindfulness-Based Cognitive Therapy for Depression: A New
Approach to Preventing Relapse, New York, Guilford Press.
AUTOBIOGRAPHICAL
MEMORY AND
THE SELF
Clare J. Rathbone, Chris J.A. Moulin, Martin A. Conway, and
Emily A. Holmes
3 A memory recalled when reading about ‘flashbulb’ seat passenger in a car when it was in a high speed
memories – vivid memories of one’s personal cir- collision with another vehicle; activation of the air
cumstances when learning an item of news (Brown bags in the front of the car produced a cloud of pow-
and Kulik, 1977): ‘My own memory for the declara- der, which he thought at the time was smoke. At the
tion of the Second World War, from September time he could smell petrol and thought the car might
1939, occurred when I was aged 6 years and 6 ignite and remembered thinking “I will be burned
months. I have a clear image of my father standing alive.” His wife was unconscious after the impact
on the rockery of the front garden of our house and he thought that she had died. He remembered
waving a bamboo garden stake like a pendulum in thinking to himself “What am I going to do now?” as
time with the clock chimes heard on the radio which he thought about his future alone without his wife.
heralded the announcement. More hazily, I have an He had been experiencing terrific guilt about this as
impression that neighbours were also out in the it suggests to him that he is a selfish person. In addi-
adjoining gardens listening to the radio and, tion, he was an experienced driver and anticipated
although my father was fooling around, the feeling the crash, but did not cry out. He felt that he could
of the memory is one of deep foreboding and have averted the crash if he had done this. He expe-
anxiety.’ rienced intrusive thoughts, such as “I should have
(Gillian Cohen cited in Conway and Pleydell-Pearce, 2000) shouted” (to warn the driver) and he relived the feel-
ing he felt when he thought his wife had died, which
4 A memory reported by David Pillemer in a study of he believed to be his fault because he had not
‘self-defining’ memories (Singer and Salovey, 1993): shouted out.’
‘I remember sitting in X’s class on the day that a mid- (Conway et al., 2004; see also Ehlers et al., 2004)
particularly evident in the distribution of memories memories above none date to when the rememberers
across the lifespan. You might have already noticed in were five years or younger. In Section 2 we consider
the example memories listed above that some date to the accessibility of memories across the lifespan.
when the rememberers would have been in their late Section 3 concentrates on the psychological nature of
teens or early twenties (for example, memories 1 and autobiographical memories, their representation in
4). This seems to be a time when particularly enduring long-term memory, and their relation to the self. In
memories are formed that remain highly accessible, in Section 4 we review findings on disruptions of auto-
contrast to memories from childhood and infancy, biographical memory following brain injury and the
which are difficult to access. Indeed, in the example experience of trauma.
ACTIVIT Y 17.1
The lifespan retrieval curve also rate each of the memories on the rating scales
used in Activity 17.2.
We are going to carry out an autobiographical
Now we want to plot AaE. To do this, use a scale
memory retrieval experiment. You will need the
ranging from ‘0′ (birth) to your actual age now.
following equipment: a pen, a stack of plain paper
Then divide the scale into five-year time bins (any
(say 20 to 40 sheets of A4 cut in half), and a watch.
size of ‘bin’ will do and we have chosen five-year
You will also need a quiet room to work in for about
‘bins’ or periods of time simply because this is often
an hour. When you are ready, read the instructions
used in published reports). This AaE scale will form
and start immediately.
the x-axis running along the bottom of the graph.
Instructions The y-axis will be a count of the number of memo-
ries falling in each five-year time bin and will run
1 In the next 10 minutes recall as many memories
from 0 to about 10 (it is unlikely that you will have
as you can. The memories should be specific and
more than 10 memories falling in any one time bin
detailed as in the examples at the start of the
but if you do, increase the y-axis scale to, say, 15 or
chapter. Try to sample from across your life and
20, or whatever best suits your data). For each bin,
avoid recalling memories all from one period (for
plot how many memories fall in that time bin. For
example, a recent holiday). No memories from
example, maybe six memories date to the period
the past 12 months are allowed.
when you were 20 to 25 years of age. The ‘X’
2 Each time you recall a memory, write down a
marked in this bin will then map on to ‘6’ on the
short title on a piece of paper. The title should
y-axis. Next join up the ‘X’s and compare your lifes-
be designed so that if you read it again you would
pan retrieval curve to Figure 17.1.
know exactly what you recalled. IMPORTANT:
turn the sheet face down and do not look at the
12
title again during this recall phase.
Period of
Number of memories
10
3 When the 10 minutes are up, STOP. The reminiscence bump recency
8
Period of
4 DO NOT READ FURTHER UNTIL YOU 6 childhood
HAVE RECALLED YOUR MEMORIES. THEN amnesia
4
RETURN TO THE INSTRUCTIONS BELOW.
2
Now go back through and date each of the mem- 0
ories by recording how old you were, in months, 5 10 15 20 25 30 35 40 45 50
when you think the recalled event took place (Age Age at encoding (in five-year bins)
at Encoding or AaE). If you really want to simulate FIGU RE 17.1 An idealized representation of the
an autobiographical memory experiment you could lifespan retrieval curve.
at encoding of the remembered experiences, and the twenties or younger do not show such a clear pattern.
resulting lifespan retrieval curve typically takes a form As can be seen in Figure 17.1 the lifespan retrieval
similar to that shown in Figure 17.1. Did your own curve consists of three components: the period of child-
lifespan retrieval curve take this form? Experiments in hood amnesia (from birth to approximately five years
our laboratories repeatedly produce curves such as in of age), the period of the reminiscence bump (from 10
Figure 17.1, although we do find that people in their to 30 years) and the period of recency (which declines
550 PART 6 CHALLENGES, THEMES, AND ISSUES
from the present back to the period of the reminiscence AoA) of the word used to probe that memory. Age of
bump). acquisition norms have now been established for
many different words (Gilhooly and Logie, 1980;
Stadthagen-Gonzalez and Davis, 2006). Morrison and
2.1 Childhood amnesia Conway showed that people tended to produce an ear-
lier autobiographical memory in response to words
There are many theoretical explanations for childhood acquired early in life, e.g. jelly, and a later memory for
amnesia (see Pillemer and White, 1989), but most words acquired later in life, e.g. cigarette. This suggests
flounder on the fact that children below the age of five that linguistic factors may play at least some part in
years have a wide range of specific and detailed auto- the accessibility of memories from earlier in life.
biographical memories (Fivush et al., 1996), which are
not accessible later in life. Explanations that postulate
childhood amnesia to be related to general develop- 2.2 The reminiscence bump
mental changes in intellect, language, emotion, etc.
fail simply because apparently normal autobiographi- The second component of the lifespan retrieval curve
cal memories were in fact accessible when the indi- is the period when rememberers were aged 10 to
vidual was in the period of childhood amnesia. It 30 years, which is known as the reminiscence bump
seems unlikely that an increase in general functioning (RB). The RB is distinguished by an increase in recall
would make unavailable already accessible memories. of memories relative to the period that preceded it and
From the perspective of the Conway and Pleydell- those that follow it. The RB has been observed in doz-
Pearce (2000) model of autobiographical memory this ens of studies, leading David Rubin (a leading
period is seen as reflecting changes in the working researcher in this area) to describe it as one of the
self ’s goal hierarchy. The goals of the infant and young most ‘reliable’ empirical observations in cognitive psy-
child, through which experience is encoded into chology (e.g. Rubin, 2002). Nonetheless, care must be
memory, are so different from those of the adult that taken in collecting memories for the RB. If memories
the adult working self is unable to access those memo- are given dates as they are recalled then rememberers
ries. Another possibility, one much more in line with have a tendency to become ‘stuck’ in a time period.
Freudian thinking on childhood amnesia (Freud, Then they may not produce an RB, or may produce an
1899/1955), is that the working self of infancy and exaggerated RB depending on which time period the
early childhood is much less able to control the occur- rememberer adheres to. Similarly, some rememberers
rence and intensity of emotional experience. Episodic can become ‘stuck’ in the very recent past and recall
memories encoded during this period are then satu- only memories from the last few months, again
rated with intense emotions and, if recalled in matu- obscuring the RB and period of childhood amnesia.
rity, could destabilize the adult working self by As a result, it is typical to ask people to avoid generat-
reinstating intense infant emotions. This view suggests ing memories for the most recent 12-month period, as
that access to autobiographical memories encoded in Activity 17.1, to avoid this ‘recency effect’ biasing
during this period might be quite powerfully limited retrieval.
by the adult working self, leading to the lack of memo- In general, these types of retrieval strategies need to
ries from this period. Currently, there is no generally be minimized and access to memories should be open
accepted explanation for this component of the lifes- (rather than constrained or directed). The remem-
pan retrieval curve, although a recent study has berer should therefore respond with the first memo-
pointed to language factors in the retrieval of early ries that come to mind, i.e. those that are most
memories. Morrison and Conway (2010) have shown accessible, for the full lifespan retrieval curve to be
that the AaE of adults’ autobiographical memories is observed. When these conditions are met the RB is
related to the age of acquisition (also abbreviated frequently observed. Interestingly, however, the RB is
CHPATER 17 AUTOBIOGR APHICAL MEMORY AND THE SELF 551
present not just in the recall of specific autobiographi- (Rubin and Berntsen, 2003; Berntsen and Rubin,
cal memories but also emerges in a range of different 2004). In their influential 2003 study, Rubin and
types of autobiographical knowledge. For example, Berntsen showed that the structure and qualities of
the RB has been observed in the recall of films people’s memories from the RB matched the structure
(Sehulster, 1996), music (cf. Rubin et al., 1998), books and qualities of ‘memories’ generated for a hypotheti-
(Larsen, 1998), and public events (Holmes and cal 70-year-old. This suggests an overlap between the
Conway, 1999; Schuman et al., 1997). Memories life story structure for someone away from the context
recalled from the period of the RB are more accurate of a memory task, and for the memories retrieved of
(Rubin et al., 1998). They are judged by the remem- one’s own life. You could try emulating this study –
berer as more important than memories from other have a go at generating a fictitious character and see if
time periods, and are rated as highly likely to be you can generate defining events from their life. When
included in one’s autobiography (Fitzgerald, 1988, do these occur? Rubin and Berntsen (2003) found
1996; Fromholt and Larsen, 1991, 1992; Rubin and that, just like ‘real’ autobiographical memories, they
Schulkind, 1997). The autobiographical memories of tended to come from the RB, and were emotionally
middle-aged and older adults are therefore character- positive. Another theme of Rubin’s work is that ‘Events
ized by a high degree of accessibility to autobiographi- from the bump period are remembered best because
cal memories dating to the period when they were 10 they occur when rapid change is giving way to relative
to 30 years of age, and this is typically most marked for stability that lasts at least until retrieval’ (Rubin, 2002,
the narrower period of 15 to 25 years of age. p.14). By this view, a period of rapid change is domi-
In a rather similar manner to the period of child- nated by novel experiences that more fully engage
hood amnesia, the RB also has several plausible expla- encoding processes, and so become represented in
nations (see Rubin et al., 1998). Some obvious memory in a highly accessible way and lead to the RB.
explanations can, however, be ruled out. Memories An alternative theory is that the high accessibility of
from the RB period are not dominated by first-time memories from this period may be related to their
experiences, but rather appear to consist of memories enduring relation to the self (Conway and Pleydell-
of experiences that are idiosyncratic to individual Pearce, 2000). Arguably, many memories from the
rememberers. Similarly, the suggestion that memories period of the RB are of self-defining experiences
from the RB are more vivid – the idea being that mem- (Fitzgerald, 1988; Singer and Salovey, 1993), and have
ory encoding is at peak efficiency during this period – a powerful effect in binding the self to a specific reality.
turns out to be incorrect (Holmes and Conway, 1999; The ‘novelty’ of RB experiences lies in their distinctive-
Janssen et al., 2011; Rubin and Schulkind, 1997). Also ness and uniqueness for the self, and they may play a
incorrect are explanations that either postulate prefer- crucial role in the final formation of a stable self-system
ential effort to recalling memories from this period, or during late adolescence and early adulthood. Memories
suggest RB memories are of more pleasant experi- from this period help to define identity (Conway, 1996)
ences. However, research has shown that the RB is and, because of this, they endure in memory in a highly
found only for positive (and not negative) events (e.g. accessible form. Conway’s account and Rubin and
Rubin and Berntsen 2003), showing some role of emo- Berntsen’s account are not necessarily in opposition to
tion in the RB. each other and, as often occurs in psychology, might
It seems that a more complex explanation is both be plausible explanations. The life scripts theory
required of the RB, and there have been several differ- might be a good description of the cultural under-
ent accounts over the years focusing variously on bio- standing of the lifespan, but it may be that the organi-
logical, cognitive, and self-based explanations (for a zational properties of the self are what drive us to
review see Rubin et al., 1998). One recent explanation characterize our lives like this. One thing is clear from
comes from Rubin and Berntsen and is based upon this research – the reminiscence bump is not purely a
people generating a ‘life script’ of their experiences memory phenomenon – it occurs when we talk about
552 PART 6 CHALLENGES, THEMES, AND ISSUES
our favourite books and films and when we put questioned why such memories or salient experiences
together the life of a fictitious character, and it is even should be ‘forgotten’ in this way. Moreover, it might
evident when children are asked to imagine the events also be noted that when people are specifically
that might occur during their future life (Bohn and instructed to recall older autobiographical memories,
Berntsen, 2011). there are apparently plenty of available memories (see
Holmes and Conway, 1999, for example). Thus, it is not
forgetting but rather a bias or preference in access. It
2.3 Recency may be that the recency portion of the lifespan retrieval
curve reflects a lowering in self-relevance of memory
The final component of the lifespan retrieval curve is for experiences from the recent past, and hence a
the ‘recency’ component (see Figure 17.1). It is possibly corresponding lowering of accessibility rather than
the least interesting and can be simply explained as a complete forgetting. Thus, as recently acquired autobi-
period of forgetting older memories: memories ographical memories become less relevant to the self ’s
recently encoded remain accessible, while memories goals, their accessibility is attenuated, but not lost, and
retained over a longer retention interval are subject to can be restored by direct attempts to retrieve recent
decay and/or interference and so become progressively information. Of course, as the retention interval
less accessible. This pattern of retention is familiar lengthens access may actually become lost, rather than
from laboratory studies and is one that has been just attenuated, and in that case forgetting would occur.
observed many times. On the other hand it might be
SUMMARY OF SECTION 2
• The ‘lifespan retrieval curve’ illustrates how frequently autobiographical memories are recalled over
different periods in someone’s life. The lifespan retrieval curve is characterized by periods of child-
hood amnesia, the reminiscence bump, and recency.
• The concept of the ‘working self’ (Conway and Pleydell-Pearce, 2000) can be thought of as a hierar-
chy of currently active goals and self-concepts through which experience is encoded and memories
constructed.
3AUTOBIOGR APHICAL
KNOWLEDGE, EPISODIC MEMORY,
THE WORKING SELF, AND
MEMORY CONSTRUCTION
Try Activity 17.2 before you read any further. strongly implicates the self in memory retrieval. The
The pattern of memories retrieved over the lifespan has a lifespan retrieval curve is, however, just one aspect of this
particular shape, as shown in Figure 17.1, and one that complex higher order form of cognition. Another and
CHPATER 17 AUTOBIOGR APHICAL MEMORY AND THE SELF 553
ACTIVIT Y 17.2
Taking part in an autobiographical memory the memory in mind, write down a description of it
experiment: retrieving memories to cue and provide a title. You should also rate each mem-
words ory on the following scales:
Let’s create a response sheet now. On a sheet of
Before reading further, it will be useful to retrieve a
paper write the following:
few more of your own memories, and reflect on what
comes to mind both while forming a memory and
when it is fully constructed. To do this, imagine that Memory 1
you are a participant in an autobiographical memory Title: . . .. . .. . .. . .. . .. . .. . .. . .. . .. . ...
experiment. The experimenter tells you that you will Memory description: . . .. . .. . .. . .. . .. . .. . .. . .. . .. . ...
have to bring to mind memories of specific experi- Ratings (circle a number):
ences of events that you yourself experienced, and Vividness: 1 2 3 4 5
that took place over periods of seconds, minutes, and Valence: 1 2 3 4 5
hours, but no longer than one day – as with the exam- Intensity: 1 2 3 4 5
ple memories listed at the start of the chapter. This Rehearsal: 1 2 3 4 5
means that responses such as ‘last summer’, ‘when I AaE: . . .. . .. . .. . .. . .. . .. . .. . .. . .. . ... (leave this blank for now)
was little’, or ‘holiday in Italy’ are too general and do Do this three times so you have three memory
not count as memories. Instead you are required to response sheets (in an actual experiment far more
recall detailed memories, memories of specific memories would be collected, usually 20 or more).
events. These can be from any part of your life, indeed Assuming you are now ready:
sampling widely would be good, but they should not
1 Recall your first memory to the cue word CHAIR
be of events experienced in the last 12 months.
and then complete the response sheet.
You are asked to recall specific memories by
reading ‘cue’ words, then bringing to mind the first 2 Now recall a memory to the word ILLNESS and
memory about which the cue word reminds you – complete the response sheet.
bearing in mind the constraints of sampling widely 3 Finally recall a memory to the cue SUMMER and
and not from the past 12 months. Once you have complete the response sheet.
1 2 3 4 5
Memory vividness No imagery Some imagery Usual image Vivid imagery Extremely vivid
vividness imagery
Valence of the Very negative Negative Neutral Positive Very positive
remembered
experience
Emotional intensity of Very mild Some emotion Emotional Intense As intense as
the remembered any emotional
experience experience I
have ever had
Rehearsal: how Very rarely Sometimes With about Above average Very frequently
frequently have you average
thought and/or talked frequency
about this event?
554 PART 6 CHALLENGES, THEMES, AND ISSUES
4 Now, go back and at the bottom of each to elaborate the cue, for example, think about
response sheet on the line that says ‘AaE’ write a chair at home and some incident associated
(in months and as exactly as you can) your age with it, such as when you bought it?
when the remembered event occurred (Age at (v) Did it take longer to retrieve a memory to cue
Encoding or ‘AaE’). two than to cues one and three?
Keep the response sheets handy while you read the (vi) How complete a record of the actual event
rest of this chapter, as we will often refer back to would you say the memory is?
them. For now try to answer the following ques- (vii) Did you notice how ‘time compressed’ the
tions. Keep a record of your answers and come memory was? That is, it almost certainly
back to them when you have finished the chapter. took far less time to recall the event than the
experience itself took.
(i) Did your memories always contain both
autobiographical knowledge as well as very (viii) How accurate, as a record of the experiences,
detailed records of actual experiences? were the memories?
(ii) Were the details always or predominantly in (ix) At some point in the attempt to retrieve/
the form of visual mental images? If not, what construct the memories you must have decided
form were they in? that you had an appropriate memory in mind.
Was this associated with any feelings? Did
(iii) Did you feel any emotions? Particularly
you have a sort of ‘Aha’ experience when the
with respect to the last two memories in
memory came to mind? Did you feel as though
comparison to the first memory.
you were almost reliving at least a small part
(iv) Did the memories just ‘pop’ into your mind of the past (memory researchers call this
when you read the cue words, or did you have recollective experience)?
3.1.1 General events In one of the few studies of this type of knowledge,
General events refer to a variety of autobiographical Robinson (1992) examined people’s memories of the
knowledge structures such as single events (e.g. the day acquisition of skills (e.g. riding a bicycle or driving a
we went to South Wales), repeated events (e.g. Friday car) and of aspects of personal relationships. These
afternoons at the pub), and extended events (e.g. the general events were found to be organized around a
conference in Sydney). General events may themselves series of vivid memories relating to goal attainment.
be organized in several different ways. For example, Consider two examples from Robinson’s study:
they may be ‘mini-histories’ structured around detailed
1 ‘Ever agreeable, and eager to do anything that
and sometimes vivid episodic memories of goal-attain-
would get me out of the doldrums of inferiority, my
ment in developing skills, knowledge, and personal
father rented a bike and undertook to help me to
relationships (Robinson, 1992). Some general events
learn. . . . I shall always remember those first few glo-
may be of experiences of particular significance for the
rious seconds when I realized I was riding on my
self and act as reference points for other associated gen-
own . . .’
eral events (Pillemer, 1998; Singer and Salovey, 1993).
(Quinn, 1990, cited in Robinson, 1992, p.224)
Other general events may be grouped together because
of their emotional similarity (McAdams et al., 2001),
2 ‘The first time I flew an airplane was one of the
and it is likely that there are yet other forms of organiza-
best firsts. It marked a sense of accomplishment for
tion at this level that await investigation (Brown and
myself, and it also started me on the career path I
Schopflocher, 1998). However, the research currently
have always wanted to follow. The day was warm and
available indicates that organization of autobiographi-
hazy, much as summer days in Louisville are. My
cal knowledge at the level of general events is extensive,
nervousness didn’t help the situation, as I perspired
and it appears to virtually always refer to progress in the
profusely. But as we took off from runway 6 the feel-
attainment of highly self-relevant goals.
ing of total euphoria took over, and I was no longer
Conway and Pleydell-Pearce (2000) indicate that
nervous or afraid. We cruised at 2,500 feet and I
general events contain knowledge about locations,
worked on some basic manoeuvres for approximately
others, activities, feelings, and goals common to an
45 minutes. We then returned to the airport, where I
event, as well as some specific episodic memories that
realized that this will soon be a career.’
help organize the general event knowledge. This auto- (Robinson, 1992, p.226)
biographical knowledge may be represented in several
different ways and consist of a mental construction of These ‘first time’ memories can cue other related mem-
images, feelings, and verbal statements (cf. Johnson- ories and the whole general event carries powerful self-
Laird, 1983 and Chapter 12). However, autobiographi- defining evaluations that persist over long periods of
cal knowledge in general events predominantly takes time. Importantly, Robinson found that many memo-
the form of generic visual images, i.e. images derived ries featured goal-related evaluative knowledge or self-
from repeated experiences (Brewer, 1986, 1988, 1996; defining memories (Singer and Salovey, 1993) along
Conway, 1996, 2001; Rubin and Greenberg, 1998). with more general knowledge and specific episodic
General event autobiographical knowledge can then memories. General event autobiographical knowledge
be used to access associated sensory–perceptual epi- can also be used to access related lifetime periods that
sodic memories and, when it is used in this way, a spe- contain associated knowledge.
cific and detailed autobiographical memory (AM) can
be formed. Thus, a specific AM will usually, if not 3.1.2 Lifetime periods
always, contain some general event knowledge and Lifetime periods, like general events, contain repre-
this will often be in the form of generic images (was sentations of locations, others, activities, feelings, and
this the case with the memories you recalled earlier?). goals common to the period they represent. They
556 PART 6 CHALLENGES, THEMES, AND ISSUES
effectively encapsulate a period in memory and in so that a specific episodic memory is part of a general
doing may provide ways in which access to autobio- event, which in turn is part of a lifetime period, which
graphical knowledge can be limited, channelled, or is part of a life schema (Conway, 1996).
directed. As with general events there is evidence that Recent research has aimed to provide some empiri-
lifetime periods contain evaluative knowledge, nega- cal support for this partonomic structure, using
tive and positive, of progress in goal attainment (Beike research into healthy older adults, who are known to
and Landoll, 2000), and it seems likely that lifetime have subtle deficits in memory. In this work, Piolino
periods may play an important role in what Bluck and and colleagues (2010) have developed an autobio-
Habermas (2000) call the life story. graphical memory test to examine four levels of
A life story is some more or less coherent theme or Conway and Pleydell-Pearce’s model: lifetime periods,
set of themes that characterize, identify, and give general events, specific events, and details. Participants
meaning to a whole life. A life story consists of several have to generate as many different lifetime periods as
life story schema, which associate together selective possible in a given time period. For one of these life-
autobiographical knowledge to define a theme (Bluck time periods, they then generate as many general
and Habermas, 2000). A schema is a memory struc- events as they can retrieve, and for one general event,
ture that encapsulates an event such that common as many specific events, and so on. The evidence for
parts are fixed, while variable parts occur as ‘slots’. the model comes from the fact that older adults, who
Thus a schema for ‘going to the cinema’ would have have difficulties with episodic retrieval, struggle to
pre-defined common parts (such as queuing for tick- generate the more specific levels of the hierarchy. This
ets, buying popcorn) and slots for variable parts points to a critical difference between episodic and
(which cinema we went to, who I was with, what film semantic memory. But you could try this yourself –
we saw). Lifetime periods might provide the autobio- you will probably find that the list of lifetime periods
graphical knowledge that can be used to form life is somewhat easier to generate than specific events –
story schema and thus support the generation of the task gets more difficult the more you drill down
themes – an idea that is very similar to Rubin and through the hierarchy.
Berntsen’s (2003) life scripts theory (presented
above).
Lifetime period evaluations access related general
events and, in turn, episodic memories that, when
Episodic and semantic
3.2
formed, provide the ‘evidence’ justifying the evalua- memory
tions (see Beike and Landoll, 2000, and Conway and
Pleydell-Pearce, 2000, for more on how autobiograph- In Tulving’s (1972) original distinction between epi-
ical knowledge ‘grounds’ the self in memories of expe- sodic and semantic memory, the defining feature of epi-
rience). In summary, lifetime period autobiographical sodic memory was that it contained spatio-temporal
knowledge is less event-specific than general event information (see Chapter 8, Section 3.2). Episodic
autobiographical knowledge; it is also more concep- memories were of specific events that occurred at
tual and abstract. It encapsulates significant parts of unique times, while semantic knowledge was of
the life story and may form an important bridge from abstract, conceptual, context-free knowledge not linked
autobiographical memory to core aspects of the self, to any specific place, time, or learning episode. The ref-
most likely through the generation of narrative ‘scripts’ erence for episodic memory was then individual per-
of one’s past experiences. Figure 17.2 depicts this sonal experience, whereas the reference for semantic
scheme of autobiographical knowledge organization, knowledge was social and universal (Tulving, 1983). So,
and shows how such knowledge may be represented at for example, if you think about what you ate for break-
different levels to form hierarchical partonomic fast this morning, and retrieve vivid and specific details
knowledge structures. Partonomic refers to the way of this one experience, that is episodic memory. In
CHPATER 17 AUTOBIOGR APHICAL MEMORY AND THE SELF 557
Life story
Lifetime periods
School friends
Working at ‘x’
Living with ‘M’
Working at ‘y’
At university Married to ‘N’
Others (relationships) Others (relationships)
Locations (classes, etc.) Locations (classes, etc.)
Activities (projects) Activities (projects)
Goals (personal-collective) Goals (personal-collective)
General
events
Film club
Prof. ‘A’
Union building
comparison, recalling that the French traditionally have for ‘breakfast’, which specifies the location, time,
coffee and croissants for breakfast is general knowledge, actions, order of actions, and objects involved in a
reproduced from semantic memory. typical breakfast (Schank and Abelson, 1977). Is this a
In autobiographical memory, we see the interaction semantic or episodic representation? A third issue
of these two forms of memory – and it would appear relates to autobiographical knowledge. For instance, a
that they are not as clear-cut as these examples might person may know that last year they took a holiday in
suggest. For instance, episodic memories must, of Italy – no other information needs to be brought to
course, contain semantic knowledge and this raises mind. But the reference for this knowledge (namely
the question of how easily the two types of knowledge the holiday) is both personal and universal and, more-
can be distinguished. Secondly, there are knowledge over, it clearly contains spatio-temporal knowledge
representations in long-term memory that on Tulving’s (see also Dritschel et al., 1992). Perhaps a better way to
(1972) original definition we would want to term classify episodic and semantic has been provided by
‘semantic’, but which contain spatio-temporal infor- Tulving in more recent work. He suggests that epi-
mation. For example, there arguably exists a schema sodic memories can be described as ‘mental time
558 PART 6 CHALLENGES, THEMES, AND ISSUES
travel’ where the self is able to retrieve specifics of a 3.3 The working self
past experience. When recalled, these specific memo-
ries give rise to recollective experience, the feeling of Constructing an autobiographical memory is a com-
experiencing the past, and this does not occur when plex form of cognition and has several effects on pro-
other types of long-term knowledge are brought to cessing generally. One of the main theories is that the
mind (e.g. Tulving, 2002). entire cognitive system enters what Tulving (1983)
We now turn to recollective experience in autobio- called retrieval mode. In retrieval mode, attention is
graphical memory. Conway (2001) suggested that directed inwards towards internal representations of
knowledge contained in episodic memories is largely knowledge, and conscious awareness becomes domi-
sensory–perceptual in nature. Figure 17.2 conveys this nated by these representations. As a memory is
by depicting episodic memories in an undifferentiated formed, the rememberer’s awareness becomes emo-
pool of representations of sensory–perceptual experi- tionally influenced by recollective experience and a
ences. Thus, episodic memory is a repository of ‘expe- powerful sense of the self in the past arises. The divi-
rience-near’, highly event-specific sensory–perceptual sion of attention that then occurs gives rise to an
details of recent experiences; experiences that lasted attenuation of all other cognitive processes and,
for comparatively short periods of time (seconds, because of this, recall of AMs could, potentially, be
minutes, or at most hours). These sensory–perceptual highly dysfunctional in that current processing
episodic memories do not endure in memory unless sequences would be disrupted. In extreme cases, such
they become linked to more permanent autobio- as in the involuntary and intrusive recall of prior
graphical memory knowledge structures. Conway trauma that is symptomatic of PTSD, autobiographi-
(2001) argues that access to sensory–perceptual epi- cal recall may be pathologically disruptive to everyday
sodic memories is rapidly lost. This is because most functioning (as in Memory 5 at the beginning of this
episodic memories do not become linked to more sta- chapter). The point is that constructing a specific and
ble and permanent autobiographical knowledge in detailed AM is a major cognitive occurrence with con-
long-term memory and, as a consequence, they rap- sequences for all other types of processing. Memory
idly decay and become permanently inaccessible. As a construction has therefore to be controlled, and
simple demonstration, cast your mind back over the according to Conway and Pleydell-Pearce (2000), this
events of today. They will be extremely detailed and is one of the main functions of their concept of the
numerous. If you try the same exercise, remembering working self (see also Markus and Ruvolo, 1989).
today’s events, in a day or so, or perhaps next week,
few episodic memories will have been retained rela-
tive to the number available on the day of experience. 3.3.1 Goals and the working self
The theory is that when experience-near sensory– The working self is conceived as a complex hierarchy
perceptual fragments are accessed during memory con- of interconnected goals, all of which are in varying
struction, this is associated with recollective experience states of activation, but only some of which can enter
and the sense of ‘remembering’, as opposed to just consciousness (see an extended discussion of goals in
knowing. As a concept, recollection is supported by a relation to the ACT-R cognitive architecture in
large number of studies looking at recognition memory Chapter 19). The working self may also contain repre-
for word lists. A number of prominent researchers sentations of at least some goal-related knowledge, e.g.
including Tulving and Conway converge on the idea lifetime periods, life schema, and life story or stories,
that it is the sense or experience of the self in the past as well as currently active models of the self. It is
and is associated with images, feelings, and other details through the working self goal structure that episodic
that come to mind during remembering (see Gardiner memories are formed and autobiographical knowl-
and Richardson-Klavehn, 2000, for a review). edge is abstracted from experience. Thus, goal-related
CHPATER 17 AUTOBIOGR APHICAL MEMORY AND THE SELF 559
experience is prioritized in terms of encoding, con- (1938) and McClelland (e.g. McClelland et al., 1989),
solidation, accessibility, and construction into spe- Woike identified implicit and explicit motives in a
cific, if transitory, autobiographical memories. Strong group of people who then recorded memorable events
evidence exists showing that overall goal orientation over a period of 60 days. According to McClelland
of particular personality types acts to raise the acces- et al. (1989), implicit motives are evident in prefer-
sibility of goal-related autobiographical knowledge ences for certain types of affective experience such as
and so facilitate their recall. This work has its origin in ‘doing well’ for achievement and ‘feeling close’ for inti-
a seminal paper by Markus (1977) who found that macy, whereas explicit motives are present in social
people with a strong personality trait relating to the values and aspects of the self that can be introspected.
dependent–independent dimension showed preferen- A corollary of this view is that affective experiences
tial access to memories of experiences in which they should give rise to memories associated with implicit
had behaved in dependent or independent ways. In motives. Explicit motives, on the other hand, should
contrast, individuals within whom the dependent– lead to memories of less affective, routine experiences,
independent dimension was weak did not have this more closely associated with self-description than
memory bias. with measures of implicit motives (i.e. TAT perfor-
These types of self-memory congruency effects mance). This was exactly Woike’s finding in both a
have since been observed in several studies and most diary study and in a laboratory-based autobiographi-
especially in the work of McAdams on power, inti- cal memory retrieval experiment. Woike et al. (1999)
macy, and generativity (McAdams, 1982, 1985, 2001; also investigated groups of individuals classified as
McAdams, et al., 1997). McAdams (1982) used the ‘agentic’ (concerned with personal power, achieve-
thematic apperception test (TAT; Murray, 1938, 1943) ment, and independence) or as ‘communion’ (con-
to assess non-conscious aspects of personality cerned with relationships, interdependence, and
(McClelland et al., 1989) and categorized individuals others). Agentic personality types are considered to
into those with a strong intimacy motivation or, in structure knowledge in terms of ‘differentiation’ (the
contrast, with a distinctive power motivation. Content emphasis is on differences, separateness, and inde-
analysis of subsequently freely recalled memories of pendence) whereas communal individuals, in con-
‘peak’ and other experiences found that the intimacy trast, structure knowledge in terms of ‘integration’
motivation group recalled peak experiences with a (the emphasis is on similarity, congruity, and interde-
preponderance of intimacy themes compared to indi- pendence). Across a series of studies, people with
viduals who scored lower on this motivation, who in agentic self-focus were found to consistently recall
turn showed no memory bias. Similarly, the power emotional memories of events that involved issues of
motivation group recalled peak experiences with agency (mastery, humiliation) with their content
strong themes of power and satisfaction. Interestingly, structured in terms of differentiation. People with
neither group showed biases in memories for more communal self-focus recalled emotion memories fea-
mundane, less emotional, less self-defining memories. turing others, often significant others, in acts of love
These striking biases in memory availability by domi- and friendship, with the memory content structured
nant motive type suggest that the goal structure of the in terms of integration. These findings clearly impli-
working self makes highly available those aspects of cate the self in determining recall and lend further
the knowledge base that relate most directly to cur- weight to the suggestion that the self influences access
rently active goals. to sets of goal-related memories.
Work by Woike and her colleagues has further In an intriguing study, Pillemer et al. (1996; also
established the connection between personality and Pillemer, 1998) investigated memory for specific edu-
memory (Woike, 1995; Woike et al., 1999). In the tra- cational episodes (e.g. Memory 4 at the beginning of
dition of personality research deriving from Murray this chapter). The initial impetus for this work was the
560 PART 6 CHALLENGES, THEMES, AND ISSUES
observation that autobiographies often contain associated with feelings of happiness and pride were
accounts of highly specific events that were ‘turning strongly linked with goal attainment and the smooth
points’ (self-defining moments) for the individual and running of personal plans (see also Sheldon and Elliot,
usually involved the adoption of a superordinate life 1999). In contrast, memories associated with feelings
goal that then determined much of the individual’s of sadness and anger were linked to the progressive
later activities. Pillemer et al. (1996) found that stu- failure to achieve goals. Singer and Salovey (1993)
dents and alumni were frequently able to report, in proposed that each individual has a set of self-defining
detail, highly vivid memories of interactions with pro- memories that contain critical knowledge of progress
fessors and other teachers that had profoundly influ- on the attainment of long-term goals. Such goals, e.g.
enced their academic interests and, sometimes, the attaining independence, intimacy, mastery, and so on,
whole of their lives. These were often events in which may have been adopted as solutions to dominant self-
superordinate long-term goals were adopted by the discrepancies arising from childhood experiences
individual, e.g. to become a chemist, a writer, etc. (Strauman, 1996). Related to this, Thorne (1995)
Consider the following account by a postgraduate found that the content of memories freely recalled
mature student of her first undergraduate Shakespeare across the lifespan by 20-year-olds conformed to what
class: she called ‘developmental truths’. Thus, memories
from childhood very frequently referred to situations
‘I was fascinated by the easy way the professor roamed
in which the child wanted help, approval, and love,
through Shakespeare, by just the amount of knowledge
usually from the parents, whereas memories from late
he had. He seemed to know everything. In fact, after
adolescence and early adulthood referred to events in
class, I asked him if he could identify a quote I had
which the rememberer wanted reciprocal love, was
found about fencing, “Keep up your bright swords, for
assertive, or helped another.
the dew will rust them.” Immediately he said “Othello,
Conway’s notion of a ‘working self ’ consisting of an
Act 1 Scene 2, I believe.” Which turned out to be exactly
active complex goal hierarchy is therefore a useful way
right. I wanted to know a body of literature that well.
in which to understand the pattern of findings from
I’m still working on it.’
the study of personality and autobiographical mem-
(Pillemer et al., 1996, p.330)
ory. The evidence points to a particular role for the
Further emphasizing the power of specific episodic working self, which is to modulate access to knowl-
events, recent work by Kuwabara and Pillemer (2010) edge in long-term memory and to control what new
shows that activating a positive memory of someone’s information enters the knowledge base and which epi-
time at university makes them more likely to donate sodic memories are rehearsed and become integrated
money to their university. Such research is critical with long-term knowledge structures. The working
because it demonstrates the link between autobio- self ’s control structures may make some long-term
graphical memory and behaviour. Of course, not all knowledge highly accessible, e.g. self-congruent
self-defining moments are positive and Pillemer et al. knowledge, whereas other knowledge may be inhib-
(1996; and Pillemer, 1998) list several other memories ited, e.g. self-incongruent knowledge.
of more negative educational experiences that led to a
subject being dropped, negatively conceived as ‘diffi-
cult’ or ‘boring’, and, in some cases, the emergence of
negative conceptions of self as a poor or incompetent
Constructing
3.4
learner. autobiographical memories
Singer and Salovey (1993) provide one of the main
statements on the relation between goals and memo- Autobiographical memories can either be intentionally
ries. A major finding in their study was that memories constructed or, alternatively, may come to mind without
CHPATER 17 AUTOBIOGR APHICAL MEMORY AND THE SELF 561
the formation of any specific intention to recall a mem- might lead to access of the lifetime period ‘when I was
ory. We refer to the former type of construction as gen- a student’. Lifetime period knowledge can then be
erative retrieval and the latter type as direct retrieval. used to access general events, which in turn access
Generative retrieval occurs when remembering is episodic memories, and in this way a specific and
intentional and the knowledge base is iteratively sam- task-relevant AM is constructed. Perhaps you were
pled as a memory is effortfully constructed. During aware of this process when recalling memories to the
this protracted process an initial cue is used to probe cues ‘chair’, ‘illness’, and ‘summer’ in Activity 17.2?
the knowledge base and accessed knowledge is evalu- Figure 17.3 lists two protocols collected from people
ated against a retrieval model generated by the self. If recalling memories to cue words while saying aloud
the constraints of the retrieval model are satisfied then what was going through their minds. Perhaps you
a memory is formed, and the knowledge activated in were aware of similar types of knowledge coming to
the knowledge base (by the cue), together with associ- mind when you recalled your memories? Figure 17.4
ated goals of the self, form the autobiographical mem- provides a diagrammatic illustration of generative and
ory in that episode of remembering. Usually this direct retrieval.
process takes several or more cycles of access, evalua- Although the process of generative retrieval may
tion, and cue elaboration, as a stable pattern of acti- seem laborious and is certainly effortful (retrieval
vated knowledge that meets the constraints of the times to word cues usually average between five and
retrieval model gradually emerges. For example, in eight seconds), it nevertheless may operate with high
attempting to construct an AM to a cue such as ‘cin- efficiency when the system is in retrieval mode and
ema’, a rememberer might elaborate the cue into the multiple memories are to be recalled. Such circum-
question ‘When did I go to the cinema a lot?’ This cue stances arise in a conversation with another person
That was when we lived in ‘X’ after Difficulty parking - it was very busy.
moving to the house at ‘Y’.
Episodic
Cycle 3 General event Cycle 3
memories
Saw it in a sale at store ‘W’. Images of the car parked in the
supermarket car park and returning to
it with a loaded trolley.
Episodic
Cycle 4
memories
Images of a large window near the cash
desk, colour of old credit card, stack
of lampshades by cash desk, plus other
details.
FIGU RE 17. 3 Two protocols collected while rememberers related what came to mind when recalling memories to
cue words.
562 PART 6 CHALLENGES, THEMES, AND ISSUES
Excutive process
Working self goal
hierarchy
Generative
retrieval (generation of a)
Cue
RETRIEVAL MODEL
Elaborated cue
Activated AK
Direct access
Memory formation
(retrieval model criteria met)
about a shared experience or in a discourse in which systematic study of involuntary and voluntary autobi-
accounts of autobiographical memories are important. ographical memories. They found that involuntary
In conversation about the ‘good old days’ one does not memories were more specific and faster retrieved than
feel held back by the effort of generating anecdotes or voluntary autobiographical memories. They were also
comparing notes on the specifics of a shared event. more likely to be experienced in response to a negative
Nevertheless, when a cue activates a general event cue. The study showed that involuntary memories
and associated episodic memories, a specific autobio- often come to mind whilst engaged in repetitive and
graphical memory can be formed, apparently effort- low-level cognitive tasks – in the case of their experi-
lessly and spontaneously. In certain instances, direct ment, repeatedly detecting vertical lines amongst an
retrieval occurs. In direct retrieval a cue causes a pat- array of horizontal lines. We return to direct access of
tern of activation in autobiographical knowledge (AK) negative events in the section on PTSD below.
that stabilizes as a specific autobiographical memory Compared to the research on voluntary autobiograph-
and bypasses the stages of generative retrieval ical memory, there is a lack of data on involuntary
(repeated autobiographical knowledge access, evalua- memories. How often do you have the memory of a
tion, and cue elaboration) (see Box 17.1). Sometimes, previous event come to mind whilst you are busy
direct retrieval occurs completely involuntarily, when doing something else? Does it seem like a random
memories come to mind seemingly unbidden. occurrence, or might there also be a role for the self in
Schlagman and Kvavilashvili (2008) conducted a what is retrieved involuntarily?
CHPATER 17 AUTOBIOGR APHICAL MEMORY AND THE SELF 563
An experiment by Haque and Conway (2001) illus- specific autobiographical memories at this very
trates how both types of retrieval occur when peo- short probe indicates direct retrieval. Thus both
ple recall specific autobiographical memories in types of retrieval can occur in the same individual.
response to a range of cue words naming common As can also be seen from Table 17.2, the incidence
activities, locations, and emotions. In this experi- of reports of autobiographical knowledge at the
ment the cue words were displayed on a computer longer probe times sharply decreases (although
screen and participants attempted to recall a mem- note the persistence of some general event knowl-
ory for each cue individually. edge), while the formation of specific memories
In order to ‘probe’ the process of memory con- strongly increases. As might be expected, as the
struction, a signal was displayed two seconds, five retrieval time lengthens so the generative process
seconds, or 30 seconds after the cue word was on runs its course and specific autobiographical memo-
screen. In response to the signal the participant had ries were formed.
to report as exactly as they could the current con-
tents of consciousness. TAB LE 17. 2 Distribution of protocols by protocol
The reports were then classified for the predom- type and probe time in experiment 1 from Haque
inant type of knowledge they contained, i.e. lifetime and Conway (2001)
period, general event, specific memory, or ‘nothing
Protocol Time of
in mind’. Table 17.2 shows the number and percent- type probe
age of each type of report at each of the probe
2 seconds 5 seconds 30 seconds
intervals. From Table 17.2 it can be seen that similar
Lifetime
numbers of reports at the two-second probe con- 30 (70%) 10 (23%) 3 (6%)
period
tain either autobiographical knowledge (lifetime General
18 (32%) 23 (41%) 15 (27%)
periods and general events) or specific autobio- event
graphical memories. Specific
33 (19%) 59 (35%) 79 (46%)
Autobiographical knowledge indicates the oper- memory
ation of the generative retrieval process (a memory Nothing in
19 (63%) 8 (27%) 3 (10%)
mind
has not yet been formed) whereas the report of
SUMMARY OF SECTION 3
• Autobiographical remembering of a specific episode is constructive in nature. It brings together auto-
biographical knowledge (general events and lifetime periods), generic images, and episodic memories.
• In autobiographical memory, episodic memory is thought to consist of ‘experience near’, highly spe-
cific, sensory–perceptual details of recent experiences. Only those episodic memories that then go
on to be linked to long-term memory will be available later to support the formation of subsequent
autobiographical memories. It is helpful to think of episodic memories not by their content, but by
the experience of recollection during retrieval.
• One role of the self is to control the process of autobiographical memory construction. This is
because constructing an autobiographical memory is a major cognitive occurrence, and has
consequences for all other types of processing. The working self can be thought of as a complex goal
564 PART 6 CHALLENGES, THEMES, AND ISSUES
hierarchy, modulating access to knowledge in long-term memory, and controlling knowledge that can
enter the knowledge base. Episodic memories are then interpreted in terms of the self.
• The process of memory construction itself can be either intentional (generative retrieval) or uninten-
tional (direct retrieval).
(Details of the case have been changed in order to pro- mood. He had stopped work three months previ-
tect anonymity.) ously and spent all day at home. He did not like to
‘John’ was seen for an emergency appointment leave his house, although he felt safer going out in the
with a psychiatrist due to his recent suicidal thoughts. dark. He could not listen to music. He reported feel-
The psychiatrist noted that three months previously ing very tired as he frequently had nightmares. He
he had seen a friend fall to his death from a building, also described being overwhelmed by mental images
but would not talk about it. He was then referred for of his friend’s death, which he tried hard to push
assessment with a clinical psychologist. At the first away from his mind. He had periods where he felt
meeting he appeared distracted, jumpy, and low in unreal and cut off from other people.
CHPATER 17 AUTOBIOGR APHICAL MEMORY AND THE SELF 565
PTSD is made up of several components (American develop the full range of PTSD symptoms. In other
Psychiatric Association, 1994): the traumatic event; words the traumatic event has to be experienced as
response at the time of trauma; and subsequent psy- stressful in a major way and possibly a biological stress
chological symptoms. response must also occur if PTSD is to follow.
While the American Psychiatric Association’s defi-
nition focuses on reactions of intense fear, hopeless-
4.1 Traumatic event ness, and horror, other intense emotions are also
frequently experienced at the time of trauma, such as
First of all, the patient needs to report having experi- anger or shame (Grey et al., 2001). Conway and
enced a ‘traumatic event’. This is typically a situation in Pleydell-Pearce (2000) suggest that the perception of
which the individual experienced or witnessed actual extreme danger and/or imminent death poses a fun-
or threatened death, or serious injury to self or others. damental challenge to the goal system of the working
Examples include natural disasters, sexual assault, road self. The trauma experience cannot be easily processed
traffic accidents, physical attack, and torture. In John’s by the working self as it threatens the entire goal sys-
case, the trauma was seeing his friend fall down the tem, and because of this the experience cannot readily
centre shaft of a stairwell in a block of flats to his death. be integrated with autobiographical memory knowl-
edge structures in long-term memory. On the other
hand, if the working self were to survive such trauma
it would be highly useful from a survival perspective
4.2Response at the time to retain a detailed record of what occurred. Thus, the
of trauma tension is between either not encoding the (life)
threatening experience (traumatic amnesia) or keep-
It is not only the experience of a trauma that contrib- ing a good record of it just in case one survives (a
utes to a diagnosis of PTSD. The person’s reaction to vivid, or ‘flashbulb’, memory). In fact, what is fre-
the trauma is also critical. For example, soldiers fight- quently observed in PTSD is, initially at least, a frag-
ing or doctors performing surgery are exposed to mentary and often jumbled memory containing
death or serious injury routinely. While many people highly vivid details that are unordered with respect to
in such occupations do at some stage become trauma- their original order of experience, and often inter-
tized, many do not. In comparison to the number of spersed with extensive ‘gaps’ (islands of amnesia). This
people who have experienced ‘a trauma’, community is perhaps just the sort of compromise we might
studies have estimated variable rates of PTSD occur- expect when the working self is caught between
ring within the general population ranging from 1 per encoding and not encoding.
cent to 14 per cent (American Psychiatric Association, In John’s trauma, he was on the stairs several floors
1994). Clearly, not everyone who has a trauma goes on below his friend when he slipped, so could not see him
to develop PTSD. Thus, the second component of initially. John’s first reaction was intense fear that the
PTSD is that the person’s response to the trauma banging sound meant impending danger. Then he
involved intense fear, hopelessness, or horror experienced intense horror as he saw his friend fall
(American Psychiatric Association, 1994). For exam- past. He therefore meets the ‘emotional response’ cri-
ple, if there were two people in a car that crashed into teria for PTSD. At the time John also felt intensely
the side of a bus, narrowly missing a head-on colli- unreal, as if he was watching the event happen to him
sion, one person might think ‘I’m going to die’ and be from outside of his body. He felt as if time had slowed
intensely afraid. The other person might feel only mild down and that he was watching the event in slow
fear and conclude ‘Phew! I’m so lucky this isn’t worse’. motion. This phenomenon is known as detachment or
Only the first person would display a symptom of dissociation (American Psychiatric Association,
PTSD and probably only this person would go on to 1994), and is a common reaction during trauma. At
566 PART 6 CHALLENGES, THEMES, AND ISSUES
the time of trauma, the feelings of unreality John is mediated by episodic memories of the traumatic
experienced can be thought of as protecting the self event itself. This stands in sharp contrast to other psy-
from the destabilizing psychological impact of the chological disorders that may also feature intrusive
trauma (van der Kolk et al., 1996). That is, through imagery of an imagined traumatic event (as in some
mentally distancing himself from the situation, he cases of psychosis, e.g. of being cut in two by a man
may have protected the self from being overwhelmed wielding a large sword; Morrison et al., 2002) or of a
with emotion. Interestingly, it is also worth noting that catastrophic future event (as in obsessive–compulsive
while dissociation may be protective at the time of disorder, e.g. violently attacking elderly parents with
trauma, it is also a strong predictor of developing an axe; de Silva, 1986). Thus, John, for example, was
PTSD (Shalev et al., 1996). plagued by countless episodic images of his trauma,
and mentioning the incident in his assessment inter-
view caused him to re-experience them. He had five
specific images that intruded. These were:
Subsequent psychological
4.3
• a banging noise
symptoms
• seeing his friend fall past him
PTSD includes various psychological symptoms dis- • the bottom of a helicopter ambulance
played by the patient. The symptoms present in three • the exterior of the block of flats
groups as outlined below.
• himself swearing at another friend.
Re-experiencing symptoms including
4.3.1
These episodic images contained sensory and emo-
intrusive memories tional experience from the time of encoding that
‘Re-experiencing’ a trauma includes having recurrent included mood states at the time of trauma (for John,
and intrusive recollections of the event (known col- fear and horror) and feelings of unreality.
lectively as ‘intrusions’), recurrent distressing dreams,
and ‘flashbacks’ that involve suddenly acting or feeling 4.3.2 Avoidance symptoms
as if the event were happening again, as well as intense Various reminders of the trauma trigger the re-experi-
physiological reactivity and psychological distress to encing of traumatic memories. In the exercise you did
reminders of the event. Ehlers et al. (2004) provide earlier you saw how cue words facilitate retrieval of
many case study examples of intrusive flashback detailed episodic memories. However, the key point
memories; one neatly illustrates just how powerful about both generative and direct retrieval is that at
these traumatic episodic memories can be: some stage during retrieval a cue has to be present that
can access the content of the sought-for knowledge
‘A patient who thought that he was going to die dur-
(Tulving and Thompson, 1973). In PTSD, however,
ing an assault and would never see his children again,
there may be many cues for the trauma knowledge
was not able to access the fact that he actually sur-
(especially if this is represented in memory in terms of
vived and saw his children again when he remem-
goals active at the time of the experience) and
bered this particularly distressing point of the assault.
these have a tendency to generalize to other stimuli
And when the intrusion occurred he would again be
with shared features. For example, for a person raped
overwhelmed with sadness.’
by a bearded man, all men with beards may trigger
(Ehlers et al., 2004)
re-experiencing symptoms, i.e. memory intrusions.
It should be noted that these sensory–perceptual– Even more generally, for someone who had a road traf-
affective details are just the sort of autobiographical fic accident with a red car, the colour red, even on post
information contained in recently formed episodic boxes or clothes, may trigger intrusive memories of the
memories in Conway’s model outlined above. Indeed, crash. These generalizations are made non-consciously
it is central to the PTSD illness that the re-experience and at first it may not be evident why an intrusive
CHPATER 17 AUTOBIOGR APHICAL MEMORY AND THE SELF 567
4.3.4 Hyperarousal symptoms
memory comes to mind. Ehlers et al. (2004) give the
following example: ‘A rape victim noticed that she was Hyperarousal may feel like being in a constant state of
feeling extremely anxious while talking to a female ‘red alert’ for potential danger. People with PTSD have
friend in a restaurant and subsequently realized that an exaggerated startle response in that even small,
the feeling was probably triggered by the presence of a unexpected noises make them jump. John repeatedly
man on another table who bore some physical similar- flinched throughout his assessment interview, for
ity with the rapist’ (Ehlers et al., 2004). example if he heard a sound in the corridor outside.
PTSD sufferers rapidly learn what triggers their Other symptoms of hyperarousal are impaired con-
re-experiencing of intrusive memories and, once centration and irritability. Some patients are no longer
learned, such potent cues are avoided, which can able to concentrate on simple activities such as read-
sometimes lead to dysfunctional behaviour, e.g. avoid- ing a newspaper or cooking. Impaired concentration
ing all red objects of a certain size or leaving a restau- links with features of autobiographical memory dis-
rant abruptly. Avoidance is then the second cluster of cussed earlier, that is, the process of retrieval of spe-
PTSD symptoms. John, for example, stopped playing cific events (such as intrusions) is disruptive to other
all music as any rhythmic beat caused him to re-expe- cognitive processes. John found it difficult to read the
rience the ‘banging’ image and distress. He stopped psychological assessment questionnaires and even to
going out during the day as the sight of tall buildings sustain attention when watching television.
also brought back powerful intrusions. He also
avoided talking about the trauma. Although avoid-
ance may feel helpful in the short term, in the longer 4.4 Impact of symptoms
term avoidance of reminders of a trauma will not ena-
ble someone with PTSD to recover. Avoidance forms The final component of PTSD is the duration and
part of the vicious cycle that maintains the disorder impact of the disorder. To meet the diagnostic criteria
(Ehlers and Clark, 2000). the person must have had the cluster of PTSD symp-
toms for at least one month. This is because after a
4.3.3 Amnesia as avoidance trauma most people typically have trauma symptoms,
A further form of avoidance is involuntary in nature such as intrusive memories, for a short time. The
and takes the form of amnesia for the trauma. This impact criterion is standard to most mental disorders;
may occur because the self inhibits knowledge that that is, that the symptoms have caused significant and
was nonetheless encoded: often in therapy some persistent distress for the person, for example in their
memory returns to PTSD patients, suggesting that it occupation or socially. John had stopped working and
was in fact inhibited rather than not encoded. On the also avoided all his friends. Indeed, he was so dis-
other hand, the overwhelming of the working self by tressed by his symptoms and the impact that they had
negative emotions may render encoding through this had on his life that he had begun to contemplate com-
structure ineffective. The result is an amnesia more mitting suicide.
like that seen in anterograde amnesia following brain In summary, then, to receive a diagnosis of PTSD, a
damage. This could also occur because the stress patient must have experienced a traumatic event and
response causes a temporary increase in a particular responded to it with fear, helplessness, or horror. The
neurohormone in a part of the brain, the medial tem- patient must persistently re-experience the trauma,
poral lobe, which as a result is temporarily disabled. avoid stimuli associated with it, and have symptoms of
At his therapy assessment John was not able to recall increased arousal such as an exaggerated startle
his memory of the time between seeing his friend fall response. The trauma in John’s case of PTSD was wit-
past him at the top of the stairwell, and then when he nessing the violent death of a friend. John showed the
was standing outside the building in a crowd. He said full range of PTSD symptoms, especially intense intru-
it felt like a ‘gap’ and, unlike the rest of his trauma, he sive memories, and these had a profound negative
was unable to recall it even with effort. impact on his quality of life. Now we have gone through
568 PART 6 CHALLENGES, THEMES, AND ISSUES
the diagnosis, go back and read the case vignette at the intensity of re-experience: the PTSD sufferer does not
start of this section. Can you see how the symptoms have a sense or feeling of the self in the past; instead
John presented at assessment make sense? they are actually in that past moment. One woman
with PTSD, for example, had a traumatic experience
involving gun shots. Whenever she heard a sudden
bang, such as a balloon pop at a children’s birthday
4.5The nature of intrusive party, she would feel as if it was happening again and
trauma memories throw herself to the floor in protection. This type of
experience is an example of a ‘flashback’. Such cue-
Re-experiencing trauma in the form of intrusive mem- driven direct recall of overwhelming re-experienced
ories is the hallmark symptom of PTSD, and because of memories is unusual in normal autobiographical
it, PTSD is one of the major psychopathological disor- remembering. Nevertheless, the same mechanisms
ders of autobiographical memory. Phenomenologically, may be operating: namely a cue accesses the content of
intrusive trauma memories have several distinctive fea- an episodic memory and this becomes rapidly availa-
tures that relate to our understanding of normal, non- ble to attention and consciousness. Without the self to
traumatized autobiographical remembering. For effectively intervene in direct retrieval, the memory
instance, intrusive memories are image-based and they will capture attention and dominate consciousness.
very often take the form of visual sensory–perceptual Perhaps this would occur much more frequently in
snapshots like ‘film clips’ (Ehlers and Steil, 1995) or epi- normal recall if control processes did not act to pre-
sodic memories. The intrusive trauma images, although vent thoughts and memories coming to mind.
typically visual, may also incorporate sounds and smells Additionally, if episodic memories were more inte-
and, sometimes, bodily sensations (Ehlers et al., 2002). grated with the autobiographical knowledge base it
For example, a woman who was raped in the dark seems likely that they would not come to mind with
encoded memory in non-visual sensory modalities, such a feeling of ‘nowness’ and instead be recollec-
and during treatment reported suddenly experiencing tively experienced as a part of an extended and inte-
physical pain and smells. John’s images were a mixture gral past. Indeed, one of the goals of successful
of visual and auditory images. The memories also con- treatment of PTSD is to reach a point at which, when
tain the emotion experienced at the time of trauma, a patient recalls a trauma memory, it is experienced
such as fear, shame, or disgust (Grey et al., 2002), or more like a normal autobiographical memory, as a
feelings of unreality. As his friend fell past him, John felt part of the past and less as a part of the ‘now’ (Ehlers
unreal and saw the scene as if he were outside of his and Clark, 2000).
own body looking down on himself. He therefore expe- Another point of departure between normal and
rienced most of his intrusive images as if he was ‘out-of- trauma memories is that, unlike usual autobiographi-
body’ and often felt unreal. Also, intrusive memories cal remembering, the intrusive memories of trauma in
can include verbal cognition from the time of trauma, people with PTSD often seem to be exact copies of
typically catastrophic thoughts such as ‘I’m going to die’ what was experienced at the time of trauma. Moreover,
(Holmes et al., 2004). the intrusions are usually highly consistent, being the
Trauma memories have a quality of ‘nowness’ or same each time they come to mind. Such impressive
‘live feel’ (cf. Brown and Kulik, 1977). In normal auto- consistency suggests that the same mental representa-
biographical remembering the recall of specific events tion (episodic) memory is accessed each time an
is accompanied by visual images and recollective intrusion occurs. However, the veridicality of trauma
experience, but in PTSD intrusive memories can be so images is a contentious issue and these may not always
compelling that the trauma feels as if it is in reality be based on experience. Holmes et al. (2004) found
happening again. That is to say that the recollective that, of a sample of patients with PTSD, approximately
experience component, the sense of the self in the 2 per cent of different intrusive images were reported
past, appears to be overwhelmed or blocked by the by participants as not actually being of their trauma
CHPATER 17 AUTOBIOGR APHICAL MEMORY AND THE SELF 569
experience. While this indicates that participants rather than as a sequence and often do not appear to
believed that most of their intrusions were of the coalesce in any obvious way, instead presenting as
event, it is possible that objectively they may not have fragmented and disorganized (Foa et al., 1995). Earlier
been. Images, for instance, can be associated with it was reported that John had five distinct images of
beliefs that do not accurately reflect what in reality his trauma and these too appeared unorganized and
happened. Hackman et al. (2004) report the case of a fragmented. Interestingly, most PTSD patients spon-
woman who, after a house fire, experienced repeated taneously report between three to five trauma images
intrusions of curtains burning. These led her to believe (Hackmann et al., 2004) suggesting that there may be
that her daughter was burning alive. However, she also some consistency in accessing trauma memories.
had another intrusion of when she saw her daughter’s More generally, however, one of the fascinating ques-
body in the morgue, which was unburned. The daugh- tions about trauma memories is why are there intru-
ter had in fact died of smoke inhalation. The patient sive images of some moments but not others?
was, however, unable to connect the different infor- Researchers have begun to address this question by
mation in the two images. Possibly these contradic- investigating ‘hotspots’ in trauma memories (Richards
tory, highly vivid trauma images reflect unresolved and Lovell, 1999; Ehlers and Clark, 2000). These are
affective conflicts in the patient. elicited by asking the patient ‘What are the worst parts
Incidents of distortion and false images in trauma of your trauma when you describe it?’ These worst
memories do then occur (Ehlers et al., 2004; Conway moments correspond to the moments that intrude.
et al., 2004) and they pose an interesting question: if a Grey et al. (2001) found that hotspot images are asso-
memory of a trauma is created in part to preserve a ciated with a wide range of ‘peak’ emotions. They con-
detailed record of what occurred when one survived a sist of the sensory–perceptual information encoded at
trauma, how can it contain distortions and errors? The that point in time, as well as the cognition linked to
question has not yet been addressed by the appropri- the specific emotion. For example, a patient had an
ate research but we might speculatively consider the extremely fear-filled image of the sound of impact
role of the self in generating fantasies that protect the during a crash and the sensation of being flung for-
self from deeply undermining cognition. Whatever wards, accompanied by the cognition ‘I’m going to
eventually turns out to be the explanation, it is clear die’. Hotspots that return as intrusive memories may
that distortion in PTSD images requires just as much then relate to moments during the experience of
explanation as do accurate flashbacks. trauma when the self was most intensely challenged
Trauma images are like ‘highlights’ picked out in a and, clearly, repetitively and intrusively recalling such
trailer for a film, except that they can occur one by one moments must act to destabilize the self.
SUMMARY OF SECTION 4
• Direct retrieval in an extreme, disruptive, and distressing form is illustrated by the intrusive memo-
ries of trauma (e.g. flashbacks) experienced by people with post-traumatic stress disorder (PTSD).
• The features of PTSD include the traumatic episode itself, the person’s experience at encoding,
symptoms of re-experiencing the trauma in memory, avoidance and amnesia, and hyperarousal. The
case study considered the clinical features from an autobiographical memory perspective.
• Section 4 describes an application of theory to a clinical condition, where arguably memory research
has helped inform the care and understanding of a relatively common condition. The keen student
will find other instances of the application of theory – to brain damage, depression, child develop-
ment, and autism, to name but a few. We have given some suggestions for further reading below.
570 PART 6 CHALLENGES, THEMES, AND ISSUES
and the dates of the memories clustered around the from moment to moment, is a difficult endeavour. In
time when they judged that impatience first became Section 3 we discussed how the working self controls
part of their identity. memory construction, but one might ask the question
This procedure then enabled the examination of the of what controls the working self? This philosophical
relationship between the self and memory in amnesia. problem is similar to the homunculus argument
In the case of PJM (see Box 17.3; Rathbone et al., (Gregory, 1987), in that one apparently needs to keep
2009), we showed that even someone with little or no searching one step back for a controlling agent that
episodic memory generated appropriate ‘I am’ state- oversees conscious experience. Although no one has
ments, and with these a set of clustered events, even if yet solved the puzzle of how to explain conscious
these events were not remembered or experienced as experience (see Chapter 18), these difficult conceptual
episodic memories in the sense described above. Our issues are part of what makes the topic of self and
interpretation of this was that the self is maintained memory such an intriguing area of research.
even without episodic memory, and semantic knowl- It is perhaps fitting to finish up by looking to the
edge about life events takes on the role of supporting future. The autobiographical memory system
the sense of self. We found similar results in a case of described in this chapter is clearly a complex, dynamic
memory impairment in epilepsy (Illman et al., 2011). system, which is arguably shaped by personal goals
This chapter has discussed many studies that and the need to orientate oneself in a life story. Perhaps
explore the link between self and memory, but per- unsurprisingly, one of the most recent developments
haps you’ve found yourself wondering what this ‘self ’ in the field has been the notion that this reconstruc-
is, how it is defined, and how it is measured? These are tive, goal-driven system is at play when looking into
all important questions, from both scientific and phil- the future as well as the past (Schacter and Addis,
osophical points of view. In order to study the self, we 2007). According to this view, overlapping brain and
must first define it in some way. For example, in the cognitive systems are responsible for both imagining
studies that involve ‘I am’ statements, the self is exam- the future and retrieving the past. The evidence for
ined in terms of aspects of self-knowledge (e.g. ‘I am a their similarity comes largely from neuroimaging
researcher’). However, tapping into the more nebu- studies, with both autobiographical remembering
lous aspects of self, such as what it feels like to be ‘me’ and imagining the future seeming to rely on the
PJM suffered a brain injury after falling from a bicy- memory might affect her sense of self, and the
cle, and this damage left her with an inability to way that memories were used to support self-
remember episodic memories from several years of knowledge in the IAM Task. Results showed that
her life. Some key life events were missing from PJM’s semantic memories clustered temporally
PJM’s autobiographical memory, including moving around periods of identity development (e.g. when
house and having a baby – events that most people she became a mother), suggesting that semantic
would have many salient and readily accessible facts support information about the self in much
memories for. Although PJM lacked episodic recol- the same fashion as episodic memories. Further-
lection, she was able to retrieve semantic facts more, PJM’s ability to generate and date ‘I am’
about her past. Thus she knew she had moved statements was not impaired, indicating that the
house, but could not recall any specific events asso- ability to possess information about the self is not
ciated with that knowledge. reliant on episodic memory.
Rathbone et al. (2009) were interested in explor-
ing how this change in PJM’s autobiographical
572 PART 6 CHALLENGES, THEMES, AND ISSUES
hippocampus, a small region of the brain traditionally memory. And it would appear that the self is critical in
thought to be responsible for memory and navigation future thinking too – people’s ‘I will be . . .’ statements
(Addis et al., 2010). Interestingly, the same issues, are supported by imagined events that seem to cluster
such as specificity and the relationship between epi- temporally in the same way that events and recollec-
sodic and semantic systems, emerge as research tions are distributed around the self in the past
themes in future thinking just as in autobiographical (Rathbone et al., 2011).
FURTHER READING
Conway, M.A. and Pleydell-Pearce, C.W. (2000) ‘The con- Addis, D.R. and Tippett, L. J. (2004) ‘Memory of myself:
struction of autobiographical memories in the self memory autobiographical memory and identity in Alzheimer’s disease’,
system’, Psychological Review, vol.107, no.2, pp.261–88. Memory, vol.12, pp.56–74. A recent study of the integrity of
McAdams, D.P. (2001) ‘The psychology of life stories’, autobiographical memory and identity in Alzheimer’s disease.
Review of General Psychology, vol.5, no.2, pp.100–22. These Kuwabara, K.J. and Pillemer, D.B. (2010) ‘Memories of past
articles review research on autobiographical memory and pro- episodes shape current intentions and decisions’, Memory,
pose, respectively, models in which memories are mental con- vol.18, no.4, pp.365–74. A recent study that tested the idea that
structions within a self-memory system, and in which people people’s decisions and future plans are influenced by recently acti-
construct narratives of the self. vated autobiographical memories.
Brewin, C.R. and Holmes, E.A. (2003) ‘Psychological theo- Rathbone, C.J., Moulin, C.J.A., and Conway, M.A. (2009)
ries of posttraumatic stress disorder’, Clinical Psychology ‘Autobiographical memory and amnesia: using conceptual
Review, vol.23, no.3, pp.339–76. Brewin and Holmes review knowledge to ground the self ’, Neurocase, vol.15, no.5,
recent research on the psychological processes involved in PTSD pp.405–18. A study that reports on a patient with retrograde
and its treatment, describe early theoretical approaches, and com- amnesia, PJM, and sheds light on the relationship between self,
pare three recent theories. episodic memory, and autobiographical knowledge.
REFERENCES
Addis, D.R., Chen, T.P., Roberts, R., and Schacter, D.L. (2010) Berntsen, D. and Rubin, D.C. (2004) ‘Cultural life scripts
‘Hippocampal contributions to the episodic simulation of spe- structure recall from autobiographical memory’, Memory &
cific and general future events’, Hippocampus, doi: 10.1002/ Cognition, vol.32, pp.427–42.
hipo.20870. Bluck, S. and Habermas, T. (2000) ‘The life story schema’,
American Psychiatric Association (1994) Diagnostic and Motivation and Emotion, vol.24, no.2, pp.121–47.
Statistical Manual of Mental Disorders: DSM-IV, 4th edition, Bohn, A. and Berntsen, D. (2011) ‘The reminiscence bump
Washington, DC, American Psychiatric Association. reconsidered: children’s prospective life stories show a bump
Baddeley, A.D. (1986) Working Memory, Oxford, Clarendon in young adulthood’, Psychological Science, vol.22, no.2,
Press. pp.197–202.
Baddeley, A.D. (2000) ‘The episodic buffer: a new compo- Brewer, W.F. (1986) ‘What is autobiographical memory?’ in
nent of working memory?’ Trends in Cognitive Sciences, vol.4, Rubin, D.C. (ed.) Autobiographical Memory, Cambridge,
no.11, pp.417–23. Cambridge University Press.
Baddeley, A. and Wilson, B. (1988) ‘Frontal amnesia and the Brewer, W.F. (1988) ‘Memory for randomly sampled auto-
dysexecutive syndrome’, Brain & Cognition, vol.7, no.2, pp.212–30. biographical events’, in Neisser, U. and Winograd, E. (eds.)
Beike, D.R. and Landoll, S.L. (2000) ‘Striving for a consist- Remembering Reconsidered: Ecological and Traditional
ent life story: cognitive reactions to autobiographical memo- Approaches to the Study of Memory, New York, Cambridge
ries’, Social Cognition, vol.18, no.3, pp.292–318. University Press.
CHAPTER 17 AUTOBIOGR APHICAL MEMORY AND THE SELF 573
Brewer, W.F. (1996) ‘What is recollective memory?’ in Rubin, Fitzgerald, J.M. (1996) ‘Intersecting meanings of reminis-
D.C. (ed.) Remembering Our Past: Studies in Autobiographical cence in adult development and aging’, in Rubin, D.C. (ed.)
Memory, Cambridge, Cambridge University Press. Remembering Our Past: Studies in Autobiographical Memory,
Brewin, C.R. and Holmes, E.A. (2003) ‘Psychological theo- Cambridge, Cambridge University Press.
ries of posttraumatic stress disorder’, Clinical Psychology Fitzgerald, J.M. and Lawrence, R. (1984) ‘Autobiographical
Review, vol.23, no.3, pp.339–76. memory across the life-span’, Journal of Gerontology, vol.39,
Brown, N.R. and Schopflocher, D. (1998) ‘Event cueing, no.6, pp.692–8.
event clusters, and the temporal distribution of autobiograph- Fivush, R., Hammond, C., and Reese, E. (1996)
ical memories’, Applied Cognitive Psychology, vol.12, no.4, ‘Remembering, recounting, and reminiscing: the develop-
pp.305–19. ment of autobiographical memory in social context’ in Rubin,
Brown, R. and Kulik, J. (1977) ‘Flashbulb memories’, D.C. (ed.) Remembering Our Past: Studies in Autobiographical
Cognition, vol.5, no.1, pp.73–99. Memory, Cambridge, Cambridge University Press.
Conway, M.A. (1996) ‘Autobiographical memories and Foa, E.B., Molnar, C., and Cashman, L. (1995) ‘Change in
autobiographical knowledge’, in Rubin, D.C. (ed.) rape narratives during exposure therapy for posttraumatic
Remembering Our Past: Studies in Autobiographical Memory, stress disorder’, Journal of Traumatic Stress, vol.8, no.4,
Cambridge, Cambridge University Press. pp.675–90.
Conway, M.A. (2001) ‘Sensory perceptual episodic mem- Franklin, H.C. and Holding, D.H. (1977) ‘Personal memo-
ory and its context: autobiographical memory’, Philosophical ries at different ages’, Quarterly Journal of Experimental
Transactions of the Royal Society, Series B, Biological Sciences, Psychology, vol.29, pp.527–32.
vol.356, no.1413, pp.1375–84. Freud, S. (1955, first published 1899) ‘Screen memories’, in
Conway, M.A. and Pleydell-Pearce, C.W. (2000) ‘The con- Strachey, J. (ed. and trans.) The Standard Edition of the
struction of autobiographical memories in the self memory Complete Psychological Works of Sigmund Freud, Volume 3,
system’, Psychological Review, vol.107, no.2, pp.261–88. London, Hogarth Press.
Conway, M.A., Meares, K., and Standart, S. (2004) ‘Images Fromholt, P. and Larsen, S.F. (1991) ‘Autobiographical
and goals’, Memory, vol.12, no.4, pp.525–31. memory in normal aging and primary degenerative dementia
de Silva, P. (1986) ‘Obsessional compulsive imagery’, (dementia of the Alzheimer type)’, Journal of Gerontology:
Behaviour Research and Therapy, vol.24, no.3, pp.333–50. Psychological Sciences, vol.46, pp.85–91.
Dritschel, B., Williams, J.M.G, Baddeley, A.D., and Nimmo- Fromholt, P. and Larsen, S.F. (1992) ‘Autobiographical mem-
Smith, I. (1992) ‘Autobiographical fluency: a method for the ory and life-history narratives in aging and dementia (Alzheimer
study of personal memory’, Memory and Cognition, vol.20, type)’, in Conway, M.A., Rubin, D.C., Spinnler, H., and
pp.133–40. Wagenaar, W. (eds.) Theoretical Perspectives on Autobiographical
Ehlers, A. and Clark, D.M. (2000) ‘A cognitive model of Memory, Utrecht, Kluwer Academic Publishers.
posttraumatic stress disorder’, Behaviour Research and Gallagher, T., Campbell, M., and Gillies, M. (1995) The
Therapy, vol.38, no.4, pp.319–45. Smiths: All Men Have Secrets, London, Virgin Books.
Ehlers, A. and Steil, R. (1995) ‘Maintenance of intrusive Gardiner, J.M. and Richardson-Klavehn, A. (2000)
memories in posttraumatic stress disorder: a cognitive ‘Remembering and knowing’, in Tulving, E. and Craik, F.I.M.
approach’, Behavioural and Cognitive Psychotherapy, vol.23, (eds.) Handbook of Memory, Oxford, Oxford University
no.3, pp.217–49. Press.
Ehlers, A., Hackmann, A., and Michael, T. (2004) ‘Intrusive Gilhooly, K.J. and Logie, R.H. (1980) ‘Age of acquisition,
re-experiencing in post-traumatic stress disorder: phenome- imagery, concreteness, familiarity and ambiguity measures for
nology, theory and therapy’, Memory vol.12, no.4, pp.303–415. 1944 words’, Behaviour Research Methods and Instrumentation,
Ehlers, A., Hackmann, A., Steil, R., Clohessy, S., Wenninger, vol.12, pp.395–427.
K., and Winter, H. (2002) ‘The nature of intrusive memories Gregory, R.L. (ed.) (1987) The Oxford Companion to the
after trauma: the warning signal hypothesis’, Behaviour Mind, Oxford, Oxford University Press.
Research and Therapy, vol.40, no.9, pp.995–1002. Grey, N., Holmes, E., and Brewin, C. (2001) ‘It’s not only
Erikson, E.H. and Erikson, J.M. (1982/1997) The Life Cycle fear: peri-traumatic emotional “hot spots” in posttraumatic
Completed, New York, W.W. Norton & Co. stress disorder’, Behavioural and Cognitive Psychotherapy,
Fitzgerald, J.M. (1988) ‘Vivid memories and the reminis- vol.29, no.3, pp.367–72.
cence phenomenon: the role of a self narrative’, Human Grey, N., Young, K., and Holmes, E. (2002) ‘Cognitive restruc-
Development, vol.31, pp.261–73. turing within reliving: a treatment for peri-traumatic emotional
574 PART 6 CHALLENGES, THEMES, AND ISSUES
“hot spots” in posttraumatic stress disorder’, Behavioural and Markus, H. and Ruvolo, A. (1989) ‘Possible selves: person-
Cognitive Psychotherapy, vol.30, no.1, pp.37–56. alized representations of goals’, in Pervin, L.A. (ed.) Goal
Hackmann, A., Ehlers, A., Speckens, A., and Clark, D.M. Concepts in Personality and Social Psychology, Hillsdale, NJ,
(2004) ‘Characteristics and content of intrusive memories in Lawrence Erlbaum Associates.
PSTD and their changes with treatment’, Journal of Traumatic McAdams, D.P. (1982) ‘Experiences of intimacy and power:
Stress, vol.17, no.3, pp.231–40. relationships between social motives and autobiographical
Haque, S. and Conway, M.A. (2001) ‘Probing the process of memory’, Journal of Personality and Social Psychology, vol.42,
autobiographical memory retrieval’, European Journal of no.2, pp.292–302.
Cognitive Psychology, vol.13, no.3, pp.1–19. McAdams, D.P. (1985) Power, Intimacy, and the Life Story:
Hollway, W. and Jefferson, T. (2000) Doing Qualitative Personological Inquiries into Identity, New York, Guilford Press.
Research Differently: Free Association, Narrative and the McAdams, D.P. (2001) ‘The psychology of life stories’,
Interview Method, London, Sage. Review of General Psychology, vol.5, no.2, pp.100–22.
Holmes, A. and Conway, M.A. (1999) ‘Generation McAdams, D.P., Diamond, A., de Audin, E., and Mansfield
identity and the reminiscence bump: memories for public (1997) ‘Stories of commitment: the psychosocial construction
and private events’, Journal of Adult Development, vol.6, of generative lives’, Journal of Personality and Social Psychology,
pp.21–34. vol.72, no.3, pp.678–94.
Holmes, E.A., Grey, N., and Young, K.A.D. (2005) ‘Intrusive McAdams, D.P., Reynolds, J., Lewis, M.L., Patten, A., and
images and “hotspots” of trauma memories in posttraumatic Bowman, P.T. (2001) ‘When bad things turn good and good
stress disorder: an exploratory investigation of emotions and things turn bad: sequences of redemption and contamination
cognitive themes’, Journal of Behaviour Therapy and in life narrative, and their relation to psychosocial adaptation
Experimental Psychiatry, vol.36, no.1, pp.3–17. in midlife adults and in students’, Personality and Social
Howe, M.L. and Courage, M.L. (1997) ‘The emergence and Psychology Bulletin, vol.27, pp.472–83.
early development of autobiographical memory’, Psychological McClelland, D.C., Koestner, R., and Weinberger, J. (1989)
Review, vol.104, pp.499–523. ‘How do self-attributed and implicit motives differ?’
Illman, N.A., Rathbone, C.J., Kemp, S., and Moulin, C.J.A. Psychological Review, vol.96, no.4, pp.690–702.
(2011) ‘Autobiographical memory and the self in a case of Morrison, A.P., Beck, A.T., Glentworth, D., Dunn, H., Reid,
transient epileptic amnesia’, Epilepsy & Behavior, vol.21, no.1, G., Larkin, W., and Williams, S. (2002) ‘Imagery and psychotic
36–41. symptoms: a preliminary investigation’, Behaviour Research
Janssen, S.M.J., Rubin, D.C., and St. Jacques, P.L. (2011) and Therapy, vol.40, pp.1063–72.
‘The temporal distribution in autobiographical memory: Morrison, C.M. and Conway, M.A. (2010) ‘First words and
changes in reliving and vividness over the life span do not first memories’, Cognition, vol.116, no.1, pp.23–32.
explain the reminiscence bump’, Memory & Cognition, vol.39, Moscovitch, M. and Melo, B. (1997) ‘Strategic retrieval and
no.1, 1–11. the frontal lobes: evidence from confabulation and amnesia’,
Johnson-Laird, P.N. (1983) Mental Models, Cambridge, Neuropsychologia, vol.35, no.7, 1017–34.
MA, Harvard University Press. Murray, H.A. (1938) Explorations in Personality, New York,
Kuhn, M.H. and McPartland, T.S. (1954) ‘An empirical Oxford University Press.
investigation of self-attitudes’, American Sociological Review, Murray, H.A. (1943) The Thematic Apperception Test:
vol.19, pp.68–76. Manual, Cambridge, MA, Harvard University Press.
Kuwabara, K.J. and Pillemer, D.B. (2010) ‘Memories of past Pillemer, D.B. (1998) Momentous Events, Vivid Memories,
episodes shape current intentions and decisions’, Memory, Cambridge, MA, Harvard University Press.
vol.18, no.4, 365–74. Pillemer, D.B. and White, S.H. (1989) ‘Childhood events
Larsen, S.F. (1998) ‘What is it like to remember? On phe- recalled by children and adults’, in Reese, H.W. (ed.) Advances
nomenal qualities of memory’, in Thompson, C.P., Herrmann, in Child Development and Behaviour, Volume 21, San Diego,
D.J., Bruce, D., Reed, J.D., Payne, D.G., and Toglia, M.P. (eds.) CA, Academic Press.
Autobiographical Memory: Theoretical and Applied Perspectives, Pillemer, D.B., Picariello, M.L., Law, A.B., and Reichman,
Mahwah, NJ, Erlbaum. J.S. (1996) ‘Memories of college: the importance of specific
Markus, H. (1977) ‘Self-schemata and processing informa- educational episodes’, in Rubin, D.C. (ed.) Remembering Our
tion about the self ’, Journal of Personality and Social Psychology, Past: Studies in Autobiographical Memory, Cambridge,
vol.35, no.2, pp.63–78. Cambridge University Press.
CHAPTER 17 AUTOBIOGR APHICAL MEMORY AND THE SELF 575
Piolino, P., Coste, C., Martinelli, P., Macé, A.L., Quinette, P., Schacter, D.L. and Addis, D.R. (2007) ‘The cognitive neuro-
Guillery-Girard, B., and Belleville, S. (2010) ‘Reduced speci- science of constructive memory: remembering the past and
ficity of autobiographical memory and aging: do the executive imagining the future’, Philosophical Transactions of the Royal
and feature binding functions of working memory have a Society, Series B, Biological Sciences, vol.362, no.1481,
role?’ Neuropsychologia, vol.48, pp.429–40. pp.773–86.
Rathbone, C.J., Conway, M.A., and Moulin, C.J.A. (2011) Schacter, D.L., Norman, K.A., and Koutstaal, W. (1998)
‘Remembering and imagining: the role of the self ’, ‘The cognitive neuroscience of constructive memory’, Annual
Consciousness & Cognition, vol.20, pp.1175–82. Review of Psychology, vol.49, pp.289–318.
Rathbone, C.J., Moulin, C.J.A., and Conway, M.A. (2008) Schank, R.C. and Abelson, R.P. (1977) Scripts, Plans, Goals,
‘Self-centred memories: the reminiscence bump and the self ’, and Understanding, Hillsdale, NJ, Erlbaum.
Memory & Cognition, vol.36, no.8, 1403–14. Schlagman, S. and Kvavilashvili, L. (2008) ‘Involuntary
Rathbone, C.J., Moulin, C.J.A., and Conway, M.A. (2009). autobiographical memories in and outside the laboratory:
‘Autobiographical memory and amnesia: using conceptual how different are they from voluntary autobiographical mem-
knowledge to ground the self ’, Neurocase, vol.15, no.5, ories?’ Memory and Cognition, vol.36, no.5, pp.920–32.
pp.405–18. Schuman, H., Belli, R.F., and Bischoping, K. (1997) ‘The
Richards, D. and Lovell, K. (1999) ‘Behavioural and cogni- generational basis of historical knowledge’, in Jodelet, D.,
tive interventions in the treatment of PTSD’, in Yule, W. (ed.) Pennebaker, J., and Paez, D. (eds.) Political Events and
Post-traumatic Stress Disorders: Concepts and Therapy, Collective Memories, London, Routledge.
Chichester, Wiley. Sehulster, J.R. (1996) ‘In my era: evidence for the percep-
Robinson, J.A. (1992) ‘First experience memories: contexts tion of a special period in the past’, Memory, vol.4, pp.145–58.
and function in personal histories’, in Conway, M.A., Rubin, Shalev, A.T., Peri, T., Canetti, L., and Schreiber, S. (1996)
D.C., Spinnler, H., and Wagenaar, W. (eds.) Theoretical ‘Predictors of PTSD in injured trauma survivors: a prospective
Perspectives on Autobiographical Memory, Dordrecht, The study’, American Journal of Psychiatry, vol.153, no.2, pp.219–25.
Netherlands, Kluwer Academic Publishers. Sheldon, K.M. and Elliot, A.J. (1999) ‘Goal striving, need
Rubin, D.C. (2002) ‘Autobiographical memory across the satisfaction, and longitudinal well-being: the self-concordance
lifespan’, in Graf, P. and Ohta, N. (eds.) Lifespan Development model’, Journal of Personality and Social Psychology, vol.76,
of Human Memory, Cambridge, MA, MIT Press. no.3, pp.482–97.
Rubin, D.C. and Berntsen, D. (2003) ‘Life scripts help to Singer, J.A. and Salovey, P. (1993) The Remembered Self,
maintain autobiographical memories of highly positive, but not New York, The Free Press.
highly negative, events’, Memory & Cognition, vol.31, pp.1–14. Stadthagen-Gonzalez, H. and Davis, C.J. (2006) ‘The Bristol
Rubin, D.C. and Greenberg, D.L. (1998) ‘Visual-memory- Norms for age of acquisition, imageability and familiarity’,
deficit amnesia: a distinct amnesic presentation and etiology’, Behavior Research Methods, vol.68, pp.598–605.
Proceedings of the National Academy of Sciences, vol.95, pp.1–4. Strauman, T.J. (1996) ‘Stability within the self: a longitudi-
Rubin, D.C. and Schulkind, M.D. (1997) ‘The distribution nal study of the structural implications of self-discrepancy
of autobiographical memories across the lifespan’, Memory theory’, Journal of Personality and Social Psychology, vol.71,
and Cognition, vol.25, pp.859–66. no.6, pp.1142–53.
Rubin, D.C., Rahhal, T.A., and Poon, L.W. (1998) ‘Things Thorne, A. (1995) ‘Developmental truths in memories of
learned in early adulthood are remembered best’, Memory and childhood and adolescence’, Journal of Personality, vol.63,
Cognition, vol.26, pp.3–19. no.2, pp.138–63.
Rubin, D.C., Wetzler, S.E., and Nebes, R.D. (1986) Tulving, E. (1972) ‘Episodic and semantic memory’, in
‘Autobiographical memory across the adult lifespan’, in Rubin, Tulving, E. and Donaldson, W. (eds.) Organization of Memory,
D.C. (ed.) Autobiographical Memory, New York, Cambridge New York, Academic Press.
University Press. Tulving, E. (1983) Elements of Episodic Memory, Oxford,
Ryan, L., Nadel, L., Keil, K., Putnam, K., Schnyer, D., Clarendon Press.
Trouard, T., and Moscovitch, M. (2001) ‘Hippocampal com- Tulving, E. (2002) ‘Episodic memory: from mind to brain’,
plex and retrieval of recent and very remote autobiographical Annual Review of Psychology, vol.53, pp.1–25.
memories: evidence from functional magnetic resonance Tulving, E. and Thompson, D.M. (1973) ‘Encoding speci-
imaging in neurologically intact people’, Hippocampus, vol.11, ficity and retrieval process in episodic memory’, Psychological
no.6, pp.707–14. Review, vol.80, pp.352–73.
576 PART 6 CHALLENGES, THEMES, AND ISSUES
van der Kolk, B.A., van der Hart, O., and Marmar, C.S. cognitive processes in everyday life’, Journal of Personality and
(1996) ‘Dissociation and information processing in posttrau- Social Psychology, vol.68, no.6, pp.1081–91.
matic stress disorder’, in van der Kolk, B.A., McFarlane, A.C., Woike, B., Gershkovich, I., Piorkowski, R., and Polo, M.
and Weisaeth, L. (eds.) Traumatic Stress, New York, Guilford (1999) ‘The role of motives in the content and structure of
Press. autobiographical memory’, Journal of Personality and Social
Woike, B. (1995) ‘Most-memorable experiences: evidence Psychology, vol.76, no.4, pp.600–12.
for a link between implicit and explicit motives and social
1 INTRODUCTION
Consciousness is probably the most fascinating and explain consciousness or even how to define the prob-
challenging subject of psychological research. lem, yet are already generating many exciting results.
Although we know that much of human cognition This chapter aims to explain briefly the historical
occurs at a subconscious level, most of us feel that it is and philosophical roots of consciousness research,
our conscious thoughts that form our personalities and and then to discuss the place of consciousness as a
inspire our actions. Over centuries, philosophers have concept in contemporary cognitive psychology. It
provided frameworks for investigating consciousness, then considers empirical studies of aspects of con-
possible solutions to some of the problems of con- sciousness and cognitive accounts of consciousness.
sciousness, and vocabularies for discussing the human It is difficult to give a coherent account of this topic
mind. Only more recently have psychologists begun to because, although many areas of cognitive psychology
research consciousness in its own right. Much of this inform our understanding of consciousness, these
recent research concerns the biological aspects of con- areas are not well integrated and few researchers are
sciousness. It uses neuroscience techniques, such as trying to pull together the different findings to create a
recording the electrical activity of individual neurons, grand theory of consciousness. Much recent cognitive
to discover how brain activity differs when we are con- psychology research in the field of consciousness
scious, or conscious of something, from when we are studies has focused on unconscious cognition (the
unconscious, or unconscious of something. However, terms unconscious, non-conscious, and implicit cog-
progress is also being made with cognitive approaches nition are used interchangeably in much of the litera-
to consciousness. Cognitive psychology has helped ture). Baars (1988) recommends contrasting conscious
define the functions of consciousness, telling us how and unconscious cognition and using the differences
conscious processes differ from unconscious processes between them to infer the functions of consciousness.
and suggesting possible evolutionary functions of con- He calls this procedure ‘contrastive analysis’. Many
sciousness. These different approaches mean that con- studies do not do this, however, but instead just focus
sciousness research is still a frontier area of psychology, on demonstrating truly unconscious learning or
in which explorers still lack agreement about how to memory. We will look at some of these studies to see
578 PART 6 CHALLENGES, THEMES, AND ISSUES
whether there is convincing evidence that we can the functions of consciousness. We will look briefly at
remember or learn without being aware of doing so. how studies of altered states of consciousness can
Many cognitive psychologists research high level complement more conventional studies of cognition
processes that are apparently dependent on conscious- in suggesting hypotheses about the functions of con-
ness, for example visual attention, working memory, sciousness. I will argue that although consciousness
and mental imagery. As an example of this research, appears to be associated with particular cognitive pro-
we will look at a relatively old study by Schneider and cesses, for example selective attention, all we really
Shiffrin (1977) that helps show the conditions under know is that these processes are correlated with con-
which automatic and controlled processes operate. scious awareness of stimuli in the environment or in
Automatic processes are relatively unconscious, in the memory. They are the cognitive correlates of con-
sense that we have little awareness of their operation, sciousness. Discovering these correlates of conscious-
whereas controlled processes are associated with con- ness does not explain conscious experience – why it
scious awareness of what is being processed. The con- feels the way it does to see blue or remember a face or
cept of controlled processing appears in working imagine a voice – but it does help us to understand the
memory (see Chapter 9), where the central executive possible role of consciousness in cognition. This role
controls the operation of the phonological loop and seems to include integrating selected information
visuo-spatial sketchpad, and in models of action selec- from different processing modules and making that
tion, where controlled processing enables us to behave information available across the cognitive system so
in novel ways rather than acting through habit. We that it can guide our behaviour.
shall discuss working memory and a model of action The term ‘consciousness’ means different things to
selection at the end of this chapter when we consider different people, so we begin by trying to define what
different ways of explaining consciousness. it is we want to study.
Dissociations between conscious and unconscious
processes might lead to suggestions that we have a
specific module, or modules, for consciousness. We 1.1 Defining consciousness
will consider how cognitive neuropsychology, the
study of the effects of brain injury, can shed light on Before reading on, try Activity 18.1.
the issue of where if anywhere consciousness occurs. What was on your list of features of consciousness?
The main thrust of the chapter, though, is exploring For many people, one of the most salient aspects of
ACTIVIT Y 18.1
Before reading further, spend five minutes thinking sensations or mental events. Thus while reading this
about what it means to be conscious. Make a list of sentence you may be conscious of someone entering
the special features of consciousness. the room or of a craving for coffee, but unconscious
of the hardness of your chair or the hum of distant
COM M ENT
traffic. This sense of consciousness has been termed
Consciousness can be thought of in different ways.
‘access consciousness’. ‘Phenomenal consciousness’
There is the state of consciousness, in the sense of
refers to the particular qualities of our conscious
being awake and aware of ourselves in our environ-
experiences; what it feels like to taste beer or hear a
ment, rather than being asleep and more or less
flute, for example. Finally there is self-consciousness,
oblivious to what is happening around us. Also under
our awareness and monitoring of what we are doing,
this heading come altered states of consciousness
feeling, thinking, and so on.
brought about by drugs or hypnosis. Then there is
consciousness in the sense of awareness of particular
CHAPTER 18 CONSCIOUSNESS 579
being conscious is that we have a feeling of control mental events; that is, awareness of particular sights,
over our behaviour and even over our thoughts. We sounds, memories, ideas, mental images, and so on.
feel that we act in a particular way because we decided Even if we limit our discussion to consciousness of
to act that way, that we have free will. Although it may things, there are still two aspects of this type of con-
be difficult to stick to our new year’s resolutions, we sciousness to consider. There is the consciousness
can modify our behaviour in less ambitious ways. If itself, being aware rather than unaware of something,
you get a headache while reading this, you may decide and there is the experience that this consciousness
to stop reading – and behave accordingly. Alternatively, engenders, what it feels like to taste chocolate or per-
you may choose to ignore your headache and attend to ceive green, for instance. Block (1995) argues that we
the chapter because you wish to finish reading it should treat these two aspects of consciousness as
before going out. Resolving, deciding, choosing, separate problems. He uses the term phenomenal con-
ignoring, feeling pain, attending, and wishing are all sciousness for the experiential aspects of the problem
aspects of our conscious mental life. and access consciousness for the problem of how, when
Our conscious experience seems fairly continuous. we are conscious of something, we are able to name it,
William James (1890) described it as a ‘stream of con- remember it, decide whether to pick it up, etc. The
sciousness’. We have a coherent and persistent aware- term ‘access consciousness’ captures the idea that the
ness of ourselves and of our environment, and are contents of consciousness are accessible to other cog-
unaware of brief or inconsequential changes in our nitive processes; thus we can talk about our memories
sensory input. For example, you were probably una- or remember things we said. Access consciousness
ware of this page disappearing from view last time you describes this cross-talk between different cognitive
blinked. modules (a module is a set of mental processes acting
Consciousness is not only about our ability to con- together and separately from other sets of processes).
trol our behaviour or to know what is going on around Block argues that cognitive psychology only addresses
us. It is also about feelings and experiences, for exam- the problem of access consciousness, despite some-
ple the smell of spices as you walk past a restaurant, times claiming to solve the problem of phenomenal
the taste of chocolate, the sensation of jumping into a consciousness as well.
cold swimming pool or relaxing in a hot bath, the par- Chalmers (1996) makes a similar distinction. He
ticular feel of looking at something red (rather than refers to the problem of how information is shared
something green). Philosophers use the term ‘qualia’ between modular neural and cognitive systems as the
to describe these qualitative, subjective, experiential ‘easy problem’ of consciousness. Empirical research
aspects of consciousness. into vision, memory, attention, decision making, and
Consciousness has so many different features that, so on addresses the easy problem. The ‘hard problem’
before studying it, we need to know whether it is actu- of consciousness, according to Chalmers, is to explain
ally a single thing or several quite different things how and why the neural or cognitive processes of
inappropriately called by the same name. Could a vision, memory, etc. give us the phenomenal con-
theory of consciousness in principle explain all the scious experiences of seeing colours or enjoying happy
different aspects of consciousness that we have dis- recollections. In a similar vein, Levine (1983) argued
cussed so far, or will we need different solutions to dif- that there is an ‘explanatory gap’ between understand-
ferent problems of consciousness? This chapter will ing the neural or cognitive basis of consciousness and
say little about states of consciousness, being awake explaining the phenomenology. There seems to be
rather than asleep for example, although it briefly dis- nothing about neural or cognitive processes that
cusses what altered states of consciousness could necessitates their being accompanied by particular
reveal about the cognitive correlates of consciousness. experiences. Even if we knew everything about the
It also says nothing about self-consciousness. Rather, structure and function of the visual system, could that
it focuses on consciousness of particular stimuli or ever be sufficient to explain why it feels the way it does
580 PART 6 CHALLENGES, THEMES, AND ISSUES
to see red? This chapter discusses the extent to which talk about mental entities such as images or beliefs
cognitive psychology has helped advance our under- having spatial positions.
standing of access consciousness, but while you are
reading it, keep asking yourself whether a full under- 1.2.1 Mind–body dualism
standing of access consciousness would be sufficient
to explain phenomenal consciousness. Dualists such as Descartes solve this mind–body prob-
lem by arguing that the mind and the brain are entirely
different things. The mind consists of an immaterial
‘mindstuff ’ whereas the brain, like the rest of the body,
Philosophical approaches
1.2
is made of matter – water, protein, lipids, etc. For con-
to consciousness sciousness researchers, this is a defeatist stance
because it means that the mind does not obey natural
This section gives a very brief introduction to philoso- scientific laws and is not amenable to scientific inves-
phy of mind, so called because many of the issues per- tigation. There are other strong objections to dualism.
tain to mental processes and states in general, and not Perhaps the most important is that it does not explain
merely to conscious processes and states. This section how the mind interacts with the brain or body. How
is not intended to be a tutorial on philosophy of mind, can a thought about drinking water make our physical
just an overview of some of the philosophical issues hand move to pick up a glass and take a sip unless the
facing researchers wanting to explain consciousness thought is also somehow physical?
(in both the access consciousness and phenomenal
consciousness senses). 1.2.2 Monism
Let’s look at the problem of the explanatory gap The converse of dualism is monism, the idea that
more closely. Perhaps the reason it is so difficult to mind and body are essentially the same thing.
relate cognitive and neural brain processes to con- Philosophers and scientists who assume that con-
scious experience is that they are two entirely different sciousness is a property of the physical brain are
things. Here are three examples of the ways in which called materialists. How do materialists deal with the
they appear to differ: explanatory gap? One way is to take an extreme view
known as eliminative materialism. Proponents of this
1. Phenomenal quality. Imagine looking at a
view, such as Patricia and Paul Churchland, argue
particularly bright, warm shade of red. How can
that the apparent explanatory gap arises because we
interactions between neurons or modules in your
use mentalistic terms such as ‘desire’ and ‘belief ’ that
brain be ‘bright’ or ‘warm’ in the way your
have no scientific basis. We should eliminate these
experience is? If you imagine a hot cup of black
terms from our scientific vocabulary and concentrate
coffee, presumably nothing in your brain turns hot
on investigating the underlying neuroscience of con-
or black.
sciousness. They compare our current use of mental-
2. Intentionality. Philosophers describe conscious istic terms with the use of the term ‘phlogiston’ (once
states such as desiring, believing, and perceiving thought to be a substance that escapes when matter
as ‘intentional’, meaning they are about things. burns), which was abandoned when new theories of
You can’t just desire, you have to desire something. natural science explained the role of oxygen in com-
It is hard to see how brain states can be about bustion. Most materialists do use mentalistic terms
things in the way that mental states are. but argue that conscious states are brain states and
3. Spatial position. Neurons are physical entities so concentrate on investigating their material basis – the
they take up space. One neuron can be to the left chemical and neuronal interactions that underpin
or right of another, but it does not make sense to consciousness.
CHAPTER 18 CONSCIOUSNESS 581
Functionalists, the vast majority of whom are also long-term potentiation, so might consciousness best
materialists, take a different approach to researching be explained in terms of cognitive processes.
consciousness. Functionalism views mental states as
functional or causal states, defined by the ways in
which they transform some input (an external stimu-
lus or the product of an earlier cognitive process) into
The place of
1.3
output (information passed to another cognitive consciousness within
module or an overt behaviour). Conscious states are
not just epiphenomena – by-products of brain pro-
cognitive psychology
cesses that have no effect in themselves. Rather, they
are the direct causes of our behaviour. Functionalists This section provides a brief reminder of the history of
use the analogy of a computer: the brain is analogous cognitive psychology, to help explain why cognitive
to the hardware of the computer (the silicon chips, psychologists are sometimes ambivalent towards the
wires etc.) and the mind is analogous to the comput- topic of consciousness, with some using it as a variable
er’s software. The mind is implemented in (‘running in their research but few studying it directly. Early in
in’, to use computer jargon) the physical brain, in the the history of experimental psychology, Wundt
way that word-processing software might be imple- trained ‘observers’ to use introspection (to ‘look into’
mented in a personal computer. The mind could also their minds) to give detailed reports on their mental
be implemented in some other physical system, such and emotional responses to stimuli. Introspectionism
as a computer, just as a particular software package foundered partly because of the subjective nature of
could run on different sorts of computers. A logical the data it produced. When two observers disagreed,
extension of this position leads us to ‘strong artificial it was not possible for an objective third person to
intelligence’ (strong AI), the argument that, if we resolve their disagreement by looking into their minds
could program a computer with the same ‘software’ as and deciding who was reporting their mental states
a human, then it would be conscious in the same way more accurately, or indeed whether their mental states
as us. A less extreme position, weak AI, assumes that were the same or different. Other problems for intro-
computers can have similar ‘mental’ properties to spectionism included research into unconscious, and
humans but that there might be something special hence unreportable, processes (e.g. Freud’s writings
about biological entities (e.g. carbon-based sensory on the contribution of unconscious urges to adult
systems) that make us conscious in the particular way behaviour and Helmholtz’s investigations of uncon-
that we are. scious processes in vision) and a new emphasis on the
Functionalism lies at the heart of cognitive psychol- functions rather than the structure of mental pro-
ogy. It means that cognitive psychologists can focus cesses. For example, James (1890) suggested that the
on investigating mental functions without much refer- function of short-term memory was to keep in con-
ence to the brain biology that underpins them. Thus sciousness events that have just passed.
cognitive approaches to consciousness focus on These changes paved the way for a radical shift in
explaining the mental processes that cause one con- the way human behaviour was studied. Behaviourists
scious state or another, rather than investigating phys- argued that psychologists should concern themselves
ical brain activity during that conscious state. It is with objective data, i.e. publicly observable behaviour,
partly a question of finding an appropriate level of rather than subjective introspections. Although some
explanation for the phenomenon. Just as your success behaviourists included mental events in their explana-
in an exam might best be explained in terms of your tions of behaviour, the emphasis was on studying the
level of attention during lectures, the amount of revi- relationships between external stimuli and overt,
sion time devoted to your notes, and so on, rather behavioural responses. Consciousness was no longer a
than in terms of biological memory processes such as respectable topic for psychological research.
582 PART 6 CHALLENGES, THEMES, AND ISSUES
ACTIVIT Y 18.2
Think of cognitive theories from other chapters. conscious of some stimuli or cognitive products. For
What role does consciousness play in these theo- example, are we conscious of information by dint of it
ries? Do any of the theories help to explain con- being in short-term memory, as James suggested?
sciousness? More recent researchers have argued that we are
only fully aware of a subset of representations in
COM M ENT
working memory (e.g. McElree, 2001). The relation-
Although many cognitive theories include concepts
ship between consciousness and working memory is
like attention or working memory, they generally
discussed in Section 4 of this chapter.
do not specify what processes or qualities make us
SUMMARY OF SECTION 1
• The term consciousness encompasses the state of being awake, our ability to control our behaviour
and be aware of our surroundings, and our mental experiences or ‘qualia’.
• There is an explanatory gap between understanding the neural and cognitive functions of the brain
and explaining conscious experience.
• Cognitive psychologists view mental states as causal states that affect our behaviour.
2EMPIRICAL RESEARCH:
COGNITIVE STUDIES OF
CONSCIOUSNESS
This section focuses on three areas of cognitive psy- consciousness. The areas it does cover are those in
chology. Each area tackles the problem of conscious- which researchers have particularly used their find-
ness in part by investigating unconscious processes. ings to frame questions about consciousness, although
Although this may seem perverse, it helps us work out even in these areas much research is reported with
what processes are associated only with consciousness scant if any mention of what it tells us about
and not with unconscious processing. The first part consciousness.
covers implicit cognition (specifically, implicit mem-
ory and learning, where there is no awareness of what
is remembered or learned). Implicit cognition research
is important because it can help us to define con-
2.1 Implicit cognition
sciousness better by contrasting it with unconscious
2.1.1 Implicit memory
processes. It raises the question of what, given the
extent of unconscious processing, might be the func- Implicit memory is memory without any accompany-
tion of consciousness. The second part revisits earlier ing sensation of remembering. It is revealed by
research into automatic and controlled processing. changes in performance on specially designed mem-
Although not phrased in terms of unconscious and ory tests. For example, if I show you the word ‘witness’
conscious cognition, these studies show us the essen- in the context of an apparently unrelated, non-
tial characteristics of conscious processes. They are memory task and then give you a surprise memory
slow but flexible whereas automatic or unconscious test, you may not recall seeing ‘witness’ or recognize it
processes are fast and efficient but inflexible. The third as a word from the earlier task. However, if I ask you
part considers the condition known as blindsight. to say the first word that comes to mind starting
Neuropsychological studies help elucidate the func- ‘wit—’, your implicit memory for the word will make
tion of ‘normal’ consciousness and raise questions you more likely to say ‘witness’ than if you had not just
about the functional and physical structure of con- seen that word.
sciousness. This account necessarily misses much of Tests such as this word stem completion task are
the research in cognitive psychology that relates to often referred to as indirect memory tests because
584 PART 6 CHALLENGES, THEMES, AND ISSUES
they measure memory without directly asking people assumed to measure mainly conscious or explicit
to decide if they remember the stimuli. Indirect tests memory. Participants were unable to recognize the
are assumed to measure predominantly implicit mem- unattended words. For the second memory test, the
ory, whereas direct tests measure explicit memory. experimenter read out a list of words and participants
Note, though, that no memory test is ‘process pure’; were asked to spell them. Their spelling was biased by
performance on almost any memory test can be influ- the previous presentation of the homophones (e.g.
enced by both implicit and explicit memory. For they were biased towards spelling P-A-N-E rather
example, if you are asked to think of the first word that than the more common P-A-I-N). This spelling test is
comes to mind beginning with ‘wit–’ and nothing an indirect test of memory because it does not require
comes to mind, you may try to think back to the ear- deliberate recollection. These findings therefore sug-
lier task to search for clues, for words that might fit the gest that participants had implicit memory for the
stem. If you remember that ‘witness’ was one of the homophones, but not explicit memory.
words on the first task, and use that as your response, Another example of implicit memory in the absence
then you are using your explicit memory and the task of explicit recollection is the false fame effect. Jacoby
is not giving a pure measure of your implicit memory. et al. (1989) used a task on which participants had to
Two studies of implicit memory are described say whether names belonged to famous people. In the
below. Further examples are given in Chapter 8, but study phase of Experiment 2 of their investigation, par-
these two are chosen because they appear to show ticipants read aloud a list of 40 non-famous names.
implicit memory in the absence of explicit memory In the test phase, 10 of these names were mixed with
(with the caveat about the process-impurity of mem- 10 new non-famous names for a recognition memory
ory tests). test. The remaining 30 names were mixed with 30 new
In an early study of implicit memory, Eich (1984) non-famous names and 60 famous names for the fame
showed that prior presentation of a word in a particu- judgement task. Before the fame judgement task, par-
lar context could bias its subsequent interpretation. ticipants were told that the names they had just read
Participants in Eich’s experiment heard a list of word were the names of non-famous people, hence if they
pairs. One word in each pair was a homophone, that recognized any name from the first phase of the exper-
is, it sounded like another word with a different mean- iment they should respond ‘non-famous’. The experi-
ing and spelling, for example PANE (as in ‘pane of menters manipulated the degree of attention paid to
glass’) is a homophone of PAIN (as in ‘stomach pain’). the names in the study phase. In the full attention con-
The other word in each pair made clear the intended dition, participants were told that the experimenters
interpretation of the homophone. ‘Window-PANE’ were interested in their ability to pronounce the names
and ‘taxi-FARE’ are examples of the word pairs used quickly and accurately. In the divided attention condi-
by Eich. Note that the homophones he used were the tion, they were told to pay as little attention as possible
less common interpretations, PAIN and FAIR being to the pronunciation task, concentrating instead on
the more frequently encountered spellings and mean- listening to a stream of spoken digits and spotting runs
ings. Although participants in Eich’s study could hear of three odd numbers. The fame judgement task was
the word pairs, they could not attend to them because sufficiently difficult that participants made a number
their main task was to shadow (repeat) an essay played of false positives, saying that a name was famous when
at the same time. Memory for the homophones was in fact it was not. If participants had encountered a
tested in two ways. On the recognition test, partici- non-famous name earlier in the experiment, they were
pants listened to a list of words and were asked to say more likely to judge incorrectly that it was famous if
whether each word was old (i.e. present in the unat- the study phase took place under conditions of divided
tended list of word pairs) or new. This is a direct test attention. Divided attention impaired explicit recog-
of memory because it requires participants to make nition of the names and thus reduced participants’
a judgement about their memory; it is therefore ability to use explicit memory to interpret feelings of
CHAPTER 18 CONSCIOUSNESS 585
familiarity. In the absence of conscious recognition, mance caused by previous exposure to the target stim-
familiar names were assumed to be famous. ulus or by previous or concurrent exposure to a closely
One of the most exciting things about this field of related stimulus. For example, Meyer and Schvaneveldt
research was the discovery that people with amnesia (1971) showed that participants decided more quickly
often performed as well as people with normal mem- that pairs of letter strings were two real words when
ory on the indirect tests of memory. In other words, they were related words (e.g. doctor and nurse) than
despite their severely impaired explicit memory, amne- when they were unrelated words (e.g. doctor and cab-
sics had almost normal implicit memory. For example, bage). Building on this study, Marcel (1983) showed
Squire and McKee (1992) replicated the false fame that participants identified ‘doctor’ as a real word
effect in amnesic participants. Amnesics were signifi- faster when it was preceded by a very brief presenta-
cantly impaired at recognizing the previously pre- tion of the word ‘nurse’ than when it was preceded by
sented names compared with the control subjects, but an unrelated word. The word ‘nurse’ in this example is
they were just as biased towards judging presented called the prime. Marcel’s study is mentioned again
non-famous names as famous. Such findings led to below, and is also discussed in Chapter 2. The idea
new rehabilitation strategies because they showed that behind priming is that: a) activation of an item’s repre-
amnesics had the potential to learn new information sentation in memory lingers, so that the representa-
even though they appeared to have no memory. We’ll tion is still slightly activated next time the item is
see an example of a new learning strategy that has been encountered, making it easier to reactivate even if only
used in rehabilitation later in this chapter (in Box 18.3 a partial cue is presented, such as a word-stem; b) acti-
on errorless learning). The dissociation between the vation spreads to related representations, making
effects of brain injury on implicit and explicit memory related representations easier to activate than unre-
raises questions about the structure of consciousness. lated, unprimed representations. Priming is also used
We will return to these questions in Section 2.3. in a more general sense, to refer to the activation of
Implicit memory phenomena are often referred to moods or stereotypes (see Box 18.1 on unconscious
as priming. Priming is the improvement in perfor- influences on behaviour). Demonstrations of priming
Research in the field of social cognition suggests that accordance with that stereotype even though they
priming may considerably influence our behaviour had not noticed the primes. Neumann and Strack
outside the laboratory. Primes may influence our (2000) showed that people’s mood can be affected
mood and behaviour without us being aware of by the mood of others around them, even when
them. For example, Bargh et al. (1996) asked partici- they are unaware of the cause of their mood change.
pants to arrange lists of words to form meaningful When participants listened to text read in a sad
sentences. In the experimental group, each word list voice, they were more likely to rate their own mood
contained a word related to the concept of old age, as sad but were unaware that their mood had
for example ‘wrinkled’ or ‘ancient’. Participants were changed as a result of listening to the sad voice.
surreptitiously timed as they left the laboratory after Lieberman (2000) argues that implicit cognitive
completing this task. Those in the experimental processes, such as priming of stereotypes and
group, who had been exposed to the elderly primes, mood states, underlie the phenomenon commonly
left the laboratory more slowly than those in the con- known as ‘intuition’, that is, our ability to judge
trol group, who were not exposed to those primes. social situations and respond appropriately without
Bargh et al. argued that the primes activated a being aware of the information (other people’s
stereotype of old age and participants behaved in moods, etc.) on which we base our judgements.
586 PART 6 CHALLENGES, THEMES, AND ISSUES
show that we are not aware of all our knowledge, or of presentation of the primes was apparently subliminal,
the basis of our behaviour. Priming is often preserved and controversial because of claims that the findings
even when brain injury causes impairments to explicit could not be replicated when stricter definitions of
cognition; thus people with amnesia typically have ‘subliminal’ were used. However, subsequent research-
preserved implicit memory despite their impaired ers have used subliminal presentation with other test
explicit memory. Box 18.3 on errorless learning in procedures to provide further evidence for implicit
Section 3 mentions a way of using this preserved learning.
priming in rehabilitation. Despite preserved implicit Some of this evidence comes from demonstrations
memory, lack of explicit memory has an impact on the of the mere exposure effect, the tendency for people to
more general aspect of consciousness that James prefer stimuli they have encountered before even if
(1890) termed our ‘stream of consciousness’. Baddeley they were unaware of them during the previous
(1990) cites the example of Clive Wearing, whose encounter. For example, Kunst-Wilson and Zajonc
amnesia was so severe that he repeatedly noted in his (1980) presented novel black and white patterns sub-
diary that he had just regained consciousness. Memory liminally. Even though participants said they could
and consciousness thus appear to be correlated, but not see the patterns because they were presented so
the direction of causation is unclear: does normal briefly, they later tended to select those patterns when
consciousness require intact memory function or presented with pairs of patterns (one presented earlier
does normal memory function require conscious- and one new) and asked to choose the one they pre-
ness? We will return to this problem of correlational ferred. On a recognition test in which participants
evidence at the end of the chapter. chose the pattern they remembered seeing earlier
from each pair, participants performed at chance, ie.
2.1.2 Implicit learning they were just guessing. So their first, unconscious,
Studies of implicit memory show that we can ‘remem- encounter with the patterns apparently changed their
ber’ things without having any conscious experience emotional response to them even though they had no
of remembering them. A more profound claim has conscious or explicit memory of seeing the patterns
been made by researchers in the field of implicit learn- before (see also Chapter 16).
ing, namely that we can learn things without ever As suggested by the controversy over Marcel’s
being aware of them. If this claim is true, it helps (1983) study, there are problems with using sublimi-
establish some ground rules for our study of con- nal presentation to demonstrate unconscious learn-
sciousness by telling us what is possible without con- ing. One problem is ensuring that all stimuli are
sciousness. Evidence that a lot of learning is possible subliminal for all participants. This is tricky because
without consciousness might suggest that conscious- some stimuli are easier to perceive than others. For
ness is just an epiphenomenon that plays no causal example, you can sometimes hear someone say your
role in our cognition. We will therefore look closely at name even if you don’t hear anything else they say
some of the evidence for implicit learning and at some because you are attending to another conversation
of the methodological problems that face researchers (Moray, 1959). Another limitation is the equipment
trying to show that participants had no awareness of used to present the stimuli. Early studies used tachis-
the material they learned. toscopes, boxes that were specially designed to show
One way of demonstrating this unconscious or stimuli for very brief and accurately timed periods.
implicit learning is to present the stimuli to be learned Many researchers now use computers for running
very quickly, too quickly for participants to notice their experiments, but computerized presentation
more than just a flash on the screen. This is called sub- times are limited by factors like the screen refresh
liminal presentation. The study by Marcel, mentioned rate – how quickly the computer redraws the display.
above, has become a controversial classic: a classic A refresh rate of 17 msec means that stimuli can only
because it demonstrated priming even though the be presented for multiples of 17 msec. This limitation
CHAPTER 18 CONSCIOUSNESS 587
ACTIVIT Y 18. 3
First, trace through the network shown in Figure were aware of the information they learned. The
18.1 to convince yourself that TPPPTS and VXVPS stimuli used in these experiments are typically com-
are grammatical strings whereas VTPS and TPTTTS plex and novel and therefore difficult to describe. You
are ungrammatical. Now try writing down or may have struggled to report the rules of Reber’s
explaining to a friend the rules of this grammar. grammar even though you were looking at Figure 18.1
while doing so. The problem of eliciting participants’
COM M ENT
explicit knowledge through verbal report is addressed
Verbal report is often used as a way of finding out
later in this section.
whether participants in implicit learning experiments
588 PART 6 CHALLENGES, THEMES, AND ISSUES
asked to use their knowledge of those sentences to learning without awareness. So researchers have to ask
decide if each test sentence was grammatical or participants afterwards what they were aware of during
ungrammatical. Their decisions were correct on a the task. This is unsatisfactory, because it relies on
mean of 79 per cent of trials, well above the mean of people’s memory of what they were aware of rather
50 per cent expected from chance. than measuring awareness on-line. Another problem is
Subsequent studies of artificial grammar learning that quite a small amount of knowledge may be enough
have used procedures similar to that of this second to boost people’s performance above the chance level.
experiment. Participants learn a set of grammatical For instance, they may not know the whole grammar,
strings to a predetermined criterion, and then attempt just that a certain letter can be repeated or come at the
to distinguish novel grammatical strings from start of a letter string. Knowing possible starts for
ungrammatical strings. Performance is typically above grammatical strings may be sufficient to distinguish a
chance, though not as impressive as in Reber’s study, few of the grammatical strings from the ungrammati-
even though participants cannot state the rules they cal strings, resulting in performance that is slightly
used to decide which were the grammatical items. above baseline. If a test of awareness simply asks ‘Were
This apparently implicit learning of the grammar is you aware of the grammar?’ or ‘What was the gram-
dissociable from explicit recall of the grammatical mar?’ then it will miss the knowledge that actually
strings presented in the learning phase. For example, boosted performance on the grammar test, and that
Knowlton et al. (1992) found that amnesic patients knowledge may well be explicit. Participants may
were as good as controls at classifying novel strings as interpret the question as asking for a complete report
grammatical or ungrammatical, but were poorer at of the grammar, which they cannot give, and so do not
recognizing exemplars that had been encountered in volunteer their knowledge of fragments of the gram-
the learning phase. mar. These problems are discussed by Shanks and
Nissen and Bullemer (1987) used an alternative St John (1994). They argue that experimenters must
procedure for testing implicit learning of hidden regu- use tests of explicit knowledge, or awareness, that meet
larities between visible stimuli. They gave control and two criteria before they can claim that learning resulted
amnesic participants a choice reaction time task in in truly implicit knowledge. The information criterion
which they had to watch a panel of four lights (ABCD) states that the test of awareness must probe for the sort
and, whenever a light came on, to press the key under of information that could support performance on the
that light as quickly as possible. Participants were not test of learning (for example, knowledge that a particu-
told that the lights came on in a fixed order (the lar letter often comes at the start of a grammatical letter
10-item sequence DBCACBDCBA was presented string). The sensitivity criterion states that the test of
repeatedly). Controls and amnesics got faster at this awareness must be sensitive to all the relevant explicit
task until the sequence was switched to a random knowledge; it must be just as sensitive as the test of
order; at this point, their reaction times increased. The implicit knowledge. Simply asking participants to state
amnesic participants showed no awareness that the the rules of the artificial grammar fails on both counts.
lights had come on in a regular sequence. Control par- It does not prompt them to report fragments of the
ticipants were also often unaware of the sequence, grammar and it does not give them any recall cues,
particularly if they performed the key pressing task whereas the grammar judgement test presents the
under conditions of divided attention. actual grammatical stimuli and these may serve as cues
A problem with these demonstrations of implicit to memory.
learning is that we have no way of determining partici- Given the difficulty of ensuring lack of awareness of
pants’ awareness of the key stimuli or relationships while critical stimuli in awake participants, perhaps a better
they are doing the task. If we ask them if they are aware strategy would be to study learning in people who are
of the grammar, for example, then we draw their atten- unconscious. Testing patients receiving anaesthetics
tion to it and lose the opportunity for demonstrating offers a way of tackling this issue, though one that
CHAPTER 18 CONSCIOUSNESS 589
presents more difficulties than might at first be imag- memories can be primed in someone who is uncon-
ined. One difficulty is that depth of anaesthesia, or scious. The next step is to show that new information
‘degree of unconsciousness’, fluctuates during an oper- can be learned during anaesthesia.
ation and there is not yet a universally agreed way of To summarize, there is some evidence for learning
measuring this fluctuation or of establishing exactly without consciousness of what is learned. However,
the depth of anaesthesia at which a person loses con- this implicit learning is rather difficult to demonstrate
sciousness, in the sense of losing all awareness of convincingly and is also not very useful, in the sense
themselves and their surroundings. Thus a finding that we cannot revise, contemplate, or tell people
that patients can learn information presented during about what we have learned implicitly. We cannot
anaesthesia may reflect explicit learning during unde- select what we learn when learning implicitly, and we
tected moments of consciousness, rather than truly cannot retrieve the learned material voluntarily. It
unconscious learning. Another difficulty is that the would appear that conscious processes (e.g. the active
sensitivity of the memory tests has not been estab- selection, rehearsal, and elaboration of information)
lished so, if a study shows no evidence for learning contribute to much of our everyday learning. Even so,
during anaesthesia, this may be due to use of a test that implicit learning may help us to pick up repeated pat-
is too insensitive to detect small amounts of preserved terns or relationships among stimuli or events, and by
learning. Not surprisingly, although many studies doing so help us direct our conscious learning pro-
have investigated learning during anaesthesia, their cesses towards interesting features of our environ-
findings have been mixed (Andrade, 1995). ment. Implicit memory is easier to demonstrate.
Catherine Deeprose and I obtained evidence for When only a small amount of learning has occurred,
priming during anaesthesia in a study that overcame because of inattention or brain damage for example,
some of the problems discussed above (Deeprose the resulting memory may be implicit. We may be
et al., 2004, 2005). We played words (e.g. tractor) to unaware of what we have learned because the encoded
patients during surgery. When the patients came material does not reach some threshold for conscious-
round from the anaesthetic, we asked them to respond ness or because it has not been processed by a ‘con-
to word stems (e.g. tra–) with the first word that came scious memory module’. This issue of the structure of
to mind. Playing a word during surgery increased the consciousness is discussed briefly in Section 2.3 on the
likelihood of patients using that word to complete a neuropsychology of consciousness.
word stem on recovery. In other words, they showed
some implicit memory for the words even though
they were anaesthetized while receiving them. We had
pilot tested our word stem completion test to ensure
Controlled versus
2.2
that it was reasonably sensitive and also reasonably automatic processing
uncontaminated by explicit memory (it was relatively
unaffected by a manipulation of attention known to The concept of controlled processing is closely allied to
affect explicit memory). Thus we gave ourselves a good that of conscious processing. As you have seen in the
chance of demonstrating implicit memory for words previous section, if we want to demonstrate implicit
played during surgery. We minimized the chance of learning or memory, we have to make it very difficult
priming occurring during moments of awareness by for participants to process the target material in an
using an EEG measure of depth of anaesthesia through- active way, for example by distracting their attention
out word presentation and testing patients who were from it. This sort of active processing is often known as
unparalysed, because the drugs that are often used to controlled processing (as opposed to automatic pro-
paralyse patients during surgery make it even harder cessing). The idea of controlled processing is central
to detect moments of consciousness. We are therefore to concepts such as working memory, discussed in
reasonably confident that we have demonstrated that Section 4 as a potential model of consciousness.
590 PART 6 CHALLENGES, THEMES, AND ISSUES
Controlled cognitive processes typically accompany Schneider and Shiffrin demonstrated the difference
consciousness, that is, they are cognitive correlates of between these two processing modes using ‘target
consciousness. This section therefore describes a clas- search tasks’ that required participants to detect targets
sic study by Schneider and Shiffrin (1977) that defined among arrays of distractors as quickly and accurately
and demonstrated controlled and automatic processes as possible. They manipulated: a) the number of targets
in visual attention. participants had to search for; b) the number of items
Schneider and Shiffrin (1977) based their theoriz- (targets and distractors combined) on each slide or
ing on Atkinson and Shiffrin’s (1968) model of mem- ‘frame’; and c) the mapping between the set of targets
ory (see Chapters 8 and 9), arguing that automatic for any series of trials (the ‘memory set’) and the dis-
processes operate on the long-term memory store (an tractor set. This mapping manipulation was the key to
interconnected array of nodes) whereas controlled demonstrating automatic and controlled processing
processes require the limited capacity short-term modes. In the consistent mapping condition, the targets
store, essentially the currently activated nodes of the were always selected from the same set of items and the
long-term store. They defined automatic processes as distractors were always selected from a different set so,
the activation of a sequence of nodes in the long-term for example, participants might search for target digits
store via connections between those nodes that have among distractor letters. In the varied mapping condi-
become relatively permanent through repeated use. tion, the targets and distractors were drawn from the
Once triggered, automatic processes operate without same set, so participants might search for letters among
active control so it is difficult to stop them or change letters and a particular letter could be a target on one
their course. In contrast, activation of a novel sequence trial and a distractor on another. Figure 18.2 gives
of nodes requires attention, which limits our capacity examples of trials in these different conditions.
to activating just one novel sequence at a time but The consistent and varied mapping conditions pro-
gives us control over the activation. duced quite different patterns of response times. In
(a)
9 4 N P N 4
2 7 * * * *
(b)
Z K N P N K
W H W H
FIGU RE 18 . 2 Examples of stimuli from Schneider and Shiffrin’s (1977) experiments. On a given trial, participants
saw and memorized the set of targets for that trial (the ‘memory set’). They then saw a sequence of frames. Their
task was to detect whether any of the memorized targets appeared in the sequence. (a) Looking for digits among
letters: stimuli from a consistent mapping condition with a memory set size of 4 and a frame size of 2. The asterisks
represent pattern masks in the positions not occupied by targets or distractors. (b) Looking for letters among letters:
stimuli from a varied mapping condition with a memory set size of 2 and a frame size of 4.
CHAPTER 18 CONSCIOUSNESS 591
would suggest? The answer is not clear. Patients with visual stimuli. GY could detect the direction of move-
amnesia may lack consciousness of their memories ment of slow- and fast-moving stimuli, but he was
because they lack critical unconscious processes that usually only conscious of the fast stimuli. The two
feed into a unitary consciousness. Likewise neglect types of stimuli differentially triggered activity in
patients may not have suffered damage to a ‘con- motion cortex, the increase in activity being greater
sciousness of space’ module but rather have deficits with the fast-moving stimuli for which GY reported
in attentional processes that feed into a unitary some conscious experience. Thus consciousness of
consciousness. visual stimuli appears to be related to the amount
Zeki and ffytche (1998) studied a blindsight patient of activity in a localized brain area, a brain area spe-
known as GY. Blindsight is a disorder exhibited by cialized for processing that type of stimulus rather
some patients with brain damage leading to blindness than a general ‘consciousness centre’. ffytche (2000)
in part of the visual field. In blindsight, there is a suggests that the increased localized activity asso-
somewhat preserved ability to respond appropriately ciated with consciousness may reflect the activity of
to visual stimuli in the blind region of the visual field, additional populations of neurons in that brain region
despite having no sense of seeing them. GY’s blind- or it may reflect more complex processing by neurons
ness is selective, so that he reports having some sort that are also active when we are not conscious of
of conscious experience of some visual stimuli in his the stimulus to which they respond. Note, however,
blind field (e.g. fast-moving stimuli) but denies having that although Zeki and ffytche’s data support the
any experience of other stimuli (e.g. slow-moving hypothesis of a modular consciousness, our overall
stimuli). Usually, GY can identify a stimulus from a conscious experience – our individual ‘stream of
small selection of distractors only if he has some consciousness’ – may still reflect the aggregation of
conscious experience of it. Occasionally, however, he processing across many brain regions. Consciousness
can identify stimuli even without any conscious expe- for motion may be dissociable from consciousness for
rience, that is, he exhibits blindsight for these stimuli. colour, for instance, but these two consciousness
Zeki and ffytche (1998) used functional magnetic modules must somehow be bound together to pro-
resonance imaging (fMRI) to compare GY’s brain duce our normal conscious experience of a moving
activity with and without conscious perception of coloured stimulus.
SUMMARY OF SECTION 2
• Studies of priming or implicit memory show that people retain more information than they are aware
of remembering.
• Studies of learning without awareness of what is learned have been hotly debated; so-called implicit
learning might reflect failure to detect small amounts of awareness. A recent study of learning during
anaesthesia suggests that memory priming occurs even when patients are unconscious.
• Schneider and Shiffrin (1977) argued that controlled search processes operate serially and are slow,
increasingly so as task demands increase, because they depend on limited capacity short-term mem-
ory systems. Automatic search processes are fast and can operate in parallel because they operate
on well-learned pathways in long-term memory. Automatic processing typically happens without
awareness, whereas controlled processing is associated with conscious awareness of the task in hand
and explicit memory for its products.
• Neuropsychological studies can help determine the structure of consciousness. ff ytche (2000) used
a study of blindsight to argue that consciousness is a function of modular brain systems. Alternative
arguments are that is a single ‘consciousness module’ or that consciousness is a distributed function.
CHAPTER 18 CONSCIOUSNESS 593
ACTIVIT Y 18.4
Make a list of the features and functions of con- learning without awareness are of limited use in
sciousness revealed by the research discussed in the directing our behaviour. They may serve to bias our
previous section. behaviour – to give us a ‘hunch’ about the correct
answer – but they do not give us the confidence to
COM M ENT
alter our behaviour deliberately as a result of what
The studies of automatic and controlled processing
we have learned. For example, people often don’t
suggest that automated, relatively unconscious pro-
particularly enjoy doing artificial grammar learning
cessing is fast and efficient, helping us to deal with
tests, because they feel they are just guessing and do
large amounts of information. However, automatic
not have strategies for maximizing their performance
processes make little impact on memory and the
on the test.
studies of implicit cognition suggest that memory and
594 PART 6 CHALLENGES, THEMES, AND ISSUES
Zajonc (1980) hypothesized that emotional or lingering in iconic memory. Participants in the opti-
affective responses can be triggered by information mal prime condition viewed each prime slide for
that undergoes only minimal processing (see also 1 second, followed immediately by the ideograph. A
Chapter 16). Cognitive responses require more summary of these experimental trials is shown in
processing. This is known as the ‘affective primacy Figure 18.3.
hypothesis’. Murphy and Zajonc (1993) tested this The results are shown in Table 18.1. The ideo-
hypothesis in a series of experiments that compared graphs were rated as more pleasant when preceded
the influence of subliminal and ‘optimal’ (i.e. con- by a subliminal positive prime, compared with the
sciously visible) primes on responses to subsequent no prime and irrelevant prime control conditions,
stimuli. and more unpleasant when preceded by a sublimi-
In the first experiment in their study, Murphy and nal negative prime. In contrast, the visible or ‘opti-
Zajonc asked 32 participants to rate their liking of mal’ primes had no effect on ratings of the
Chinese ideographs, on a scale of 1 = did not like ideographs.
the ideograph at all, to 5 = liked the ideograph In a follow-up experiment, Murphy and Zajonc
quite a bit. Each ideograph was shown for 2 sec- tested the effects of subliminal and optimal primes
onds. There were four types of trial: on ratings of the size of object represented by each
ideograph. This time the relevant primes were small
• No prime controls, where the ideographs were
or large shapes and the irrelevant primes were faces
shown alone.
with neutral expressions. The results contrasted
• Irrelevant prime controls, where a geometric shape with those of the experiment described above: the
preceded each ideograph. subliminal primes had no effect on ratings of size
• Positive prime trials, where a photograph of a whereas the large optimal primes led to higher rat-
happy face preceded each ideograph. ings and the small optimal primes to lower ratings.
4 ms (subliminal prime)
1000 ms 2000 ms
1000 ms (optimal prime)
TAB LE 18 .1 Mean ratings of liking for Chinese were unaware of it, their affective response to the
ideographs in affective prime, irrelevant prime, and no primes ‘spilled over’ onto the rating task. For nega-
prime conditions tive primes, the authors referred to this effect as
‘free floating anxiety’ – that is, anxiety without
Condition Subliminal Optimal
presentation presentation awareness of what caused it or what we are anxious
(4 msec) (1000 msec) about. Consciousness of the primes allowed par-
Positive prime 3.46 3.02 ticipants to override their affective response to
Negative prime 2.70 3.28 them when judging the ideographs.
Irrelevant prime 3.06 3.15
No prime 3.06 3.11
Baddeley and Wilson (1994) argued that one of the the word was QUOTE (or a back-up word if they
main functions of explicit memory is to help us learn happened to guess the target straight away) and
from our mistakes. Without awareness of our asked to write it down. This procedure was
errors, past mistakes serve only to prime similar repeated for the other words in the list, and then
mistakes in the future. They tested their hypothesis again two more times for the entire list.
by comparing two modes of learning in 32 partici- In the errorless learning condition, participants
pants with normal memory (16 young and 16 elderly were told ‘I am thinking of a five-letter word begin-
adults) and 16 participants with amnesia who were ning with QU and that word is QUOTE; please
assumed to have normal implicit memory combined write that down’ (p.55). The list of target words was
with impaired explicit memory. Participants with presented three times, as in the errorful condition.
normal memory received one list of ten words in the These first three trials were termed the pre-
errorful learning condition and another list of ten training phase. Learning condition was only manipu-
words in the errorless learning condition. Amnesic lated during this pre-training phase. The test phase
participants received five words in each condition, to comprised nine further learning trials. On each of
avoid floor and ceiling effects. The stimulus words these trials, regardless of the initial learning condi-
were all five letters long and chosen because their tion, the experimenter provided the first two let-
two-letter stems could be completed in several ters of each word in the list and asked the participant
ways. For example, the stem QU- could be com- to write down a word starting with those letters
pleted as QUOTE (the stimulus in this case) or from the earlier list. If they could not remember a
QUIET, QUEEN, QUACK, etc. The large number of word from the previous phase, they were asked to
potential completions maximized the possibility for say any word that came to mind beginning with
making errors in the errorful learning condition. those letters. In the case of incorrect responses, the
In this errorful learning condition, participants experimenter provided the correct word. Baddeley
were told that the experimenter was thinking of a and Wilson analysed performance in the test phase
5-letter word beginning QU- and were asked to in terms of the probability of learning, that is, the
guess what the word might be. After making up to probability of an item that is not known on one trial
four incorrect guesses, the participant was told that becoming learned on the next trial. The learning
596 PART 6 CHALLENGES, THEMES, AND ISSUES
probabilities for the two learning conditions are 1.0 Errorless Errorful
illustrated in Figure 18.4, which shows that the par-
ticipants with amnesia benefited considerably more 0.8
from the errorless learning procedure than the
Probability of learning
young and elderly participants with normal mem- 0.6
ory. Without explicit memory for their errors,
amnesic participants were unable to correct their 0.4
mistakes on subsequent trials and so found the
learning task particularly difficult when they were 0.2
encouraged to make errors on the initial, pre-train-
ing trials. Errorless learning techniques have been
0
used to teach amnesics useful information such as Young Elderly Amnesics
Group
how to program a personal organizer to remind
them of appointments. FIGU RE 18 .4 Learning as a function of learning
condition. Source: Reprinted from Baddeley, A. and Wilson,
B.A. (1994) ‘When implicit learning fails: amnesia and the
problem of error elimination’, Neuropsychologia, vol.32, no.1,
pp.53–68, with permission from the publisher, Pergamon
An important feature of consciousness is that it visual percept makes it available to action and lan-
seems to break the modularity of mind. Cognitive guage modules. In blindsight, although some visual
psychologists often assume that cognitive processes information is processed and influences ‘guessing’
are modular, that is, that they operate in clusters that behaviour, that information is not sufficient to break
function independently from other clusters of pro- out of the visual perception module to form a basis for
cesses. Each cluster or ‘module’ processes a particular conscious behaviour. Likewise with implicit learning.
sort of information, so there may be one module for Although exposure to covert regularities may improve
comprehending spoken language and another module performance on an implicit learning task with similar
for recognizing faces. Consciousness involves cross- stimuli, even without awareness of what has been
talk between these otherwise independent modules. If learned, there is limited transfer of this improvement
we are conscious of something, we can talk about it, to tasks with different stimuli constructed according
decide to touch it or ignore it, imagine holding or to the same rules (e.g. Gomez, 1997). When we are
owning it, and have beliefs about it. In studies of aware of what we have learned, we are better able to
blindsight, note that patients do not tend to initiate apply that learning to novel tasks.
responses towards stimuli. Even though they can Although cognitive research has helped identify the
respond appropriately to stimuli when encouraged to functions of consciousness in controlling our behav-
guess, their residual processing of the stimuli is of lit- iour and allowing cross-talk between cognitive mod-
tle practical use to them. Without the conscious expe- ules, it does not explain why these functions are
rience of seeing, someone with this condition would associated with conscious experience. Could it be pos-
not, for example, pick up a glass of water placed in sible for a computer, say, to perform these functions
their blind field even if they were thirsty and could without consciousness? Philosophers use the term
point to its location when encouraged to do so. ‘zombie’ to refer to the idea of someone exactly like us,
Normally, seeing a glass of water means that we can with the same cognitive processes as us, the same
also drink it or talk about it – consciousness of the knowledge, memories, planning abilities, and so on,
CHAPTER 18 CONSCIOUSNESS 597
Does consciousness do anything? Think carefully The premise of the Turing test, proposed by the
before you answer this question (and look back at mathematician Alan Turing as a test of computer intel-
Activity 18.4) because the answer matters for the ligence, is that we can tell if a computer is intelligent,
real-life problem of detecting consciousness in or conscious, by comparing its responses to those of
other people, not to mention other animals, com- an intelligent and conscious human. If they are indistin-
puters, and robots. If consciousness does some- guishable, then we should conclude that the com-
thing, then we should be able to find a difference puter is conscious like the human. This test assumes
between the behaviour of organisms that have con- that consciousness makes a difference to our answers;
sciousness and those that do not. If consciousness is there could not be zombies. It also assumes that com-
an epiphenomenon, an inessential luxury of feeling puter consciousness will be like human conscious-
that accompanies our thoughts and behaviours but ness. If what it is like to be a computer is very different
does not influence them, then we can only truly from what it is like to be a human, then conscious
know about our own consciousness (see Nagel’s computers will fail the Turing test.
(1974) classic: ‘What is it like to be a bat?’). How could we detect consciousness if someone
Searle (1980) explores the problem of detecting or something is unable to communicate? This is an
consciousness with his Chinese Room thought everyday problem for anaesthetists, because the
experiment. In this thought experiment, Searle is in amount of anaesthetic needed to make someone
a room receiving questions in Chinese about a unconscious varies across individuals and opera-
Chinese story and sending out answers in Chinese. tions. It is difficult to judge accurately a patient’s
He does this by following a set of rules that tell him level of unconsciousness, or ‘depth of anaesthesia’,
how the questions map onto the story script and using physiological signs such as heart rate. This
how to translate the script into answers in Chinese. problem is being solved by new depth of anaesthe-
Searle speaks English but not Chinese. To an sia monitors that provide on-line analysis of the
observer on the outside of the Chinese Room, his brain’s electrical activity (EEG) during surgery.
behaviour is the same as if he were doing the task in However, these EEG measures only tell us the prob-
English, but for Searle inside the room it is very dif- ability that a patient is unconscious. Detecting con-
ferent. In English, he has understanding; in Chinese sciousness requires communication with the
he does not. Searle uses the Chinese Room to patient, for example by asking them to answer
argue that computers will never be conscious – all questions by moving their hand. If patients are para-
they can do is simulate consciousness, as he simu- lysed during surgery, this can be done using the so-
lates understanding Chinese in the Chinese Room. called ‘isolated forearm technique’ where a
In relation to detecting consciousness, the impor- tourniquet is used to prevent paralysing drugs
tant point is that we, as outside observers, cannot reaching the patient’s lower forearm, allowing them
tell the difference. to move their hand in response to questions should
598 PART 6 CHALLENGES, THEMES, AND ISSUES
they regain consciousness during the operation he or she has not yet learned that that sensation is
(see Andrade et al., 2008). This method is used pain. Learning what pain is – acquiring a ‘pain repre-
much less than EEG measures. sentation’ – requires interactions with the world
People in vegetative states pose similar problems. and other humans. Consider the ethical ramifica-
New research suggests that brain imaging techniques tions of this position, and indeed of any argument
could help inform arguments about continuing life that only humans have sufficiently large and com-
support treatment for unresponsive patients. Owen plex brains to support consciousness. At what point
and colleagues (2006) reported the case of a patient in development does an individual’s brain become
with a diagnosis of vegetative state who, when asked sufficiently large and complex? Vohs and Schooler
to imagine hitting a tennis ball or moving through her (2008) provided a neat, and ethically innocuous,
house, showed brain activity in exactly the same areas demonstration that how we answer such questions –
of the brain that support mental imagery in conscious what we believe about consciousness – affects how
subjects. She later recovered consciousness. we behave. Participants in their study who read
Derbyshire (2006) argues that consciousness arguments against free will were more likely to
requires representational memory. A fetus or new- cheat on a maths test than those who read neutral
born infant cannot feel pain, for example, because statements.
reflect on what ‘normal’ consciousness is like. Because ness, or merely a response to the particular combina-
they are generally dysfunctional states, in the sense tion of relaxation and social pressure to conform to
that they are not conducive to normal everyday behav- the hypnotist’s suggestions. Nonetheless, hypnotized
iour, they give us clues about the functions of normal people can perform surprising feats, such as speaking
conscious states. Altered states are therefore included ‘forgotten’ languages from their childhood or even
briefly in this chapter as a discussion point to help you undergoing minor surgery without painkillers or
think about the possible functions of consciousness. anaesthetic. One explanation of such feats is that hyp-
Drugs such as ketamine and lysergic acid diethyla- nosis reduces our normal tendency to check our men-
mide (LSD) cause hallucinations and other perceptual tal contents against the outside world. This checking
disturbances such as synaesthesia, a condition where and updating of our mental model of ourselves and
stimuli in one sensory modality trigger experiences in our environment is called reality monitoring. With
another sensory modality (e.g. touching something reduced reality monitoring, hypnotized people
hard may produce the sensation of seeing green). It become more credulous because they are less likely to
appears that these drugs cause a flooding of the sen- check the hypnotist’s suggestions against what they
sory system and a breaking down of the modularity of know to be true. This makes them better able to main-
sensory systems. Normal consciousness may therefore tain a ‘hallucination’ even if it contradicts incoming
involve selecting incoming sensory information to sensory information.
prevent too much information reaching higher level Altered states of consciousness suggest that normal
cognitive processes. Drugs such as alcohol cause loss of consciousness operates with or on a selected portion
inhibition, making us more likely to say things or do of the information that constantly bombards our
things that we would refrain from doing in our normal senses. For a demonstration of this selection, try the
conscious state. Normal consciousness may therefore Cheshire Cat activity described in Activity 18.5.
involve monitoring and controlling our behaviour. Normal consciousness also involves checking our cur-
Hypnosis is a state of deep relaxation that makes rent mental state against incoming information from
people more susceptible to suggestion. There is debate our environment and checking our behaviour against
about whether it is truly an altered state of conscious- our intended goals.
CHAPTER 18 CONSCIOUSNESS 599
ACTIVIT Y 18. 5
SUMMARY OF SECTION 3
• Consciousness is associated with feelings of behavioural control. It helps us override habitual and
emotional responses and to learn from our mistakes.
• If consciousness plays a causal role in our behaviour or thought processes, then we should be able to
detect or measure consciousness in others by observing their behaviour or changes in brain activity.
• The effects of mind-altering drugs and of hypnosis suggest that normal conscious states involve mon-
itoring and control of behaviour, and selection of incoming information. We are only conscious of a
small amount of information at any time.
600 PART 6 CHALLENGES, THEMES, AND ISSUES
4COGNITIVE THEORIES OF
CONSCIOUSNESS
This section focuses on three theories: working mem- work towards achieving them (Elaborated Intrusion
ory, global workspace theory, and higher order theory; Kavanagh et al., 2005).
thought theory. Baddeley’s working memory model is By combining information from different modali-
chosen because it is already a widely used model in ties into conscious representations or images, working
cognitive psychology (see Chapter 9). If it can also say memory presents one solution to the binding problem.
something about consciousness then it helps us inte- This is the problem of creating a coherent, unified
grate our thinking about consciousness with our exist- conscious experience from disparate sensory inputs
ing understanding of other aspects of cognition. Baars’ (note, though, that the binding problem also pertains
global workspace approach is discussed as a contrast, at lower levels of cognition, so we also need to bind
partly because it is the most detailed and comprehen- together the results of location and object detection
sive cognitive model of consciousness currently avail- processes, for example). Baddeley (2000) added a new
able and partly because Baars explicitly discusses the component to the working memory model, called the
hypothetical relationship between consciousness and episodic buffer, as a temporary store for bound infor-
working memory. Finally, higher order thought the- mation and as an interface between working memory,
ory (actually a class of theories) is included because it long-term memory, and consciousness. However, the
gives a central role to mental representation and has revised model does not specify whether information
led to interesting speculations about why conscious- is conscious by virtue of being stored in the episodic
ness evolved. buffer or whether it is conscious only when acted
Short-term memory, and later working memory, upon by central executive processes. Nonetheless, the
have often been identified with consciousness. Thus wealth of evidence for a role of working memory in
James (1890/1918) described memory generally as a conscious cognition, such as problem solving and
way of bringing back past conscious experiences, but mental imagery, suggests that working memory is a
argued that for primary memory there is nothing to cognitive correlate of consciousness.
bring back because ‘it was never lost; its date was The hypothetical central executive of working mem-
never cut off in consciousness from that of the imme- ory seems particularly closely correlated with con-
diately present moment’ (1918, p.647). Baddeley sciousness, playing a key role in conscious, strategic
(1993) portrays working memory as a conduit to con- activities such as retrieval of information from long-
sciousness that serves to bring together information in term memory and selective attention (Baddeley, 1996).
different modalities from perception and long-term Baddeley (1986) used Norman and Shallice’s (1986)
memory, enabling us to imagine novel solutions to cognitive model of contention scheduling and supervi-
problems of evolutionary significance. For example, sory attentional system (SAS) as a model of the central
he suggests that a vivid image of a hunting ground, executive. Norman and Shallice’s model aimed to
which included locations where food was found before explain action selection. They hypothesized that rou-
and locations where danger lurked, would have evolu- tine responses are selected by a relatively automatic
tionary significance as a tool for predicting events and process called contention scheduling, essentially the
planning action. In a similar vein, my colleagues and I selection of habitual action schemata by virtue of their
have argued that mental imagery, which is heavily high activation level and ability to inhibit competing
dependent on working memory resources, serves as a schemata. Changes in behaviour are effected by a SAS
‘motivational bridge’ to keep goals in mind while we system that increases the activation of a non-habitual
CHAPTER 18 CONSCIOUSNESS 601
action schema so that it ‘wins’ in the contention sched- eye’ it is sent there for. Dennett’s theory aims to get
uling process. The SAS thus serves as an error-correct- around these awkward questions. Stimuli are not pro-
ing mechanism and as the basis for conscious cessed and then sent to a consciousness module, they
behavioural control, allowing us to respond appropri- are just processed. Which of many parallel streams of
ately in novel situations. Failure of the SAS explains processing we become aware of, and how we experi-
errors in behaviour, such as everyday action slips (e.g. ence them, depends on how and when the system is
habitually adding milk when intending to make a cup ‘probed’ by tasks that require particular responses (see
of black coffee) and perseverative behaviours following Activity 18.6).
frontal brain injury (i.e. persisting with an established Whereas Baddeley argues that working memory is
response when altered conditions mean a new response necessary for consciousness, Baars (2002) argues that
is needed). Baddeley’s adoption of the SAS as a model consciousness is necessary for working memory. All
of the central executive extended its remit from the elements of ‘active working memory’, such as sub-
conscious control of action to the conscious control of vocal rehearsal and visual imagery, are conscious.
cognition generally. However, both models are subject Baars describes consciousness as a ‘global workspace’,
to the criticism of postulating little more than a a means of bringing together the products of process-
‘homunculus’, a little man in the head that tells us ing from widely distributed modules. This bringing
which action to do or which memory to retrieve. together – of inner speech, mental imagery, strategic
Dennett (1991) refers to the homunculus problem recall, etc. – is necessary for working memory to func-
as the problem of the Cartesian theatre: defining a tion. Voluntary control of behaviour is also dependent
cognitive or neuroanatomical module that ‘does’ con- on consciousness, requiring conscious goals and con-
sciousness does not help us explain consciousness, it scious perception of the effects of our actions. Thus we
merely tells us where it occurs. Dennett’s multiple can learn from our mistakes or avoid emotions biasing
drafts theory of consciousness offers a solution to this our behaviour because our behavioural control pro-
problem. Dennett argues that it is misleading to think cesses have access to our knowledge of past mistakes
of consciousness as something that suddenly happens, or the causes of our mood swings. Baars (1997) uses
in the sense that stimulus processing works its way up the analogy of a theatre. The unconscious processes of
from low-level sensory processes to higher-level cog- syntax analysis, visual boundary analysis, semantic
nitive processes and somewhere along the way our processing, etc. are the stagehands working behind the
representation of the stimulus suddenly enters con- scenes in the theatre of consciousness. Although there
sciousness. The idea that information is processed and are actors on the stage, we only see the actor currently
then ‘sent’ to consciousness raises all sorts of awkward performing in the spotlight. Working memory forms
questions about what sort of homunculus or ‘inner the stage of consciousness, and representations in
ACTIVIT Y 18.6
Quickly make a list of what you are conscious of conscious of any of them before you started making
right now. the list? If not, what were you conscious of then? This
activity shows that, although we feel intimately
COM M ENT
acquainted with our own conscious experience, that
What was on your list? Did it include the feel of the
experience changes according to the task we are
chair against your legs, how warm or cold you feel, a
doing. There is no coherent ‘stream of consciousness’,
tickle or an itch? Are you conscious of any of those
just ‘multiple drafts’ with the potential to become
sensations now? If the answer is ‘yes’, then ask yourself
conscious.
this: of the items on your original list, were you
602 PART 6 CHALLENGES, THEMES, AND ISSUES
working memory are the actors on the stage. Actors Baars’ theory. Thus it appears that consciousness is
only step into the spotlight when chosen by the stage often but not always associated with global brain
director – likewise the contents of working memory activity.
have the potential to become conscious but usually do Whereas Baars argues that information is conscious
not do so unless selected by the central executive. when it is globally accessible, higher order thought
Once in the spotlight, the actor can be seen by every- (HOT) theories (e.g. Rosenthal, 1997) argue that
one else: once a representation becomes conscious, information is conscious when it is the subject of a
it is accessible to other cognitive processes. Thus thought. Although my senses are constantly bom-
consciousness may appear to overcome some of the barded, I only consciously perceive those sensations
modularity of mind, enabling us to talk about our that lead, via cognitive feedback loops, to the thought
ideas, express our feelings, use remembered informa- that I am having then, ‘I am seeing yellow’ or ‘I’m
tion to solve problems, and so on (though see also hungry’ (Humphrey, 2006). Pause for a moment to
Chapter 20). consider how a higher order thought theory might
Baars (2002) draws on many recent neuroscience explain your answers to Activity 18.6. Sensing the
studies to support his theory. The essence of these world around us and also thinking about those sensa-
findings is that unconscious processing of stimuli acti- tions requires considerable brain power, so higher
vates localized brain regions, whereas conscious pro- order thought theories predict that only organisms
cessing of the same stimuli activates widely distributed with large and complex brains will be conscious. Being
brain regions. For example, an fMRI study by Dehaene able to represent our own sensations and feelings sets
et al. (2001) showed that processing of masked visual us up well to be able to represent other people’s feel-
words was associated with activation in early visual ings, in other words to develop ‘theory of mind’. If
cortex, whereas processing of visible, unmasked words there is something that it is like to be me, then I can
was also associated with activation in parietal and pre- infer that there is something that it is like to be some-
frontal cortex. However, the finding by Zeki and one else, an essential step towards predicting how
ffytche (1998) of increased but still localized activa- other people will behave and therefore a building
tion with conscious perception seems to contradict block of social interaction (Humphrey, 2002).
SUMMARY OF SECTION 4
• Working memory is closely allied to consciousness, providing a way of binding together information
from perception and long-term memory to create conscious, multi-modal representations.
• Although working memory is a cognitive correlate of consciousness, the relationship between work-
ing memory and consciousness is unclear. Baars (1997) suggested that working memory serves to
select the information that will become conscious. More recently, he has argued that consciousness
is necessary for working memory (Baars, 2002).
• Baars sees consciousness as a global workspace, enabling cognitive modules to share information.
‘Global access’ to conscious information is consistent with findings of widespread brain activity when
participants are aware of a stimulus, contrasted with more localized activity when they are unaware
of it.
• According to higher order thought theories, we are conscious of information that is the subject of a
thought. Consciousness requires a large and complex brain and provides us with insight into our own
mental states and those of other people.
CHAPTER 18 CONSCIOUSNESS 603
FURTHER READING
Blackmore, S. (2010) Consciousness: An introduction, 2nd Blackmore, S. (2001) ‘Consciousness’, The Psychologist,
edition, London, UK, Hodder Education. A comprehensive vol.14, no.10, pp.522–5. A succinct overview of the most inter-
and accessible introduction to philosophical and empirical issues esting issues at a very basic level – a good starting point.
in consciousness studies. Includes interesting practical exercises There are several excellent collections of chapters on conscious-
to help you think about key problems. What I really like about ness that offer compulsive reading once you start browsing:
this book is that it begs to be read rather than merely dipped Metzinger, T. (ed.) (2000) Neural Correlates of Consciousness,
into, providing explanation as well as information about the key Cambridge, MA, MIT Press. Particularly recommended are the
issues. chapters by Hardcastle and ffytche.
604 PART 6 CHALLENGES, THEMES, AND ISSUES
Velmans, M. and Schneider, S. (eds.) (2007) The Blackwell Güzeldere gives a clear and comprehensive overview of philo-
Companion to Consciousness, Oxford, Blackwell. Schneider’s sophical and empirical issues.
chapter, ‘Dennett on the nature of consciousness’, is a good intro- Bayne, T., Cleeremans, A., and Wilken, P. (eds.) (2009) The
duction to Dennett’s work. Oxford Companion to Consciousness, Oxford, Oxford
Block, N., Flanagan, O., and Güzeldere, G. (eds.) (1997) University Press. An alphabetized series of entries ranging from
The Nature of Consciousness: Philosophical Debates, ‘absent qualia’ to ‘zombies’.
Cambridge, MA, MIT Press. The introduction by Güven
REFERENCES
Andrade, J. (1995) ‘Learning during anaesthesia: a review’, Banks, W.P. (1993) ‘Problems in the scientific pursuit of
British Journal of Psychology, vol.86, no.4, pp.479–506. consciousness’, Consciousness and Cognition, vol.2, no.4,
Andrade, J., Deeprose, C., and Barker, I. (2008) ‘Incidence pp.255–63.
of awareness and memory priming in paediatric surgery with Bargh, J.A., Chen, M., and Burrows, L. (1996) ‘Automaticity
general anaesthesia’, British Journal of Anaesthesia, vol.100, of social behavior: direct effects of trait construct and stereo-
pp.389–96. type activation on action’, Journal of Personality and Social
Atkinson, R.C. and Shiffrin, R.M. (1968) ‘Human memory: Psychology, vol.71, pp.230–44.
a proposed system and control processes’, in Spence, K.W. and Block, N. (1995) ‘On a confusion of a function of con-
Spence, J.D. (eds.) The Psychology of Learning and Motivation, sciousness’, Behavioral and Brain Sciences, vol.18, no.2,
Vol. 2, New York, Academic Press. pp.227–87.
Baars, B.J. (1988) A Cognitive Theory of Consciousness, New Chalmers, D. (1996) The Conscious Mind, Oxford, Oxford
York, Cambridge University Press. University Press.
Baars, B.J. (1997) In the Theater of Consciousness: The Deeprose, C., Andrade, J., Harrison, D., and Edwards, N.E.
Workspace of the Mind, New York, Oxford University Press. (2005) ‘Unconscious memory priming during anaesthesia: a
Baars, B.J. (2002) ‘The conscious access hypothesis: origins replication’, British Journal of Anaesthesia, vol.94, no.1, pp.57–62.
and recent evidence’, Trends in Cognitive Sciences, vol.6, no.1, Deeprose, C., Andrade, J., Varma, S., and Edwards, N. (2004)
pp.47–52. ‘Unconscious learning during surgery with propofol anaesthe-
Baddeley, A.D. (1986) Working Memory, Oxford, Oxford sia’, British Journal of Anaesthesia, vol.92, no.2, pp.171–7.
University Press. Dehaene, S., Naccache1, L., Cohen, L., Le Bihan, D.,
Baddeley, A.D. (1990) Human Memory: Theory and Mangin, J.-F., Poline, J.-B., and Rivière1, D. (2001) ‘Cerebral
Practice, Hove, UK, Lawrence Erlbaum Associates Ltd. mechanisms of word masking and unconscious repetition
Baddeley, A.D. (1993) ‘Working memory and conscious priming’, Nature Neuroscience, vol.4, pp.752–8.
awareness’, in Collins, A.F., Gathercole, S.E., Conway, M.A., Dennett, D. (1991) Consciousness Explained, Boston, Little,
and Morris, P.E. (eds.) Theories of Memory, Hove, UK, Brown & Co.
Lawrence Erlbaum Associates Ltd. Derbyshire, S.W.G. (2006) ‘Can fetuses feel pain?’ British
Baddeley, A.D. (1996) ‘Exploring the central executive’, Medical Journal, vol.332, pp.909–12.
Quarterly Journal of Experimental Psychology, vol.49, pp.5–28. Duensing, S. and Miller, B. (1979) ‘The Cheshire Cat effect’,
Baddeley, A. (2000) ‘The episodic buffer: a new component Perception, vol.8, pp.269–73.
of working memory?’ Trends in Cognitive Science, vol.4, no.11, Eich, E. (1984) ‘Memory for unattended events: remember-
pp.417–23. ing with and without awareness’, Memory & Cognition, vol.12,
Baddeley, A.D. and Wilson, B.A. (1994) ‘When implicit pp.105–11.
learning fails: amnesia and the problem of error elimination’, ffytche, D. (2000) ‘Imaging conscious vision’, in Metzinger,
Neuropsychologia, vol.32, pp.53–68. T. (ed.) Neural Correlates of Consciousness, Cambridge, MA,
Baddeley, A.D., Emslie, H., Kolodny, J., and Duncan, J. MIT Press.
(1998) ‘Random generation and the executive control of work- Gomez, R.L. (1997) ‘Transfer and complexity in artificial
ing memory’, Quarterly Journal of Experimental Psychology, grammar learning’, Cognitive Psychology, vol.33, no.2, pp.
vol.51A, no.4, pp.819–52. 154–207.
CHAPTER 18 CONSCIOUSNESS 605
Hardcastle, V.G. (2000) ‘How to understand the N in NCC’, Murphy, S.T. and Zajonc, R.B. (1993) ‘Affect, cognition, and
in Metzinger, T. (ed.) Neural Correlates of Consciousness, awareness: affective priming with optimal and suboptimal
Cambridge, MA, MIT Press. stimulus exposures’, Journal of Personality and Social
Humphrey, N. (2002) The Mind Made Flesh: Frontiers of Psychology, vol.64, pp.723–39.
Psychology and Evolution, Oxford, UK, Oxford University Press. Nagel, T. (1974) ‘What is it like to be a bat?’ The Philosophical
Humphrey, N. (2006) Seeing Red: A Study in Consciousness, Review, vol.83, pp.435–50.
Cambridge, MA, Harvard University Press. Neumann, R. and Strack, F. (2000) ‘Mood contagion –
Jacoby, L.L., Woloshyn, V., and Kelley, C. (1989) ‘Becoming the automatic transfer of mood between persons’, Journal
famous without being recognized: unconscious influences of of Personality and Social Psychology, vol.79, no.2,
memory produced by dividing attention’, Journal of pp.211–23.
Experimental Psychology: General, vol.118, no.2, pp.115–25. Nissen, M.J. and Bullemer, P. (1987) ‘Attentional require-
James, W. (1890/1918) The Principles of Psychology, Vol. I, ments of learning: evidence from performance measures’,
London, Macmillan and Co. Ltd. Cognitive Psychology, vol.19, pp.1–32.
Kavanagh, D.J., Andrade, J., and May, J. (2005) ‘Imaginary Norman, D.A. and Shallice, T. (1986) ‘Attention to action:
relish and exquisite torture: the Elaborated Intrusion theory of willed and automatic control of behavior’, in Davidson, R.J.,
desire’, Psychological Review, vol.112, no.2, pp.446–67. Schwartz, G.E., and Shapiro, D. (eds.) Consciousness and self-
Knowlton, B.J., Ramus, S.J., and Squire, L.R. (1992) ‘Intact regulation, New York, Plenum.
artificial grammar learning in amnesia: dissociation of classi- Owen, A.M., Coleman, M.R., Boly, M., Davis, M.H.,
fication learning and explicit memory for specific instances’, Laureys, S., and Pickard, J.D. (2006) ‘Detecting awareness in
Psychological Science, vol.3, no.3, pp.172–9. the vegetative state’, Science, vol.8, p.1402.
Kunst-Wilson, W.R. and Zajonc, R.B. (1980) ‘Affective dis- Reber, A.S. (1967) ‘Implicit learning of artificial grammars’,
crimination of stimuli that cannot be recognized’, Science, Journal of Verbal Learning and Verbal Behavior, vol.6, pp.855–63.
vol.207, pp.557–8. Rosenthal, D.E. (1997) ‘A Theory of Consciousness,’ in
Levine, J. (1983) ‘Materialism and qualia: the explanatory Block, N., Flanagan, O.J., and Guzeldere, G. (eds) The Nature
gap’, Pacific Philosophical Quarterly, vol.64, pp.354–61. of Consciousness, MIT Press.
Lieberman, M.D. (2000) ‘Intuition: a social cognitive neu- Schneider, W. and Shiffrin, R.M. (1977) ‘Controlled and
roscience approach’, Psychological Bulletin, vol.126, no.1, automatic human information processing: 1. Detection,
pp.109–37. search, and attention’, Psychological Review, vol.84, pp.1–66.
Logothetis, N.K. and Schall, J.D. (1989) ‘Neuronal correlates Searle, J.R. (1980) ‘Minds, brains, and programs’, Behavioral
of subjective visual perception’, Science, vol.245, pp.761–3. and Brain Sciences, vol.3, pp.417–57.
Marcel, A.J. (1983) ‘Conscious and unconscious percep- Shanks, D.R. and St John, M.F. (1994 ) ‘Characteristics of
tion: experiments on visual masking and word recognition’, dissociable human learning systems’, Behavioural and Brain
Cognitive Psychology, vol.15, pp.197–237. Sciences, vol.17, no.3.
Marcel, A.J. (1988) ‘Phenomenal experience and function- Squire, L.R. and Mckee, R. (1992) ‘Influence of prior events
alism’, in Marcel, A.J. and Bisiach, E. Consciousness in on cognitive judgments in amnesia’, Journal of Experimental
Contemporary Science, Oxford, Oxford University Press. Psychology: Learning, Memory, and Cognition, vol.18, no.1,
McElree, B. (2001) ‘Working memory and focal attention’, pp.106–15.
Journal of Experimental Psychology: Learning, Memory, and Vohs, K.D. and Schooler, J.W. (2008) ‘The value of believing
Perception, vol.27, no.3, pp.817–35. in free will: encouraging a belief in determinism increases
Meyer, D.E. and Schvaneveldt, R.W. (1971) ‘Facilitation in cheating’, Psychological Science, vol.19, pp.49–54.
recognizing pairs of words: evidence of a dependence between Zajonc, R.B. (1980) ‘Feeling and thinking: preferences need
retrieval operations’, Journal of Experimental Psychology, no inferences’, American Psychologist, vol.35, pp.151–75.
vol.90, pp.227–35. Zeki, S. and ffytche, D.H. (1998) ‘The Riddoch syndrome:
Moray, N. (1959) ‘Attention in dichotic listening: affective insights into the neurobiology of conscious vision’, Brain,
cues and the influence of instructions’, Quarterly Journal of vol.121, pp.25–45.
Experimental Psychology, vol.11, pp.56–60.
COG NITIVE
MODELLING
AND COG NITIVE
ARCHITEC TU R ES
Paul Mulholland and Stuart Watt
1WHAT IS COGNITIVE
MODELLING?
In this chapter we are going to return to a psychologi- that model against human performance. If the model
cal method that was introduced in Chapter 1 and has behaves in the same way as humans, then the struc-
been raised at various points since: cognitive model- ture of the model and the way it works may give some
ling. You have already met a few cognitive models, insight into how humans perform the task. Cognitive
although you may not have realized that they were modelling has been used to help explain a range of
cognitive models at the time. Now is a good time to cognitive processes such as face recognition (see
look at the method of cognitive modelling in a bit Chapter 4), language comprehension (Chapter 6), and
more detail and see the contributions that models analogical problem solving (Chapter 10).
make to cognitive psychology. Cognitive modelling is very like the kind of tech-
First of all, what is cognitive modelling? Cognitive nique that car designers or architects use to make it
modelling involves building a working model of a cog- easier to see and test their designs. Psychologists use
nitive process and then comparing the behaviour of models in the same way: to make it easier to understand
CHAPTER 19 COGNITIVE MODELLING AND COGNITIVE ARCHITECTURES 607
ACTIVIT Y 19.1
(a) Assuming that units A and B in Figure 19.2 are COM M ENT
activated simultaneously, and both have an activa- (a) The maximum threshold value would be 0.8. This
tion level of 1.0, what is the maximum threshold would be the sum of the weights of the two input
value of unit C that would still allow it to be acti- links 0.3 and 0.5. If the threshold value was higher
vated? than 0.8, it would be impossible for the unit to fire
(b) Assuming that units A and B in Figure 19.3 given these two inputs.
are activated simultaneously, and both have an (b) The minimum weight would be 0.1. This would
activation level of 1.0, what is the minimum weight make the sum of the two weights, 0.6, equal to the
of the link from unit A that would allow unit C to be threshold value of unit C. If the weight of the link was
activated if it had a threshold value of 0.6? lower than 0.1, it would be impossible for unit C to
fire given a threshold value of 0.6.
C C
A B A B
of the unit. The behaviour of a network (i.e. the out- feeding directly into the output layer, but by adjusting
puts it provides according to inputs received from the all of the links that indirectly affect the output layer.
outside world) will be determined by the threshold Modifying the behaviour of a unit in the output layer
values of the units and the weights of the links. can therefore involve modifying the weights of links
PDP models can also ‘learn’ – one way in which this between the hidden and output layers, and between
can be done is via an automatic procedure for succes- the input and hidden layers. It is possible to adjust the
sively modifying the weights of its links until the net- weights of the network in this way automatically, by
work ultimately produces the correct outputs. During calculating backwards from the links between hidden
training, the network will be provided with a large and output layers to the links between input and hid-
number of example inputs, and a specification of the den layers. This process of adjusting weights backward
output the network should produce for each one. For from the output layer is known as the backward prop-
example, suppose we present a network with an input agation of error.
pattern and a unit in the output layer provides an out- In addition to their ability to learn, PDP models
put when it is not desired. This can be corrected in the have other characteristics that are important for our
model by decreasing the weights of the links that pro- understanding of cognition:
vide this unit’s input, and so making it more difficult
for the unit to reach its threshold value when the net- 1. PDP models need not contain any explicit rules,
work is presented with the same input pattern again. but can still behave as if they are following such
Conversely, if a unit in the output layer fails to provide rules. For example, Prince and Smolensky (1997)
an output when desired, then the weight of its input developed a PDP model of how words are
links can be increased, making it easier for the unit arranged in order to produce grammatical
subsequently to reach its threshold value. sentences. The behaviour of the model could be
In practice, a PDP model ‘learns’ in this way not explained in terms of a set of grammatical rules,
through modifying just the weights of the links but none of these rules were explicitly present in
CHAPTER 19 COGNITIVE MODELLING AND COGNITIVE ARCHITECTURES 609
the model. The behaviour of the model conformed Output sent to outside world
to, but was not governed by, any explicit rules.
2. If a network is damaged, for example through the
removal of specific units, then performance of the Output layer
model will typically deteriorate slightly, rather
than fail completely. This gradual deterioration in
performance is referred to as graceful degradation. Hidden layer
It is also a characteristic of the human brain – for
example, the gradual loss of neurons in the brain
due to ageing has a gradual rather than sudden
Input layer
effect on cognitive processes such as learning and
memory.
3. PDP models can exhibit emergent properties. An
Input received from outside world
emergent property is a behaviour that the model
comes to exhibit over time, through training, that FIGU RE 19.4 A PDP architecture comprising an input
was not explicitly programmed into the model. layer, hidden layer, and output layer, adapted from
This feature also makes PDP models interesting Rumelhart and McClelland (1986).
from a psychological viewpoint, as much of
human learning derives from accumulated
The production rule written in an English-like form in
experience rather than explicit instruction.
(1) could be used in a model of how to make a cup of
tea. A complete model of tea-making might contain
production rules for boiling the kettle, warming the
1.2 Rule-based systems pot, adding tea bags to the pot, adding sugar, and stir-
ring the tea. Each production rule would fire when the
PDP models can be contrasted with rule-based sys- current state of the tea-making process matched its
tems. A rule-based system models cognition as an condition. The rule in (1) would only fire once the
explicit set of rules – for example, production rules – milk had been added to the cup and the tea was ready
that provide a recipe for how the model should behave. to pour.
Production rules contain two parts – a condition and It is possible to model complex cognitive processes
an action. They are structured in the form ‘IF condi- using production rules. For example, a rule-based
tion is met THEN perform action’. The condition model of how humans produce grammatical sen-
specifies what must be true in order for the rule to be tences may have production rules for selecting an
applied. The action is what the production rule should appropriate verb depending on the meaning of the
perform if the condition is true. If a production rule sentence, and for selecting an appropriate ending for
matches its condition and performs its action, then the verb depending on the tense to be used.
the rule is said to have fired. A rule-based model is Unlike PDP models, rule-based models focus on
constructed out of a set of production rules that how the cognitive tasks humans perform can be
together can produce the desired cognitive behaviour. understood as the processing of information without
considering how such processing might be realized in
the brain. The relationship between the approaches
(1) IF the cup just contains milk AND the tea in taken by PDP and rule-based systems can be under-
the pot is ready stood in terms of Marr’s (1982) levels of explanation
THEN pour the tea into the cup. (discussed in Chapter 1). Marr argued that psycho-
logical explanations can be understood at any of three
610 PART 6 CHALLENGES, THEMES, AND ISSUES
levels: computational, algorithmic, and hardware. The a fixed set of mechanisms. As well as maintaining con-
traditional PDP approach places a greater emphasis sistency across a set of models, cognitive architectures
on the hardware level, arguing that if the model have another important advantage. Cognitive archi-
reflects some basic properties of the human brain, tectures distinguish clearly between the cognitive
then interesting psychological behaviour will emerge. model and the computer (and any associated pro-
On the other hand, a traditional rule-based approach gramming languages) on which the model is running.
places virtually no emphasis on the actual brain, effec- When a cognitive model is developed using a standard
tively saying that the way the brain works is more a programming language (such as the C programming
matter for biology than psychology. Instead, it argues language) there is a need to distinguish which parts of
that psychological phenomena can be most appropri- the program are psychologically relevant and which
ately explained at the computational and algorithmic are just dependent on the programming language
levels. In practice, this distinction is increasingly being used. For example, a programming language has
fuzzy; many PDP models explore complex cognitive facilities for storing information but the model devel-
behaviours, and current rule-based models are con- oper is not necessarily claiming that the way this
cerned about biological plausibility. information is stored in the computer bears any rela-
tion to the way humans store information in memory.
A rule-based cognitive architecture is ‘emulated’ on a
1.3 Cognitive architectures computer, but there is a clear distinction between the
working of the model and the working of the com-
Newell (1973) argued that it was not sufficient to puter. By this we mean that the cognitive architecture
develop a collection of discrete models to describe a is used on a computer but has its own self-contained
broad range of psychological phenomena. Instead, set of processes, such as production rules. It does not
there should be some integration and consistency directly use the general purpose processes of the com-
across the models being developed. For example, play- puter that are used to provide the computer user with
ing chess, recognizing objects, and producing gram- all kinds of facilities from email to word processing.
matical sentences are all psychological processes that PDP is itself a cognitive architecture comprising a
use long-term memory. If rule-based models of these fixed set of artificial neural mechanisms. Two of the
three psychological phenomena contained completely most well known rule-based cognitive architectures
different ways of representing, organizing, and retriev- are Soar (Newell, 1990) and ACT-R (Anderson and
ing from long-term memory, this would clearly be a Lebiere, 1998). In the next three sections we will look
problem. Humans use the same cognitive processes in detail at ACT-R as a rule-based cognitive architec-
across a range of tasks. ture and at some of the empirical data it has been used
This led to the development of cognitive architec- to model. Particular consideration will be given to the
tures that could account for a range of cognitive pro- extent to which ACT-R meets Newell’s (1990) goal to
cesses using the same modelling components. A develop a cognitive architecture that can provide an
cognitive architecture is an overarching framework integrated and consistent account of a wide range of
that can account for a wide range of phenomena using psychological processes.
SUMMARY OF SECTION 1
• Cognitive modelling involves building a model of a cognitive process and then comparing the behav-
iour of the model against human performance.
• The two main types of cognitive modelling are parallel distributed processing (PDP) and rule-based
systems.
CHAPTER 19 COGNITIVE MODELLING AND COGNITIVE ARCHITECTURES 611
• PDP models have neural-like properties and aim to demonstrate how a neural architecture can sup-
port human cognition.
• Rule-based models focus on how information is processed and give less consideration to how cogni-
tive processes are realized in the brain.
• Rule-based cognitive architectures such as ACT-R and Soar attempt to provide an integrated account
of a range of cognitive theories and empirical findings.
2 AN OVERVIEW OF ACT-R
To give you a taste of cognitive modelling, in this In 1993, ACT-R was developed and since then it has
chapter we will describe, evaluate, and use Anderson’s been gradually revised. The ‘R’ stands for ‘rational’ and
ACT-R cognitive architecture (Anderson and Lebiere, refers to Anderson’s (1990) theory of ‘rational analysis’
1998). ACT-R is perhaps the most widely used cogni- (recall the different explications of rationality dis-
tive architecture in the cognitive modelling commu- cussed in Chapter 12). Basically, rational analysis the-
nity, and reflects a trend towards hybrid models that ory states that each component of the cognitive system
attempt to span Marr’s levels of explanation. Although is optimized with respect to demands from the envi-
ACT-R is primarily a rule-based cognitive architec- ronment, given its computational limitations. ACT-R
ture, it has certain characteristics more usually associ- also shifted the emphasis towards a finer-grained
ated with PDP. model. Whereas earlier rule-based models tended to
use a small number of complex rules, in ACT-R there
is a definite shift to a larger number of simple rules. In
2.1 A brief history of ACT-R fact, Anderson and Lebiere (1998) argue that the sim-
ple chunks of ACT-R’s memory, and the simple rules
ACT (which stands for ‘Adaptive Control of Thought’) of its production system, are ‘atomic’ in the sense that
has its roots in Anderson and Bower’s (1973) theory of they should not be broken down into further, more
human associative memory, and their model of it, fine-grained ACT-R constructs.
called HAM. A number of different versions of ACT
have been developed. The first version of ACT proper,
called ACTE, combined elements of HAM’s memory
representations with rule-based production systems
The architecture of
2.2
that modelled control of behaviour and more complex ACT-R
activities like problem solving. In 1983, Anderson
revised ACTE producing ACT* (pronounced ‘act The ACT-R cognitive architecture comprises a clear
star’), which revised the underlying memory system set of components, whose interactions lead to its spe-
to be more plausible biologically and introduced a cial behaviour. These components are more or less dis-
mechanism for learning new rules for the first time. tinct modules within it. We have shown an overview
ACT* was the first complete theory in the ACT series, of the architecture for ACT-R in Figure 19.5 below.
and was capable of modelling a wide range of behav- The ACT-R architecture consists of three core com-
iours, from memory to complex problem solving and ponents: declarative memory, procedural memory (see
skill acquisition. Chapter 8), and a goal module. Put simply, declarative
612 PART 6 CHALLENGES, THEMES, AND ISSUES
Procedural memory
interplay between declarative and procedural mem-
ory. There is also a goal module (see Section 2.5). This
Selection
is important for models involving lots of rules, as the
current goal is a kind of focus of current attention –
Execution
this represents what ACT-R is currently trying to do.
ACT-R also has a range of (very simple) perceptual
and motor components that allow it to model visual
Visual buffer Manual buffer and auditory stimuli, and actions including changing
visual attention and vocalizing, as well as physical
actions. These components are not directly linked to
Visual module
procedural memory, but – like declarative memory
Manual module
and the goal system – are connected through small
shared spaces called buffers. It is only the buffer con-
tents that affect productions.
External world
Combined, these components allow ACT-R to
model a very wide range of cognitive phenomena,
FIGU RE 19. 5 An overview of the ACT-R architecture
(adapted from Anderson et al., 2004). from memory (we will look at an example in Section
3) and problem solving (see Section 4.2) to tasks that
involve perception and action (see Section 4.3).
memory is full of things that we just know, for example, This gives you the big picture of ACT-R. Now let’s
that ‘1 + 3’ is ‘4’, that grass is green, and that books have go into each part of the architecture in a little more
pages in them. Procedural memory, on the other hand, detail.
is full of things that we know how to do. For example,
few people would know the answer to ‘154 + 367’
directly, but most would know a procedure that can be 2.3 Declarative memory
used to work out the answer. The steps in this procedure
would be stored in procedural memory. All of the ACT models, going way back to HAM in
Importantly, declarative memory and procedural 1973, conceived of declarative memory as a collection
memory are not independent, but interrelated. There are of chunks, or declarative memory elements, which
two kinds of connection between them. First, a produc- themselves contain a number of elements, usually
tion rule in procedural memory often involves retriev- between two and four. A typical chunk is shown in
ing elements from declarative memory through the Figure 19.6.
retrieval buffer shown in Figure 19.6. Second, new pro- This chunk encodes the addition fact, ‘1 + 3 is 4’.
duction rules can be created in procedural memory Each of the main rows in the chunk holds a value in a
from ‘chunks’ in declarative memory (this process will different slot. Chunks also have the ‘isa’ slot (pro-
be discussed in Section 2.4). This process is known as nounced ‘is a’), which says what kind of chunk it is (i.e.
production compilation. The importance of production ‘this chunk isa addition fact’).
CHAPTER 19 COGNITIVE MODELLING AND COGNITIVE ARCHITECTURES 613
Chunk1
ISA addition-fact
Number1 = 1
Number2 = 3
Sum = 4
Chunks are not isolated from each other; they are ACT-R is a lot more than a place for storing chunks. It
all linked to each other through their values in a kind plays an active and essential role in the behaviour of
of network. For example, the chunk shown in ACT-R itself.
Figure 19.6 will be linked to all other chunks that are
addition facts or that use the numbers one, three, or
four. Chunks influence one another through these 2.4 Procedural memory
links by a limited form of spreading activation (dis-
cussed in detail in Section 3.3). Put simply, each chunk The central component of ACT-R is its procedural
has a level of activation, a kind of energy attached to it. memory. This represents procedures in the form of
But activation in one chunk tends to leak out and add production rules, which have a condition (i.e. IF) part,
to all the other chunks it is connected to through its and an action (i.e. THEN) part. Unfortunately, since
values. For example, increasing the activation of the ACT-R is a computer program, its rules tend to be
addition fact ‘1 + 3 = 4’ would automatically increase written in a fairly cryptic form. Box 19.1 shows a rule,
the activation of other addition facts and of chunks first in an English-like representation, and then in
that contain ‘1’, ‘3’, or ‘4’ in their slots. Chunks that are ACT-R form.
both addition facts and that contain ‘1’, ‘3’, or ‘4’ would To give you an idea of the relation between these
get even more activation. representations, the condition part of the rule (the IF
Activation is central to many aspects of ACT-R. If a part) can be found in the rows before the ‘= =>’ char-
chunk has a lot of activation, it will be easy to find and acter, and the action part (the THEN part) appears
to retrieve quickly from memory. If a chunk has very after it. The bits that begin ‘= something >’ are refer-
low activation, it will be hard to find and may never be ences to chunks, and each line that follows is a slot
retrieved at all. Highly active chunks, therefore, look a name followed by a value. When a word begins with
bit like short-term memory, and chunks with less acti- the ‘=’ character, it is a variable; that is, it can change
vation look a bit like long-term memory. If a chunk each time the rule is used. Variables are very impor-
has no activation, it has effectively been forgotten, at tant to production rules, as they are what make rules
least temporarily, until its activation level is increased. sufficiently general to run with different problems. For
Activation is not constant for a chunk. If nothing example, the rule in Box 19.1 could be used to add any
happens, a chunk slowly loses activation. But if a addition column for which the matching addition fact
chunk is used, it gains activation, and the more it is was stored in declarative memory. Variables and val-
used, the more it gains. This allows ACT-R to model ues will be covered in more detail later.
effects such as priming (e.g. see Chapter 6). For exam- ACT-R uses production rules in the following way.
ple, if a chunk is retrieved, its activation will increase. All production rules are available to be used depend-
If the chunk is then retrieved again shortly after ing on the current state. For a production rule to be
(before the added activation has been lost), it will be used, its condition part (the IF part) must match the
retrieved more quickly. So declarative memory in current goal and use chunks already available in
614 PART 6 CHALLENGES, THEMES, AND ISSUES
declarative memory. This gives quite subtle control memory. The process by which production rules are
over timing. For example, the greater the activation of learned in ACT-R has three stages:
a chunk in declarative memory, the faster any produc-
tions that use that chunk can be fired. ACT-R uses this 1. Understanding. The first stage involves
technique extensively to give reasonably accurate understanding instructions and available worked
models of human response times (as we shall see in examples. For example, a teacher may provide a
Section 3). child with verbal instructions for multiplying two
Activation also plays a significant role in procedural numbers together. In ACT-R this new knowledge
memory. Rules have activation too, and if a rule has a is encoded as chunks in declarative memory.
very low activation it might not be used even though 2. Production compilation. In the second stage, we try
its conditions match the current state. However, the to solve problems by applying these instructions. By
more a rule is activated, the more likely it is to be working on a range of problems we start to
retrieved and used again in the future. generalize from our experience. For example,
Procedural memory is not fixed like a computer through attempting multiplication problems for
program – new rules can be learned through a process themselves a child will start to realize the range of
called production compilation. Production compila- problems to which the multiplication instructions
tion is the name given to the process by which knowl- can be applied. In the initial stages, the child may
edge is transferred from declarative to procedural only be able to correctly solve the multiplication
CHAPTER 19 COGNITIVE MODELLING AND COGNITIVE ARCHITECTURES 615
problem when it has certain characteristics, such as To complete the circle, as these rules are used, they
containing or not containing particular numbers. may themselves create new chunks in declarative
Through experience the child will come to realize memory. As we shall see in Section 4.2, for example, a
how general instructions can be used to solve a child who does not know from memory the answer to
wide range of multiplication problems. In ACT-R ‘4 + 2’ may use a counting procedure to arrive at the
this is supported by the process of production answer. The child may then remember this answer and
compilation. Through application, the declarative so subsequently can provide the answer to ‘4 + 2’
representation of the instructions becomes directly from memory. In ACT-R this is modelled by a
transformed into a production rule. The production production rule (e.g. the child’s counting procedure)
rule becomes more general than the declarative producing a chunk in declarative memory (e.g. a
chunks as specific values in the chunks become chunk representing ‘4 + 2 = 6’) that can later be used
replaced by variables in the production rule. For to answer the same question without using the origi-
example, chunks representing the instructions for nal production rule. We will come back to ACT-R’s
multiplying 27 by 3 may be generalized into a approach to learning in Section 4, where we will look
production rule for multiplying any two-digit at a model that shows it working in practice.
number by three, and then further generalized for The idea that memory is divided into declarative
multiplying any two-digit number by a one-digit and procedural memory is central to the ACT-R the-
number. This process is described in detail in ory. One of the sources of evidence for this distinction
Section 4.1. is the experiment conducted by Rabinowitz and
3. Practice. Through practice we solve problems with Goldberg (1995), which relies on the fact that declara-
increasing speed and accuracy. For example, a tive encodings of instructions can be reversed more
child who has become more experienced with easily than procedural encodings of the same instruc-
multiplication problems will deliberate less over tions (see Box 19.2).
the individual steps in the task, and come to solve
the problems with relative ease. ACT-R explains
this in terms of an increasing use of the Goals and the goal
2.5
production rules and a decreasing use of the
declarative instructions. When first developed, the module
production rules have a low level of activation,
making the retrieval and use of the production Production systems like ACT-R’s procedural memory
rules more difficult. Through further learning and grew out of work on problem solving systems in the
use, the activation level of the production rules field of artificial intelligence. These systems adopt a
increases until they take over from the declarative goal-directed approach to problem solving. Basically,
representation of the instructions. they take a current goal and a current state, and the
system acts either to achieve the goal or add a new
Much of ACT-R’s explanatory power comes from the goal that needs to be completed first. For example, if
production compilation process, which sets up a con- someone wishes to have home-made lasagne for their
tinual interplay between the chunks in declarative meal, they will probably first set themselves the goal of
memory and the rules in procedural memory. assembling all the ingredients in their kitchen. This
Instructions for how to perform a given task start out may involve going shopping. Once the initial goal of
as chunks in declarative memory, and then as perfor- assembling the ingredients has been met, then he or
mance improves through practice, these chunks are she can move onto the next stage and make the lasa-
turned (or compiled) into rules in procedural mem- gne using the ingredients.
ory, which do the same thing as the chunks but do it In ACT-R, if the current goal (e.g. finding the ingre-
automatically. dients) is being used, it is held in a goal buffer managed
616 PART 6 CHALLENGES, THEMES, AND ISSUES
Rabinowitz and Goldberg’s (1995) experiment but also on a transfer task – subtractive arithmetic
investigated differences between declarative and on the same problems, for example ‘F – 3 = ?’, with
procedural encodings of the same instructions. If a the expected response ‘C’.
declaratively encoded instruction can be reversed Participants who received less practice per-
more easily than a procedurally encoded one, this formed better on the transfer task when the prob-
lends support to the idea of relatively distinct mem- lems presented featured the same number and
ory systems. letters as problems they had tackled in the first task.
Participants were given a simple alphabet arith- For example, they answered more quickly to
metic task, with stimuli like ‘C + 3 = ?’, where the ‘F – 3 = ?’ if they had already seen ‘C + 3 = F’. This
number indicated how many letters the participant was not the case for participants who had received
should advance along the alphabet. The expected more practice.
response here would be ‘F’. Two participant groups Participants who received less practice could
took part in the experiment. The first group was solve subtraction problems by reversing the addi-
given 12 letter–number combinations in rehearsal, tion solutions held in declarative memory. Partic-
but the second group was given 72 (thereby gaining ipants receiving more practice had built a procedure
more practice time). After this practice time, both for arithmetic addition within their procedural
groups were tested on additive alphabet arithmetic, memory, and this could not be reversed.
by a goal module. The current goal – the goal in the goal Although the current implementation of ACT-R
buffer – is fundamental to the behaviour of production has a goal module that only provides a goal buffer con-
rules. It represents the current context of the task, and is taining a single chunk, with no goal memory system,
the main source of activation for declarative memory the theory is not committed to that. Trafton et al.
retrieval. In ACT-R, however, the nature of goal mem- (2011), for example, describe a more subtle activation-
ory is still an open question. Working memory based goal system written as a replacement to the one
(Baddeley, 1986) could be considered one type, but built into standard ACT-R, which is capable of
there are expected to be others (Anderson et al., 2004). accounting for some of the slips and errors described
One open question is the role of activation in goal by Norman (1981).
selection. Norman (1981) describes a number of com-
mon types of slips and errors that can occur because of
changes in activation. For example, one common 2.6 Perception and action
error is a ‘loss of activation error’ where a goal loses
activation, perhaps due to a delay or interruption. You Most often, an ACT-R model is intended to be com-
might forget one ingredient for the lasagne when pared to a participant in an experiment, so ACT-R has
shopping, because so many other goals are going on a wide range of perceptual and motor modules that
(getting to the shops, taking money, paying, and so enable it to model the kinds of stimuli and actions used
on). A second is a ‘capture error’ where a more fre- in classic psychology experiments. Typically, the model
quently used goal takes over a plan. For example, if the corresponds to a participant sitting in front of a com-
bus you use to go shopping happens to be the same puter, looking at a monitor, listening to speakers, and
one you use every day to go to work, you may find using a keyboard and mouse. As such, ACT-R includes
yourself getting off the bus at the wrong stop, and set- standard visual and auditory location and identification
ting off for work instead. modules, and motor and speech modules (allowing
CHAPTER 19 COGNITIVE MODELLING AND COGNITIVE ARCHITECTURES 617
sub-vocalization, so that rehearsal can be modelled), by a unique visual feature, e.g. finding one green object
but it is designed so these can be replaced by more com- in a field of blue ones. The time to complete such a
plex versions if needed. Each module is connected to search tends not to increase even as the number of dis-
the central production system through its own buffers, tractors increases. However, when the target is uniquely
allowing rules to pick up perceptual information and specified by a combination of features, e.g. finding a
start appropriate actions. green square in an array of distractors, some of which
Perception and action are relative newcomers to are green circles while others are blue squares, then
ACT-R. Earlier versions focused primarily on the rela- search time tends to increase linearly in relation to the
tionship between procedural memory, declarative number of distractors. This module therefore allows an
memory, and goals. ACT-R has evolved to incorporate ACT-R model to make more accurate predictions for
perception and action more deeply into its models, yet tasks. ACT-R does not explain how pre-attentive visual
it does not claim to model perception or action pro- processing happens, but it does show how it can play its
cesses themselves. part in a more complex task.
Visual perception, for example, is immensely com- Consider the Towers of Hanoi problem you encoun-
plex, as optical patterns on the retina are interpreted tered in Chapter 10. Many effective strategies for the
and transformed into cognitive representations. ACT- Towers of Hanoi use perception to avoid having to
R, as it stands, does not attempt to explain any of those remember too many sub-goals, by making the current
processes, although it does describe some of the com- state of the problem easily accessible to production
mon perceptual effects. This distinction between rules. Without modelling perception, these strategies
explaining cognitive phenomena and simply describ- simply cannot be modelled.
ing them is an important one: both may be useful, but While accounting for perception and action is
to a cognitive psychologist, explanation is far more important to an accurate model of the behaviour of a
useful and interesting. participant in front of a computer, what is happening
ACT-R’s visual location module, for example, models inside these standard modules is in most cases trivial,
pre-attentive visual processing effects such as ‘pop out’, and not especially important to the rest of the model.
where a target can be found rapidly among an array of Accordingly, there are clear areas where ACT-R does
distractors when the target differs from the distractors not claim any psychological plausibility.
SUMMARY OF SECTION 2
• ACT-R is a cognitive architecture based around three core components: declarative memory, proce-
dural memory, and a goal buffer.
• Declarative memory is organized as a set of interconnected chunks forming a network, each chunk
having a level of activation.
• Procedural memory is comprised of production rules that also have activation levels and that can
perform some action if the condition part of the rule is met.
• ACT-R production memory is not fixed; new rules can be learned, modelling skill acquisition through
instruction, examples, and practice.
• Coordination between production rules is managed by a current goal held in a goal buffer, represent-
ing the context of the task.
• In its standard implementation ACT-R rules depend on a single current goal, and do not model the
effects of activation on goal selection.
• Because most real cognitive behaviours depend on an external world, ACT-R includes modules that
enable models to incorporate perception and action.
618 PART 6 CHALLENGES, THEMES, AND ISSUES
Latency (seconds)
0.9
2
0.8
1.5
0.7 1
0.6 0.5
0.5 0
1 2 3 4 5 6 7 8 9 1 2 3 4 5 6 7 8 9
Input position Input position
FIGU RE 19.7 Recall accuracy and latency in the forward recall of a nine-element list.
CHAPTER 19 COGNITIVE MODELLING AND COGNITIVE ARCHITECTURES 619
ACTIVIT Y 19.2
How many chunks in total are required to represent elements. Fifteen chunks are required for the
a list of 15 elements with: individual elements. (Note that the list itself does
(a) a group size of three not have a chunk. ‘List1’ appears as a value in
each of the 15 chunks.)
(b) a group size of five?
(b) Eighteen chunks would be required. Three
COM M ENT chunks are required for the three groups of five
(a) Twenty chunks would be required. Five chunks elements. Fifteen chunks are required for the
are required for the five groups of three individual elements.
620 PART 6 CHALLENGES, THEMES, AND ISSUES
Chunk1
Position = 1st
Group = Group1
List = List1
Content = 5
FIGU RE 19.9 The chunk associated with the first item of List1.
single item. (Recall from Chapter 10 that Chase and Each chunk also has a unique name by which it can be
Simon (1973) found that expert chess players could referenced. Figure 19.10 represents the chunk associ-
remember the positions of more chess pieces after a ated with the first group of List1. (This group has been
glance than novices. This suggests that, although given the name Chunk10. The chunks associated with
experts and novices can form the same number of the nine elements of List1 have been named as Chunks
chunks in short-term memory, experts can represent 1 to 9, and the chunks associated with the three groups
the positions of a greater number of pieces in one have been named as Chunks 10 to 12.)
chunk.)
As mentioned in the previous section each chunk is
represented using slots and values; however, the
chunks used to encode groups and individual items 3.2 Production rules for the
have a slightly different set of slots. A chunk associated
with an individual element has slots for the group to
rehearsal and retrieval of
which it belongs, its position within the group, the lists
overall list to which it belongs, and its content (i.e. the
list item). The chunk associated with the first item in The ACT-R model has to perform a number of proce-
the list is shown in Figure 19.9. This chunk states that dures in order to simulate performance in the list
the item in the first position of Group1 of List1 is the memory task. The list contents have to be rehearsed in
value ‘5’. It is important to note, according to the memory and then retrieved, and responses have to be
assumptions of ACT-R, that each individual element given. These procedures are stored in the form of
has a slot associating the element directly to the list as production rules in procedural memory, as described
well as to the group to which it belongs. This allows earlier.
ACT-R to model some complex memory effects, as we The condition part of the production rule may
shall see later in Section 3.3. specify what must be the current goal, and may spec-
A chunk encoding a group has slots to indicate the ify what chunks have to be made available in declara-
list to which it belongs, the number of elements in the tive memory. For example, as was shown in Box 19.1,
group, and the position of the group within the list. the Add-numbers production rule could only fire if
Chunk10
list = List1
Size = 3
Position = Group1
FIGU RE 19.10 The chunk associated with the first group of List1.
CHAPTER 19 COGNITIVE MODELLING AND COGNITIVE ARCHITECTURES 621
ACTIVIT Y 19. 3
(a) Write down the slots and values of the chunk (b) The last element of Group2 would be Chunk6.
associated with Group3 of List1. As this chunk refers to an individual item, it has
a slot for its content. The sixth number in the
(b) Write down the slots and values of the chunk
list is 2. The chunk would therefore look like
associated with the last item of Group2 of
Figure 19.12.
List1.
Chunks therefore organize a seemingly flat list of ele-
COM M ENT ments into a hierarchy, where the list is initially bro-
(a) According to our numbering scheme, the chunk ken down into three groups and the groups are then
associated with the third group is Chunk12 and broken down into individual elements.
it has a size of three. It also maintains a link to
the list. The chunk would therefore look like
Figure 19.11.
Chunk12
List = List1
Size = 3
Position = Group3
FIGU RE 19.11
Chunk6
Position = 3rd
Group = Group2
List = List1
Content = 2
FIGU RE 19.12
(the ACT-R textual syntax has been removed for clar- Activation is part of the PDP-like nature of the
ity). Basically, the rule states that if you can retrieve ACT-R architecture. Activation of (artificial neuronal)
the item you are trying to recall (i.e. the item at posi- elements is used within PDP architectures and is itself
tion X in group Y), then set a sub-goal to output (i.e. inspired by our understanding of neurology. The acti-
say) the retrieved item and then move onto the next vation level of each chunk in declarative memory is
item (i.e. item X + 1). calculated using a set of activation equations provided
(3) shows the production rule used to output an and modifiable within ACT-R.
item in a recall task via a key press. Here the action The activation level of a chunk is calculated as the
part just provides an output and does not transform sum of its base-level activation and associative activa-
any goals. tion. The base-level activation of a chunk depends on
the number of times it has been rehearsed in memory
and the amount of time that has elapsed since it was
(3) Rule in English form last rehearsed. If a chunk has been rehearsed a high
number of times and only a small amount of time has
Type out the item
elapsed since the last rehearsal, then its base-level acti-
IF the goal is to output item X and we can vation will be high.
retrieve a key for X that is found on the key- The base-level activation provided by the ACT-R
board architecture can help to account for primacy and
THEN output by pressing the key. recency effects in list memory. The primacy effect is
due to the number of times the item has been
rehearsed, increasing its base-level activation. The
The production rules shown above contain certain recency effect is due to the small time lapse since the
characters written in italics (X, Y, and Z). These are presentation or last rehearsal of the item, which also
variables that act as empty slots and can accept a range means base-level activation will be high.
of specific values. These are used in order to satisfy the The association strength is the strength of the bond
ACT-R assumption that production rules should pro- between an item and the required chunk, and influ-
vide a level of generalization and be applicable to a ences the flow of activation between chunks. Looking
range of specific cases. For example, the ‘Get next item back to Figure 19.8, there will be an association
from group’ production rule can be used to get any strength between item ‘5’ on the list (the first number
item from a group. Similarly the ‘Type out the item’ on the list) and a chunk that encodes that item, such as
production rule can be used to output any printable Chunk1. The strength of association between an item
character. Goals will be discussed in more depth in and a chunk depends on the total number of associa-
Section 4 on arithmetic skills. tions that the item has. An important assumption of
the ACT-R architecture is that activation is a limited
resource. If an item is only associated with one chunk,
3.3 List activation then this chunk receives the full associative strength of
the item and, therefore, the full effect of any activa-
As we discussed in the previous section, retrieval from tion. If the item is associated with three chunks, then
declarative memory is performed within the condi- the association strength is split three ways and less
tion part of the production rule. The success of this activation will flow to each individual chunk.
retrieval process for recall tasks is a function of the The limited capacity of association strength can be
activation level of the chunk that matches the condi- used to explain what is known as the fan effect
tion. The higher the activation level of the chunk, the (Anderson, 1974). The fan effect is the empirically
more easily – and faster – it can be retrieved. observed finding that the greater the number of facts
CHAPTER 19 COGNITIVE MODELLING AND COGNITIVE ARCHITECTURES 623
related to some concept that a subject has to memorize, latency. The weaker the activation, the slower the
the slower the subject will be to recall any one of them. recall process will be.
For example, imagine you are asked to memorize three However, retrieval is not always ‘all or nothing’. It is
facts about a pretend person called Fred – that he is six possible to select a chunk that only partially matches
feet tall, has a beard, and works in a hospital. Your the item sought in the condition part of the produc-
recall will be slower for the fact that Fred is six feet tall tion rule. This process, called partial matching, hap-
because you have been asked to remember other facts pens if, for example, the partially matching chunk has
about him. If you had been asked to remember just this a high level of activation and a fully matching chunk is
one fact about Fred, your recall would be quicker. either absent or below the activation threshold. Partial
Although the fan effect can be explained in terms of matching is also important in modelling certain
spreading activation, the mechanism within ACT-R is empirically observed effects. Positional confusions,
precise and restricted – activation only spreads to the where the participant recalls a correct item but in the
immediate neighbours in the network. However, wrong position, are common in list recall data.
spreading activation is assumed to encompass a wider (Positional confusions are also discussed in Section
region of neurons (or units) than just the immediate 4.1 of Chapter 9, where they are referred to as transpo-
neighbours of the activation source. sition errors.) For example, in the case of List1, a par-
The same interpretation for the fan effect also ticipant might recall the number 4 in the seventh
applies to list memory. In Section 3.1 it was shown position rather than the eighth. Once again, equations
that each chunk encoding either a group or an indi- in ACT-R determine the likelihood of positional con-
vidual item in a list has an association to the list itself, fusion. Items are more likely to be confused if they
in that case, List1. The association strength for List1 appear in the same group, and if they appear in adja-
has to be shared out among all the associated chunks. cent positions in the same group. ACT-R uses this
The more chunks that are associated with List1 (either mechanism to successfully model the positional con-
due to a smaller group size or larger list size), the more fusions exhibited by human participants.
thinly the association activation has to be spread
between the chunks, making it increasingly difficult to
(quickly) retrieve any of the associated chunks. 3.4 Running the model
Limited association strength therefore offers an
account of how list size affects the recall of items from We have just covered three important features of ACT-
a list. The larger the list, the smaller the percentage of R. First, we have seen how lists can be represented in
items successfully recalled. This is also one of the rea- declarative memory. Second, we have seen how pro-
sons why the group size is optimally set to three rather duction rules can be used to retrieve items from mem-
than two, as this reduces the number of associations ory. Third, we have seen how ACT-R employs a model
with the list concept itself, without overloading any of activation that influences recall accuracy and
particular group. latency. Now we will consider the running of the
In order for a chunk to be retrieved at all, its activa- ACT-R model of list memory to see how these features
tion (which is the sum of the base-level activation and work. Figure 19.13 shows the performance of the
the association activation) has to reach a certain level, ACT-R model on forward recall superimposed on the
specified in the ACT-R model. This pre-set level is empirical data presented in Figure 19.7.
called the activation threshold. A chunk that falls The results for recall accuracy from the empirical
below the activation threshold is unavailable for study and the running of the ACT-R model are very
retrieval by the production rules. The activation level similar (Figure 19.13, left). Both show a primacy
therefore affects recall success. An equation in ACT-R effect, having the highest recall for the first three ele-
also specifies the relationship between activation and ments. Both also show a recency effect for the last item
624 PART 6 CHALLENGES, THEMES, AND ISSUES
Proportion correct
1 Human performance
Latency (seconds)
2.5
0.9 2 ACT-R simulation
0.8 1.5
0.7 1
Human performance
0.6 0.5
ACT-R simulation
0.5 0
1 2 3 4 5 6 7 8 9 1 2 3 4 5 6 7 8 9
Input positon Input positon
FIGU RE 19.13 A comparison of ACT-R simulation and human performance on accuracy and latency in forward recall.
in the nine-element list. The simulation closely mir- been used to model data from forward recall, back-
rors the findings but certain parameters had to be set ward recall, and also free recall, but in each case the
within the ACT-R model in order to fit the results so model needs to be customized in certain ways to fit
closely. This included the parameter that affects the the data.
likelihood of a positional confusion. The issue of set- Certain parameters need to be set, particularly
ting parameters in ACT-R and its implications for the those relating to the activation settings of ACT-R
validity of the model is considered in Section 3.5. within the model. For example, parameters affecting
When examining latency (Figure 19.13, right), data the likelihood that an item will be recalled and the
from the empirical study show spikes at intervals of time delay involved in accessing a new chunk vary
three items that are mirrored in the ACT-R model. In across the different versions of the model. Anderson
ACT-R, when a production rule is retrieving the next et al. (1998) admit this variation and offer explana-
item from a list it takes longer if that item is from the tions, but it is clearly an area of concern requiring fur-
next group rather than from the same group. If the ther work. If such variation is required to explain
next item is from the same group then the production different list memory experiments, which use a heav-
rule just needs to increment the counter in the current ily restricted and artificial task, to what extent can
group and retrieve the item. If the next item is from ACT-R hope to provide a unified theory of cognition?
the next group then production rules have to be used However, ACT-R does impose certain architectural
to retrieve the next group and then retrieve the first constraints, limiting how the model can work. These
item of that group. So, these data support the assump- include the procedural–declarative distinction and
tion that items in declarative memory are grouped, the use of chunks to group items in declarative mem-
and that groupings of three tend to be used for list ory. However, these constraints still allow for some
recall experiments. flexibility when modelling empirical data. Decisions
on how to deal with this flexibility are called auxiliary
assumptions. An auxiliary assumption is made on a
case by case basis to deal with the peculiarities of a
Evaluation of the ACT-R
3.5
particular experiment. How the rehearsal of previ-
approach to modelling ously presented items in a list occurs and how this
competes with attention to the presentation of the
memory remaining items in the list is an example of an auxil-
iary assumption. These can be contrasted with archi-
ACT-R has been used to develop versions of a model tectural assumptions. An architectural assumption
that can explain a range of empirical data related to list (such as the procedural–declarative distinction)
memory. The versions, however, are not identical in makes a general claim as to the nature of human cog-
every way. The overall model described above has nition, and is consistent across all cognitive models
CHAPTER 19 COGNITIVE MODELLING AND COGNITIVE ARCHITECTURES 625
developed using the architecture. If an architectural There is ongoing debate as to whether ACT-R (and
assumption of ACT-R made it impossible to model other cognitive architectures) sufficiently constrain
certain empirical data, then this would suggest that the modelling process. However, one advantage of
the assumption does not reflect a general feature of ACT-R and other cognitive architectures is that at
human cognition, and that the architectural assump- least all assumptions are made explicit, allowing such
tion should be rejected or at least modified. debates to occur.
SUMMARY OF SECTION 3
• Chunks are used to organize items in declarative memory into groups.
• Chunks have slots and values and are used to encode both groups and individual items.
• Chunks have an activation level comprising base-level activation and association strength.
• ACT-R is used to model the accuracy and latency of forward and backward recall, as well as other list
memory experiments.
• Model fitting is used to match the ACT-R model to the empirical results.
• Any model makes associated architectural and auxiliary assumptions that jointly specify the model
and how it works.
answer 7 An answer 7.
==> Then
FIGU RE 19.15 A specific production rule produced from the dependency goal chunk shown in Figure 19.14.
CHAPTER 19 COGNITIVE MODELLING AND COGNITIVE ARCHITECTURES 627
items in the rule by variables. The heuristic used by focusing on too small a part of the problem. Now let’s
ACT-R is that if the same item appears in two or more look at how this can be extended to learn a more real-
places within the rule then these should be replaced by istic skill, addition by counting. In looking at this, we
a variable. For example, in Figure 19.15, the item ‘3’ are turning the clock back a bit from the examples we
appears in two places. It appears as the first number in have shown before, to the point where we have a child
the goal, and as addend1 in the addition fact. who does not yet know that ‘3 + 4 is 7’. In ACT-R
Production compilation would replace these with a terms, there is no addition-fact for ‘3 + 4 = 7’ in
variable. This means that the items in first-number declarative memory.
and addend1 would have to be the same, but not nec- This introduces a whole new issue: how do children
essarily ‘3’. A similar transformation would happen to learn these addition facts? One possibility is that they
the two occurrences of ‘4’ and the two occurrences of are simply learned by rote – children recite them often
‘7’. This would in effect produce a rule that said: enough that they become chunks in declarative mem-
ory directly. However, there is a second possibility:
If the goal is to find the answer to X + Y and there is
that they are developed through a procedure. Basically,
an addition fact X + Y = Z then the answer is Z.
given the problem: ‘What do you get if you add 3 and
The rule that emerges from this process would work 4?’, a child starts from ‘3’ and adds ‘1’ to it four times.
just as well for ‘2 + 2 is 4’ and ‘5 + 2 is 7’ as it does for The result is, of course, ‘7’. Siegler (1988) provides an
‘3 + 4 is 7’. The newly made rule, created by generaliz- account of how children use this counting strategy
ing the rule shown in Figure 19.15, is the one we saw when learning arithmetic.
earlier in Box 19.1. So, ACT-R does not have to be The full ACT-R model for this would be a bit hard
programmed to deal with every eventuality; it can to read and to understand, so let’s look at a formatted
learn new rules to deal with new examples. version of it (Box 19.3). Above each rule is a plain
Of course, generalizing a rule like this may not English description of what it does.
always work properly. Although the new rule has These rules may look clumsy but they are enough to
become part of procedural memory, its use depends model children working out the answer to problems
on its activation. If the rule works, it will gain activa- like ‘3 + 4 is 7’, as if by counting on their fingers. Let’s
tion and will become an active player in problem-solv- look at how these rules work in a little more detail.
ing actions. On the other hand, if it doesn’t work it will First of all, the rules ‘Add-numbers’ and ‘Sub-goal-
gradually lose activation and become less significant, counting’ work together. Basically, if the child already
until it is eventually forgotten. knows the answer (for example, the answer is a chunk
Overall, therefore, production compilation trans- in declarative memory, as an addition fact, for exam-
forms a specific ‘lesson learned’ represented as a ple) then the child can just say it (that’s what ‘Add-
dependency goal chunk into a general ‘lesson learned’ numbers’ does). On the other hand, if the child does
represented as a production rule in procedural not know the answer, they have to begin to work it out.
memory. The three rules ‘Start-count’, ‘Add1-count’, and ‘Stop-
count’ all work together, once counting is started by
the rule ‘Sub-goal-counting’. ‘Start-count’ starts the
counting process, then ‘Add1-count’ is used once for
An example of human
4.2
each step, and ‘Stop-count’ stops it when it is com-
problem-solving behaviour: plete. Then the rule ‘Found-sum’ retrieves the answer
from the counting process. Finally, there is a rule ‘Say’
addition by counting that is used when the child says the answer to the
problem. Table 19.1 shows how a model might trace
This gives you a pretty good idea of how a single step through these various rules in practice, given the
in problem solving can be learned, but perhaps this is question ‘What is the answer to 3 + 4?’
628 PART 6 CHALLENGES, THEMES, AND ISSUES
BOX 19.3 Production rules for addition by counting (based on Anderson and Lebiere, 1998)
This is the rule from Box 19.1 again. It can answer Add1-count
any addition problem for which it can access the IF goal is to add 1 to N1, N2 times
appropriate fact from declarative memory. and New N1 is 1 more than N1
and New N2 is 1 less than N2
Add-numbers
THEN change goal to add 1 to New N1, New N2
IF goal is to answer a question about the sum of
times
N1 and N2 and can retrieve as a fact the sum of
This stops the counting process when no more ‘1′s
N1 and N2
need to be added. For example, ‘Add 1 to 7, 0
THEN replace current goal with one to say the
times’.
sum
If Retrieve-sum cannot fire (the sum cannot be Stop-count
retrieved) because the addition fact is not in declar- IF goal is to add 1 to a number, zero times
ative memory, then this rule will create a sub-goal THEN mark goal as completed
to calculate the answer by counting. This retrieves the answer from the counting
process.
Sub-goal-counting
IF goal is to answer a question about the sum of Found-sum
N1 and N2 IF goal is to find the sum of N1 and N2 and can
THEN create sub-goal to calculate the sum of N1 retrieve the calculated sum of N1 and N2
and N2 THEN mark goal as completed
and create sub-goal to say the sum This prints the answer on the computer screen.
If the goal is to calculate the answer by counting,
then this rule turns the goal ‘Add X to Y’ into the Say
goal ‘Add 1 to X, Y times’. IF goal is to say N
THEN output N to the screen
Start-count and mark current goal as completed
IF goal is to calculate the sum of N1 and N2
THEN create sub-goal to add 1 to N1, N2 times
This can add 1 to the number and create a new goal.
For example, ‘Add 1 to 4, 3 times’ can lead to the
goal ‘Add 1 to 5, 2 times’.
However, if the same question is put again immedi- here, where the answer is retrieved directly after only
ately, you might get a completely different behaviour one trial, is a bit unrealistic – in practice one might
from ACT-R (as shown in Table 19.2). want ACT-R to go through the process many times
In practice, this general procedure can work out lots before the new chunk can be retrieved reliably.
of addition facts, given the ability to count up from Of course, this is not necessarily the only way that
one. Over time, this means that chunks corresponding children learn these arithmetic facts. Although some
to these addition facts will be stored in declarative children do seem to use this process (Siegler, 1988),
memory, and the more they are used (in other, more others may learn them by rote. Modelling can help to
complex arithmetic problems, for example) the more reveal the implications of these strategies in a way that
they gain activation as chunks in their own right, and makes it easier to design experiments and use other
the rules may be used less and less. The example shown techniques to study them in more detail. This leads to
CHAPTER 19 COGNITIVE MODELLING AND COGNITIVE ARCHITECTURES 629
TAB LE 19.1 ACT-R ‘trace’ for ‘What is the answer to Learning in an everyday
4.3
3 + 4?’ (first time around)
context: the development of
ACT-R trace Explanation
mobile phone texting skills
Cycle 0: Sub-goal- Create a sub-goal to find the
counting answer to three plus four by
counting The need to model a more gradual retrieval of new
Cycle 1: Start-count Set the goal to add one to three, chunks, and therefore a more gradual increase in
four times speed of performance, can be seen in an ACT-R model
Cycle 2: Add1-count Add one to three to make four and of the development of texting proficiency. Das and
change the goal to add one to four, Stuerzlinger (2007, 2008) developed ACT-R models to
three times
simulate how proficiency in texting with a mobile
Cycle 3: Add1-count Add one to four to make five and
phone gradually increases over many hours of prac-
change the goal to add one to five,
two times tice. Understanding the longer-term use of different
Cycle 4: Add1-count Add one to five to make six and mobile phone keypads is of interest to researchers and
change the goal to add one to six, also product designers. However, investigating this
one time empirically is extremely difficult for a number of rea-
Cycle 5: Add1-count Add one to six to make seven and sons. First, particularly in some parts of the world,
change the goal to add one to
seven, zero times finding novices with no prior experience of texting is
Cycle 6: Stop-count Goal is add one, zero times, becoming increasingly difficult. Second, longitudinal
therefore the counting goal is studies of the development of texting and other skills
completed are logistically hard, requiring the same participants
Cycle 7: Found-sum Calculated answer has been to attend a number of sessions over an extended
retrieved
period of time. For example, an empirical study of dif-
Cycle 8: Say Output the answer to the screen
ferent computer keyboards required 20 sessions each
‘seven’ The outputted answer is seven
of 45 minutes (MacKenzie and Zhang, 1999). Third,
those participating in longitudinal studies of texting
one of the more interesting features of cognitive report boredom or fatigue (Butts and Cockburn,
models – they correspond more to individuals than to 2002), which can be expected to affect the results.
populations, and for this reason we sometimes need to Fourth, it may be difficult to determine how the results
be careful when comparing a model’s predictions with of an experiment translate to a slightly modified key-
statistical results from an experiment. In the case of the pad design and repeating the experiment for each new
addition by counting example we have just looked at, phone would be close to impossible.
we can study differences between individuals in prob- This had led researchers to investigate how ACT-R
lem solving by looking at the differences between the could be used to simulate how users become more
rules that represent their problem-solving strategies. proficient at texting. This would allow predictions to
be made for new keypad designs. Feedback from the
simulation could inform rapid improvements to the
TAB LE 19. 2 ACT-R ‘trace’ for ‘What is the answer to design without the costs or time delays demanded by
3 + 4?’ (second time around) a longitudinal study. A similar approach could be
potentially used to simulate the long-term use of other
ACT-R trace Explanation
devices such as a car dashboard.
Cycle 9: Retrieve-sum Retrieve the answer to three plus The model of texting that Das and Stuerzlinger
four
(2007, 2008) developed made use of the visual and
Cycle 10: Say Output the answer to the screen
motor components of ACT-R. The model therefore
‘seven’ The outputted answer is seven
encompassed not only cognitive processes involved in
630 PART 6 CHALLENGES, THEMES, AND ISSUES
ACTIVIT Y 19.4
Why do you think ACT-R uses a different process declarative memory, and has a relatively high activa-
to give the answer second time around? tion. This means that second time around, the rule
‘Add-numbers’ can pick up the answer directly.
COM M ENT
The second time ACT-R runs, the chunk that records
the answer to ‘3 + 4 is 7’ has already been stored in
texting but also perception of the environment and module. These represented individual movements such
interaction with the keyboard. as moving to a key and pressing it once, and pressing
To inform the model of interacting with the key- again on a key that the thumb is already positioned
board some informal sessions were run with novice over. The ACT-R motor module could estimate timings
users in order to determine how a mobile phone is for each of these actions. Similarly, the vision module
typically operated during texting. This led them to represents the user’s view of the phone and incorporates
devise a layout similar to that shown in Figure 19.16. procedures representing, for example, how to locate a
When a right-handed person was operating a phone, particular letter on the keypad.
they would tend to start with their thumb on the start Based on previous empirical evidence, learning and
position, move their thumb to the relevant key, press it therefore speedier performance is modelled as a grad-
the required number of times, then move their thumb ual shift over time from locating where letters are on
to the recoil position before moving onto the next key. the keypad during texting to remembering their posi-
Inexperienced users in particular tended to move tion. The expert’s reduced need to visually scan the
their thumb to the recoil position between key loca- keyboard for letters accounts for their increased speed.
tions in order not to obstruct their view of the key- A similar effect can be found in the use of a QWERTY
board when searching for letters. keyboard by touch typists.
Production rules representing different thumb This trend in performance is modelled in ACT-R in
movements were then specified using the ACT-R motor a way that is similar to the addition example in the
previous section. The user has the goal of locating a
particular letter on the keypad. If the location is
Start accessed from memory, then the user can proceed to
position
press the key. If not, then the user has to scan the key-
pad to locate the correct key. This is essentially the
Recoil same ACT-R process by which a child will solve an
1 2 abc 3 def position
addition sum by counting if the answer cannot be
accessed from memory.
4 ghi 5 jkl 6 mno
In order to model a more gradual retrieval of new
chunks than found in the addition example, an equa-
7 pqrs 8 tuv 9 wxyz tion was added to the ACT-R model to slowly vary the
activation level of the new chunk. This varies the acti-
0 # vation level (and therefore probability of successful
*
[
knowing the location of a letter. The trend in perfor- instructions of how to perform the process. An ACT-R
mance found with the ACT-R model closely mirrored account of this form of learning appears highly satis-
previous empirical data. The ACT-R model could also factory. Performance gradually becoming faster, less
potentially be modified in order to predict learning error prone, and more automatic can be explained as
trends in different task contexts and with new keypad being due to production compilation.
layouts for which there is no existing empirical data. However, other forms of human learning are harder
This research is still ongoing, though ACT-R model- to explain, as learning may not always be character-
ling would seem to hold promise as a technique to be ized as a gradual increase in performance through
used as part of the product development process for experience. For example, children’s learning of the
mobile phones and other new devices. past tense verbs in English doesn’t quite follow this
pattern (Bowerman, 1982). Initially children are very
good at forming the past tense correctly. However,
over time, and as they learn more words, their perfor-
Models of learning and
4.4
mance deteriorates, and they start tending to use the
problem solving in practice regular verb rule ‘add –ed’ even when they shouldn’t,
saying, for example, ‘breaked’ rather than ‘broke’. Of
In the previous three sections we have seen two com- course, over time, they overcome this problem, and
plementary parts of the ACTR approach to learning. the accuracy goes up again – forming a kind of
In Section 4.1 we considered how the ACT-R produc- ‘U-shaped’ pattern.
tion compilation process can be used to create general This pattern can be interpreted as being due to a
rules from dependency goal chunks. In Section 4.2 we progression through three ways of performing the task
described how production rules, in this case a model during learning. At first, each problem to be solved
of a counting procedure, can be used to create new (e.g. each past tense verb to be constructed) is dealt
facts in the form of chunks in declarative memory. In with uniquely. The high degree of regularity (e.g. the
Section 4.3 we saw how the gradual retrieval of new large number of past tense words that can be created by
chunks can be modelled and how learning may inter- just adding ‘ed’) is not reflected in the cognitive mecha-
act with visual and motor systems. So to what extent nism used to generate past tense verbs. Later, a single
does ACT-R provide a general explanation of how mechanism is used to solve an (overly) wide range of
humans learn? cases. The child now starts to use ‘breaked’ rather than
Learning is modelled by ACT-R as an incremental ‘broke’. Finally, exceptions are correctly handled and
process through which new knowledge is acquired the child starts to say ‘broke’ once again.
declaratively, and performance gradually becomes A similar U-shaped pattern of performance over
faster and less error prone though practice. Such an time has been found in children’s ability to solve cer-
account of learning would seem to accurately reflect tain mathematical puzzles (Richards and Siegler,
how, for example, someone learns to change gears in a 1981) and in students’ radiological diagnoses (Lesgold
manual car. The instructor initially gives verbal instruc- et al., 1988). Lesgold et al. found that students roughly
tions (i.e. a declarative account) on how to change three or four years into a course perform worse than
gears. Initial attempts by the learner to change gear are more experienced professionals, but also worse than
slow, deliberate, error prone, and rely heavily on the they did the previous year. In terms of performance, it
declarative account. Months later the same person will appears that sometimes a skill has to be acquired, lost,
be able to swiftly move through the gears, rarely mak- and then regained. Human learning therefore may be
ing errors, and will no longer be using the declarative more complex than ACT-R might suggest.
632 PART 6 CHALLENGES, THEMES, AND ISSUES
SUMMARY OF SECTION 4
• Complex behaviour can be modelled using production rules, which contain a condition (IF part) and
an action (THEN part).
• ACT-R has a production compilation mechanism for learning new production rules from instructions
and examples.
• Learning can also involve the creation of new declarative chunks from production rules.
• Learning and problem solving behaviour in ACT-R, as driven by the production rules, is influenced by
levels of activation.
• ACT-R tends to characterize learning as an incremental process through which performance gradu-
ally becomes faster and less error prone. Human learning does not always follow this pattern.
5A COMPARISON OF ACT-R
AND PDP
In the past few sections we have described the ACT-R does. This over-generalization is corrected in the PDP
cognitive architecture. Here we will compare ACT-R network through training (see Section 1.1), where the
as an example of a rule-based cognitive architecture network receives feedback as to the correct answer.
against the PDP cognitive architecture overviewed at Rumelhart and McClelland’s two-layer model was
the beginning of the chapter. relatively simple – it depended on this forced increase
Children’s learning of past tense verbs in English is in vocabulary. Plunkett and Marchman (1991) used a
a good point for comparison, as it has been modelled three-layer network instead, and found that adding a
using both PDP models and rule-based models like hidden layer produced a similar ‘U-shaped’ pattern
ACT-R. The central question is: what is happening to without needing to increase the vocabulary dramati-
cause the ‘U-shaped’ pattern effect? One possibility is cally at one point in the learning process. They still
that there is an area of memory that functions like a needed a gradual increase in vocabulary to get the
PDP network and that can generalize as it learns from right pattern, however (Plunkett and Marchman,
examples. Rumelhart and McClelland proposed a 1996).
model like this for learning past tenses. In contrast, Taatgen and Anderson (2002) set out to
In Rumelhart and McClelland’s model, the changes model past tense learning using ACT-R, where there
in accuracy are caused by the child learning more new are two parts of memory involved: declarative mem-
verbs. When there are only a few words, a network can ory and procedural memory. They suggested that chil-
fit in all the words by simply making strong links dren initially learn past tenses as declarative chunks,
between individual input and output units. Each past and then through a process of production compilation
tense verb is therefore dealt with uniquely. There (see Section 4.1) form a slightly unreliable production
comes a point when this won’t work – when there are rule to generate past tenses. Over time, they develop a
more words than available units – and then the net- blocking mechanism that stops the rule from being
work needs to build a more generalized association. used when there is an exception stored in declarative
For a short time the model over-generalizes, as a child memory. The dip in performance is caused by the
CHAPTER 19 COGNITIVE MODELLING AND COGNITIVE ARCHITECTURES 633
unreliability of the production rule when initially con- production rule fires at any one time. The parallel pro-
structed. cessing of the network is mimicked in ACT-R by the
Both the PDP and ACT-R models correspond, more activation equations that simultaneously update the
or less, to the observed behaviour, but the underlying activation of elements in declarative memory.
explanations differ in a few subtle ways. For example, A final important difference between ACT-R and
the PDP model depends on feedback. However, there PDP concerns the kinds of cognitive phenomena that
is a problem with this explanation because children they most successfully explain. Sub-symbolic cognitive
aren’t always given feedback, and even when children architectures such as PDP models, although able to
are corrected, they still tend to use the over-general- emulate rules, are generally stronger at explaining
ized regular verb rule. Conversely, the dip in perfor- automatic processes (e.g. face recognition). Symbolic
mance of the ACT-R model is due to the unreliability cognitive architectures such as ACT-R are stronger at
of the production rule when first formed. This unreli- modelling consciously controlled processes such as
ability is responsible for cases of over-generalization, problem solving.
but feedback is not required in order to correct this As we have seen, ACT-R incorporates some fea-
over-generalization. Taatgen and Anderson (2002) cite tures of the PDP approach. However, to what extent is
evidence that children also pick up correct past tenses it possible (or desirable?) to build a rule-based system
from listening to others, largely without receiving feed- fully integrated with a PDP architecture?
back on their own performance. This was attempted by Lebiere and Anderson (1993)
The PDP and ACT-R models make different theo- in the design of ACT-RN, in which aspects of the
retical claims. The PDP model has the assumption that ACT-R architecture, such as chunks and the goal mod-
there is one area of memory, and change is driven by ule, were implemented using a PDP network. Although
change in acquired vocabulary. The ACT-R model has successful to a degree, many features of ACT-R were
the assumption that there are two areas of memory difficult to model using PDP. This finding led them to
(declarative and procedural), and change is driven by actually remove many of these features from ACT-R,
practice. In principle, these differences can be tested, on the grounds that they were not neurologically plau-
and experiments used to gather empirical evidence on sible. For example, ACT-R used to allow a slot in a
the matter. chunk to have a long list of items as its value. This can-
To sum up, the key difference between rule-based not be done in the current version of ACT-R and lists
architectures, such as ACT-R, and the PDP approach is must be represented as described in Section 3.1. The
the nature of the representation used in the model. PDP experiment with ACT-RN also led to PDP-like features
models, being closer to Marr’s hardware level, are being incorporated into ACT-R itself. Partial match-
described as having a sub-symbolic representation. Sub- ing, as introduced in Section 3.3, is one such example.
symbolic models do not contain any explicit representa- There is therefore reasonable justification to refer to
tions of symbols, such as production rules. Instead, they ACT-R as a hybrid architecture that shows both PDP
construct a sub-symbolic neural-like representation that and rule-based characteristics.
can help support and explain a symbolic account of cog- However, it is still unclear to what extent it is pos-
nition. Conversely, rule-based systems explicitly use sible to completely integrate symbolic and sub-sym-
symbolic representations, such as the ‘breaked’ and bolic architectures. And even if it is possible, it may
‘broke’, that might be found in the declarative chunks not always be desirable. The models will necessarily be
and production rules we have seen in this chapter. far more complex, and may inherit the weaknesses
In terms of their operation, PDP models, as their rather than the strengths of the symbolic and sub-
full name suggests, work in parallel, with signals being symbolic approaches. This is one of the reasons why
passed simultaneously throughout the network of the current version of ACT-R has features motivated
artificial neurons. Symbolic cognitive architectures by PDP, such as activation, but does not encompass all
tend to be serial in operation. In ACT-R only a single features of PDP within it.
634 PART 6 CHALLENGES, THEMES, AND ISSUES
SUMMARY OF SECTION 5
• Rule-based architectures such as ACT-R provide a symbolic account of human cognition, operate in
a largely serial way, and are particularly strong at modelling consciously controlled processes such as
problem solving.
• PDP architectures provide a sub-symbolic account of human cognition, operate in parallel, and are
particularly strong at explaining automatic processes such as face recognition.
• Attempts to completely integrate symbolic and sub-symbolic architectures have had limited success,
but there appear to be advantages in the translation of certain coarse-grained features from one
architecture to the other.
motivating factor in the development of cognitive it along, there are limits to what it can tell you about
architectures was to logically separate the cognitive how a car actually works. Both PDP and symbolic
model from the workings of the computer. The fea- models have made simplifying assumptions about the
tures of ACT-R available to the modeller, such as pro- nature of the brain, but an increasing attention to
cedural and declarative memory, chunks, production brain imaging is starting to make testable claims about
rules, and production compilation, are the mecha- how parts of the brain work together to achieve cogni-
nisms by which the model produces its behaviour. tion, and these are increasingly important to cognitive
Each of these features can be debated and compared modelling as a method (Anderson et al., 2004).
against the psychological literature. This clear distinc- Despite its increasing maturity, cognitive modelling
tion between the model and its computer implemen- still lacks a clear method for how models should be
tation has been one of the great successes of work into evaluated. However, the above criteria can be used to
cognitive architectures. provide a broad evaluation of any cognitive model,
Our third criterion is parsimony. The law of parsi- whether it is a rule-based or a PDP model.
mony or Ockham’s Razor states that an explanation of Other work in the area of model evaluation has
a phenomenon should not contain any unnecessary aimed to devise and follow an ambitious set of criteria
detail. Specifically, and in relation to cognitive model- against which individual cognitive models and the
ling, a model should contain only the minimum num- progression of the cognitive modelling field as a whole
ber of components and so should not contain can be tracked. Anderson and Lebiere (2003) elabo-
components that do not impact on the behaviour of the rate Newell’s (1990) 12 criteria for assessing the qual-
model. Therefore, any component of a model has to ity of a model, which they call the Newell Test. These
provide explanatory significance that justifies the addi- are shown in Box 19.4.
tional complexity that it also brings. Ockham’s Razor Anderson and Lebiere (2003) gave ACT-R a grade
can also be used to criticize the careful fitting of a model for each point and, based on these criteria, there are
to the empirical data, as this can increase the complex- some areas where ACT-R is strong. It is pretty good at
ity of the model for little gain. exhibiting rational behaviour, at coping with error,
Finally, the biological plausibility of a model is learning, and at modelling real-time behaviour. But
important. To come back to the car analogy, if some- there are other areas where ACT-R is weaker, such as
thing looks like a car and moves from A to B on in using natural language, exhibiting self-awareness,
wheels, but you know there is a person inside pushing and being realizable within the brain.
BOX 19.4 METHODS Constraints on a human cognitive architecture (after Anderson and
Lebiere, 2003)
A successful model should: 6 Integrate diverse knowledge
However, these criteria should not only be used to models that would cope with many tasks rather than just
highlight the strengths and weaknesses of cognitive one or two, would help the science of cognitive psychol-
architectures such as ACT-R and PDP, but also to show ogy to progress more effectively. In many senses, Newell’s
how researchers working with different architectures article laid the foundations for cognitive architectures
can learn from each other. Anderson and Lebiere like ACT-R and Newell’s own Soar architecture (Newell,
claimed that the Newell Test could lead PDP research- 1990). And the move to using cognitive models in con-
ers to incorporate ideas from ACT-R, similar to the junction with empirical studies and the development of
way ACT-R has over recent years incorporated ideas cognitive theory to help connect diverse elements of
from PDP. These criteria and the cognitive architec- cognitive psychology is set to continue.
tures they evaluate can therefore help to provide an As a set of points, though, Newell’s list of criteria is
overarching account. helpful simply because it is so extensive. It shows just
As mentioned in Section 1.3, Newell (1973) argued how far there is to travel before cognitive models are
that at that time cognitive psychology was asking lots of capable of explaining cognitive behaviour in an inte-
small questions, and progressing through small steps, grated manner. But we should not leave models on
but that the big picture was disjointed because there was this note, as this issue and the list of criteria apply to
little in the way of an overarching framework to glue the all cognitive psychological theories, not just the kinds
work together. He argued that a move to complete theo- of model exemplified by ACT-R. ACT-R may still have
ries and models rather than partial ones, to complex a long way to go, but it is one of the best approaches
composite tasks rather than narrow focused ones, and to available.
SUMMARY OF SECTION 6
• It is possible to set out many criteria to help judge the usefulness of a model.
• ACT-R performs reasonably well across the board, although it shows weaknesses in the areas of
natural language, self-awareness, and biological plausibility.
• Models can be useful independently of the quality of their empirical predictions, in that they allow a
community of researchers to be brought together to share ideas.
7 CONCLUSIONS
The advent of computers was central to the founda- mation of these symbolic representations in order to
tions of cognitive psychology. They provided both a perform tasks (e.g. actions performed by production
new set of concepts that could be used to understand rules).
human behaviour and a new method that could be The ACT-R cognitive architecture can be used
used to study it. Symbolic cognitive architectures such successfully to model a wide range of psychological
as ACT-R, however, are offering something more pre- phenomena such as recall effects in list memory and
cise than computer metaphors of the human mind. the development of skills in arithmetic and mobile
Rather, they assume that the working of the mind is phone texting. Each model makes use of, and
essentially the symbolic representation of knowledge provides a test of, the same underlying modelling
(e.g. in the form of chunks) and the use and transfor- constructs.
CHAPTER 19 COGNITIVE MODELLING AND COGNITIVE ARCHITECTURES 637
Symbolic cognitive architectures are emulated on a elling that aims to combine the benefits of symbolic
computer but can be thought of as distinct from the and sub-symbolic approaches.
workings of the computer itself. The PDP cognitive Cognitive modelling involves not only building
architecture is also emulated on a computer, but here models but also evaluating them and the cognitive
the assumption is that cognitive functions can be con- architectures that have been used to build them. A
structed from artificial neural elements having some number of evaluation criteria have been proposed,
similar properties to the human brain. The progres- encompassing issues such as the fit between the model
sive development of ACT-R, and the incorporation of and both human performance and psychological the-
PDP-like properties into the ACT-R architecture, ory, its parsimony, and its biological plausibility.
highlights a trend towards a hybrid approach to mod-
FURTHER READING
Anderson, J.R. and Lebiere, C. (1998) The Atomic Components of in this chapter and ranks ACT-R against them. The paper is fol-
Thought, Mahwah, NJ, Lawrence Erlbaum Associates. ACT-R has lowed by an extensive commentary from a number of researchers
changed a little since this book was written, but it provides a good in the field.
introduction to ACT-R and a selection of models that can be built Anderson, J.R., Bothell, D., Byrne, M., Douglass, S., Lebiere,
using ACT-R, covering topics such as learning, memory, arithme- C., and Qin, Y. (2004) ‘An integrated theory of the mind’,
tic, and analogy. Psychological Review, vol.111, pp.1036–60. This paper explains
Anderson, J.R. and Lebiere, C. (2003) ‘The Newell Test for the updated ACT-R architecture as used in this chapter and illus-
a theory of mind’, Behavioural and Brain Sciences, vol.26, trates its use through some example models.
pp.587–640. This paper describes Newell’s 12 criteria as outlined
REFERENCES
Anderson, J.R. (1974) ‘Retrieval of prepositional information Bowerman, M. (1982) ‘Reorganizational processes in lexi-
from long-term memory’, Cognitive Psychology, vol.6, cal and syntactic development’, in Wanner, E. and Gleitman,
pp.451–74. L.R. (eds.) Language Acquisition, The State of the Art,
Anderson, J.R. (1990) The Adaptive Character of Thought, Cambridge, Cambridge University Press.
Hillsdale, NJ, Lawrence Erlbaum. Butts, L. and Cockburn, A. (2002) ‘An evaluation of mobile
Anderson, J.R. and Bower, G.H. (1973) Human Associative phone text input methods’, Australian Computer Science
Memory, Washington, Winston and Sons. Communications, 24, 55–9.
Anderson, J.R. and Lebiere, C. (1998) The Atomic Chase, W.G. and Simon, H.A. (1973) ‘Perception in chess’,
Components of Thought, Mahwah, NJ, Lawrence Erlbaum Cognitive Psychology, vol.4, pp.55–81.
Associates. Das, A. and Stuerzlinger, W. (2007) ‘A cognitive simulation
Anderson, J.R. and Lebiere, C. (2003) ‘The Newell Test for model for novice text entry on cell phone keypads’, in
a theory of mind’, Behavioural and Brain Sciences, vol.26, Proceedings of the European Conference on Cognitive
pp.587–640. Ergonomics: ECCE 2007, London, UK.
Anderson, J.R., Bothell, D., Byrne, M., Douglass, S., Lebiere, Das, A. and Stuerzlinger, W. (2008) ‘Modeling learning
C., and Qin, Y. (2004) ‘An integrated theory of the mind’, effects in mobile texting’, in Proceedings of the International
Psychological Review, vol.111, pp.1036–60. Conference on Mobile and Ubiquitous Multimedia: MUM
Anderson, J.R., Bothell, D., Lebiere, C., and Matessa, M. 2008, Umea, Sweden.
(1998) ‘An integrated theory of list memory’, Journal of Hitch, G.J., Burgess, N., Towse, J.N., and Culpin, V. (1996)
Memory and Language, vol.38, pp.341–80. ‘Temporal grouping effects in immediate recall: a working
Baddeley, A. (1986) Working Memory, Oxford, Clarendon memory analysis’, Quarterly Journal of Experimental
Press. Psychology, vol.694, pp.116–39.
638 PART 6 CHALLENGES, THEMES, AND ISSUES
Lebiere, C. and Anderson, J.R. (1993) ‘A connectionist Plunkett, K. and Marchman, V. (1996) ‘Learning from a
implementation of the ACT-R production system’, in connectionist model of the acquisition of the English past
Proceedings of the Fifteenth Annual Meeting of the Cognitive tense’, Cognition, vol.61, no.3, pp.299–308.
Science Society, Hillsdale, NJ, Erlbaum. Prince, A. and Smolensky, P. (1997) ‘Optimality: from neu-
Lesgold, A., Rubinson, H., Feltovich, P., Glaser, R., Klopfer, ral networks to universal grammar’, Science, vol.275, no.14,
D., and Wang, Y. (1988) ‘Expertise in a complex skill: diagnos- pp.1604–10.
ing X-ray pictures’, in Chi, M.T.H., Glaser, R., and Farr, M.J. Rabinowitz, M. and Goldberg, N. (1995) ‘Evaluating the
(eds.) The Nature of Expertise, Hillsdale, NJ, Erlbaum. structure-process hypothesis’, in Weinert, F.E. and Schneider,
MacKenzie, I.S. and Zhang, S.X. (1999) ‘The design and evalu- W. (eds.) Memory Performance and Competencies: Issues in
ation of a high-performance soft keyboard’, ACM Conference on Growth and Development, Hillsdale, NJ, Lawrence Erlbaum.
Human Factors in Computing Systems (CHI ‘99), New York, Richards, D.D. and Siegler, R.S. (1981) ‘U-shaped curves:
ACM. it’s not whether you’re right or wrong, it’s why’, in Strauss, S.
Marr, D. (1982) Vision: A Computational Investigation into and Stavy, R. (eds.) U-shaped Behavioural Growth, New York,
the Human Representation and Processing of Visual Academic Press.
Information, New York, W.H. Freeman. Roberts, S. and Pashler, H. (2000) ‘How persuasive is a
Newell, A. (1973) ‘You can’t play 20 questions with Nature good fit? A comment on theory testing’, Psychological Review,
and win: projective comments on the papers of this symposium’, vol.107, pp.358–67.
in Chase, W.G. (ed.) Visual Information Processing, pp.283–308, Rumelhart, D.E. and McClelland, J.L. (eds.) (1986) Parallel-
New York, Academic Press. Distributed Processing: Explorations in the Microstructure of
Newell, A. (1990) Unified Theories of Cognition, Cambridge, Cognition, Vol.1, Cambridge, MA, MIT Press.
MA, Harvard University Press. Siegler, R.S. (1988) ‘Strategy choice procedures and the
Norman, D.A. (1981) ‘Categorization of action slips’, development of multiplication skill’, Journal of Experimental
Psychological Review, vol.88, pp.1–15. Psychology: General, vol.117, pp.258–75.
Pitt, M.A. and Myung, I.J. (2002) ‘When a good fit can be Taatgen, N.A. and Anderson, J.R. (2002) ‘Why do children
bad’, Trends in Cognitive Science, vol.6, pp.421–5. learn to say “broke”? A model of learning the past tense with-
Plunkett, K. and Marchman, V. (1991) ‘U-shaped learning out feedback’, Cognition, vol.86, no.2, pp.123–55.
and frequency effects in a multilayered perceptron: implica- Trafton, J.G., Altmann, E.M., and Ratwani, R.M. (2011) ‘A
tions for child language acquisition’, Cognition, vol.38, no.1, memory for goals model of sequence errors’, Cognitive Systems
pp.43–102. Research, vol.12, pp.134–43.
THEOR E TIC AL
I S S U E S IN
COG NITIVE
P SYCHOLOGY
Tony Stone and Martin Davies
1 INTRODUCTION
In the preceding chapters you have met a wide variety in Activity 20.1). The Bruce and Young (1986) model of
of theories of our cognitive capacities. In addition to face recognition discussed in Chapter 4, for example,
debates over competing theories of specific capacities contains a component labelled face recognition units
(e.g. of visual perception, autobiographical memory, or (FRUs): these are stored mental representations of the
reasoning), cognitive psychology has seen debates that faces with which you are familiar. Similarly, models of
range more widely across the different areas of cogni- spoken word recognition (Chapter 6) make use of the
tion. These concern the key concepts and explanatory notion of a mental lexicon – this can be thought of as a
strategies that are used in modelling cognition. This store that contains mental representations of all the
chapter introduces you to some of these debates. Before words that you know and representations of various
reading on, try Activity 20.1. properties of those words (e.g. their meanings). In the
In doing Activity 20.1 you may have noticed that study of memory, there are thought to be mental repre-
nearly all the cognitive theories discussed in this book sentations of the episodes in one’s life (in episodic
make use of the notion of mental representation (in memory) and of the ‘know how’ that one has (in proce-
addition to the notion of mental processing mentioned dural memory). In each of these examples, the idea is
640 PART 6 CHALLENGES, THEMES, AND ISSUES
ACTIVIT Y 20.1
Look through the notes relating to theories or mod- (Chapter 6), you might note that there are two routes
els of cognition that you have made on previous for the pronunciation of written words. One route
chapters and try to identify themes and concepts involves assembling the phonological representation of
that recur. the word using spelling-sound rules (also called the
‘rule-based’ route in Chapter 6), and the other route
COM M ENT
links the written form of the word with a stored repre-
You might start by simply making a list of all the theo-
sentation of its correct pronunciation (also called the
ries or models that have been discussed in the previous
‘lexical’ route in Chapter 6). You might then investigate
chapters and then look for similarities and differences
the extent to which other cognitive models involve
between them. If you look, for example, at the dual-
these two distinct kinds of mental processing.
route cascaded (DRC) model of word recognition
that there is something internal to the mind that connections between the FRUs and the person iden-
encodes information about the external world and tity nodes (PINs) with activation flowing from an
about one’s experiences, past, present, or future. active FRU to the associated PIN.
A fundamental principle of contemporary cogni- The idea that cognition can be understood in terms
tive psychology is that cognition involves the storage of the rule-guided transformation of mental represen-
and processing of information and that this informa- tations is at the heart of the computational model of
tion processing is achieved by the processing or trans- the mind that has been dominant throughout most of
formation of structured mental representations. There the history of cognitive psychology. The first theoreti-
are two basic kinds of processing in evidence in con- cal debate that we shall examine, in Section 2, con-
temporary cognitive models. Sometimes representa- cerns whether human information processing involves
tions are transformed by rules. For example, in Marr’s rules and representations to the extent proposed by
model of the early stages of visual processing (see many of the cognitive models you have studied.
Chapter 3) we find the successive transformation of A further thing you may have noticed when doing
mental representations by a kind of rule called an Activity 20.1, though you might have thought it too
algorithm. Thus, the grey level description is trans- obvious to mention, is that there are different models
formed into the raw primal sketch by an algorithm for different cognitive capacities. Thus, there are sepa-
that compares images that have been blurred to differ- rate models for spoken word recognition and visual
ent degrees. Similarly, in the DRC model of word word recognition (Chapter 6), for object recognition
reading, the pronunciation of non-words such as and face recognition (Chapter 4), for episodic mem-
SLINT ‘requires the postulation of a system of rules . . . ory and autobiographical memory (Chapters 8 and
loosely referred to as the letter-sound rule system’ 17), and for speech comprehension and production
(Coltheart et al., 1993, p.590). On other occasions (Chapters 6 and 7). This is not just a matter of practi-
information processing is conceptualized as the trans- cal convenience reflecting the specialized interests of
mission of activation from one representation or different cognitive psychologists. Rather, it reflects the
group of representations to others. Whilst this kind of idea that the mind itself is composed of relatively
information processing is particularly characteristic independent, special-purpose systems that carry out
of connectionist models of cognition (see Chapter specific information-processing tasks – that is, the
19), it is also found in more traditional models. In the idea that the mind is modular. Section 3 of this chap-
Bruce and Young model of face recognition, there are ter is devoted to debates about modularity.
CHAPTER 20 THEORETICAL ISSUES IN COGNITIVE PSYCHOLOGY 641
Debates on these two themes – rules and represen- work). To take just one example from many, the
tations and the modularity of the mind – have been study of people with prosopagnosia (a specific ina-
central to recent theoretical work, but there are other bility to recognize once-familiar faces) has provided
important questions that have also been subject to important evidence for the development of the Bruce
intense discussion. For instance, it is one of the and Young model of face recognition. This interac-
attractions claimed for many connectionist models tion between the study of normal and disordered
that they are more brain-like than traditional models. cognition raises searching theoretical questions. For
Yet it is noticeable that, in most of the preceding example, how exactly are inferences about normal
chapters, less is said about the way in which the vari- cognitive processes made from cases of impaired
ous models of cognitive functioning are actually cognitive functioning? These questions are taken up
implemented in the brain. It may seem that there is in Section 4.
only a poorly understood connection between, on The importance of neuropsychological evidence
the one hand, cognitive modelling and theories (Chapter 13) and the rapid development of neuroim-
about cognitive processes and, on the other hand, the aging techniques (Chapter 14) both highlight the need
actual study of the physical brain. Nonetheless, much for a clear account to be given of the relationship
of the most compelling data for cognitive models between the kinds of models discussed in this book
over the past 35 years or so has come from the study and the study of the brain. Will cognitive psychology
of people who suffer from various kinds of cognitive ultimately reduce to – or will it perhaps be replaced
impairment resulting from brain injury (Ellis and by – neuroscience? These issues will be the topic of
Young, 1998, give a textbook introduction to this Section 5.
SUMMARY OF SECTION 1
• A fundamental principle of contemporary cognitive psychology is that cognition involves the process-
ing of structured mental representations.
• Two kinds of processing are in evidence in cognitive models: rule-guided processing and the transmis-
sion of activation.
• Cognitive modelling reflects the idea that the mind is composed of modular systems.
• Inferences are made from neuropsychological case studies to models of normal cognitive functioning.
• There is a need to clarify the relationship between cognitive models and neurobiological models of
the brain.
2COMPUTATION AND
COGNITION
One question that might occur to you as you near the the aims of science is to try to find general theories for
end of this book is whether there is a general theory of seemingly disparate phenomena. One proposal for
the mind (or of mental functioning) that can be dis- such a general theory has been influential throughout
tilled from the preceding chapters. After all, one of the history of cognitive psychology – indeed, it was
642 PART 6 CHALLENGES, THEMES, AND ISSUES
present at its inception. This is the view that the mind that we can then test by measurement. For example,
V
is a computational device; that cognition is computa- we can deduce from I = that IR = V, and then we
R
tion. can measure current and resistance, compute the
numerical product (I × R), and see if the result
matches what we find when we measure voltage (V).
But the electrical circuit itself does not need to do the
2.1The computational model same computation. Ohm’s law accurately describes the
of the mind behaviour of electrical circuits, but computation
guided by this law is not part of the causal story of why
We have already met the basic notions that lie behind an electrical circuit behaves in the way it does. The
this approach in discussing Activity 20.1 – it is the electrical circuit itself does not contain representations
approach that sees cognition as the rule-guided trans- of the current, voltage, and resistance, or a representa-
formation of structured mental representations. We tion of the law that describes their relationship.
refer to this idea as the computational model of the It is essential to the CMM that cognition is compu-
mind (CMM). tation in the sense that it involves the rule-guided pro-
An excellent example of this idea in action is the cessing of structured mental representations. For
DRC model of word reading (Coltheart et al., 1993, processing to be guided by a rule, the rule must be part
2001) that you met in Chapter 6, and that was men- of the causal story of how the processing takes place.
tioned in Section 1. This model proposes that there is Why is this approach called the computational
an assembled phonology route where the pronuncia- model of the mind? The reason is that the digital
tion of regular words and non-words is computed via computer is an example of a physical device that can
spelling-sound rules. The pronunciation of the non- process information by transforming symbols via a
word SLINT, for instance, is arrived at through the program – a set of rules stored in memory. Thus, the
application of the rules that S is pronounced /s/, L is thought lying at the root of the computational view is
pronounced /l/, I is pronounced /i/, and so on. It is that the brain (a physical device) processes informa-
important to be clear that these spelling-sound rules tion in the way that a computer does, in so far as
are not thought merely to be summary descriptions of human information processing involves transforma-
the ways in which English regular words and non- tion of mental representations and this transforma-
words happen to be pronounced, but are meant to be tion is guided by rules (akin to the computer
part of the causal story of how people produce pronun- program). It is important to recognize that this is a
ciations of regular words and non-words of English. model of the mind. Models aim to capture what is
(Strictly speaking, familiar regular words will generally fundamental to the thing being modelled – just as a
be pronounced via the lexical route, but they can also geographical map (another kind of representation)
be pronounced via these spelling-sound rules.) attempts to capture what is fundamental to the ter-
Let us compare the causal role played by spelling- rain being mapped. So the CMM only aims to capture
sound rules in generating the pronunciations of words those aspects of the mind that are thought to be fun-
and non-words (according to the DRC model) with damental to information processing. Thus, the fact
the role played by a rule that merely describes the that a computer is made of silicon, wires, metal, and
operation of a system. Consider, for example, Ohm’s plastic (the computer hardware), whereas human
law (this example is taken from Gallistel, 2001). Ohm’s information processors are made of flesh and blood
V
law states that in any electrical circuit, I = (where (our hardware or, perhaps better, wetware), is not an
R
‘I’ represents current, ‘V’ represents voltage, and ‘R’ objection to the CMM, because those aspects of a
represents resistance). The symbols ‘I’, ‘V’, and ‘R’ refer computer are not part of the model (and reasonably
to measurable properties of an electrical circuit, and so given that the aim is to model the human mind,
we can manipulate the symbols and make predictions not human tissue).
CHAPTER 20 THEORETICAL ISSUES IN COGNITIVE PSYCHOLOGY 643
But, you might wonder, shouldn’t a model of the and the units in the next layer (the units that are receiv-
mind at least try to model that part of the human ing activation). Through a process of adjusting the
body – the brain – wherein mental processing occurs? strengths of connections – the weights on the connec-
Shouldn’t we model the physical networks of neurons tions – such models are trained to associate patterns of
and the transmission of physical electro-chemical sig- activation across units in the input layer with patterns
nals that actually implement information processing? It of activation across units in the output layer.
is a key aspect of the CMM that it does not try to model Patterns of activation in the input and output lay-
those neural processes as such. It does aim to provide a ers are the network’s input and output representa-
model of the brain, but at a level that is more abstract tions. For example, written words of English might
than the physical level. The CMM models ‘the mind as be represented by patterns of activation in the input
the software of the brain’ (Block, 1995). It is a matter of layer and the output patterns of activation that the
debate, of course, whether this degree of abstraction, model is trained to produce might represent the pro-
this failure to model the brain’s physical processes as nunciations of those words. Networks of this kind
such, is really a virtue, rather than a vice, of the CMM.1 have been developed as competitors to the DRC
model of reading English words aloud (Seidenberg
and McClelland, 1989; Plaut et al., 1996). In the
2.2 Connectionist modelling development of a connectionist model of reading
aloud, the modeller has to decide how written words
We turn now to the first of the theoretical debates that (made up of letters) will be represented by patterns
we want to consider in this chapter – connectionist of activation across the input layer. Will the repre-
objections to the CMM. Connectionism (also known sentation of a word be made up of representations of
as ‘parallel distributed processing’ (‘PDP’) and ‘neural letters? If so, will individual letters be represented by
network modelling’) is a style of psychological theo- activation of single units, or by patterns of activation
rizing and model building that re-emerged in the across several units? How will the order of the letters
middle of the 1980s, and has become massively influ- in a word be represented, so that BAT and TAB have
ential in cognitive psychology since then. distinct representations? Similar decisions have to be
Though there are many types of connectionist model, made about how pronunciations (made up of pho-
typically a model will be a network composed of three nemes) will be represented by patterns of activation
layers of artificial neurons or units – an input layer and across the output layer.
an output layer with a layer of hidden units sandwiched A key aspect of connectionist models is that they
between (Chapter 19). There are multiple connections can learn to associate patterns of input activation with
between adjacent layers, and these connections trans- patterns of output activation; they are not pro-
mit activation from input units to hidden units, and grammed in advance with an algorithm or rule that
from the hidden units to output units. The level of acti- specifies what pattern should be associated with what.
vation passed from units in one layer to units in the (There are various learning procedures, of which the
next layer is a function of the activation of the units in most important is back-propagation of error. We need
the first layer (the units that are passing on activation) not go into the details here but see Chapter 19.)
and the strength of the connections between these units At their most radical, connectionist modellers say
that they aim to model human cognition in ways that
1 It might be thought that the CMM must be wrong because we dispense with rule-guided mental processing. For
are conscious and computers are not. But this would be too quick. instance, McClelland and Patterson say that, in the
The CMM is a model and does not have to capture all aspects of connectionist approach to the psychology of language,
human psychology. Perhaps a different model could deal with
‘cognitive processes are seen as graded, probabilistic,
consciousness. However, it would be an objection to the CMM if
failing to model consciousness meant that it thereby failed to interactive, context-sensitive and domain-general. . . .
model cognition – a claim made by John Searle (e.g. 1992). Characterizations of performance as “rule-governed”
644 PART 6 CHALLENGES, THEMES, AND ISSUES
are viewed as approximate descriptions of patterns of the English language) that do not follow this + ED pat-
language use: no actual rules operate in the processing tern. These verbs form their past tense in seemingly
of language’ (McClelland and Patterson, 2002b, p.465). irregular fashions. Thus the past tense of the verb TO
Connectionism thus attacks a fundamental aspect GO is WENT (not GO + ED) and the past tense of the
of the CMM. It claims that mental processing is typi- verb TO BUY is BOUGHT (not BUY + ED).
cally not rule-guided. One way to model how people form the past tense has
been developed by Steven Pinker and his colleagues
(e.g. Pinker and Ullman, 2002a and b; Ullman et al.,
1997). This model – the words and rules model – ‘claims
The past-tense debate:
2.3
that the regular-irregular distinction is an epiphenome-
connectionism versus the non of the design of the human language faculty’ (Pinker
and Ullman, 2002a, p.456). In outline, the model posits
CMM that two separate structures within the language faculty
are responsible for the formation of the past tense: the
We are going to present the connectionist challenge to lexicon and the grammar. When a past tense is to be
rule-guided mental processing by considering the formed, both the lexicon and the grammar are accessed
so-called past-tense debate. First, we set the scene for in parallel. Verbs that have an irregular past tense will
the challenge by describing an approach that does access the appropriate form in the lexicon. Verbs that
conform to the CMM. have the regular past tense will access no past tense form
in the lexicon, and the grammar component of the lan-
2.3.1 The words and rules model guage faculty will therefore add the regular + ED ending
The past-tense debate concerns how we should best or inflection. (This is, then, a dual-route model analo-
understand the ability, possessed by all competent gous to the DRC model of reading aloud, with which
speakers of English, to form the past tense of English you are familiar.) Given that the lexicon and the gram-
verbs. (The debate has also been concerned with how mar are accessed in parallel, the model posits an inhibi-
children develop the ability to form the past tense, but tory signal from the lexicon to the grammar. Whenever
we leave such developmental questions to one side in an irregular past tense (e.g. BOUGHT) is accessed in the
this chapter.) This example is not as complex as some lexicon, this inhibitory signal then blocks the parallel
of the models and tasks you have met in this book, but rule-guided formation of an incorrect regular form
it has been the subject of considerable debate, and the (e.g. BUY + ED).
apparent simplicity of the phenomena being modelled This model (see Figure 20.1) has been coupled with
allows one of the fundamental divides between the a hypothesis that draws on the distinction between
CMM and connectionism to be clearly seen. declarative and procedural memory (Chapters 8 and
Consider, then, the problem of how a competent 19). It has been proposed (Ullman, 2001; Pinker and
speaker of English puts a verb into the past tense. The Ullman, 2002a) that the lexicon is part of declarative
past tense of the overwhelming majority of English memory and is subserved by temporal and temporo-
verbs takes the form VERB STEM + PAST TENSE parietal regions of the neocortex, and that the gram-
MORPHEME. Thus the past tense of the verb TO mar component is part of procedural memory and is
HUNT is HUNT + ED (HUNTED), the past tense of subserved by the basal ganglia and the areas of frontal
the verb TO STROLL is STROLL + ED (STROLLED), cortex to which they project. This proposal links the
the past tense of the verb TO JUMP is JUMP + ED words and rules model with neural structures that are
(JUMPED), and so on. (Note that, although the written known, from independent evidence, to be involved in
form of the past tense morpheme is the same in these language processing. Moreover, independently of the
examples, its phonology does vary.) However, there is a debate about the past tense, declarative memory is
minority of verbs (around 180 of the most common in thought to be responsible for the retention of facts,
CHAPTER 20 THEORETICAL ISSUES IN COGNITIVE PSYCHOLOGY 645
Lexicon Grammar
V suffix
X
walk -edpast
X suffix
V V
hold heldpast
V V
heldpast V suffix
walk -edpast
Form of
computation: lookup, association combination, unification
Principal
substrate: temporo-parietal cortex frontal cortex, basal ganglia
FIGU RE 20.1 A simplified illustration of the words and rules theory and the declarative/procedural hypothesis.
When a word must be inflected, the lexicon and grammar are accessed in parallel. If an inflected form for a verb (V)
exists in memory, as with irregulars (e.g. held), it will be retrieved; a signal indicating a match blocks the operation of
the grammatical suffixation process via an inhibitory link from lexicon to grammar, preventing the generation of holded.
If no inflected form is matched, the grammatical processor concatenates the appropriate suffix with the stem,
generating a regular form. Source: Pinker and Ullman, 2002a, Figure 1, p.457
and procedural memory responsible for the learning processing. How can this be achieved for the past
and control of motor skills, including skills that tense? The first connectionist model of past-tense for-
require sequencing. The thought, then, is that reten- mation was developed by Rumelhart and McClelland
tion of an irregular past tense is the retention of a fact, (1986). This was a pattern associator, a simple net-
whereas the construction of regular past tense forms work with just two layers of units (input and output
depends on retention of a procedure. units, but no hidden units) and one layer of connec-
tions. Patterns of activation across input units repre-
Connectionist modelling of the
2.3.2
sent verb stems; patterns of activation across output
past tense units represent past-tense forms. (These are represen-
Before reading on, try Activity 20.2. tations of the phonology, rather than the orthography
Connectionist models aim to account for cognitive (written form), of verbs and their past-tense forms.)
capacities without relying on rule-guided mental The network was trained to associate the correct
646 PART 6 CHALLENGES, THEMES, AND ISSUES
ACTIVIT Y 20.2
past-tense form to both regular and irregular English What Rumelhart and McClelland (and other con-
verbs. Yet it did this with just a single route. All verbs, nectionist modellers) have shown, at least, is that
both regular and irregular, were processed via the there is an alternative to dual-route, ‘words and rules’
same set of weighted connections from input units to style models. But does the single-route connectionist
output units. This appears to show that connectionist alternative provide a better account of the available
models are capable, in principle, of accounting for data than the dual-route words and rules model?
what looks like rule-guided behaviour in a way that McClelland and Patterson (2002a) argue that con-
does not require the use of a rule! nectionist models do provide a better fit with the
Rumelhart and McClelland’s model learned to associ- data. They argue that the English past tense is a
ate the appropriate past-tense form with each verb stem quasi-regular domain: in all but a few cases, past-
by relying on the statistical regularities contained in the tense forms that do not conform to the regular rule
training data. No rule was programmed into the model, still display aspects of the regular pattern. Thus,
and the trained model did not learn the task by repre- McClelland and Patterson point out, the vast major-
senting and storing its own rule, such as ‘add -ED to ity of English verbs with a so-called irregular past-
regulars’. How then does the model perform the task? tense form fall into one of nine groups, each of which
Understanding this – and the same goes for any con- exhibits aspects of the regular past tense. For
nectionist model – requires exploring in detail the acti- instance, there is a group of verbs, including SAY,
vations of units and the weights on connections in the DO, TELL, and FLEE, whose past tenses are SAID,
trained network. It should not be assumed, for instance, DID, TOLD, and FLED. Verbs in this cluster form
that the Rumelhart and McClelland model forms the the past tense by adding the /d/ sound as in the regu-
past tense of all verbs in the way that the words and rules lar past tense but with a vowel adjustment to the
model forms the past tense of irregular verbs. It should stem. Another group, including BRING, CATCH,
not be assumed, that is, that the correct past-tense form SEEK, TEACH, and THINK, form their past tenses
of every verb is stored in a kind of declarative memory by replacing the final consonant cluster with /t/ (the
and then addressed by the appropriate verb stem. sound of the regular past tense following an unvoiced
The Rumelhart and McClelland (1986) model consonant, as in JUMPED) and adjusting the middle
came in for some severe criticism from defenders of vowel to /O/ (sounds like ‘aw’); thus BROUGHT,
traditional rule-based theories (e.g. Pinker and CAUGHT, and so on.
Prince, 1988) but subsequent connectionist models McClelland and Patterson claim that this quasi-
have been able to meet some of those criticisms (e.g. regularity is not well explained by the words and
Plunkett and Marchman, 1993; but see Pinker, 2006). rules model, in which formation of irregular and
CHAPTER 20 THEORETICAL ISSUES IN COGNITIVE PSYCHOLOGY 647
processing in a network leads from patterns of activa- the implementation of the assembled phonology route
tion across units in the input layer to patterns of acti- in the DRC model of reading. Coltheart et al. (1993)
vation across units in the output layer. The input describe the model’s use of spelling-sound rules as
patterns may represent written words and the output follows:
patterns may represent pronunciations; or the input
patterns may represent verb stems and the output pat- When confronted with a letter string for translation, it
terns may represent past-tense forms. If the network [the model] seeks to apply the rules to the string from left
associates the correct pronunciations with written to right, starting with the longest possible rule that could
words or the correct past-tense forms with verb stems, accommodate that string. For the word chip it would
this is because the weights on the connections have start with four-letter rules, looking for a rule that maps
been adjusted (through a process of training such as the letters chip onto a single phoneme. No such rule will
back-propagation of error) to achieve this result. The be found in the rule base. So a rule corresponding to the
trained network’s knowledge of the task domain is first three letters chi is sought; none will be found. The
thus embodied in the weights on the connections search for a rule for the first two letters ch [ch → /t∫/
between units in adjacent layers. If the network’s (sounds like ‘ch’)] will, however, be successful.
knowledge is in the weights then there is no need to (Coltheart et al. 1993, p.601)
access that knowledge before it can be used. When
units in the input layer are activated, the activation is You will not find explicit letter-sound rules in a con-
immediately passed forward from layer to layer, nectionist model of reading aloud. But there is still a
through the weighted connections, and a pattern of sense in which rules can figure in the causal story of
activation across the output units is produced. As how a connectionist model works and not just as a
McClelland et al. put it: ‘Using knowledge in process- description of the network’s performance. We can
ing is no longer a matter of finding the relevant infor- introduce this sense by considering a ‘toy’ connection-
mation in memory and bringing it to bear; it is part ist network that takes representations of 25 written con-
and parcel of the processing itself ’ (1986, p.32). sonant–vowel pairs (built from five consonants and five
When we introduced the idea of rule-guided pro- vowels) and associates each of these with a representa-
cessing in the CMM, we said that rules are supposed tion of the corresponding pronunciation. For example,
to be part of the causal story of how a task is per- when given a representation of the written pair BA as
formed. For example, letter-sound rules are supposed input the network produces a representation of its pro-
to be part of the causal story of how the task of reading nunciation /bæ/ (sounds like ‘ba’ as in ‘bat’) as output.
words aloud is performed. We contrasted this with the The network is represented in Figure 20.2.
idea of rules as merely providing a summary descrip-
tion of patterns in the task domain. For example, it
10 output units
might be true of some domain of words that each
word that begins with the letter B has a pronunciation
that begins with the phoneme /b/. A successful model
of the reading aloud task will perform in a way that
10 hidden
conforms to this B → /b/ rule. But conformity to the units
rule does not tell us how the performance is actually
achieved – it does not tell us whether the rule is merely
descriptive or whether the rule is causal. B D F H K A E I O U
One possibility – in line with the CMM – is that the 10 input units
processing in the model is guided by explicit rules that FIGU RE 20. 2 A connectionist model with implicit
are stored in memory, and have to be accessed before letter-sound rules (not all connections are shown).
they can be used. An example of such a case is, again, Source: Based on Davies, 1995, Figure 3, p.181
CHAPTER 20 THEORETICAL ISSUES IN COGNITIVE PSYCHOLOGY 649
This network associates input representations with The point to take away from this discussion is not that
output representations in a way that conforms to the all connectionist models embody implicit rules in this
B → /b/ letter-sound rule. How does the network sense. There can certainly be networks whose perfor-
achieve this performance? Examine the network shown mance conforms to rules, even though the input-out-
in Figure 20.2 carefully. The input representation for a put transitions that conform to a particular rule do
consonant–vowel pair such as BA involves activation of not have a common causal explanation. When exam-
two units in the input layer (in this case, the consonant ining a connectionist model that performs a cognitive
unit that represents B and the vowel unit that represents task, it is often useful to ask whether the performance
A). Whenever a pair beginning with B is presented to is achieved by virtue of a structure of causal common
the system, the same input unit (representing B) is factors that are the implicit analogues of explicit rules.
activated and, because the network conforms to the If the network does not embody implicit rules, then
letter-sound rule, we know that the same output unit we need to try to discover how the model does com-
(representing the phoneme /b/) is activated. plete the task set for it.
Now, the important point to notice is that, whichever
of the five pairs beginning with B is being processed, the
causal explanation for the activation of the /b/ unit in 2.5Connectionism,
the output layer is exactly the same. Activation is passed
from the B unit to the leftmost hidden unit and on to
structure, and
the /b/ unit. So the five cases of conformity to the compositionality
B → /b/ letter-sound rule have a common causal expla-
nation. The explanation is grounded in a causal com- Connectionist modelling also challenges the style of
mon factor – the passing of activation along the mental representation that is characteristic of the
weighted connections from the B unit to the hidden CMM. This is a complex and (in parts) technical
unit and on to the /b/ unit. We could say that the debate and we will briefly discuss just one issue.
B → /b/ rule is implicit in the network. The same, of The CMM holds that the mental representations
course, goes for the nine other letter-sound rules that processed by rules have compositional structure and
capture the pronunciations of these consonant–vowel that this structure explains a fundamental property of
pairs. This notion of a rule being implicit in a process- our cognitive systems – their systematicity. This latter
ing system requires more than just conformity to the property can most easily be introduced by reference to
rule. It requires that all the transitions that conform to our linguistic abilities. Suppose I understand the sen-
the rule have a common causal explanation. But the tences ‘The dog bit the cat’ and ‘The cow jumped over
notion of a rule being implicit in a system does not the moon’. My understanding of these sentences is sys-
require that the rule is explicitly represented and stored tematic in that I need to learn nothing more in order
and then accessed when it is needed. to understand the additional sentences ‘The cow bit
Rules can figure in the causal story of how a con- the dog’ and ‘The cat jumped over the moon’. This sys-
nectionist model works because rules can be embod- tematic understanding is possible because sentences
ied implicitly in networks: are composed of words, and the same words, with the
Is there, within the system [network], a component same meanings, can be deployed in different sentences
mechanism, or processor, or module that operates as to express new thoughts. It is this compositional struc-
a causal common factor to mediate all the input- ture of sentences that makes systematic understand-
output transitions that instantiate the pattern ing of a language possible.
described by the rule? If so, then the rule is said to be Contrast this systematic understanding of our
implicit in the system (or the system is said to have native language with what might happen when some-
implicit or tacit knowledge of the rule). one learns a second language from a phrase book. It is
(Davies, 1995, p.162) perfectly possible for a monolingual English speaker
650 PART 6 CHALLENGES, THEMES, AND ISSUES
to learn to say the Romanian sentences ‘O sticle cu vin It is certainly possible for connectionist representa-
roşu’ and ‘Un caiine cu dinţ mici’ in appropriate cir- tions to be compositionally structured. The network
cumstances and yet be unable to combine the words in in Figure 20.2 represents the written consonant–vowel
these sentences in new ways to express appropriate pair BA by activation of two units in the input layer, a
new thoughts. Equally, an English speaker might learn consonant unit that represents B and a vowel unit that
to recognize and respond to utterances of those two represents A. The consonant–vowel pair DE is repre-
sentences without being able to understand any other sented by activation of a consonant unit that represents
sentences of Romanian. You could achieve systematic D and a vowel unit that represents E. Recombination
understanding – going beyond those two sentences to of the resources in these two representations allows
use and understand additional sentences constructed the network to represent the pairs BE and DA.
from the same words – only if you knew what each Compositional structure allows systematicity of rep-
word in the sentences meant and had some rudimen- resentation. In a similar way, a network might repre-
tary grasp of the grammar of the language (how the sent New York is dangerous by activation of a unit that
words are put together). Sentences of Romanian do, represents the city of New York and another unit that
of course, have compositional structure, just as sen- represents danger. The thought London is safe might
tences of English do. But knowledge of the meanings be represented by activation of a unit that represents
of a few phrases or sentences does not guarantee that the city of London and a unit that represents safety.
you will become attuned to this structure (indeed, Recombination of these representational resources
typically you will not). The CMM supposes, at least would allow the network to represent New York is safe
for the most part, that mental representations have or to represent London is dangerous. Once again, com-
compositional structure and that this structure is part positional structure explains systematicity, just as it
of the causal story of how cognitive processes take does according to the CMM.
place. Although connectionist modelling of cognitive
Connectionist modelling challenges this approach processes allows for the possibility of representations
to mental representation. It is claimed, for example, with compositional structure, it does not require com-
that connectionist models can explain the systematic- positionality. There might be no pattern of activation
ity of human cognition without appeal to mental rep- across units that is present in every representation of a
resentations with compositional structure (at least, consonant–vowel pair beginning with B. There might
in the sense of compositional structure used by be no pattern of activation that is shared by all of a
the CMM). network’s representations of thoughts about New
Consider a simple example – this time in the York. In a limiting case, each consonant–vowel pair, or
domain of thought, rather than language. It seems to each thought, might be represented by activation of a
be a fact about human thought that if I am able to distinct unit or pool of units.
think the thought New York is dangerous and to think It is at this point that the challenge to the CMM
the thought London is safe, then I can also think the becomes clear because, even without compositional
thought New York is safe and the thought London is structure, systematicity can, in a way, still be pre-
dangerous (systematicity again). The capacity to think served. The modeller just needs to make sure that, if
the first two thoughts seems to be intrinsically linked there is an input unit that represents BA and another
to the capacity to think the second two thoughts. The that represents DE, then there are two additional units
CMM explains the systematicity of thought by saying that represent BE and DA. If there are separate pools
that the mental representations that underpin think- of units that represent the thought New York is danger-
ing have compositional structure, just as the sentences ous and the thought London is safe then there need to
of a language have compositional structure. This is be two additional pools of units to represent the
the language of thought hypothesis (Fodor, 1975, 1987; thoughts New York is safe and London is dangerous. If
see also 2008). these conditions are met, then there can, indeed, be a
CHAPTER 20 THEORETICAL ISSUES IN COGNITIVE PSYCHOLOGY 651
kind of systematicity without compositional structure. the connectionist approach departs from the CMM, it
But does this approach promise an illuminating makes systematicity look like an accident. A modeller
account of the systematicity of language understand- who adds two separate pools of units to represent the
ing or the systematicity of thought? thoughts New York is safe and London is dangerous
An advocate of the CMM may argue that this con- could just as well – for all that connectionist represen-
nectionist way of delivering systematicity without tation requires – have added two separate pools of
compositional structure fails to capture the idea that units to represent the thoughts Life is short and Prunes
the capacity to think New York is dangerous and go well with custard. Connectionists are not without
London is safe is intrinsically linked to the capacity to reply, of course, but we shall not pursue the issue fur-
think New York is safe and London is dangerous. When ther here.
SUMMARY OF SECTION 2
• The computational model of the mind (CMM) is the view that cognition is computation.
• The CMM sees mental processing as involving the rule-guided transformation of structured mental
representations.
• Connectionist models are computational models that challenge the idea that mental processing is
rule-guided. In connectionist models the primary role is played by the transmission of activation.
• In the past-tense debate, the dual-route words and rules model illustrates the CMM approach.
Connectionist modellers have demonstrated that a single-route model can be trained to form the
past tense of regular and irregular verbs by transmission of activation.
• Connectionist models do not make use of explicit rules and a network’s knowledge of the task
domain is embodied in the weights on connections. Nevertheless, there is a sense in which rules can
figure in the causal story of how a connectionist model works.
• Connectionist models also challenge the need for mental representations to have compositional
structure.
3 MODUL ARIT Y
Modularity should have been near the top of the list of circuit for the lights, another for the sockets, and a
concepts and themes relating to theories or models of separate circuit for kitchen appliances.
cognition that you identified in Activity 20.1. But In cognitive psychology, it is important that we
exactly what is meant when a psychological system or apply this everyday notion of modular components
function is said to be modular? A notion of modular- at the appropriate level, the level of information pro-
ity is familiar from everyday life. Stereo systems and cessing. The brain has anatomical components, but
kitchens have modular components: a CD player con- we cannot simply assume that modular information-
nected to an amplifier and a pair of speakers; a 600 mm processing components map directly onto anatomical
drawer unit next to a 1200 mm cupboard unit. The components of the brain. Cognitive modules are dis-
electrical wiring in a home is also modular, with one tinguished from each other functionally; that is, not by
652 PART 6 CHALLENGES, THEMES, AND ISSUES
what they are neurally, but by what they do computa- Jerry Fodor (1983) has, however, provided us with a
tionally. more detailed – and more controversial – discussion
One aspect of the everyday notion of modularity is of modularity in his book The Modularity of Mind.
that modular components are somewhat independ- This will be the topic for the remainder of this section.
ent from each other. It is possible to upgrade or even
replace an amplifier, while continuing to use the
same CD player and speakers, or to replace the CD
player with a turntable. Similarly, in the kitchen, the
An outline of Fodor’s
3.1
cupboard unit can continue in use even if the drawer theory of modularity
unit is removed to make way for a dishwasher. When
there is an electrical problem in the home, one cir- According to Fodor’s account, the mind is divided
cuit may need its fuse replaced (or its circuit breaker into three different types of system: (1) sensory trans-
reset) while the other circuits continue to operate ducers; (2) modular input systems; and (3) non-mod-
normally. ular central systems (see Figure 20.3).
David Marr argued that, without modularity, com- The sensory transducers pick up physical stimuli
putational processes would be hard to debug or from the environment – photons hitting the retina,
upgrade and he proposed a principle of modular design sound waves causing the tympanic membrane to
for computational systems: ‘a large system can be split vibrate, etc. – and transform these stimuli into a for-
up and implemented as a collection of parts that are as mat or code that the brain can understand. In short,
nearly independent of one another as the overall task transducers produce internal representations in
allows’ (Marr, 1982, p.102). In a similar spirit, Tim response to stimuli from the external world. Recall
Shallice speaks of modules as ‘isolable subsystems’ that in Chapter 6 (Figure 6.1) you were provided
and endorses a definition of modularity proposed by with a picture of the waveform of a segment of
Endel Tulving, who suggested that two psychological speech. That picture is a representation of some of
systems are functionally different if the following con- the physical properties of the speech stream. The
ditions hold: sensory transducers have to transform those physical
properties into a format that the language-process-
One system can operate independently of the other
ing system can understand. Once external stimuli
although not necessarily as efficiently as it could with
the support of the other intact system. The operations
of one system could be enhanced without a similar Transducer 1 Transducer 2 Transducer M
have been internally represented, computation can intending the utterance to be interpreted metaphori-
begin. cally), and deciding how to respond to the utterance,
The modular input systems mediate between the are tasks for the non-modular central systems. The
sensory transducers and the central systems. They seventh property of modules – that there is only lim-
deliver, we might say, the perceptual experiences that ited central access to the mental representations that
provide a database of evidence for the processes of they compute – is the idea that the information at the
belief formation and decision making that are jobs for various intermediate stages of a module’s computation
the non-modular central systems. The non-modular is not generally available to central systems.
central systems also contain all the encyclopaedic Fodor does not say that a psychological system
knowledge one has stored in memory. In forming must possess all of the nine properties on the list if it is
beliefs and making decisions, the central systems will to be modular; indeed, he explicitly states that his con-
typically take account of evidence from perception cept of modularity is a cluster concept and that modu-
and also stored knowledge. larity admits of degrees. However, it is clear from
Fodor characterizes the modular input systems as Fodor’s other writings that some of these properties –
those that possess the following cluster of properties: in particular, domain specificity and especially infor-
mational encapsulation – are more important to his
• Mandatory operation
conceptualization of a modular input system than
• Fast speed of operation others (e.g. Fodor, 1985).
• Fixed neural architecture
3.1.1 Domain specificity
• Characteristic and specific patterns of breakdown
In The Modularity of Mind, Fodor’s main examples of
• Characteristic pace and sequencing of their
modular input systems are those responsible for visual
ontogeny
perception and for the recognition of spoken lan-
• Shallow outputs guage. The claim that these systems are domain specific
• Limited central access to the mental amounts to the idea that these input systems deal only
representations that modules compute with a limited, idiosyncratic range of stimuli. The lan-
• Domain specificity guage module, for example, only deals with linguistic
input. Thus it processes spoken language, but not
• Informational encapsulation
more general environmental sounds such as the sound
This list of nine properties clearly goes well beyond of a bell tolling. You should note that, because the lan-
the idea we introduced earlier of a module as a func- guage module can also process written language and
tionally somewhat independent component of a larger sign language, the modular input systems do not cor-
information-processing system. respond in a one-to-one way with the five senses.
The first five properties on the list are fairly straight- In cognitive psychology, it is domain specificity that
forward. When Fodor says (the sixth property) that is most often associated with claims about modularity,
the final outputs of modules, which are available to although the modules proposed are often more fine-
central systems, are ‘shallow’ (1983, p.86), he means grained than those discussed by Fodor. Cognitive psy-
that the interface between modular input systems and chologists have proposed, for instance, that the visual
central systems comes relatively early. For example, system includes three modular sub-systems that have
when you hear an utterance, the identity of the the specific jobs of processing faces, processing
words and the grammatical structure of the sentence objects, and processing written words (see Chapters 4
might be computed by a modular input system. But and 6). Moreover, in cognitive psychological models,
discerning the full significance of the utterance (work- modules can be nested within one another – for
ing out, for example, whether the speaker was asking a instance, the face-processing module might itself be
question or making a suggestion, being ironic, or broken down into sub-modules. Finer-grained
654 PART 6 CHALLENGES, THEMES, AND ISSUES
domain specificity and modules within modules can to penetrate the modular visual input system. The
be taken as wholly within the spirit of Fodor’s account. general point – well illustrated by visual illusions such
as the Ponzo illusion – is that the processing in a mod-
3.1.2 Informational encapsulation ular input system is not affected by information stored
Informational encapsulation is the property that is in the central systems.
non-negotiable for Fodor as regards whether a system In thinking about modules and the property of
is granted the status of a module. He describes the informational encapsulation, it is important to observe
informational encapsulation of input systems as ‘the that Fodor does not rule out top-down information
essence of their modularity’ (1983, p.71). We need, flow within a module. The top-down information flow
therefore, to be clear about what this property involves. that is excluded or restricted by informational encap-
The easiest way to do this is via an example. Look at sulation is the flow from central systems to modular
Figure 20.4. Do the two horizontal lines look the same input systems. The processing in a module does not
length? It would be surprising if they did. For most draw freely on all the information that is stored in the
viewers, the top horizontal line looks longer than the central systems. This point about informational
bottom one. The two lines are, in fact, of equal length encapsulation has been a source of some confusion
(measure them if you want to check). With this knowl- about Fodor’s views on modularity, so it is worth
edge in mind, look at the picture again. Do the two spending a little more time discussing it.
lines now look the same length? Once again, it would In The Modularity of Mind, Fodor considers an
be surprising if they did. You still see exactly what you objection to the idea that language comprehension is
did before. But, because you know that the two lines informationally encapsulated, an objection that stems
are really the same length, you don’t believe what you from our ability to select the relevant meaning of an
see. This is an example of informational encapsulation. ambiguous word when it occurs in an appropriate
You (now) have some knowledge – about the lines in context, such as ‘Because Bruce was running short of
the Ponzo illusion being the same length – but that cash, he went to the bank’. One possible explanation of
knowledge does not affect the processing that takes this ability is that contextually relevant knowledge
place within the visual-input system. The visual-input stored in the central systems influences processing in
system is, if you like, sealed off from that information the language-input system, specifically, the process of
or, as Fodor also describes it, visual perception is cog- lexical access. Thus, on the basis of your understand-
nitively impenetrable – thoughts and beliefs are unable ing of the early part of the sentence, your general
knowledge about financial matters ensures that only
the relevant meaning of the word BANK is accessed;
or, more accurately, that only one of the two words
spelled BANK is accessed in the lexicon.
Fodor draws on the results of Swinney (1979),
which you have already met in Chapter 6, to question
this account of contextual disambiguation. We will
return to Swinney later, but for now we focus on one
aspect of his findings. Swinney used a cross-modal
priming paradigm in which participants listened to
sentences, some of which contained an ambiguous
word such as BUGS. Immediately following this
word, a visual word (or non-word) was presented on
a screen and the participants’ task was simply to make
a lexical-decision response (‘Is this a word or not?’).
FIGU RE 20.4 The Ponzo illusion. In one condition, the ambiguous word BUGS was
CHAPTER 20 THEORETICAL ISSUES IN COGNITIVE PSYCHOLOGY 655
presented in the context of a sentence that did not contextual bias, and that the locus of contextual dis-
bias interpretation towards one or the other of the ambiguation is after lexical access.
word’s meanings. In this condition, recognition of Fodor suggests that Swinney’s findings can be
both the word ANT (semantically related to accounted for in terms of the organization of the
BUGS = insects) and the word SPY (semantically mental lexicon itself. Perhaps there are links between
related to BUGS = secret radio transmitters used in the lexical entries for semantically related words
espionage) was facilitated (by comparison with an such that presentation of a word leads to the trans-
unrelated word). This finding supports the hypothesis mission of activation to lexical entries for semanti-
that, when there is no contextual bias, both meanings cally related words. In the case of an ambiguous word
of BUGS (more accurately, both words with that (e.g. BUGS), there is transmission of activation to
spelling) are accessed. lexical entries for words related to both of its mean-
In a second condition, the heard sentence strongly ings (ANT and SPY). Since the lexicon is internal to
biased interpretation of the ambiguous word towards the language-input system, the semantic priming
one of its meanings rather than the other. Swinney effects would not provide evidence that information
found that, when BUGS was presented in the context from the central systems influences processing in the
of a sentence about insects, recognition of the word language-input system. As Fodor warns, ‘it makes a
ANT and the word SPY was once again facilitated. difference . . . where the information comes from’
This finding supports the hypothesis that, when BUGS (Fodor, 1983, p.80). If the information does not
is first presented, both meanings (more accurately, come from outside the module, it fails to be a coun-
both words with that spelling) are accessed despite the ter-example to encapsulation.
ACTIVIT Y 20. 3
yielded by your experiments (perhaps reaction times he says that confirmation of hypotheses in science
for a task of producing the past-tense form of a verb) is Quinean.
is the only kind of evidence that can be relevant. There If Fodor is right to propose that the confirmation of
is simply no way of putting a boundary around the hypotheses in science is a model for the formation of
kinds of evidence that may be relevant to the confir- beliefs in the central systems, then we should expect
mation or disconfirmation of a hypothesis. As Fodor that the operation of the central systems is isotropic
says of a closely related example: ‘Any facts about the and Quinean. An example illustrating what it means
use of language, or about how it is learned, or about for central system processes of belief formation to be
the neurology of speaker/hearers, or, for that matter, isotropic and Quinean is provided in Box 20.1. If the
about the weather on Mars, could, in principle, be rel- operation of the central systems is isotropic and
evant to the choice between competing linguistic the- Quinean then the central systems are not modular
ories’ (1981, p.199). This is what Fodor means when and, in particular, are not encapsulated. Processes of
he says that confirmation of hypotheses in science is belief formation need to have free access to anything
isotropic. (Fodor also points out (1983, pp.106–7) and everything that we know and believe.
that the processes of scientific discovery – the forma- This is Fodor’s argument from analogy, but is there
tion, rather than confirmation, of hypotheses and any direct empirical evidence that the central systems
theories – seem to depend on analogical reasoning are unencapsulated? Is scientific confirmation really a
and are even more clearly isotropic.) good model of ordinary belief formation? Unfortunately,
Saying that confirmation is Quinean is different according to Fodor, evidence on this is scanty ‘given the
from saying that confirmation is isotropic, even underdeveloped state of psychological theories of
though being isotropic may sound rather similar to thought and problem solving’ (Fodor, 1983, p.112).
being ‘sensitive to the entire belief system’. Suppose
that we have two competing empirical hypotheses, or Unencapsulated central systems
3.2.2
two competing theories, that fit all the relevant and the CMM
evidence equally well. Then we may still choose one As by his lights evidence is lacking, Fodor points to a
theory over the other because it provides a better difficulty in the development of theories of the central
explanation. One theory may have the explanatory systems that is ‘just the sort [of problem] we should
virtue of being simpler, or a better fit with the rest of expect to encounter if such processes are, in essential
science, or a less radical departure from previous respects, Quinean/isotropic rather than encapsulated’
theories (more conservative). In fact, whenever we (1983, p.112). It concerns the difficulties posed for
evaluate competing scientific theories, we consider artificial intelligence by the so-called frame problem.
the explanatoriness of the theories as well as their This is, very roughly, the problem of how to build a
probability given the available evidence. Fodor robot that can update its beliefs about the world as a
points out that, when theories are assessed for their result of the action it takes (Dennett, 1984). Consider,
explanatoriness, they are considered, not in isola- for example, a robot that is given the job of making a
tion, but against the background of the rest of sci- phone call to Mary:
ence. This is particularly clear in the case of the
explanatory virtue of offering a good fit with the rest Let’s assume the robot ‘knows’ it can get Mary’s num-
of science (offering good prospects for unification of ber by consulting the directory. So it looks up Mary’s
phenomena that are superficially disparate). But the number and proceeds to dial. So far, so good. But
same point holds for the explanatory virtues of sim- now, notice that commencing to dial has all sorts of
plicity and conservativeness as well. Thus, the choice direct and indirect effects on the state of the world
between competing hypotheses, or competing theo- (including, of course, the internal state of the robot),
ries, depends on ‘the shape of our whole science’ and some of these effects are ones the device needs to
(Fodor, 1983, p.105). This is what Fodor means when keep in mind for the guidance of its future actions
658 PART 6 CHALLENGES, THEMES, AND ISSUES
Suppose that you overhear a man in a dark suit utter international tensions? Which team of scientists is
an isolated sentence in which the word BUGS to be trusted? Which universities are they from, and
occurs. Perhaps he is talking about insects, or per- how good is the research there? So university
haps about secret radio transmitters. Suppose that, research rankings are relevant as well. And so on,
for some reason, it is crucial that you should reach without end. If you really need to know whether it
the correct belief as to whether the man is talking is more likely that the dark-suited man was talking
about insects or espionage. Then, anything and about insects or about espionage, there is no good
everything that you know might be relevant. way of putting a boundary around the potentially
First, any piece of evidence might turn out to be relevant considerations and ignoring the rest of
relevant. Does the man look as if he works for a what you know. Belief formation is isotropic.
pest control company, or does he look as if he might Second, the overall shape of your entire body of
be working for (or against) an intelligence agency? knowledge is important as well. Which hypothesis
Was there something in the newspaper about an would fit better with what you already know and
invasion of insect pests, or about a spy cell being believe? How much revision to your other beliefs
active? What about that report on the web about would be needed if you were to adopt the belief that
an interdisciplinary team of astronomers and biolo- the man was talking about insects because there is an
gists who claimed to have discovered a correlation – infestation of ants, or if you were to believe that he was
as yet unexplained – between the weather on Mars talking about espionage because there are secret radio
and the reproduction of ants? If there is a correla- transmitters everywhere? Which hypothesis would,
tion, then the weather on Mars is relevant, just as perhaps after some initial upheaval in your other beliefs,
Fodor said. But what about that other team who allow the simpler and more coherent total world view?
said they had discovered a different correlation Belief formation is Quinean; it is ‘sensitive to global
between the weather on Mars and increased properties of belief systems’ (Fodor, 1983, p.111).
and expectations. For example, when the dialing We, of course, do this everyday updating effortlessly.
commences, the phone ceases to be free to outside But, at least on Fodor’s reading of the literature, AI
calls; the robot’s fingers (or whatever) undergo appro- researchers have found building a device that can do it
priate alterations of spatial location; the dial tone intractable.
cuts off and gets replaced by beeps; . . . and so forth. It may be possible for AI researchers to solve or
Some (but, in principle, not all) such consequences sidestep the frame problem, either by adopting ambi-
are ones the robot must be designed to monitor since tions more modest than building a robot with human
they are relevant to ‘updating’ beliefs upon which it intelligence, or by abandoning the computational par-
may come to act. Well, which consequences? adigm that is the basis of the CMM. But Fodor regards
(Fodor, 1983, p.113) the frame problem in AI as illustrating a much more
ACTIVIT Y 20.4
Reconsider Chapters 10 and 12 on problem solving undermine Fodor’s views on the central systems? Is
and on reasoning. Is there any evidence provided he right that psychological theories of thought and
in those chapters that would either support or problem solving are underdeveloped?
CHAPTER 20 THEORETICAL ISSUES IN COGNITIVE PSYCHOLOGY 659
general problem about the processes of updating or input system has delivered its output; the locus
revising beliefs. The problem arises if the processes of top-down influence is post-perceptual. This
involve updating in the light of the consequences of response would fit well with the sixth property of
one’s own actions (as in the example of the robot mak- modules, namely that their final outputs are shallow.
ing a phone call). But it also arises if the updating is But here we must be careful because Fodor actually
based on new information of other kinds (delivered, introduced a further property of input systems, one
for example, by a perceptual input system). The pro- that we have not previously mentioned. Fodor
cesses of belief formation and belief revision need to regards the input systems as delivering information
be isotropic. There is no a priori method for putting a to the central systems so that it can be used in con-
boundary around the considerations that might be scious inferences. So the response would also need
relevant. And, as in AI, so more generally, this prop- to take into account the idea that the outputs of
erty of processing in the central systems presents a modules are accessible to consciousness or ‘phe-
challenge to computational theories and, specifically, a nomenologically salient’ (Fodor, 1983, p.87).
challenge to the CMM (Shanahan, 2009). Suppose, for example, that it seemed as though vis-
Fodor believes that the prospects for a computa- ual object recognition was not informationally encap-
tional psychology of the central systems are bleak. sulated. A response would be to say that visual object
Indeed, he proposes a principle that, he suggests, recognition takes place in the central systems and not
‘some day will come to be known as “Fodor’s First Law in the modular visual-input system. In Marr’s theory
of the Nonexistence of Cognitive Science”’; namely, of visual processing (Chapter 3), the primal sketch
that ‘the more global (e.g. the more isotropic) a cogni- and the 2½D sketch are shallow levels of representa-
tive process is, the less anybody understands it. Very tion and, to that extent, they would appear to be suit-
global processes, like analogical reasoning, aren’t able candidates for the output of a visual-input system.
understood at all’ (Fodor, 1983, p.107). According to But for Fodor they do not meet the requirement of
Fodor, the CMM just will not explain the central sys- phenomenological salience – ‘from the point of view
tems (Fodor, 2000 gives a book-length treatment of of phenomenological accessibility, perception is above
this issue). all the recognition of objects and events’ (Fodor, 1983,
p.94) – and so the response would fail.
According to Fodor’s account of the mind, the
Debates about
3.3
processing in input systems is informationally encap-
modularity sulated and the outputs of input systems are accessible
to consciousness (phenomenologically salient). These
Fodor’s account of modularity has a positive part – two requirements may sometimes impose conflicting
input systems are modular – and a negative part – cen- pressures on the location of the interfaces between
tral systems are not modular. The account has been input systems and central systems.
very influential, but also controversial. Many of the
criticisms of the positive part of Fodor’s account focus Arguments against informational
3.3.1
those processes of pragmatic interpretation, is the proposal would have two components. First, it would
interface between the language-input system and the be argued, spoken word recognition is an informa-
central systems located? Fodor’s proposal is that tionally encapsulated process that takes place within
the language-input system delivers information about the language-input module. But second, so the argu-
the linguistic form of the sentence that was uttered – ment would continue, deciding to press the button is
which words it contains and how they are put together. not an informationally encapsulated process, and is
This output is relatively shallow – it certainly falls well therefore a matter for the central systems. Even under
short of complete understanding of the message that speeded conditions, the decision depends on the par-
the speaker was intending to get across – but it is still ticipant’s beliefs. A slower response to the word
phenomenologically salient. GUITAR when it is presented in the pragmatically
In a critique of Fodor’s account of modularity, anomalous sentence might therefore reflect ‘the hear-
Marslen-Wilson and Tyler (1987) review a range of evi- er’s inability to believe that the speaker could have said
dence that seems to show that the language-input sys- what it sounded like he said’ (Fodor, 1985, p.5).
tem, as conceived by Fodor, is not informationally Other experiments reviewed by Marslen-Wilson
encapsulated. Processing in the language-input system and Tyler (1987) provide evidence that non-linguistic
is, they argue, influenced by knowledge about the non- knowledge influences the resolution of ambiguity in
linguistic world. In one experiment (Marslen-Wilson phrases such as ‘visiting relatives’ or ‘landing planes’
et al., 1988), participants listened to sentences, some of (Tyler and Marslen-Wilson, 1977) and influences the
which were anomalous in various ways. For our pur- interpretation of anaphors2 (Tyler and Marslen-
poses, the crucial comparison is between sentences in Wilson, 1982; Marslen-Wilson et al., 1993). In each
normal prose, such as ‘The boy held the guitar’, and sen- case where informational encapsulation is challenged,
tences containing a pragmatic anomaly, such as ‘The the defender of modularity may respond by claiming
boy buried the guitar’. The participants’ task was simply either (i) that the top-down influence is coming from
to press a button as soon as they detected a previously within the input system and not from the central sys-
specified target word – in the case of these examples, tems, or else (ii) that the processing that is being influ-
the word GUITAR. The results show that participants enced occurs in the central systems and not within the
responded significantly faster when the target word was input system. And, of course, in each case there can be
presented in the normal sentence than when it was pre- further debate about whether the response is adequate.
sented in the pragmatically anomalous sentence. Let us now return to Swinney’s (1979) experi-
This finding is important because the anomalous- ment, and the question as to whether lexical access is
ness of the second sentence does not result from the informationally encapsulated. Swinney found that
syntactic properties of BURY and GUITAR, and it is both ANT and SPY are primed when they are pre-
not explained by the literal meanings of those words, sented immediately following BUGS and, as we have
as specified within the language-input system. As the seen, these semantic priming effects could be
authors explain: ‘The pragmatic oddness of burying a explained in terms of the organization of the mental
guitar is something that we have to infer, given our lexicon, and not in terms of information from the
knowledge of the world, and given what we know about central systems. However, Swinney also discovered
guitars, the likely effects of burying them, and so on’ that if BUGS is heard in a sentence about insects and
(Marslen-Wilson et al., 1988, p.6; emphasis added). ANT or SPY is presented three syllables (about one
Thus, the finding provides evidence that knowledge of
the non-linguistic world influences on-line processing
2 Anaphors (which may be anaphoric expressions such as pro-
of spoken language input.
nouns or may be anaphoric devices that are not phonologically
In response to this finding, a defender of modular-
explicit in spoken language) refer back to someone or something
ity might propose that the locus of top-down influ- that has been introduced or identified by an antecedent in the pre-
ence is post-perceptual. In a little more detail, the vious text or linguistic context.
CHAPTER 20 THEORETICAL ISSUES IN COGNITIVE PSYCHOLOGY 661
second) after BUGS, then ANT is primed but SPY is encapsulation requires only that this data should not
not. This indicates that, while both meanings of include all the information that is stored in the cen-
BUGS (both words spelled BUGS) are accessed ini- tral systems. Domain specificity suggests, in addi-
tially, there is then a disambiguation process in tion, that the proprietary database of the language
which one of them is selected at the expense of the module, for example, should include only informa-
other. It is plausible that this process of selection tion about language – information about phonology
draws on information from the central systems, but and syntax, and information about words (a lexicon),
the locus of top-down influence can be argued to but not information about whether it is likely that
occur after lexical access. Indeed, Swinney (1979, someone would bury a guitar. Against this suggestion,
p.657) suggests that ‘a very rapid postaccess decision Marslen-Wilson and Tyler (1987) urge that we
process is at work’. should not so readily assume that language processing
Marslen-Wilson and Tyler (1987) also raise some follows the contours of linguistic theory. More gener-
more general issues for Fodor’s account of modularity. ally, there is still work to be done before we can con-
Fodor connects fast processing in input systems with fidently, and non-arbitrarily, draw boundaries
the properties of being mandatory and being informa- between input systems and the central systems.
tionally encapsulated. But the influence of non-linguis-
tic knowledge does not make processing slow. In the Prospects for the psychology of the
3.3.2
ACTIVIT Y 20. 5
idiosyncratic, type of problem. Dan Sperber argues those processes could, after all, fall within the scope of
that the massive modularity hypothesis: the CMM. A sophisticated defence of massive modu-
larity that does attempt to show these things is pro-
gets support from a wealth of recent work . . . tending to vided by Peter Carruthers (2006).
show that many basic conceptual thought processes As you consider this debate about the negative part
found in every culture and in every fully developed of Fodor’s account of modularity, you should be aware
human are governed by domain-specific competences. that complications could arise from the fact that advo-
For instance it is argued that people’s ordinary under- cates of massive modularity may not mean the same by
standing of an inert solid object, of the appearance of the term ‘module’ as Fodor means. A naïve physics, or
an organism, or of the actions of a person are based on biology, or psychology, as described by Sperber, sounds
three distinct mechanisms: a naive physics, a naive like a body of knowledge. But Fodor’s modules are pro-
biology, and a naive psychology. cessing systems, rather than stored bodies of domain-
(Sperber, 1996, p.123) specific knowledge. Carruthers relaxes Fodor’s account
of modules and, in particular, does not require that
In a similar vein, Steven Pinker says, at the beginning modules are informationally encapsulated – the essence
of his book, How the Mind Works: ‘the mind is a system of Fodorian modularity. So it seems that an advocate of
of organs of computation designed by natural selection massive modularity might actually accept the negative
to solve the problems faced by our evolutionary ances- part of Fodor’s account – the central systems are not
tors in their foraging way of life’ (Pinker, 1997, p.x). You modular in Fodor’s sense – while maintaining that cen-
may not be surprised to learn that Fodor argues against tral cognitive processes are underpinned by systems
massive modularity in his book, The Mind Doesn’t Work that are modular in a different way.
That Way (2000; for further discussion, see Pinker, You would then need to determine where, if any-
2005a; Fodor, 2005; Pinker, 2005b). where, the real disagreement between the two sides is
If massive modularity is to provide grounds for located (Robbins, 2009). Do the advocates of massive
optimism about the prospects for scientific under- modularity accept that cognitive processes of belief
standing of central cognitive processes then one thing formation have the properties of being isotropic and
that needs to be demonstrated is how processes such Quinean? Do they accept that those properties require
as belief formation, decision making, and analogical that the processes are unencapsulated? Do they accept
reasoning could be carried out by a massively modular that processes that are unencapsulated are not compu-
cognitive architecture. Ideally, it would be shown how tationally tractable?
SUMMARY OF SECTION 3
• Fodor proposes that the mind can be divided into sensory transducers, modular input systems, and
non-modular central systems.
• Modular input systems are characterized by a cluster of properties, but the properties of being
domain specific and informationally encapsulated are especially important.
• Informational encapsulation means that the processing undertaken by a module is not affected
by knowledge stored in the central systems. Top-down information fl ow within a module is
permitted.
• The central systems receive output from the modular input systems and are involved in belief forma-
tion and decision making. They are domain general and unencapsulated.
• Fodor proposes that a good model for the functioning of the central systems is the kind of
non-demonstrative inference that is used in scientific confirmation – that is, abductive inference
CHAPTER 20 THEORETICAL ISSUES IN COGNITIVE PSYCHOLOGY 663
or inference to the best explanation. This kind of inference has the properties of being isotropic
and Quinean.
• Fodor’s ‘First Law of the Non-existence of Cognitive Science’ warns that the prospects for a compu-
tational psychology of the central systems are bleak.
• Fodor’s account of modularity has a positive part – input systems are modular – and a negative part –
central systems are not modular.
• Critics of the positive part of Fodor’s account of modularity have questioned whether input sys-
tems are really informationally encapsulated.
• Critics of the negative part of Fodor’s account have proposed that the mind is modular throughout.
4 COGNITIVE NEUROPSYCHOLOGY
We now turn to a branch of cognitive psychology In order to draw these inferences about the struc-
that relies on an assumption of modularity to draw ture of normal cognition, cognitive neuropsychology
conclusions about cognitive processes. Cognitive relies on several assumptions:
neuropsychology uses data from patients with
1. The first of these is an assumption of modularity:
acquired cognitive disorders following brain injury
the normal cognitive system is made up of
in order to constrain models and theories of normal
somewhat independent components or
cognition (Chapter 13). The term ‘neuropsychology’
information-processing mechanisms. However,
is also used for a discipline that is concerned
the notion of modularity that is used in the
with the relationship between brain and behaviour
practice of cognitive neuropsychology has fewer
(and is thus close to behavioural neurology).
commitments than Fodorian modularity. Two
Cognitive neuropsychology and neuropsychology
points of contact between the modularity
in this other sense have common antecedents in
assumption in cognitive neuropsychology and
nineteenth-century neurology. But cognitive neu-
issues in Section 3 of this chapter are briefly
ropsychology is different from neuropsychology in
described in Box 20.2 and Box 20.3.
being an approach or research programme within
cognitive psychology. Its subject matter is not the 2. The second assumption is universality: the
brain, but the information-processing structure of modular structure or functional architecture of the
the mind. mind is the same, in relevant respects, for all
For cognitive neuropsychology, the most impor- normal (neurologically healthy) individuals
tant pattern of impaired cognitive functioning in (Caramazza, 1986).
patients is double dissociation of impairments on 3. The third assumption is that, when one cognitive
two cognitive tasks: one patient (A) shows impaired component is damaged, this does not bring about
performance on Task 1 but performs at a normal or substantial reorganization of the prior modular
near normal level on Task 2, while a second structure. The undamaged components continue
patient (B) shows the reverse pattern, impaired on to operate as before and no new components are
Task 2 but unimpaired or near normal on Task 1. added. This assumption is sometimes called
From this evidence, it is inferred that the two tasks transparency (Caramazza, 1986) and sometimes
involve separate information-processing routes or subtractivity (Coltheart, 2001). (See Chapter 13 for
mechanisms. further discussion.)
664 PART 6 CHALLENGES, THEMES, AND ISSUES
Fodor’s main argument for the negative part of his functions (such as a rat’s capacity to run through a
account of modularity was reviewed in Section 3.2. maze) are localized in the whole cortex and can be
The central systems are not modular because cen- impaired by damage anywhere in the cortex. If
tral cognitive processes, such as belief formation, several separate components of the central sys-
have properties – being isotropic and Quinean – tems were each to be localized in the whole cortex
that require them not to be informationally encap- then it would be diffi cult for them to be separately
sulated. But, if the notion of modularity that is used damaged and selective impairments would not be
in cognitive neuropsychology is closer to the every- expected. On the face of it, Fodor’s suggestion
day notion than to Fodor’s, then there may be mod- that the neural substrate of central cognitive func-
ules – in the sense of somewhat independent tions is diffuse may be in tension with the evidence
components – in the central systems. Damage to of selective central cognitive impairments. (One
separate components of the central systems might, possibility to consider would be that the neural
in principle, result in selective cognitive impairments basis of central cognitive processing is diffuse but
and, indeed, there is evidence that memory systems that domain-specific knowledge modules can be
can be selectively impaired, that the ability to do separately damaged.)
arithmetical calculation can be destroyed, that There is also a more general issue here. Cognitive
attentional systems can be damaged, and that eve- neuropsychology is a division of cognitive psychol-
ryday psychological understanding (theory of mind) ogy and its subject matter is the information-pro-
can be impaired (Shallice, 1988; Ellis and Young, cessing structure of the mind. But the practice of
1998; and Baron-Cohen et al., 1999 describe evi- cognitive neuropsychology depends on an addi-
dence of all these impairments). tional assumption about the brain – an assumption
One of the properties associated with Fodorian of (at least some) anatomical modularity. If selective
modularity is fi xed neural architecture and Fodor impairments are to be explained in terms of damage
suggests that this property, like informational to components of the mind – components of input
encapsulation, is missing from the central systems systems or of the central systems – then compo-
and that, perhaps, ‘central problem-solving is sub- nents that are functionally separate (modules) must
served by equipotential neural mechanisms’ be able to be damaged separately. This would not
(Fodor, 1983, p.119). Here, Fodor alludes to be possible if many separate modules all shared the
Karl Lashley (1930), who maintained that some same neural substrate.
Inference in cognitive
4.1 First, why is evidence from brain-damaged people
relevant to models of normal functioning at all? There
neuropsychology is no a priori way of putting a boundary around the
kinds of evidence that may be relevant to the confir-
In cognitive neuropsychology, inferences about the mation or disconfirmation of a hypothesis (see our
modular structure of the normal cognitive system are earlier discussion of hypothesis confirmation as
drawn from patterns of cognitive impairment in being isotropic). So there is no a priori reason to sup-
patients, and the most important pattern is double pose that evidence from brain-damaged people will
dissociation. How do those inferences work and why or will not be relevant to models of normal cognitive
is double dissociation regarded as evidence for sepa- functioning. This is an empirical issue. However, if
rate cognitive modules? We can answer this question the modularity assumption about the normal cogni-
in three steps. tive system is correct then there may be separate
CHAPTER 20 THEORETICAL ISSUES IN COGNITIVE PSYCHOLOGY 665
Coltheart (1999) proposes that a module should be based, rather than merely verbal. So he invites us to
defined as ‘a cognitive system whose application is imagine that we started out with the idea that there
domain specific’ (1999, p.118) and that it should be is a single visual-recognition system for faces, objects,
left as an empirical question whether a particular and written words: ‘Then we noticed that in the neu-
domain-specific module has any of the other proper- ropsychological literature there were reports of
ties of Fodorian modules, such as having fixed neural patients with impaired visual word recognition but
architecture or being informationally encapsulated. who retained face recognition and of patients with
The notion of a module as a domain-specific pro- impaired visual word recognition but who retained
cessing system may well be attractive to cognitive visual object recognition. We also noticed reports of
psychologists who believe that input systems, such patients with impaired visual object recognition but
as the language-input system, are not information- who retained face recognition or visual word recog-
ally encapsulated. Also, Coltheart’s notion has an nition . . . This collection of results refutes our original
advantage of generality, in that it may apply to some idea . . . Instead, it suggests that there are three sepa-
central cognitive systems as well as to input sys- rate modules’ (Coltheart, 1999, p.119).
tems. But, if the notion is to be put to use, then it This is a typical example of inference in cognitive
requires a good account of what domain specificity neuropsychology. Case studies of patients reveal
is – and what a domain is. Fodor himself warns that dissociation of impairments between tasks – in this
we have to be careful to avoid a ‘trivial kind of case, multiple dissociations amongst the three tasks
domain specificity’ (Fodor, 1983, p.48). Someone of recognizing faces, objects, and written words.
might say that cows and sheep are two different This evidence supports the hypothesis that the three
domains and that cow perception and sheep per- tasks involve three separate information-processing
ception are domain-specific processes. But this systems, each of which is domain specific. Faces,
would be a purely verbal manoeuvre if the same objects, and written words – unlike cows and
mechanisms of visual perception are involved in sheep – are empirically (and not just verbally) differ-
perceiving both cows and sheep. ent domains. Thus, Coltheart’s notion of a module
Coltheart recognizes the need to provide an as a domain-specific processing system seems to fit
account of domain specificity that is empirically well with the practice of cognitive neuropsychology.
cognitive modules involved in different cognitive sis is, to that extent, supported – by inference to the
tasks. If the assumption of anatomical modularity is best explanation.
also correct, then the separate cognitive modules It might be, of course, that these assumptions are
may be independently damaged. If the subtractivity/ incorrect. Brain injury might, in principle, have
transparency assumption is correct, then damage to resulted in apparently random patterns of impairment
one module will result in impairment of functions that could not be understood at all in terms of models
that involve that module, while other functions are of normal cognition. But it is a consistent neuropsy-
unimpaired (or spared). So the cognitive neuropsy- chological finding, from the nineteenth century until
chology framework has the potential to explain pat- the present, that brain injury often results in selective
terns of selective impairment in patients following impairment of specific cognitive functions.
brain injury. If a hypothesis about separate modules Second, why does double dissociation provide better
in the normal cognitive system allows the best expla- evidence for separate modules than a single (one-way)
nation of a pattern of impairment then the hypothe- dissociation? If the universality assumption is correct,
666 PART 6 CHALLENGES, THEMES, AND ISSUES
then the modular structure of the normal cognitive vides one possible explanation of the co-occurrence of
system is the same in all neurologically healthy indi- impairments on the two tasks following brain
viduals. Suppose that, in healthy individuals, two injury. But there is a fairly obvious possible alternative
separate modules, M1 and M2, are involved in two explanation in terms of neuroanatomy. Even if func-
different tasks, Task 1 and Task 2. Then independent tionally separate modules, M1 and M2, were involved
damage to each of the modules in two patients fol- in the two tasks, it might be that brain injury that
lowing brain injury provides a good explanation of damaged one of these modules would inevitably dam-
double dissociation of impairments on the two tasks. age the other one as well. The two modules might be
This good explanation may turn out to be the best localized in the same small region of the brain, or their
explanation. positions relative to a blood vessel in the brain might
Suppose that there were only a one-way dissocia- make it overwhelmingly likely that a blockage in or
tion: a patient shows impaired performance on Task 1 bleeding from that blood vessel would damage both
but performs at a normal level on Task 2. One possi- modules. In short, there might not be sufficient ana-
ble explanation would be that two separate modules, tomical modularity to allow the two modules to be
M1 and M2, are involved in the two tasks and that, in damaged independently.
this patient, M1 is damaged while M2 is intact. But
there is also a possible alternative explanation. It
might be that just the same modules are involved in Cognitive
4.2
the two tasks but that Task 1 is more difficult – more
demanding of cognitive resources – than Task 2. If
neuropsychology and the
that were so then, after partial damage to the modules past-tense debate
that are involved in both tasks, performance on
Task 1 might be impaired while performance on In this section we return to the past-tense debate
Task 2 remained normal. (Section 2.3) and consider how neuropsychological
A double dissociation, in which a second patient evidence has contributed to the debate.
shows the reverse pattern (normal performance on
Task 1 but impaired performance on Task 2), is better 4.2.1 Double dissociation evidence
evidence for separate modules than the single disso- Evidence of double dissociation on tasks related to the
ciation because it excludes the possible alternative past tense of regular and irregular verbs would sup-
explanation in terms of the greater difficulty of one of port the hypothesis that separate modules are involved
the tasks. But, of course, excluding one possible alter- in the formation of the past tense of regular and irreg-
native explanation is very far from providing a logical ular verbs. It would favour dual-route models, such as
guarantee that the hypothesis of separate modules the words and rules model, over single-route connec-
involved in the two tasks is correct. Normal science tionist models (e.g. Rumelhart and McClelland, 1986;
proceeds by inference to the best explanation and evi- Plunkett and Marchman, 1993).
dence does not provide logical guarantees but, at best, Double dissociations were described in two papers
a change in the balance of probabilities between com- published in 1997. Ullman and colleagues (1997)
peting theories or models (Coltheart and Davies, used an experimental paradigm in which participants
2003; Davies, 2010). read aloud pairs of sentences, such as, ‘Every day I dig
Third, just as impairments can be dissociated, they a hole. Just like every day, yesterday I _______ a hole’,
can also be associated. If impairments on two tasks and filled in the blank in the second sentence. Patients
usually occur together, can we infer that just the same suffering from Alzheimer’s disease with severely
modules are involved in the two tasks? The hypothesis impaired memory for words performed the task sig-
that, in the normal cognitive system, the same mod- nificantly worse (by comparison with control partici-
ules are involved in Task 1 and Task 2 certainly pro- pants) for irregular verbs (e.g. DIG) than for regular
CHAPTER 20 THEORETICAL ISSUES IN COGNITIVE PSYCHOLOGY 667
verbs (e.g. LOOK) or novel verbs (e.g. PLAG). 4.2.2 The connectionist response
Patients with Parkinson’s disease and severely sup- This evidence of double dissociation supports dual-
pressed movement (hypokinesia) showed the reverse route, rather than single-route, models of formation of
pattern, performing significantly worse (by compari- the past tense. But it certainly does not provide a logi-
son with control participants) for regular verbs, and cal guarantee that the words and rules model is cor-
much worse for novel verbs, than for irregular verbs. rect. It does not even provide a logical guarantee that
Ullman and colleagues argue that the double dissoci- some dual-route model is correct and all single-route
ation supports ‘psycholinguistic theories that empha- models are incorrect.
size grammar and lexicon as distinct components . . . Kim Plunkett and colleagues (Juola and Punkett,
especially in the treatment of regular and irregu- 2000; Plunkett and Bandelow, 2006) have made this
lar grammatical phenomena’ (1997, p.274; see also point vivid by demonstrating that double dissociation
Ullman et al., 2005). of impairments may arise from random damage to a
Marslen-Wilson and Tyler (1997, 1998) used an single-route network. They trained a single-route net-
auditory priming paradigm that did not require partici- work to form the past tense of verbs (and the plural of
pants to read text or give spoken responses. Participants nouns). The network (analogous to a neurologically
listened to a spoken target word, immediately preceded healthy individual) was then copied more than 13,000
by a prime. The prime was either morphologically times, and each copy subjected to random damage (by
related to the target (JUMPED–JUMP; GAVE–GIVE), removal of 1 per cent of its connections). Amongst
semantically related to the target (GOOSE–SWAN), or these ‘lesioned’ networks (analogous to patients fol-
unrelated to the target. Filler stimuli included non- lowing brain injury) there were pairs of networks
words, and the participants’ task was simply to make a instantiating double dissociation of impairments
lexical-decision response (‘Is this a word or not?’). The between regular and irregular verbs. In short, double
crucial comparison was between priming of regular dissociation evidence from damaged networks may be
verbs by their past-tense forms (e.g. JUMPED–JUMP) compatible with the undamaged network having only
and priming of irregular verbs by their past-tense forms a single route.
(e.g. GAVE–GIVE). In this primed lexical decision par- Joanisse and Seidenberg (1999) constructed a sin-
adigm, neurologically healthy individuals responded gle-route connectionist model of past-tense formation
faster to targets when the prime was morphologically or that was different from earlier connectionist models in
semantically related than when the prime was unre- an important way: it included semantic representa-
lated, and both regular and irregular verbs were primed tions of verbs as well as phonological representations.
by their past-tense forms. By subjecting components of the model to damage,
However, three patients did show significant differ- Joanisse and Seidenberg were able to simulate the
ences in priming between regular verbs and irregular double dissociation that Ullman and colleagues (1997)
verbs. Two patients, with impaired comprehension found in patients suffering from Alzheimer’s disease
and production of inflected forms following left- and Parkinson’s disease. When the semantic represen-
hemisphere stroke, exhibited priming for irregular tations in the trained network were damaged, the
verbs but not for regular verbs. A third patient, with effect was greatest for irregular verbs (as in the patients
symptoms of Broca’s aphasia following damage to with Alzheimer’s disease); when the phonological rep-
both hemispheres, exhibited the reverse pattern: resentations were damaged, the effect was greatest for
priming for regular verbs but not for irregular. novel verbs (as in the patients with Parkinson’s dis-
Marslen-Wilson and Tyler argue that this double dis- ease). Thus, in opposition to the words and rules
sociation suggests ‘the two morphological categories model, Joanisse and Seidenberg defend a single-route
ally themselves with different types of mental compu- theory of past-tense formation: ‘The same net-
tation’ (1997, p.593). work structure is used in processing all words. . . .
668 PART 6 CHALLENGES, THEMES, AND ISSUES
The explanation for the behavioral dissociations lies dyslexia (impaired reading of irregular words while
with the fact that the network includes distinct pho- reading of regular words and non-words is relatively
nological and semantic representations’ (1999, p.7597; spared) is explained in terms of damage to the lexical
see also Joanisse and Seidenberg, 2005 for a similar route in the DRC model, and phonological dyslexia
account of neuroimaging evidence). (impaired reading of non-words while reading of reg-
ular and irregular words is relatively spared) is
Cognitive neuropsychology and
4.2.3 explained in terms of damage to the non-lexical route,
connectionist modelling with its spelling-sound rules. However, a single-route
Twenty-five years or more after Rumelhart and connectionist model (Plaut et al., 1996) explains the
McClelland published their connectionist model of double dissociation in terms of damage to semantic
the English past tense, the debate continues. It may be representations or to phonological representations.
that the empirical evidence will not adjudicate deci- In both these areas – the past tense and reading
sively between the competing accounts of past-tense aloud – continuing work is providing new evidence
formation and that dual-route words and rules models against which competing models can be assessed.
and single-route connectionist models will do about Aside from asking which kind of model, rule-based or
equally well in accounting for the data – not only data connectionist, can better fit the data, researchers in
from behavioural experiments but also neuropsycho- these areas are asking another question. Which kind
logical and neuroimaging evidence. (For a recent con- of model offers the better explanation of the available
nectionist model and new behavioural evidence, see evidence – which style of explanation has broader
Woollams et al., 2009.) scope and offers better prospects for unifying seem-
There is a parallel debate about reading words ingly disparate phenomena, which is more parsimoni-
aloud. Again, there are competing models – the dual- ous, which achieves greater depth, which leads to the
route DRC model (Coltheart et al., 2001) and the sin- more interesting new predictions? These issues about
gle-route connectionist models (Seidenberg and fitting and explaining data are at the forefront of con-
McClelland, 1989; Plaut et al. 1996). Here, too, double temporary debate (Coltheart, 2006a; Seidenberg and
dissociation – between surface dyslexia and phono- Plaut, 2006).
logical dyslexia – has played an important role. Surface
SUMMARY OF SECTION 4
• Cognitive neuropsychology uses data from patients with acquired cognitive disorders following brain
injury in order to constrain models and theories of normal cognition.
• For cognitive neuropsychology, the most important pattern of impaired cognitive functioning in
patients is double dissociation of impairments on two cognitive tasks.
• Neuropsychological evidence of double dissociation of impairments has contributed to the past-
tense debate because it appears to support dual-route models over single-route models.
• Connectionist modellers have demonstrated that double dissociation of impairments may result
from random damage to a single-route model.
• Double dissociation of impairments may also result from damage to separate semantic and phono-
logical representations in a connectionist network, even though regular and irregular verbs are pro-
cessed through the same connections.
• In the past-tense debate, and in a parallel debate about reading aloud, researchers ask not only which
kind of model can fit the data better, but also which offers the better explanation of the available
evidence.
CHAPTER 20 THEORETICAL ISSUES IN COGNITIVE PSYCHOLOGY 669
5COGNITIVE PSYCHOLOGY
AND THE BR AIN
systems, we ask how the representations and
In this final section, we turn to one aspect of the rela-
algorithms specified at level 2 are physically
tionship between mind and brain – a large topic with a
realized in the human brain.
very long history reaching back at least to ancient Greek
philosophy, more than 2,000 years ago. The specific Experimental research in cognitive psychology is gen-
aspect that we shall discuss is the relationship between erally aimed at understanding actual representational
cognitive psychology and the study of the brain – that structures and cognitive processes and so it is most
is, neuroanatomy or the study of neural circuits (we directly concerned with Marr’s second level. But any
shall call this neurobiology in what follows). theory at the second level is constrained from above by
the computational theory at the first level. An empiri-
cal proposal about how a computation is actually car-
5.1 Levels of explanation ried out will be incorrect if the proposed algorithm is
not even a possible way, in principle, of accomplishing
If you look back over the previous chapters in this the transformation from input to output. Theories at
book, you will find relatively little discussion of the way the second level are also constrained from below by the
in which cognitive systems are actually implemented theory of hardware implementation, or physical reali-
by the brain. Why is this? There are, we suggest, two zation, at the third level. As Marr put it: ‘Some types of
related reasons. The first is the influence of David algorithm will suit some physical substrates better
Marr’s (1982) account of the three levels at which an than others’ (Marr, 1982, p.24).
information-processing system can be understood. As Marr’s overall view, which has been influential in
you saw in Chapter 1, these three levels are: cognitive science and cognitive psychology, was that
constraint from above, by the computational theory,
• Level 1: The level of computational theory, where
took precedence over constraint from below, by the
we ask what is being computed, and why it is being
hardware implementation. Reflecting on neurophysi-
computed. When we know what is being
ological investigations of vision in the 1970s, he
computed, we can also assess how, in principle, it
became convinced that an important level of under-
could be computed.
standing had been missing:
• Level 2: The level of representation and algorithm,
There must exist an additional level of understanding
where we ask how the computation that is abstractly
at which the character of the information-processing
described at level 1 is actually carried out in the
tasks carried out during perception are analyzed and
system that is under investigation. More specifically,
understood in a way that is independent of the par-
we ask in what formats input information and
ticular mechanisms and structures that implement
output information are represented, and by what
them in our heads. This was what was missing – the
algorithm the transformation from input to output
analysis of the problem as an information-processing
is accomplished.
task. Such analysis does not usurp an understanding
• Level 3: The level of hardware implementation, at other levels – of neurons or of computer pro-
where we ask how the representations and grams – but it is a necessary complement to them,
algorithms specified at level 2 are physically since without it there can be no real understanding of
realized. When we are trying to understand the function of all those neurons.
information processing in human cognitive (Marr, 1982, p.19)
670 PART 6 CHALLENGES, THEMES, AND ISSUES
The second reason why there has been relatively little outline, is what Patricia Churchland (1986) describes
discussion of the organization and function of the as co-evolution of theories: ‘theories at distinct levels
physical brain in cognitive psychology is that, until often co-evolve . . . as each informs and corrects the
recently, there have been few techniques and tools that other’ (P.S. Churchland, 1986, p.284).
could be used to undertake the kinds of investigation We should not, however, expect that drawing infer-
at level 3 that would speak to issues concerning human ences about cognitive psychological theories from
cognitive functioning. In essence, experimental inves- neurobiological findings will be easy or straightfor-
tigations were limited to animal studies, where inva- ward. A simple example illustrating this point is pre-
sive methods such as lesion studies and single-cell sented in Box 20.4.
recording of neurons could take place. For ethical rea-
sons, these kinds of studies could not be carried out
on humans.
However, the situation has changed quite dramati-
Co-evolution and
5.2
cally over recent years. Neuroimaging techniques reduction
such as positron emission tomography (PET), func-
tional magnetic resonance imaging (fMRI), electroen- Patricia Churchland links co-evolution of theories
cephalography (EEG), and magnetoencephalography with reduction of one theory to the other: ‘the discov-
(MEG) allow metabolic, electrical, and magnetic cor- eries and problems of each theory may suggest modi-
relates of neural activity to be measured, with varying fications, developments, and experiments for the
degrees of spatial and temporal resolution, during the other, and thus the two evolve towards a reductive
performance of cognitive tasks (Chapter 14). At the consummation’ (P.S. Churchland, 1986, p.284). Even
same time, there has been massive growth in connec- if it is not really obligatory that interdisciplinary inter-
tionist modelling that is claimed to be ‘brain-like’ or at action should aim at ‘reductive consummation’, the
least neurally plausible. So the question of the rela- idea that theories in cognitive psychology might
tionship between the kinds of cognitive models dis- reduce to theories in neurobiology requires some dis-
cussed in this book and neural models that are pitched cussion.
at Marr’s level 3 has become a matter of significant The topic of inter-theoretic reduction is a complex
theoretical interest and, indeed, dispute. one (Churchland and Churchland, 1998 give a basic
Contemporary theorists in the cognitive sciences introduction). But the basic thought is that ‘because
commonly and reasonably assume that cognitive everything in the world is made of the same basic stuff
functioning is realized in neural functioning. So Marr in complex combinations, the laws of biology ought to
is surely right that, in principle, things we find out be derivable from those of chemistry, and the laws of
about neural functioning might constrain models and chemistry from the laws of physics’ (Ladyman, 2002,
theories of cognitive processes. This bottom-up con- p.95). Similarly, the idea is that the laws of cognitive
straint from level 3 to level 2 goes hand-in-hand with psychology ought to be logically derivable from laws
top-down guidance from level 2 to level 3. It is hard to that figure in neurobiological theories. Examples from
see how an investigation at the level of the neural the history of science that are usually adduced to illus-
implementation of cognitive processes could ever get trate and motivate this view are the reduction of
started without there first being a model (however genetics to molecular biology and the reduction of
sketchy) of the cognitive processes themselves. chemistry to quantum mechanics.
If there is both bottom-up constraint and top-down
guidance between Marr’s second and third levels then 5.2.1 Reduction and the CMM
we should expect reciprocal interaction between cog- There is, however, a line of thought leading to the
nitive psychology and neurobiology, with challenges opposite claim, that cognitive psychology is not even a
and insights flowing in both directions. This, in candidate for reduction to neurobiology. The CMM
CHAPTER 20 THEORETICAL ISSUES IN COGNITIVE PSYCHOLOGY 671
As we saw earlier in this chapter, Jerry Fodor argues remark is to read Fodor as denying, in principle, the
that perception is informationally encapsulated relevance of neurobiological findings to cognitive psy-
from our beliefs and knowledge about the world. In chology. But this would not be a credible interpreta-
one of a number of responses to this claim, the neuro- tion, given Fodor’s repeated insistence that there is
philosopher Paul Churchland pointed out that, in no a priori way to put a boundary around the kinds of
addition to neuronal pathways that ‘ascend’ from evidence that may be relevant to a theory. (Recall the
the retina to primary visual cortex (via structures isotropy of scientific confirmation discussed in
such as the lateral geniculate nucleus), there is evi- Section 3.2.)
dence that there are also matched ‘descending What Fodor is suggesting – in accord with the co-
pathways’ that ‘lead us stepwise back through the evolution view – is that as matters currently stand our
intermediate brain areas and all the way out to the understanding of the role of the descending path-
earliest processing systems at the retina’ ways is too primitive to be taken as evidence against
(P.M. Churchland, 1989, p.266). Churchland inter- informational encapsulation. Moreover, we should
prets these ‘descending pathways’ as feedback path- expect that empirical theories in cognitive psychol-
ways from the central systems to the input systems ogy (and, indeed, abstract computational theories)
that ‘strongly suggest’ that perceptual processes are will guide our understanding of the role of those
not encapsulated. descending pathways. If we were to find good rea-
Fodor’s reaction to this neurobiological objec- sons for thinking that those pathways do carry infor-
tion to informational encapsulation is instructive. mation from central systems to input systems, then
He says: ‘Heaven knows what psychological func- we might need to rethink our understanding of
tion “descending pathways” subserve. . . . One thing modules and encapsulation. But until then, assump-
is clear: if there is no cognitive penetration of percep- tions of modularity and encapsulation may guide
tion then at least “descending pathways” aren’t for our understanding of the functions of descending
that’ (Fodor, 1990, p.261). One way to interpret this pathways.
models ‘the mind as the software of the brain’ (Block, puter model of the mind is profoundly unbiological’
1995). The same software, with the same scheme of (1995, p.390).
representations and the same algorithmic processes This is an important line of thought but we should
(Marr’s level 2), could run on different hardware also notice its limitations. Variable physical realization
(Marr’s level 3). So the same cognitive psychological blocks the reduction of completely general psycho-
theory could be true of minds with very different logical theories, such as the CMM, to neurobiology.
physical realizations, some of them biological but But this line of thought, by itself, leaves it open that a
some of them not. This point about the variable physi- psychological theory of specifically human informa-
cal realization of cognitive states and processes blocks tion processing might, in principle, be reduced to
any straightforward reduction of cognitive psychol- human neurobiology.
ogy to neurobiology. A truly general cognitive psy-
chological theory would apply to the cognitive states 5.2.2 Reduction and the history of science
and processes of beings with wholly different physical The linguist Noam Chomsky (2000, 2002) has articu-
compositions, some of which would not be biological lated another problem for reductionism. He argues
at all. No neurobiological theory could match the gen- that inter-theoretic reduction is historically rare,
erality of a psychological theory of that kind. Thus, and that where there have been genuine cases of
there is a sense in which, as Block puts it, ‘the com- reduction – such as that of chemistry to physics – this
672 PART 6 CHALLENGES, THEMES, AND ISSUES
was only possible when there was a radical change in The neuron doctrine has different versions depend-
the more basic science – in this case, physics. The ing on how the term ‘neuroscientific’ is interpreted. If
moral Chomsky draws is that reduction is neither to a neuroscientific theory is a theory in cognitive neuro-
be aimed for nor to be expected. science, drawing on some combination of concepts
The only sensible aim is for each theoretical enter- from cognitive psychology and neurobiology (or,
prise to pursue its own path (as did chemistry and more generally, from the psychological and biological
physics). It cannot be ruled out that there will be what sciences), then the neuron doctrine is somewhat bland
Chomsky calls the ‘unification’ of theories (as with and uncontroversial. But if a neuroscientific theory is
chemistry and physics), but nor can we be at all cer- a theory that draws only on neurobiology then we have
tain that human intelligence will be up to the task of a much more radical neuron doctrine: ‘a successful
unification. So far as psychology and neurobiology are theory of the mind will be a theory of the brain
concerned, ‘one can entertain the idea that “the men- expressed in terms of the basic structural and func-
tal is the neurophysiological at a higher level”, but for tional properties of neurons, ensembles or structures’
the present, only as a guide to enquiry, without much (Gold and Stoljar, 1999, p.814). In a little more detail,
confidence about what “the neurophysiological” will the radical neuron doctrine says:
prove to be’ (Chomsky, 2003, p.265).
neurophysiology, neuroanatomy, and neurochemis-
Chomsky’s point can, perhaps, be put in the fol-
try will by themselves eventually have the conceptual
lowing way. The reduction of one theory to another
resources to understand the mind and, as a conse-
requires that both theories are successful in their
quence, a successful theory of the mind will make no
respective domains. If either (or both) is not ante-
reference to anything like the concepts of . . . the psy-
cedently successful, then why would one either
chological sciences as we currently understand them.
expect or want reduction? With regard to psychol-
(Gold and Stoljar, 1999, p.814)
ogy and neurobiology, our theories are tentative
and far from being in the state where a reduction is, On this view, we shall have not the co-evolution of
even in principle, in the offing. So, as things cur- theories, but rather the gradual extinction of cognitive
rently stand, the claim that psychology will reduce psychological theories as neurobiological theories
to neurobiology is merely a historical speculation, take over.
and one based on very scant evidence from the his- A temptation to believe the radical neuron doctrine
tory of science. may arise from an assumption that (as we noted ear-
lier) most cognitive psychologists and cognitive scien-
tists share; namely, that cognitive functioning is
realized in neural functioning. It may seem obvious
5.3Is cognitive psychology that, if mental functioning is the result of the physical
just a historical staging post? organization and functioning of the brain, then a the-
ory of the mind will ultimately be produced that talks
Despite these reservations about reduction, it may still only about the brain – about neurons, neural circuits,
be tempting to think that contemporary cognitive neurotransmitters, and so on.
psychology is a mere historical staging post en route to But this would be to move much too fast. To use an
the terminus of a neurobiological theory of the mind. example of Gold and Stoljar’s (1999, p.815): earth-
You might expect that cognitive psychology will dis- quakes are made up of the movement of physical par-
appear when that end point is reached. Philosophers ticles that behave in accordance with the laws of
Ian Gold and Daniel Stoljar have described this view physics. But the science of earthquakes shows no signs
as a version of the neuron doctrine: ‘a successful theory of being replaced by physics, and the reason for this is
of the mind will be a wholly neuroscientific theory’ quite general. Just because phenomena of some kind,
(Gold and Stoljar, 1999, p.809). Xs, are made up of lots of Ys, it does not follow that we
CHAPTER 20 THEORETICAL ISSUES IN COGNITIVE PSYCHOLOGY 673
will achieve an understanding of Xs in terms of the years from now, and five hundred, and a thousand. . . .
science of Ys. We should not, then, allow ourselves to Its existence is unthreatened’ (P.M. Churchland and
slide from the widely held assumption that the mind is P.S. Churchland, 1996, p.220).
realized in the brain to the radical and controversial A second notion of autonomy is independence.
version of the neuron doctrine. Furthermore, if we Cognitive psychology is autonomous from neurobiol-
were to begin on this slide then it would be completely ogy in this second sense if it is entirely unconstrained
unmotivated to maintain that the real science of the by neurobiology. Note that autonomy in this second
mind is neurobiology. For neural phenomena are sense entails autonomy in the first: if cognitive psy-
made up of the activity of lots of molecules and atoms, chology were to be fully independent from neurobiol-
protons, neutrons, and electrons, and ultimately, of ogy then it could not be reducible to neurobiology.
whatever turn out to be the fundamental building However, the reverse does not hold: cognitive
blocks of all matter. psychology could be constrained by neurobiology –
as in Marr’s account – without being reducible to
neurobiology.
Is cognitive psychology
5.4 We can therefore reject the autonomy of cognitive
psychology in the second sense without rejecting
autonomous from autonomy in the first sense. We can allow that theories
neurobiology? in cognitive psychology and neurobiology co-evolve
without being committed to reductive consummation.
Philosophical commentators on the relationship Indeed, this seems to be quite an attractive account of
between cognitive psychology and neurobiology have the relationship between the two disciplines (Stone
used two different notions of autonomy, each of them and Davies, 1999).
important. Some psychologists maintain that the cognitive psy-
One notion of autonomy is irreducibility. Suppose, as chological level (Marr’s level 2) takes priority over the
we assume is true, and this book is predicated on, that neurobiological level (Marr’s level 3). This priority has
theories in cognitive psychology provide genuine theoretical and practical aspects. The theoretical aspect
empirical explanations. If the laws that figure in those of the priority of cognitive psychology is expressed by
theories are not derivable from laws in neurobiology Coltheart and Langdon, when they say that ‘it can be
then cognitive psychology is autonomous from neurobi- very hard to understand what a system is actually doing
ology in this first sense (Fodor, 1998, p.9). If, instead, the if one’s only information about it is a description at the
key concepts in cognitive psychology can be defined in physical-instantiation level’ (1998, p.150). This aspect of
terms of concepts in neurobiology, and if the laws that the priority of cognitive psychology seems to coincide
figure in cognitive psychological theories are derivable with that we earlier described as top-down guidance
from laws of neurobiology, then cognitive psychology is from Marr’s level 2 to level 3. In Marr’s account, the pro-
reducible and not autonomous in that same sense. ject at level 3 is to discover how the representations and
Suppose, for a moment, that cognitive psychology algorithms specified at level 2 are physically realized in
were to be reducible to neurobiology. It is important to the brain. It would seem to be a very much more difficult
notice that it would not immediately follow that the project to work out which representations and algo-
radical neuron doctrine was also true. According to rithms were being realized, given only a neurobiological
the radical neuron doctrine, cognitive psychology description of neural states and processes.
will, in due course, be discarded. But a successful The practical aspect of the priority of cognitive
reduction can be a way of vindicating, rather than psychology is simply a manifestation of the fact that
eliminating, the reduced theory. The Churchlands, all scientists need to make decisions about how to
who are certainly friends of reduction, say: ‘The conduct research with limited resources. One option
discipline of psychology will still be with us a hundred for a cognitive psychologist may be to push ahead
674 PART 6 CHALLENGES, THEMES, AND ISSUES
with the development of an information-processing rejected if there were no neurobiological account con-
model while abstracting, for the time being, from sistent with it.
debates within neurobiology. For example, Andy Sometimes, however, these claims about the theo-
Young describes how the development of a cognitive retical and practical priority of cognitive psychology
model of face recognition proceeded in relative seem to be associated with the less plausible claim
abstraction from debate about a neuroanatomical pro- that neurobiological findings are irrelevant to cogni-
posal (Bauer, 1984) concerning two of the routes in tive models. Examples of findings whose relevance
the model. Young comments: ‘It is a good example of sometimes seems to be contested include findings
how, even though they can often be usefully com- about the location of neural activity in neurologically
bined, psychological and neurological hypotheses can healthy individuals who are performing a cognitive
have some degree of independence from each other’ task, or the location of lesions in patients who can no
(Young, 1998, p.44). Cognitive psychologists who longer perform a particular task. As was suggested in
make these practical decisions would typically Chapter 1, the relevance of neuroimaging to cognitive
acknowledge, of course, that the model they develop psychology has thus become a topic of lively discus-
in abstraction from neurobiology is still potentially sion and debate (Henson, 2005; Coltheart, 2006b).
constrained from below. The model would have to be
SUMMARY OF SECTION 5
• According to Marr’s account of levels of explanation, models in cognitive psychology are constrained
from above by the computational theory, and from below by the theory of hardware implementation.
It was also part of the account that constraint from above takes precedence over constraint from below.
• On the co-evolution of theories view, there is reciprocal interaction between cognitive psychology
and neurobiology, with challenges and insights flowing in both directions.
• There are theoretical and historical grounds to doubt whether cognitive psychology will be reduced
to neurobiology.
• The radical neuron doctrine predicts that cognitive psychology will eventually be replaced by neuro-
biology, but this doctrine is unmotivated.
• Claims about the theoretical and practical priority of cognitive psychology are sometimes combined
with less plausible claims about the irrelevance of neurobiological findings to cognitive models.
6 CONCLUSION
This chapter has introduced you to some of the main and rule-based accounts of a particular cognitive pro-
theoretical debates in cognitive psychology and in cess, the formation of the past tense of verbs. The sec-
cognitive science more broadly. The first debate ond large-scale debate (Section 3) was about the
(Section 2) was about rules and representations and modularity of the mind and about challenges to the
the connectionist challenge to the computational two parts – positive and negative – of Fodor’s account
model of the mind (CMM). One strand in this large- of modularity. One important question was whether
scale debate concerned the competing connectionist language processing, and specifically the process of
CHAPTER 20 THEORETICAL ISSUES IN COGNITIVE PSYCHOLOGY 675
lexical access, is subject to top-down influence from psychology serves to highlight the question of
non-linguistic knowledge. whether, as Fodor claims, some of the aspects of
In Section 4, we introduced the debate about the human cognition that are the most important to us are
role of double dissociation evidence in cognitive neu- computationally intractable.
ropsychology. In this context, returning to the past There are, of course, many other theoretical debates
tense and to connectionist models of past-tense for- that warrant attention. Among those that we have
mation allowed us to highlight two points. First, cog- most reluctantly omitted are debates about the cogni-
nitive neuropsychology, like all of normal science, tive basis of our everyday psychological understand-
proceeds by inference to the best explanation. Second, ing of ourselves and others (theory of mind; Davies
competing models of cognitive processes should be and Stone, 1995), about the prospects for a science of
assessed not only for how well they fit a particular set consciousness (Chapter 18; Davies and Humphreys,
of data, but also for how well they explain the availa- 1993; Weiskrantz and Davies, 2008), and about the
ble evidence. In the final section, we briefly intro- extension of the methods of cognitive neuropsychol-
duced debates about the relationship between ogy to disorders, such as delusions, that were previ-
cognitive psychology and neurobiology – reduction, ously regarded as psychiatric phenomena (Chapter 15;
co-evolution, priority, and independence. The contri- Stone and Young, 1997).
bution that neuroimaging can make to cognitive psy- We hope that you will take away from this chapter a
chology is a topic of continuing and widespread greater insight into the fundamental principles that lie
discussion. behind theories in contemporary cognitive psychol-
None of these debates has a resolution that carries a ogy, and that this will enhance your understanding of
consensus amongst cognitive psychologists and cog- the individual topics covered in this book.
nitive scientists. But perhaps there would be wide-
spread agreement that the development of explicit, Dedication
implemented computational models – including con- Tony Stone, the author of the original version of this
nectionist models – has made a substantial contribu- chapter (published in the first edition of this book in
tion to cognitive psychology over the last 25 years. 2005), died in June 2010 at the age of 52. This revised
And perhaps the success of computational cognitive chapter is dedicated to his memory.
FURTHER READING
When we introduced the computational model of the mind, Cognitive Science, Volume 3: Thinking, Cambridge, MA, MIT
we adopted Ned Block’s phrase, ‘the mind as the software of Press. Ned Block’s classic paper explains the computational model
the brain’. Block’s chapter of that title provides an excellent of the mind in detail, and includes informative discussions of
account of the CMM, as does Tim Crane’s fine book. Andy machine intelligence, variable physical realization, the language of
Clark also provides an extensive introduction to computation thought, explanatory levels, and reduction.
and connectionism. The collection edited by Cohen, Johnston, Clark, A. (2001) Mindware: An Introduction to the Philosophy
and Plunkett is a valuable resource for thinking about the way of Cognitive Science, Oxford, Oxford University Press. Andy
in which computational cognitive psychology, and particu- Clark’s engaging and exciting book begins with ‘mindware as soft-
larly connectionist modelling, impacts on cognitive neuropsy- ware’, continues with classical symbol manipulation and connec-
chology. The relevance (or not) of neuroimaging to cognitive tionism, and introduces further topics, including robots, dynamical
psychology is discussed in a Forum in the journal Cortex systems, and embodied and embedded cognition.
(2006), with the target paper by Max Coltheart. Cohen, G., Johnston, R.A., and Plunkett, K. (eds.) (2000)
Block, N. (1995) ‘The mind as the software of the brain’, in Exploring Cognition: Damaged Brains and Neural Networks.
Smith, E.E. and Osherson, D.N. (eds.) An Invitation to Readings in Cognitive Neuropsychology and Connectionist
676 PART 6 CHALLENGES, THEMES, AND ISSUES
Modelling, Hove, Psychology Press. This collection, with an tinguish between competing psychological theories’; this is
excellent introductory chapter by Robert Johnston and Nick followed by comments and a response.
Braisby, includes papers by Coltheart and colleagues (1993), Juola Crane, T. (2003) The Mechanical Mind: A Philosophical
and Plunkett (2000), and Marslen-Wilson and Tyler (1998), along Introduction to Minds, Machines and Mental Rep-
with a wealth of additional resources. resentations, 2nd edition, London, Routledge. Tim Crane’s
Coltheart, M. (2006b) ‘What has functional neuroimaging excellent book explains representation, the computational
told us about the mind (so far)?’ Cortex, vol.42, pp.323–31. In model of the mind, and connectionism; it includes brief discus-
his position paper, Max Coltheart argues that ‘no functional neuro- sions of systematicity and modularity and concludes with a
imaging research to date has yielded data that can be used to dis- chapter on consciousness.
REFERENCES
Barkow, J.H., Cosmides, L., and Tooby, J. (eds.) (1992) The Churchland, P.M. and Churchland, P.S. On the Contrary:
Adapted Mind: Evolutionary Psychology and the Generation of Critical Essays, 1987–1997, Cambridge, MA, MIT Press.
Culture, Oxford, Oxford University Press. Churchland, P.S. (1986) Neurophilosophy: Toward a Unified
Baron-Cohen, S., Tager-Flusberg, H., and Cohen, D. (eds.) Science of the Mind/Brain, Cambridge, MA, MIT Press.
(1999) Understanding Other Minds: Perspectives from Coltheart, M. (1999) ‘Modularity and cognition’, Trends in
Developmental Cognitive Neuroscience, 2nd edition, Oxford, Cognitive Sciences, vol.3, pp.115–20.
Oxford University Press. Coltheart, M. (2001) ‘Assumptions and methods in cogni-
Bauer, R.M. (1984) ‘Autonomic recognition of names and tive neuropsychology’, in Rapp, B. (ed.) The Handbook of
faces in prosopagnosia: a neuropsychological application of the Cognitive Neuropsychology: What Deficits Reveal About the
guilty knowledge test’, Neuropsychologia, vol.22, pp.457–69. Human Mind, Hove, Psychology Press.
Block, N. (1995) ‘The mind as the software of the brain’, in Coltheart, M. (2006a) ‘Acquired dyslexias and the compu-
Smith, E.E. and Osherson, D.N. (eds.) An Invitation to Cognitive tational modelling of reading’, in Coltheart, M. and
Science: Volume 3 – Thinking, Cambridge, MA, MIT Press. Caramazza, A. (eds.) Cognitive Neuropsychology Twenty Years
Bruce, V. and Young, A. (1986) ‘Understanding face recog- On, Hove, Psychology Press.
nition’, British Journal of Psychology, vol.77, pp.305–27. Coltheart, M. (2006b) ‘What has functional neuroimaging
Caramazza, A. (1986) ‘On drawing inferences about the told us about the mind (so far)?’ Cortex, vol.42, pp.323–31.
structure of normal cognitive systems from the analysis of pat- Coltheart, M. and Davies, M. (2003) ‘Inference and explana-
terns of impaired performance: the case for single-patient tion in cognitive neuropsychology’ Cortex, vol.39, pp.188–91.
studies’, Brain and Cognition, vol.5, pp.41–66. Coltheart, M. and Langdon, R. (1998) ‘Autism, modularity
Carruthers, P. (2006) The Architecture of the Mind: Massive and levels of explanation in cognitive science’, Mind &
Modularity and the Flexibility of Thought, Oxford, Oxford Language, vol.13, pp.138–52.
University Press. Coltheart, M., Curtis, B., Atkins, P., and Haller, M.
Chomsky, N. (2000) New Horizons in the Study of Language (1993) ‘Models of reading aloud: dual-route and parallel-
and Mind, Cambridge, Cambridge University Press. distributed-processing approaches’, Psychological Review,
Chomsky, N. (2002) On Nature and Language, Cambridge, vol.100, pp.589–608. (Reprinted in Cohen, G., Johnston,
Cambridge University Press. R.A., and Plunkett, K. (eds.) Exploring Cognition: Damaged
Chomsky, N. (2003) ‘Replies’, in Antony, L.M. and Brains and Neural Networks. Readings in Cognitive
Hornstein, N. (eds.) Chomsky and his Critics, Oxford, Blackwell. Neuropsychology and Connectionist Modelling, Hove,
Churchland, P.M. (1989) A Neurocomputational Perspective: Psychology Press, 2000.)
The Nature of Mind and the Structure of Science, Cambridge, Coltheart, M., Rastle, K., Perry, C., Langdon, R., and
MA, MIT Press. Ziegler, J. (2001) ‘DRC: a dual route cascaded model of visual
Churchland, P.M. and Churchland, P.S. (1996) ‘Replies word recognition and reading aloud’, Psychological Review,
from the Churchlands’, in McCauley, R.N. (ed.) The vol.108, pp.204–56.
Churchlands and their Critics, Oxford, Blackwell Publishers. Cosmides, L. and Tooby, J. (1994) ‘Origins of domain spec-
Churchland, P.M. and Churchland, P.S. (1998) ‘Inter- ificity: the evolution of functional organization’, in Hirschfeld,
theoretic reduction: a neuroscientist’s field guide’, in L.A. and Gelman, S.A. (eds.) Mapping the Mind: Domain
CHAPTER 20 THEORETICAL ISSUES IN COGNITIVE PSYCHOLOGY 677
Specificity in Cognition and Culture, Cambridge, Cambridge Garson, J. (2010) ‘Connectionism’, in Zalta, E.N. (ed.) The
University Press. Stanford Encyclopedia of Philosophy [online] Available from:
Davies, M. (1995) ‘Two notions of implicit rules’, in Tomberlin, http://plato.stanford.edu/entries/connectionism/
J. (ed.) Philosophical Perspectives, Volume 9: AI, Connectionism Gold, I. and Stoljar, D. (1999) ‘A neuron doctrine in the
and Philosophical Psychology, Oxford, Blackwell. philosophy of neuroscience’, Behavioral and Brain Sciences,
Davies, M. (2010) ‘Double dissociation: understanding its vol.22, pp.809–69.
role in cognitive neuropsychology’, Mind & Language, vol.25, Henson, R.N.A. (2005) ‘What can functional neuroimag-
pp.500–40. ing tell the experimental psychologist?’ Quarterly Journal of
Davies, M. and Humphreys, G.W. (eds.) (1993) Experimental Psychology: Human Experimental Psychology,
Consciousness: Psychological and Philosophical Essays, Oxford, vol.58, pp.193–233.
Blackwell Publishers. Joanisse, M.F. and Seidenberg, M.S. (1999) ‘Impairments in
Davies, M. and Stone, T. (eds.) (1995) Folk Psychology: The verb morphology after brain injury: a connectionist model’,
Theory of Mind Debate, Oxford, Blackwell Publishers. Proceedings of the National Academy of Science, vol.96,
Dennett, D.C. (1984) ‘Cognitive wheels: the frame prob- pp.7592–7.
lem of AI’, in Hookway, C. (ed.) Minds, Machines, and Joanisse, M.F. and Seidenberg, M.S. (2005) ‘Imaging the
Evolution: Philosophical Studies, Cambridge, Cambridge past: neural activation in frontal and temporal regions during
University Press. (Reprinted in Boden, M.A. (ed.) The regular and irregular past-tense processing’, Cognitive,
Philosophy of Artificial Intelligence, Oxford, Oxford University Affective and Behavioral Neuroscience, vol.5, pp.282–96.
Press, 1990.) Juola, P. and Plunkett, K. (2000) ‘Why double dissociations
Ellis, A.W. and Young, A.W. (1998) Cognitive Neuropsychology: don’t mean much’, in Cohen, G., Johnston, R.A., and Plunkett,
A Textbook with Readings, Hove, Psychology Press. K. (eds.) Exploring Cognition: Damaged Brains and Neural
Fodor, J.A. (1975) The Language of Thought, Cambridge, Networks. Readings in Cognitive Neuropsychology and
MA, Harvard University Press. Connectionist Modelling, Hove, Psychology Press.
Fodor, J.A. (1981) ‘Some notes on what linguistics is about’, Ladyman, J. (2002) Understanding Philosophy of Science,
in Block, N. (ed.) Readings in the Philosophy of Psychology, London, Routledge.
Volume II, Cambridge, MA, Harvard University Press. Lashley, K.S. (1930) ‘Basic neural mechanisms in behavior’,
(Reprinted in Katz, J. (ed.) The Philosophy of Linguistics, Psychological Review, vol.37, pp.1–24.
Oxford, Oxford University Press, 1985.) Marr, D. (1982) Vision: A Computational Investigation into
Fodor, J.A. (1983) The Modularity of Mind, Cambridge, the Human Representation and Processing of Visual
MA, MIT Press. Information, New York, W.H. Freeman and Company.
Fodor, J.A. (1985) ‘Précis of The Modularity of Mind’, (Reprinted Cambridge, MA, MIT Press, 2010). (Chapter 1,
Behavioral and Brain Sciences, vol.8, no.1, pp.1–42. (Reprinted ‘The philosophy and the approach’, reprinted in Yantis, S. (ed.)
in Fodor, 1990, pp.195–206.) Visual Perception: Essential Readings, Hove, Psychology Press,
Fodor, J.A. (1987) Psychosemantics: The Problem of Meaning 2003.)
in the Philosophy of Mind, Cambridge, MA, MIT Press. Marslen-Wilson, W. and Tyler, L.K. (1987) ‘Against modular-
Fodor, J.A. (1990) A Theory of Content and Other Essays, ity’, in Garfield, J. (ed.) Modularity in Knowledge Representation
Cambridge, MA, MIT Press. and Natural Language Understanding, Cambridge, MA, MIT
Fodor, J.A. (1998) In Critical Condition, Cambridge, MA, Press.
MIT Press. Marslen-Wilson, W. and Tyler, L.K. (1997) ‘Dissociating
Fodor, J.A. (2000) The Mind Doesn’t Work that Way: The types of mental computation’, Nature, vol.387, pp.592–4.
Scope and Limits of Computational Psychology, Cambridge, Marslen-Wilson, W. and Tyler, L.K. (1998) ‘Rules, repre-
MA, MIT Press. sentations, and the English past tense’, Trends in Cognitive
Fodor, J.A. (2005) ‘Reply to Steven Pinker “So how does the Sciences, vol.2, pp.428–35. (Reprinted in Cohen, G., Johnston,
mind work?”’ Mind & Language, vol.20, pp.25–32. R.A., and Plunkett, K. (eds.) Exploring Cognition: Damaged
Fodor, J.A. (2008) LOT 2: The Language of Thought Brains and Neural Networks. Readings in Cognitive
Revisited, Oxford, Oxford University Press. Neuropsychology and Connectionist Modelling, Hove,
Gallistel, C.R. (2001) ‘Mental representations, psychology Psychology Press, 2000.)
of ’, in Smelser, N.J. and Baltes, P.B. (eds.) International Marslen-Wilson, W., Brown, C.M., and Tyler, L.K. (1988)
Encyclopedia of the Social and Behavioral Sciences, Amsterdam ‘Lexical representations in spoken language comprehension’,
and New York, Elsevier. Language and Cognitive Processes, vol.3, pp.1–16.
678 PART 6 CHALLENGES, THEMES, AND ISSUES
Marslen-Wilson, W., Tyler, L.K., and Koster, C. (1993) Rumelhart, D.E. and McClelland, J.L. (1986) ‘On learning
‘Integrative processes in utterance resolution’, Journal of the past tenses of English verbs’, in McClelland, J.A. and
Memory and Language, vol.32, pp.647–66. Rumelhart, D.E. (eds.) Parallel Distributed Processing:
McClelland, J.L. and Patterson, K. (2002a) ‘“Words or Explorations in the Microstructure of Cognition, Volume 2:
rules” cannot exploit the regularity of exceptions’, Trends in Psychological and Biological Models, Cambridge, MA, MIT
Cognitive Sciences, vol.6, pp.464–5. Press.
McClelland, J.L. and Patterson, K. (2002b) ‘Rules or con- Searle, J.R. (1992) The Rediscovery of the Mind, Cambridge,
nections in past-tense inflections: what does the evidence rule MA, MIT Press.
out?’ Trends in Cognitive Sciences, vol.6, pp.465–72. Seidenberg, M.S. and McClelland, J.L. (1989) ‘A distrib-
McClelland, J.L., Rumelhart, D.E., and Hinton, G.E. (1986) uted, developmental model of word recognition and naming’,
‘The appeal of parallel distributed processing’, in Rumelhart, Psychological Review, vol.96, pp.523–68.
D.E. and McClelland, J.L. (eds.) Parallel Distributed Processing: Seidenberg, M.S. and Plaut, D.C. (2006) ‘Progress in under-
Explorations in the Microstructure of Cognition, Volume 1: standing word reading: data fitting versus theory building’, in
Foundations, Cambridge, MA, MIT Press. Andrews, S. (ed.) From Inkmarks to Ideas: Current Issues in
Pinker, S. (1997) How the Mind Works, New York, Lexical Processing, Hove, Psychology Press.
W.W. Norton. Shallice, T. (1988) From Neuropsychology to Mental
Pinker, S. (2005a) ‘So how does the mind work?’ Mind & Structure, Cambridge, Cambridge University Press.
Language, vol.20, pp.1–24. Shanahan, M. (2009) ‘The frame problem’, in Zalta, E.N.
Pinker, S. (2005b) ‘A reply to Jerry Fodor on how the mind (ed.) The Stanford Encyclopedia of Philosophy [online] Available
works’, Mind & Language, vol.20, pp.33–8. from: http://plato.stanford.edu/entries/frame-problem/
Pinker, S. (2006) ‘Whatever happened to the past tense Sperber, D. (1994) ‘The modularity of thought and the epi-
debate?’ in Baković, E., Ito, J., and McCarthy, J.J. (eds.) Wondering demiology of representations’, in Hirschfeld, L.A. and Gelman,
at the Natural Fecundity of Things: Essays in Honor of Alan Prince, S.A. (eds.) Mapping the Mind: Domain Specificity in Cognition
Santa Cruz, CA, Linguistics Research Center, University of and Culture, Cambridge, Cambridge University Press.
California, Santa Cruz. Available online from: Sperber, D. (1996) Explaining Culture: A Naturalistic
http://www.escholarship.org/uc/item/0xf9q0n8 Approach, Oxford, Blackwell.
Pinker, S. and Prince, A. (1988) ‘On language and connec- Sperber, D. (2002) ‘In defense of massive modularity’, in
tionism; analysis of a parallel distributed processing model of Dupoux, I. (ed.) Language, Brain and Cognitive Development:
language acquisition’, Cognition, vol.28, pp.73–193. Essays in Honor of Jacques Mehler, Cambridge, MA, MIT Press.
Pinker, S. and Ullman, M.T. (2002a) ‘The past and Stone, T. and Davies, M. (1999) ‘Autonomous psychology
future of the past tense’, Trends in Cognitive Sciences, vol.6, and the moderate neuron doctrine’, Behavioral and Brain
pp.456–63. Sciences, vol.22, pp.849–50.
Pinker, S. and Ullman, M.T. (2002b) ‘Combination and Stone, T. and Young, A.W. (1997) ‘Delusions and brain
structure, not gradedness, is the issue’, Trends in Cognitive injury: the philosophy and psychology of belief ’, Mind &
Sciences, vol.6, pp.463–74. Language, vol.12, pp.327–64.
Plaut, D.C., McClelland, J.L., Seidenberg, M.S., and Swinney, D.A. (1979) ‘Lexical access during sentence
Patterson, K. (1996) ‘Understanding normal and impaired comprehension: (re)consideration of context effects’,
word reading: computational principles in quasi-regular Journal of Verbal Learning and Verbal Behavior, vol.18, no.5,
domains’, Psychological Review, vol.103, pp.56–115. pp.645–59.
Plunkett, K. and Bandelow, S. (2006) ‘Stochastic approaches Tyler, L.K. and Marslen-Wilson, W. (1977) ‘The on-line
to understanding dissociations in inflectional morphology’, effects of semantic context on syntactic processing’,
Brain and Language, vol.98, pp.194–209. Journal of Verbal Learning and Verbal Behavior, vol.16,
Plunkett, K. and Marchman, V. (1993) ‘From rote learning pp.683–92.
to system building: acquiring verb morphology in children Tyler, L.K. and Marslen-Wilson, W. (1982) ‘Processing
and connectionist nets’, Cognition, vol.48, pp.21–69. utterances in discourse contexts: on-line resolution of
Robbins, P. (2009) ‘Modularity of mind’, in Zalta, E.N. anaphors’, Journal of Semantics, vol.1, pp.297–314.
(ed.) The Stanford Encyclopedia of Philosophy [online] Ullman, M.T. (2001) ‘A neurocognitive perspective on
Available from: http://plato.stanford.edu/entries/modularity- language: the declarative/procedural model’, Nature Reviews
mind/ Neuroscience, vol.2, pp.717–26.
CHAPTER 20 THEORETICAL ISSUES IN COGNITIVE PSYCHOLOGY 679
Ullman, M.T., Corkin, S., Coppola, M., Hickol, G., Weiskrantz, L. and Davies, M. (eds.) (2008) Frontiers of
Growdon, J.H., Koroshetz, W.J., and Pinker, S. (1997) ‘A neural Consciousness: Chichele Lectures, Oxford, Oxford University
dissociation within language: evidence that the mental dic- Press.
tionary is part of declarative memory, and that grammatical Woollams, A.M., Joanisse, M.F., and Patterson, K. (2009)
rules are processed by the procedural system’, Journal of ‘Past-tense generation from form versus meaning: behav-
Cognitive Neuroscience, vol.9, pp.266–76. ioural data and simulation evidence’, Journal of Memory and
Ullman, M.T., Pancheva, R., Love, T., Lee, E., Swinney, D., and Language, vol.61, pp.55–76.
Hickok, G. (2005) ‘Neural correlates of lexicon and grammar: Young, A.W. (1998) Face and Mind, Oxford, Oxford
evidence from the production, reading, and judgment of University Press.
inflection in aphasia’, Brain and Language, vol.93, pp.185–238.
In Chapter 1 of this volume, we attempted to lay out some of the foundations of cog-
nitive psychology, in part by tracing some of its historical antecedents. We hope that,
having reached the end of the book, you now find several of the features we described
in that first chapter are in much sharper focus.
One fundamental aspect of the mind is its intentional nature – mental states are
about aspects of the world and the discussions throughout this volume have illus-
trated this. In Part 1, we saw how the visual system recovers information about per-
ceived objects from the patterns of light that fall on the retina. Part 2 outlined the
processes by which the language system recovers information about perceived words
from patterns of sound (in audition) or light (in vision). Part 3 was concerned with
our memories of particular aspects of (external) events. Even Part 4, concerned with
the seemingly inwardly directed activity of thinking, was similarly concerned
with the external aspect of mental representations – at least when thinking is deli-
berative (Type 2). Thinking about problems, choices, and arguments involves recov-
ering true information about such things if we are to arrive at correct solutions,
genuine likelihoods, and valid conclusions. And in Part 5 we saw how cognition can
be examined via brain activity and how cognition ceases truly to reflect the way the
world is when brain organization is disrupted.
Another aspect of the mind that has become clear throughout this volume is its
fractionation. In part, the strategy of isolating particular mental faculties from one
another is a methodological one, pursued by cognitive psychologists in order to facil-
itate systematic study. But cognitive psychologists also believe that the mind is frac-
tionated, containing multiple interacting components that, acting in concert, give rise
to what appears to us to be a unified mind. The different parts of this book also reflect
the fractionation – we consider visual perception in isolation from language compre-
hension partly for reasons of methodological convenience, but partly because we
believe that visual perception and language comprehension call on unique cognitive
processes.
The fractionation of the mind has been elevated to the status of a philosophical
thesis – the so-called modularity of mind – that was the subject of explicit discussion
in Chapter 20, and also much (sometimes implicit) discussion elsewhere, for example
in Chapter 19. The modularity thesis distinguishes input systems, such as visual per-
ception and the early stages of language comprehension, from central systems, such
as reasoning, judgement, and arguably certain aspects of categorization. The extent to
which mental faculties reflect distinct processing modules adds further justification
to studying them in isolation from one another.
If the mind can be characterized in terms of modularity, the question arises as to
what kind of modules it possesses. Most of the chapters in this book have shown that
682 EPILOGUE
certain cognitive processes are subject to top-down influence, and the influence of
quite general knowledge. While such influences do not necessarily undermine a strict
interpretation of modularity, one in which processes are informationally encapsu-
lated, they nevertheless suggest that alternative understandings of modularity should
be considered (see the discussion of modularity in Chapter 20). Perhaps, for instance,
there is a sense of modularity in which modules can influence one another, or can
influence one another to a certain degree. The exact nature of the mind’s modularity
remains an open question – that it has some kind of modular structure seems to be a
claim on which many different theorists agree.
In Chapter 20 we also saw an argument that our understanding of central systems
is likely always to be poor. If central systems such as reasoning are sufficiently flexible
as to be able to call on any aspect of general knowledge, if they are so informationally
unencapsulated, the argument goes, then it may not be possible to delineate them in
a precise or meaningful way. However, much of this book suggests the opposite.
Where we have seen the influences of general knowledge on systems such as reason-
ing, the result has often been an improved understanding of the processes involved.
Even straying from the prime candidates for modularity, perceptual systems and the
early stages of language comprehension, researchers have succeeded in identifying
systematic influences on processing. To take just a few examples, in reasoning, cogni-
tive psychologists have developed theories to account for conditional inference, and
have succeeded in devising tasks that evaluate these. Researchers are shedding light
on the nature of consciousness, for so long regarded as such a mysterious subject that
a scientific approach to its study should be avoided. Cognitive psychologists have also
begun to shed light on the influence that emotion exerts upon such cognitive pro-
cesses as attention, memory, and language comprehension. The evaluation of this
research may yet be incomplete, but the picture the research suggests is very different
from the negative one offered by the modularity thesis.
The chapters in this book have also illuminated the preferred kinds of explanation
of cognitive processes. Chapter 1 outlined the importance of building models in the
development of scientific theories and, throughout the book, more or less detailed
models of different cognitive processes have been considered. Generally, researchers
have developed two kinds of computational model of cognitive processes – symbolic
and connectionist. These offer very different kinds of understanding of cognition, and
two different styles of explanation. According to symbolic models, cognition involves
the rule-based manipulation of (neurally realized) symbols and symbol expressions.
In connectionism, cognition is seen as involving the formation of a stable pattern of
activation across processing units that, in general, are not symbolic.
As this volume has revealed, there is much debate about the merits of these two
styles of computational modelling. Each has arguments in its favour. Symbolic mod-
els have advantages in modelling rule-based systems, as language appears to be
(though this too is debated). Connectionist models have the advantage of modelling
cognition in terms of processes and units that are superficially similar to processes
and structures in the brain.
The debate over symbolic and connectionist models hints at a broader tension con-
cerning the kind of explanation at play in cognitive psychology. In Chapter 1, we
EPILOGUE 683
outlined Marr’s three levels of explanation, suggesting that cognitive psychology was
concerned more with levels 1 and 2, the computational and algorithmic levels, than
with level 3, the hardware or implementation level (see also the discussion of this
issue in Chapter 20). Throughout this book, however, we have seen evidence of the
close relation between cognitive processes and underlying physiological processes.
Indeed, some have questioned whether these are more closely linked than Marr’s
analysis suggests. For example, connectionists try to ensure that the processes
involved in computational models are consistent with what we know of neural pro-
cesses.
Evidence from people who have experienced brain damage provides valuable evi-
dence of the nature of cognitive processes. If cognition is truly fractionated as
researchers believe, then it ought to be possible for certain mental faculties to be
impaired through damage whilst leaving others intact. Such dissociations have been
reliably observed in many different areas of cognition, and have helped researchers to
build, evaluate, and refine ever more complex models of cognitive processes.
By providing even more direct evidence of the nature of neural activity, neuroim-
aging techniques have enriched our understanding of cognitive processing. Whilst
participants perform tasks, images can be generated that indicate regions of the brain
with greatest neural activity. If researchers have a prior understanding of the function
of those brain areas, they can use this evidence to infer what kinds of information and
information processing are involved in different tasks. Of course, it is very difficult
indeed to understand precisely the functions of particular brain areas, and so the
interpretation of neuroimaging evidence remains hotly debated. However, there
seems little doubt that the next phase in the evolution of cognitive psychology will see
closer integration between work in the neurosciences and research adopting a more
traditional behavioural or experimental approach to the study of cognition. Already
we are beginning to see the value of such integration in our understanding of the
cognitive bases of psychiatric disorders (see Chapter 15). The intertwining of evi-
dence from neuroimaging, neuropsychological, and behavioural studies is set to
become even closer, and shed light on the fine detail of cognition, as in the case of
category specificity (see Chapters 1 and 5), to take just one example.
These are just some of the main themes to have emerged from the chapters in this
volume. At heart, such themes are all deeply concerned with the fundamental nature
of cognition, and how the debates they engender ultimately turn out is likely to have
profound implications for our understanding of the mind.
Regardless of the intellectual excitement of debates and disagreements, it would be
wrong to characterize cognitive psychology solely in these terms. The chapters in this
book also document the very considerable progress researchers have made in estab-
lishing a shared understanding of the structure and time course of cognitive pro-
cesses. It is perhaps this combination of substantial progress on the detail of cognitive
processes with profoundly significant debates about fundamental features of the
mind that makes cognitive psychology such an exciting subject. We hope the chapters
of this book have given you a rich understanding of cognitive psychology and, above
all, have enabled you to share this sense of excitement and enthusiasm.
This page intentionally left blank
GLOSSARY
21/2D sketch The third stage in Marr’s theory of visual Algorithm A clear-cut formula or set of steps for solving a
perception, in which a description is formed of how the particular problem.
surfaces in view relate to one another and to the observer. Allophone Allophones are speech sounds that are dis-
3D object-centred description The fourth stage in Marr’s tinct but that do not change the meaning of a word if
theory of visual perception, in which object descriptions interchanged; for example, the ‘o’ in scone can be pro-
are produced that allow the object to be recognized nounced differently depending on regional accent, but the
from any angle (i.e. independent of the viewpoint of the listener is still able to recognize the word scone with little
observer). difficulty.
Abductive inference Inference to the best explanation. In Ambient optic array The structure that is imposed on
contrast to deductive inference, inductive inference and light when it is reflected by the textured surfaces in the
abductive inference are kinds of non-demonstrative infer- world around us.
ence: the conclusion goes beyond what is logically guaran- Amnesic syndrome This syndrome refers to a relatively
teed by the premise or premises. Abductive inference pure memory deficit for the learning of new episodic
differs from inductive inference in that it appeals to information. It includes a retrograde component extend-
explanatory considerations and not just statistical or prob- ing back months or even some years from the amnesia-
abilistic considerations. In abductive inference, the prem- inducing trauma, but amnesics retain normal memory for
ises state some evidence and the conclusion is the events that occurred prior to this period.
hypothesis or theory which, if it were true, would provide
Amygdalae The amygdalae (singular, amygdala) are
the best explanation of the evidence.
groups of nuclei found within the medial temporal lobes.
Acquisition time In fMRI, the time required to take one They have been shown to play a significant role in emotion.
scan.
Analogical problem solving Using an analogy from a
Activation PET PET studies used to determine where semantically distant domain to guide problem solving.
activity increases in the brain as a function of a particular
Anaphora Property of referring back to a previous men-
cognitive task.
tion (e.g. a man) using either a definite noun phrase (e.g.
Afferent Afferent nerve fibres run ‘in towards’ the nerv-
the man) or pronoun (e.g. he). Literally means ‘carrying
ous system. They conduct (for example) sensory informa-
back’.
tion, and contrast with efferent fibres.
Angiograms Maps of blood vessel distribution.
Affordance Refers to the fact that the visual properties of
Anosognosia Unawareness of cognitive, sensory, or
an object provide cues as to how it can be interacted with
and used. motor impairment due to brain damage. Patients showing
anosognosia tend to deny or grossly underestimate their
Agnosia Impaired perceptual recognition not due to a
own disabilities, such as paresis, amnesia, aphasia, or
deficit of sensory processes. Apperceptive agnosia refers to
blindness, despite these deficits being evident to other
a deficit of higher level perceptual processes. In these cases,
persons.
patients may not be able to recognize objects if presented
in unusual views or overlapping other stimuli. Associative Anterior In front or before; contrasts with posterior.
agnosia refers to a deficit in retrieving semantic informa- Anterograde amnesia Difficulty in learning new informa-
tion about the stimulus. tion after the brain lesion.
Alexia Impairment of reading. The term alexia is mainly Apraxia Impairment of gesture production not due to
used to imply an acquired deficit following brain damage. motor impairment per se.
686 GLOSSARY
Arousal A state of being awake and responsive to stimuli. Baseline correction In neuroimaging, a process that
Arousal depends in part on the activity of the autonomic involves calculating, for each recording channel, the mean
nervous system (ANS). signal over a specified baseline interval, prior to stimulus
Articulatory loop (phonological loop) A sub-vocal onset, which is then subtracted from the signal at all
rehearsal loop. time points.
Articulatory suppression A secondary task (see Dual Basic emotions A categorical set of discrete emotions,
task) involving the repetition of redundant and irrelevant often thought to be of biological origin, and considered to
words such as the-the-the-the. be the most fundamental or important. It is argued that
different combinations of basic emotions can produce the
Associated words Associated words are words that seem
full richness of emotion experience.
to go naturally together, such as cheddar and cheese, or fish
Between-category distinction A form of object recogni-
and chips. Association between words is often determined
tion that is based on deciding what category an object
by asking people to say or write down the first word that
belongs to. For example, deciding that an object is a car,
comes into their head when they read a target word.
rather than which specific car it might be.
Attentional blink When someone watching for a target item
Binding problem The problem of how the apparent unity
in a rapidly presented sequence of stimuli detects the target,
of conscious experience is brought about by the distributed
there follows a brief period when they are unable to identify
activities of the central nervous system. For example, how
subsequent items. It is as if their attention has ‘closed its
the features of different objects in the environment come
eyes’ – a blink (see Rapid serial visual presentation).
to be perceived as ‘belonging together’.
Attenuation The reduction in intensity of a stimulus.
Blindsight A phenomenon in which people who are per-
Wearing sunglasses attenuates the light. It has been sug-
ceptually blind in a certain area of their visual field are nev-
gested that neural activity associated with a stimulus, such as
ertheless able to demonstrate some response to visual
speech, is attenuated when attention is directed elsewhere.
stimuli.
Auditory perception The cognitive processes involved in
Block designs A kind of experimental design in which tri-
making sense of information received from the ears.
als or sets of trials are grouped together in blocks, each
Automatic process A process whose successful conduct block presenting participants with trials combining par-
has come to require little attention. Examples include ticular experimental conditions.
behaviours such as driving, and are usually the result of
Blood oxygenation Refers to the amount of oxygen in the
learning, repetition, and practice.
blood within a region of interest.
Autonomic nervous system (ANS) A network of nerve
BOLD contrast Blood oxygen level dependent or BOLD
fibres throughout the body that transmits signals to the
contrast reflects the degree of oxygenation of the blood.
various organs, muscles, and glands. The ANS is divided
into two sections. The sympathetic ANS produces effects Borderline items Whose category membership is unclear.
associated with arousal, while the parasympathetic ANS Colour categories, for example, have no obvious boundary –
tends to dominate during periods of rest, and has broadly it seems impossible to draw a line on the colour spectrum,
opposite effects on the body. say, between red and orange. In between these two catego-
ries there seem to be shades that are neither unequivocally
Backward masking A technique used in cognitive research
red nor unequivocally orange, hence our use of phrases
whereby the presentation of an initial stimulus (the target)
such as ‘a reddy-orange’.
is disrupted by the subsequent presentation of a second
Bottom-up processing An approach to cognition that
stimulus (the mask), often to the extent that a participant
begins with information received from the senses, which is
will fail to report seeing the target.
analysed in order to make sense of the environment.
Balint’s syndrome An extreme form of neglect in which
Bottom-up processing assumes that pieces of information
both parietal lobes are damaged, making it hard for a
in the input signal are initially processed separately, and
patient to shift attention between objects.
that these pieces of information are gradually linked to
Base rate The information about the broad likelihood of form larger pieces of information as processing continues.
a particular type of event. For example, when you hear a sentence you would first
GLOSSARY 687
process the phonetic features in the input before combin- Category specific impairment Impairment of knowledge
ing these features in order to generate a string of pho- about a specific category of objects (e.g. tools) caused by
nemes; these phonemes would then be combined to form brain injury.
words, with words then being combined to form a com- Central executive Hypothetical entity responsible for the
plete sentence. In other words, processing begins with the attentional control and coordination of mental operations.
smallest processing unit, and builds to produce more com-
Chaining Forming a sequence of items or actions linked
plex representations.
by associations between successive pairs of items.
Bounded rationality The idea that in decision making,
Chinese Room thought experiment An important
rationality of individuals is limited by what information
thought experiment introduced by John Searle. The exper-
they have, the cognitive limitations of their minds, and the
iment consists of Searle in a room, acting as a computer
limited amount of time they have to make decisions.
might. By hypothesis, through following a rule book and
Broca’s aphasia A language impairment mainly consisting manipulating cards with Chinese symbols written upon
of difficulties with speech associated with minor deficit of them, he can receive input symbols (questions posed by
verbal comprehension. someone outside the room) and output appropriate sym-
Canonical coordinate frame A form of 3D object-centred bols in return (answers to the self-same questions). To
description proposed by Marr and Nishihara (1978) in people outside the room, Searle understands Chinese.
which objects are represented within a framework that was However, Searle contends that he lacks such an under-
about the same shape as the object, so that a carrot would standing, and merely slavishly follows the rules that are
be a cylinder that tapered towards one end. specified. The thought experiment has been much debated
Capacity Limit on the amount of information that can be and attacked, but Searle used it to criticize the idea that
stored or processed. computers, through syntactic manipulation of symbols
alone, could ever be claimed to achieve understanding and
Capgras delusion/syndrome A neuropsychological condi-
intelligence. Thus Searle’s argument is a denial of the valid-
tion in which the patient believes that someone they know
ity of the Turing test.
has been replaced by an impostor with the same appear-
ance. This can be part of a psychiatric illness but usually Chunk A set of items of information grouped, or chunked,
results from brain injury. so as to be cognitively processed as a single unit.
Cartesian theatre A derisive phrase coined by philoso- Classical view The classical view is a view of concepts that
pher Daniel Dennett to describe a hypothetical location in has its roots in classical thought. It is the view that things
the mind where consciousness is located. belong to categories because they possess certain proper-
ties in common. Accordingly, if something is a member of
Categories Talk of concepts presupposes the existence of
a category, then it necessarily possesses the common
a corresponding category, that which a concept is about.
properties, and if something possesses the common prop-
Researchers often adopt the terminological distinction
erties this is a sufficient criterion for it to be a member of
that the word ‘concept’ refers to something in the mind
the category. The view is also synonymous with the claim
and ‘category’ refers to those things in the world that a con-
that concepts provide definitions of their corresponding
cept is about.
category.
Categorization Categorization, according to Bruner et al.
Coarticulation Coarticulation occurs when two sounds
(1956) is to ‘render discriminably different things equiva-
that are adjacent in the speech stream blend together.
lent, to group objects and events and people around us
Coarticulation occurs because you have to prepare to say
into classes, and to respond to them in terms of their class
upcoming phonemes well before they are produced. These
membership rather than their uniqueness’. Concepts may
preparations will lead to changes in phonemes that are
therefore be implicated when similar behaviour is shown
currently being produced. For example, the /d/ phonemes
toward different objects, and different behaviour is shown
in do and dah sound slightly different because of the fol-
toward different objects. For example, patting an Alsatian
lowing vowel.
and a poodle, but not a wisteria, would be explained by
the first two items but not the third sharing category Co-evolution of theories Two scientific theories are
membership. said to co-evolve when they develop in a relationship of
688 GLOSSARY
reciprocal influence, with correction, constraint, inspira- unlikely to include the property ‘jumps into swimming
tion, and enrichment operating in both directions. Two pools fully clothed’. So how might we explain the categori-
theories that co-evolve may retain their own distinctive zation? Murphy and Medin argue that categorizing the
concepts and explanatory perspectives. person as ‘intoxicated’ plays a role in explaining their
Cognitive appraisals Cognitive interpretations of physio- behaviour, that is, in explaining why they jumped into the
logical states of arousal. swimming pool.
Cognitive bias The selective processing of pathology- Complex concepts Researchers have tried to explain the
congruent information. In other words, cognitive pro- meanings of phrases and larger linguistic units in terms of
cesses are biased if an individual selectively prioritizes complex concepts, i.e. combinations of lexical concepts.
information that reinforces a pathological state. The meaning of the phrase ‘red car’ would then be
explained in terms of the combination of the constituent
Cognitive bias modification (CBM) Procedures that
lexical concepts ‘red’ and ‘car’.
experimentally train participants to select for further pro-
cessing information that is either congruent or incongru- Complex problem solving Solving problems that require
ent with their pathology. extensive domain knowledge.
Cognitive correlates of consciousness Cognitive pro- Complex system A system composed of interconnected
cesses that are (merely) correlated with conscious aware- parts that as a whole exhibit one or more properties
ness of stimuli in the environment or in memory, and are (behaviour being among the possible properties) that are
not necessarily constitutive of consciousness itself. not obvious from the properties of the individual parts.
Cognitive modelling Cognitive modelling involves build- Compositional structure Compositionality is the deter-
ing a working model of a cognitive process and then com- mination of the meaning of a complex representation by
paring the behaviour of that model against human the meanings of its constituent parts and the way that the
performance. parts are put together. When a complex representation
exhibits compositionality it is also said to have composi-
Cognitive neuropsychology The study of the effect of
tional structure. The compositional structure of natural
brain lesions in order to understand intact and impaired
language sentences allows us to understand sentences that
cognition, rather than in order to understand which ana-
we have never heard before.
tomical area(s) implement particular functions (which is
the business of the complementary discipline of neuropsy- Computational model of the mind (CMM) Also known as
chology). the computational theory of the mind, the CMM is the
proposal that the mind is an information-processing sys-
Coherence Property of connected discourse whereby the
tem and that cognition involves the rule-guided process-
sentences relate logically or psychologically to each other.
ing of structured mental representations. The claims that
Sentences may be linked together through repeated refer-
cognitive processes are rule-guided and that mental repre-
ence to the same people or things.
sentations have compositional structure are both chal-
Common ground Knowledge that is shared between two lenged by connectionism.
people such that they both know that it is shared. This is
Computational modelling An explicit account of some
often important for formulating utterances in such a way
process or processes that is implemented as a computer
that they can definitely be understood by the person you
program.
are talking to. For example, if it is common ground that
two of you were at the same party last night, you could say Concept Concepts are general ideas formed in the mind,
‘Did you enjoy it, then?’ with it meaning the party. meaning that concepts apply to every one of a class of
things (usually described as a category). For example, a
Commonsense theories Murphy and Medin argued that
concept of ‘cat’ is a general idea of all cats.
concepts are explanation-based; that there is some explan-
atory principle or theory that unites the category. They Conceptual incidental test A test of conceptual implicit
offer the example of someone at a party who jumps into a memory that requires subjects to employ semantic knowl-
swimming pool fully clothed. You might categorize this edge to answer questions or respond to a cue.
person as being intoxicated. But a similarity-based view Conditioned reflex An acquired response that is under the
cannot explain this because your concept of ‘intoxicated’ is control of (conditional on the occurrence of) a stimulus.
GLOSSARY 689
Configural processing (and face recognition) This term Controlled process In contrast to automatic processes, a
has been used in several ways, namely to refer to the pro- controlled process is one that requires for its successful
cessing of the spatial relationships between facial features, execution a considerable amount of attention or cognitive
to the way facial features interact with one another, and to effort. Such processes may become relatively automatic
the processing of the holistic nature of the face, i.e. that it is with extensive practice (e.g. driving behaviours), but in
perceived as a whole pattern. their initial stages they are typically slow and effortful.
Connectionist systems Artificial neural networks where Covert face recognition Non-conscious face recognition
representation and processing are intimately related. as measured by autonomic responses, which appears to
Connectionism supports the memory systems perspective be mediated by different pathways to overt conscious face
that memory stores and memory processing are localized recognition.
in the same part of the brain. Cross-modal priming In a cross-modal priming task the
Constructability The extent to which a pertinent descrip- prime and target are presented in different modalities.
tion of the target in memory can be constructed. Typically the prime word is spoken, followed by a written
Constructivist approach An approach to perception that target. Participants must then make some kind of decision
concentrates on the ‘top-down’ flow of information. Thus, regarding the visual target word. The critical question is
perception is guided by testing ‘perceptual hypotheses’ whether the prime word influences processing of the target
formed using previously stored knowledge about the envi- word; if the meaning of the prime word has been activated
ronment. then it should influence how the target word is processed.
Content words Words that convey meanings, including Cybernetics The interdisciplinary study of the structure
nouns, verbs, adjectives, and adverbs, are known as con- of regulatory systems.
tent words. These words have meaning even when pre- Decision tree A decision support tool that uses a tree-like
sented on their own outside of a sentence. graph or model of decisions and their possible conse-
Context-sensitivity Typicality effects are changed by lin- quences, including chance event outcomes, resource costs,
guistic context. For example, participants rated the typical- and utility. It is one way to display an algorithm.
ity of different farm animals with respect to the category Declarative knowledge Knowledge about events and
‘animal’. Participants were first presented with a context facts.
sentence that emphasized a particular activity. When the Declarative memory system Our memory for events and
context sentence referred to milking, cows were consid- facts. The key feature of the declarative memory system is
ered to be more typical ‘animals’ than horses. However, that the subject is consciously aware of the information
when the context referred to riding, horses were consid- retrieved.
ered more typical ‘animals’ than cows. Other participants
Definitions The classical view of concepts is that concepts
rated metal spoons as more typical than wooden spoons,
provide definitions of their corresponding category.
and small spoons as more typical than large spoons, but
large wooden spoons as more typical than small wooden Depolarization The change in voltage across the mem-
spoons. So, the contribution to typicality made by the val- brane of a retinal cell as light strikes it. This can be used to
ues large and small depended on whether one was think- derive the intensity of the light and produce a grey level
ing about metal spoons or wooden spoons. description of the surrounding world.
Continuous/spontaneous EEG A technique that produces Depth of processing Craik and Lockhart (1975) pre-
electroencephalograms reflecting continuous voltage fluc- sumed that processing followed a fixed sequence of levels,
tuations as a function of time, and that can be viewed from early perceptual processes, through pattern recogni-
directly for each electrode during the recording. tion, to the extraction of meaning. The greater the depth of
processing applied to an item, the more elaborate, longer
Contour generator The edge of an object’s silhouette,
lasting, and stronger were the resulting memory traces,
which Marr (1977) suggested could be used to work out
and so the more likely the item was to be remembered.
the shape of the object.
Depth perception The ability to determine how far away
Contralateral The opposite side from.
an object is. This can be achieved by comparing the differ-
Contralesional Opposite the side of the lesion. ent retinal images from the left and right eyes (known as
690 GLOSSARY
stereopsis) or by analysing available cues, such as the size knowledge system can, similarly, be described as domain
of texture elements on the surface of the object. specific if it contains knowledge only about a restricted
Derivational morphology Derivational morphology refers range of properties or objects.
to larger modifications to words that may result in a change Dorsal stream The pathway that projects from the pri-
in grammatical category. For example, the suffix ‘-ness’ can mary visual cortex to the parietal cortex that specializes in
change the adjective ‘happy’ into a noun: ‘happiness’. information about the position and movement of objects.
Developmental amnesia Impairment in episodic memory Sometimes referred to as the ‘where system’ as it deals with
despite a preserved memory for facts (semantic memory) perception for action, or in other words, information
and normal language development and literacy levels. about where an object is and how it is moving.
Diagnostic and Statistical Manual of Mental Disorders, Dot probe task A task in which participants must respond
Fourth Edition (DSM IV) The manual psychiatrists use as rapidly as possible to the presentation of a dot (termed a
to categorise psychiatric diagnoses. Published by the ‘probe’ because it is used to probe where attention is
American Psychiatric Association, it covers all mental located).
health disorders for both children and adults, it also lists Double dissociation A pattern of impaired and spared
known causes of these disorders, related statistics, and performance in two patients with brain injuries. One
research concerning the best treatments. patient shows impaired performance on Task 1 but perfor-
Diagnostic value The extent to which memory cues distin- mance within the normal range on Task 2, while a second
guish the target memory record from other records in patient shows the reverse pattern. The two tasks are said to
memory. be doubly dissociated. While double dissociation evidence
supports models or theories in which separate modules are
Dichoptic A form of visual presentation that delivers a
involved in the two tasks, the inference from evidence to
different stimulus to each eye.
theory is not deductive but, as throughout normal science,
Dichotic listening Listening to a different message in each abductive.
ear (see Shadowing).
Down-regulation Down-regulation refers to an individu-
Dipoles Neuronal current sources, which may be radial al’s ability to reduce an emotional response, and most often
(directed towards or away from the scalp) or tangential applies to negative emotions (e.g. suppressing a bad or
(parallel to the scalp). unhelpful feeling).
Direct perception Gibson’s (1950) approach to percep- Dual process signal detection theory (DPSDT) Assumes
tion, which sees the information present in light as being that recognition can enlist two retrieval processes. One
sufficient to allow a person to move through and interact retrieval process provides an assessment of the familiarity of
with the environment without the need for cognitive items and events, while the second retrieval process is simi-
processing. lar to the retrieval process underlying free recall. These two
Direct retrieval In direct retrieval a cue causes a pattern of independent retrieval processes are initiated simultane-
activation in autobiographical knowledge (AK) that stabi- ously.
lizes as a specific autobiographical memory and bypasses Dualism An approach to the relationship between mind
the stages of generative retrieval. and body that regards them as belonging to distinct onto-
Discriminability The extent to which the target memory logical categories. For example, Descartes regarded the
record can be discriminated from all other records in mind as a non-physical substance.
memory. Dual-task paradigm (primary task, secondary task) An
Distinctiveness The characteristics of a stimulus that experimental method in which two tasks are performed
makes it stand out from other stimuli. Distinctive process- simultaneously, with either one (the primary task) being
ing emphasizes the differences between stimulus items. more important than the other (the secondary task) or
both being of equal importance.
Domain specificity An information-processing system is
domain specific if its operation is restricted to information Dysgraphia Difficulty in writing and spelling.
about a particular range of properties (e.g. colours) or a Dyslexia The term dyslexia is more commonly used to
particular class of objects (e.g. faces) in the world. A refer to developmental cognitive disorder.
GLOSSARY 691
Early onset amnesia Another term for developmental Episodic The information that defines a particular instance,
amnesia. rather than a general label (such as a letter name; see
Echoic memory The brief storage of an unattended audi- Semantic). Thus, in addition to recognizing (semantic) the
tory event (say a spoken word) that enables it still to be letter P, there is information showing that this instance of the
‘heard’, like an echo, if attention is directed to it sufficiently letter is black, upper case, with a comma just to the right of it.
quickly. Episodic buffer A limited capacity multi-dimensional
Ecological optics The theory of perception developed by store that backs up the central executive and at the same
J.J. Gibson (1950) that concentrated on how the environ- time provides a link with long-term memory.
ment structures light as it is reflected. Gibson believed Episodic memory Episodic memory is the record of our
that the resultant structure in the light was so rich that life experiences along with contextual information about
no cognitive processing was required to perceive the these events and occurrences, such as information about
environment. where they occurred and the person’s thoughts and feel-
EEG (electroencephalography) The detection of the elec- ings about the event.
trical activity of neurons in the brain by means of picking Essential properties Properties such that if an object did
up and amplifying the tiny voltages that reach the scalp. not possess them, it would not be that object. The essential
Efferent Efferent nerve fibres run ‘out from’ the nervous properties of birds are properties that all birds necessarily
system; they conduct (for example) motor impulses, and possess; if something doesn’t possess them, then it isn’t a
contrast with afferent fibres. bird. Essential properties may seem rather like the defining
properties of the classical view. However, there is one criti-
Embodied meaning The idea that the meaning of words
cal difference. According to psychological essentialism
can sometimes be directly represented in terms of motor
most people will not know what a category’s essential
actions that correspond to how you would act out the
properties are, but will still believe that the category has
meaning. For example, the meaning of kick might corre-
some. We might speculate as to what the essential proper-
spond to the motor activation of muscles used in kicking,
ties are – perhaps for biological categories they would be
and the meaning of give might correspond to the motor
genetic properties – but, in general, our beliefs will be
activation of muscles used to hand something to someone.
vague and may turn out to be incorrect. So psychological
Emotion family A term used by Paul Ekman to describe essentialism proposes that people’s concepts may contain a
sets of emotions that are related to each other. ‘place-holder’ for an essence – and the place-holder may
Emotion regulation The process by which we manage and even be empty, reflecting a lack of knowledge as to what
redirect our emotions. the essential properties might be.
Essentialism Psychological essentialism is one attempt at
Encoding Encoding refers to the way in which objects and
more precisely formulating the view that categorization is
events in the world are perceived and come to be repre-
influenced by deeper, explanatory principles. Medin
sented in memory.
(1989) and Medin and Ortony (1989) suggested that peo-
Encoding specificity hypothesis Specific retrieval cues ple believe that, and act as though, category members
facilitate recall only if they and their relation to the target have certain essential properties in common. That is, peo-
item are stored along with the target item. Successful ple categorize things according to their beliefs about
retrieval of the target item increases with the overlap essential properties. They may also believe that the essen-
between the information stored in memory and the infor- tial properties constrain a category’s more superficial
mation employed at retrieval. properties. For example, the essential properties of
EOG A technique that can be used to monitor eye move- birds might be thought to involve their genetic make-up,
ments. It involves placing electrodes around the eyes and properties that would constrain their appearance and
produces an electrooculogram. behaviour.
Epiphenomenon (plural epiphenomena) The view that Evaluability Extent to which an activity or a programme
consciousness is an epiphenomenon is the view that con- can be evaluated in a reliable and a credible fashion.
scious states are simply by-products of physical (brain) Event-related designs A kind of experimental design used
processes and cannot themselves have causal effects. in neuroimaging studies that addresses problems associ-
692 GLOSSARY
ated with block designs by incorporating randomized ognized through analysing key characteristics. The
presentation of trials and averaging neural activity across Pandemonium system was based on feature recognition
trials of the same type. and successfully adapted into a computer program that
Event-related fields (ERFs) In MEG, the averaged mag- was able to recognize alphanumeric characters.
netic signals resulting from and time-locked to a particular Feedback When an event is part of a chain of cause-and-
cognitive event. effect that forms a circuit or loop, then the event is said to
Event-related potentials (ERPs) Connecting electrodes ‘feed back’ into itself.
to the scalp can reveal electrical potentials (i.e. voltages) Feedback system A process based on monitoring infor-
produced by neural activity in the brain. Since particular mation from sensory receptors in order to moderate the
patterns of potential are produced by specific events, such movement of the part of the body where the receptors are
as a flash of light or a particular sound, they are termed located. For example, information from touch receptors on
‘event-related’. In EEG, ERPs refer to the averaged electri- the fingers is used to guide how much pressure to apply
cal signals resulting from and time-locked to a particular when picking up an object.
cognitive event.
Filter A system that accepts a mixture of stimuli, but
Expert A person who possesses a high degree of skill and passes on only the attended stimulus while excluding oth-
knowledge in a given domain. ers. This contrasts with the theory that unattended infor-
Explicit learning Explicit learning occurs when the learner mation is only attenuated, not excluded. (See Attenuation.)
is fully conscious of what is being learned, and has a strong Filtering In neuroimaging, a process applied to a data set
intention to learn. For example, grammatical rules in a to remove any frequencies that are not part of the signal
non-native language are typically acquired both con- of interest.
sciously and intentionally by second language learners.
Fixations In eye movement research a fixation is a period
Explicit memory With an explicit memory test, it is clear during which the eye remains stable, fixating at the same
to subjects that they need to remember past events to com- point. Typically fixations last between 200 and 250 ms.
plete the test. Free recall, cued recall, and recognition tests
fMRI Functional magnetic resonance imaging or fMRI is a
are all examples of explicit memory tests.
technique used by psychologists to measure how the con-
Extended 10/20 system A system for identifying or refer- centration of oxygen in the blood changes in different
encing electrode locations defined with respect to frac- parts of the brain as cognitive state changes.
tions of the distance between nasion and inion (i.e. root of
Focus Linguistic emphasis placed on certain parts of an
the nose to the ‘little bump on the back of your head’, or
utterance, either through stressing the speech or through
‘front-back’) and the pre-auricular points (the little skin
using different syntactic structures.
lobules in front of your ear canals, or ‘left-right’, also
known as left pre-auricular or LPA and right pre-auricular Fovea An indented area of the retina that contains the
or RPA). highest density of cones and is responsible for the
perception of fine detail that is necessary for tasks such as
External representation Knowledge and structure in the
reading.
environment that may support learning and problem solv-
ing, e.g. an abacus, a list written on paper, colour or size. Frame problem In artificial intelligence, the frame prob-
lem is the problem of formally specifying the situation
Familiarity Another term used to indicate strength of
after an action that brings about change. This is problem-
evidence.
atic because there is a potentially open-ended set of things
Feature integration theory Triesman’s theory that the that might, in principle, have been changed and that have
separate features of a target stimulus, such as its colour to be specified as not having been changed by the action. In
and shape, have to be integrated in order to identify the robotics, the problem arises in designing a robot that needs
item. This integration is a serial process (see Serial and to update its own database to take account of changes pro-
Parallel). duced by its own actions as it performs a task. It might be
Feature recognition theories Theories of object recogni- suggested that this updating would be more tractable if it
tion designed to overcome the problems with template were restricted to information that was marked as relevant
matching in which objects are stored in memory and rec- to the task. But relevance depends on context, and what is
GLOSSARY 693
or is not relevant may itself have been changed by the Gamma oscillations In neuroimaging, a signal in the fre-
robot’s action. quency range above 30 Hz (though definitions differ
Framing effect This describes cognitive biases such that slightly), which has been associated with complex stimulus
presenting the same option in different formats can alter processing such as Gestalt perception.
people’s decisions. Specifically, individuals have a ten- Gaussian blurring A technique based on averaging the
dency to select inconsistent choices, depending on intensity values of an image in circular regions such that
whether the question is framed to concentrate on losses or the values at the centre of the circle are weighted more than
gains. those at the edges in a way identical to a normal (or
Free recall Refers to an explicit memory task where the Gaussian) distribution, which results in blurring the
subject is allowed to recall the items of a list in any order. image. Blurring images is an important way of removing
random fluctuations and identifying the edges of objects.
Function words Function words are grammatical words
such as we and on that often have little meaning on their General events A variety of autobiographical knowledge
own, but are important in expressing grammatical rela- structures such as single events (e.g. the day we went to
tionships between other words in a sentence. South Wales), repeated events (e.g. Friday afternoons at the
Functional dissociation This occurs when one has identi- pub), and extended events (e.g. the conference in Sydney).
fied a brain region that is uniquely influenced by some Generalized cone Any 3D shape that has a cross-section
experimental manipulations but not by others. of a consistent shape throughout its length. The cross-sec-
Functional fixity A tendency to represent objects in terms tion can vary in size, but not in shape.
of their normal uses, which can block insight when an Generative retrieval Generative retrieval occurs when
unusual use is required. remembering is intentional and the knowledge base is
Functionalism The idea that the mind and mental states iteratively sampled as a memory is effortfully constructed.
are constituted solely by their functional role, not by their Geon Short form of ‘geometric ion’ – a set of basic 3D
physical composition. According to functionalism, it is shapes that are used to represent objects in Biederman’s
possible for the same function to be implemented in differ- theory of recognition.
ent hardware (e.g. brains and digital computers). For a
Gerstmann’s syndrome This encompasses four deficits:
functionalist, the fact that digital computers and brains are
finger agnosia, agraphia, acalculia, and left-right disorien-
physically different is no argument against them having
tation. The association of these deficits is not due to dam-
similar properties (e.g. intelligence).
age of similar cognitive processes, but to a common brain
Functionalist psychology A general psychological philos- lesion in the left parietal lobe.
ophy that considers mental life and behaviour in terms of
Gestalt movement An approach to perception dominant
active adaptation to the person’s environment. As such, it
in the early 20th century that concentrated on how the
provides the general basis for developing psychological
parts of an image were organized and held that the ‘whole
theories not readily testable by controlled experiments and
is greater than the sum of its parts’.
for applied psychology.
Gestaltists A school of psychology originating in
Fuzzy categories Categories that seem to have genuine
Germany and Austria, which claims that all experience
borderline cases (see also Borderlines). For these, simi-
consists of ‘gestalten’, and that the response of an organism
larity to a prototype might provide the best explanation
to a situation is a complete and unanalysable whole
of category membership, since there is no prospect of
rather than a sum of the responses to specific elements in
defining these categories, and people do not seem to have
the situation.
relevant commonsense theories (e.g. a theory of the
deeper causal principles by which red things come to Global workspace theory A theory developed by Bernard
appear red). Baars in which consciousness is seen as a ‘global work-
space’, a means of bringing together the products of pro-
Galvanic skin response (GSR) The change in electrical
cessing from widely distributed modules.
resistance of the skin in response to an emotion-provoking
stimulus. The change results from changing levels of sweat Goal hierarchy A hierarchy of currently active goals and
in the sweat glands. self-conceptions through which it is hypothesized that
694 GLOSSARY
current experience is encoded and in which autobiograph- Homophones Homophones are words that are pro-
ical memories are constructed. nounced in the same way but differ in meaning. Sometimes
Grey level description The first stage in Marr’s theory of homophones both sound the same and are spelled the
visual perception in which the intensity of light is meas- same (e.g. bank – money bank vs river bank) and some-
ured at each point in the retinal image. times they are pronounced the same but spelled differently
(e.g. pair vs pear or pane vs pain).
Greyscale or grey level An image comprised solely from
shades of grey ranging from white to black. Such an image Homunculus A person in the head that can be used
can be produced by analysing the intensity of light. to give the misleading impression that we have an explana-
tion for the actions of the owner of the head, when actually
Habituation A decreased neural (psychological or behav-
the problem of explanation is being avoided.
ioural) response to a stimulus after repeated exposure to
that stimulus. Horizon ratio relation An example of what Gibson
termed invariant information. Refers to the fact that the
Haemodynamic lag The lag of the order of 4–5 seconds
ratio of how much of an object is above the horizon to how
after experimental conditions change before a correspond-
much is below remains constant regardless of how far
ing change is seen in BOLD contrast.
away the object is.
Haemodynamic response The change in BOLD contrast
Iconic memory A system that enables the experienced
that occurs with a change in neural activity in a particular
duration of a brief visual stimulus to be longer than the
brain region.
actual event; the visual equivalent of echoic memory.
Haptic information Essentially ‘touch’ information. The
Impasse A point in problem solving beyond which no fur-
information about objects and surfaces gained from com-
ther progress appears possible.
bining kinesthesis with cues from touch receptors.
Implicit learning Implicit learning occurs when the
Haptic perception The cognitive processes involved in
learner is unaware of what is being learned, and does not
making sense of information received through touch.
necessarily intend to learn. As a result, implicit knowledge
Head-up display (HUD) A transparent screen placed
can be difficult to describe to others. For example, chil-
between an aircraft pilot and the windshield, in which
dren typically learn their first language without explicitly
vital information, such as altitude and heading, can be
being taught grammatical rules, and may later find it dif-
reflected. Being transparent, it is possible to look
ficult to explain these grammatical rules to a non-native
through the HUD to the outside world, this arrangement
speaker.
eliminating the need to look into the cockpit to read
instruments. Implicit memory In tests of implicit memory, perfor-
mance is influenced by previous experience without the
Heuristic A shortcut strategy for tackling a class of prob-
subject intentionally remembering the events from the
lems that often but not always yields a solution.
past or being aware of the relevance of the past events. In
Higher order thought theory A theory (or family of theo- other words, implicit memory is supposed to be both
ries) concerning consciousness, in which it is argued that unintentional and unconscious.
information is conscious only when it is the subject of a
Indirect speech acts Saying something indirectly to mean
(higher order) thought. For example, the experience of a
something else. Typically used for polite requests (e.g. ‘Can
traffic light as red may become conscious only when it is
you pass the salt?’ meaning ‘Pass the salt.’).
the subject of another thought (I believe that I perceive the
traffic light to be red). Inflectional morphology A minor modification to a word,
for example marking pluralization or tense, is known as
Hill-climbing An example general heuristic, which
inflectional morphology.
involves taking the immediately possible action that
brings the solver closest to the goal. By analogy with Information processing A paradigm that sees cognition
climbing a hill in fog by trying out one step in each of four as being essentially computational in nature, with the
main directions and choosing the one that leads to the mind being the software and the brain being the
highest ground. hardware.
Homographs Words that have dual meanings, despite Informational encapsulation An information-processing
having the same spelling, such as ‘batter’, ‘punch’, and ‘stalk’. system within a creature or larger system is informationally
GLOSSARY 695
encapsulated if it does not have access to all the informa- recorded by EEG or MEG is usually called the inverse
tion that is represented in the creature or larger system. problem (also known as source estimation).
Specifically, a perceptual system is informationally encap- Inversion effect (and face recognition) The finding that
sulated if it does not have access to all of the creature’s or inverting a photograph of a face disrupts recognition more
larger system’s background knowledge. The standard than inverting an image of an object.
example of informational encapsulation is provided by the
Iowa gambling task A task associated with Antonio
persistence of a perceptual illusion even when you know
Damasio, in which participants are presented with four
that it is an illusion.
decks of playing cards. Selecting cards from the decks leads
Inner loop monitoring Monitoring what you are about to
either to gains or losses. The decks are crafted so that some
say before you actually say it.
lead to modest gains and others to losses. These differences
Insight Restructuring how a problem is represented so are not at all obvious, yet after playing for a while partici-
that the solution becomes immediately obvious. pants tend to make selections from the two good decks,
Integration A process that can occur in backward mask- even though they are generally unable consciously to iden-
ing, where a very brief visual target is followed quickly by a tify which decks are advantageous.
second stimulus. The visual system treats the two events as
Ipsilateral The same side as.
one, integrating the two sets of information and making
Ipsilesional The same as the lesion.
the target indecipherable.
Interactive alignment Process whereby interactants come Isomorphic Sharing a common, underlying structure.
to think the same as each other (i.e. have aligned mental Isotropic A cognitive process is said to be isotropic if there
states) as a result of speaking the same way (i.e. using the is no a priori way of putting a boundary around the knowl-
same words, meanings, and grammatical constructions). edge or information that may be relevant to the process.
Internal representation Knowledge and structure in Confirmation of a scientific hypothesis is isotropic because
memory, as propositions, productions, schemas, neural there is no way of circumscribing the evidence that may be
networks, or other forms. relevant.
Interruption A process leading to backward masking. Item specific processing A type of distinctive encoding
When a second visual stimulus follows a target stimulus, that binds the components of the processes underlying the
with a delay between them that is a little longer than is mental representation, enhancing their joint operation
required to produce integration, then processing of the tar- and coherence (leading to integration).
get is interrupted before it can be identified. Kinaesthetic Referring to kinaesthesia, the sensation pro-
Intransitivity A source of difficulties for the classical view of duced by movements of the body that allows you to know
concepts has been the observation of intransitivity in catego- where the different parts of your body are located at any
rization judgements. Transitivity is observed with many rela- moment.
tionships, e.g. the relation ‘taller than’ is transitive because if
Kinesthesis Information about the location of our limbs
‘A is taller than B’ and ‘B is taller than C’, then it simply fol-
or other body parts, derived from receptors within muscles
lows that ‘A is taller than C’. The relationship is ‘transitive’
and joints.
because the last statement follows from the first two.
Know experience Knowing that a test item appeared at
Introspection The self-observation and reporting of con-
study, but not having any conscious recollection of it.
scious inner thoughts, feelings, perceptions, and sensa-
tions. Lateral Surface of a structure situated towards the side of
the body, such as the outer side of each brain hemisphere;
Invariants Higher-order features present in the structure
contrasts with medial.
of light that remain constant despite movement or other
changes. Gibson believed that they provided unambiguous Lesion Structural alteration of bodily tissue brought
information about the environment and were a critical about by damage or disease.
part of perception. Examples of invariants include the Lexical concepts A lexical concept is a concept that cor-
horizon ratio relation and texture gradient. responds to a single word, and is thought to represent
Inverse problem The estimation of the sources in the our understanding of the word’s meaning. For example,
brain that generate the electrical and magnetic activity the concept for ‘cat’ is thought to represent people’s
696 GLOSSARY
understanding of the meaning of the word ‘cat’. Lexical Means–ends analysis Analysing a problem into goals, sub-
concepts are presumed to be stored in what is called the goals, and sub-sub-goals, and so on until sub-goals are
mental lexicon, from which it is thought lexical con- identified that can be immediately reached by some action.
cepts are retrieved during the process of understanding Medial surface Surface of a structure situated towards the
language. mid-line of the body, such as the inner side of each brain
Lexical decision task A task in which the participant must hemisphere; contrasts with lateral.
decide as quickly as possible whether a group of letters MEG MEG is a technique that produces the magnetoen-
spells a word or not. cephalogram, a record of the magnetic fields above the
Lexical effects The term ‘lexical effects’ simply refers scalp surface.
to the effect that word-level information has on lower Memory store A memory store is where non-active mem-
levels of processing. For example, a sound that is mid- ory representations are held.
way between /k/ and /g/ is more likely to be interpreted
Memory system Includes memory stores and all the pro-
as a /k/ in the context of ‘-iss’, but as /g/ in the context
cesses that operate when memory representations are active.
of ‘-ift’ – our knowledge about what constitutes a real
word affects lower-level phonetic and phonological Mental imagery (visual imagery) Images formed on the
processing. basis of memory or imagination rather than through stim-
ulation of the senses.
Lifespan retrieval curve A curve plotting numbers of
memories against age at encoding of the remembered Mental lexicon This is the store of information about all of
experiences. the words that we know, including what the word sounds
like, what it means, and how it is spelled.
Lifetime periods Lifetime periods effectively encapsu-
late a period in memory and in so doing may provide Mental model An internal representation having – in
ways in which access to autobiographical knowledge can some abstract sense – the same structure as the aspect of
be limited, channelled, or directed. Like general events, external reality that it represents.
they may contain representations of locations, others, Mere exposure effect The finding that people tend to pre-
activities, feelings, and goals common to the period they fer items to which they have previously been exposed over
represent. comparable novel ones.
Long-term memory Long-term memory contains all that Metrical foot Metrical foot refers to the rhythm within a
we know and all that makes us who we are. speech stream. In English one unit of metrical foot is typi-
Low frequency words Words that occur only rarely in a cally composed of one stressed (strong) syllable, followed
language (e.g. tavern). by one or more unstressed (weak) syllables.
Magnocellular pathway A distinct ‘stream’ of relatively Mini–mental state examination (MMSE) A short test used
large retinal ganglion cells that connect the retinal cells to to screen for cognitive impairment. A maximum score of
the primary visual cortex. 30 points is possible. People with Alzheimer’s disease gen-
erally score 26 points or less.
Marr and Hildreth’s algorithm An algorithm important in
Marr’s primal sketch stage that uses Gaussian blurring to Mind–body problem The mind–body problem is the
remove random fluctuations and identify the edges of problem that appears to be posed by the fact that minds
objects. and mental phenomena seem to be qualitatively distinct
Masking A technique used in cognitive research whereby from physical brains and bodies. The problem therefore
the presentation of one stimulus (the mask) disrupts the arises as to how the nature of the mind might be explained
presentation of a second stimulus (the target), often to the in terms of physical properties of the brain/body.
extent that a participant will fail to report seeing the sec- Mnemonic A technique used to aid remembering, such as
ond stimulus. rhyming or the use of visual imagery.
Materialism The thesis that the only thing that exists is Modularity The idea that the mind is composed of distinct
matter, and therefore that all things in existence are com- processors or processing modules, which are typically con-
posed of matter. The thesis is in opposition to Cartesian ceived of as being domain-specific and informationally
dualism. encapsulated. There is considerable division of opinion
GLOSSARY 697
over whether such modules have the remaining character- Neuropsychological data Data that relate the structure
istics proposed by Jerry Fodor (such as innateness), yet and function of the brain to specific psychological pro-
Fodor’s characterization remains a powerful statement of cesses and behaviours.
modularity. Neuropsychology The attempt to draw conclusions about
Mood congruent memory (MCM) A robust phenomenon the function of different brain areas by studying the effects
in which memory is enhanced when the nature of the of damage to one or more of the brain areas and cerebral
material to be remembered matches present mood. networks.
Mood dependent memory (MDM) A controversial idea NIRS Near-infrared spectroscopy or NIRS is a technique
that memory for a particular stimulus or event will be that uses long-wavelength light to study the oxygenation
enhanced if mood at encoding matches mood at state of blood in the brain. It is commonly used with
retrieval. infants due to its ease of use and safety.
Morpheme A morpheme is the smallest meaningful unit Node A node is any point in a network where pathways
of language that still has meaning. It is important to note intersect. In cognitive psychology, it means an element
that not all morphemes can stand as words on their own; representing a concept in a semantic network or relations
for example, the past tense ending ‘ed’ clearly conveys between nodes.
information about tense, but cannot stand on its own. Non-accidental property Key features of an object that do
Morphology Morphology is the study of how words are not vary across different viewpoints. Biederman suggested
structured. For example, the word unbreakable can be bro- five properties: curvilinearity; parallelism; cotermination;
ken down into three components, ‘un’, ‘break’, and ‘able’. symmetry; and collinearity.
Motion parallax The principle that the further an object is Non-declarative memory systems Refers to a group of
from an observer, the less it will appear to move as the behaviours that are affected by stored information (i.e.
observer travels past it. memory), but there is no conscious awareness of the
information retrieved.
Multi-store memory model Atkinson and Shiffrin’s (1968)
‘multi-store’ memory model proposed separate sensory Non-demonstrative inference An inference is demonstra-
registers for each sense modality. See also Short-term tive if it is impossible for the premise or premises of the
memory and Long-term memory. inference to be true and the conclusion false; that is, if the
truth of the premise or premises logically guarantees the
Necessary/elaborative inferences Text inferences that
truth of the conclusion. A non-demonstrative inference is
are either necessary to understanding the meaning or are
thus one in which the conclusion is supported by the prem-
not necessary but perhaps helpful. For example, when
ises but goes beyond what is logically guaranteed by the
you read ‘When Harry drove to London the car kept
premises. Inductive inference (from instances to a generali-
breaking down’, you necessarily infer that the car was the
zation) and abductive inference (from evidence to an
one Harry drove to London in. However, when you read
explanatory hypothesis) are examples of non-demonstrative
‘Harry jumped off the top of the building’, you might
inferences.
elaboratively infer that as a consequence he died, but you
might be wrong. Non-word A pronounceable but meaningless letter string
(e.g. mafer).
Neglect A shortened form of ‘hemispatial neglect’; often
used to describe patients, i.e. neglect patient. Patients show- Norman’s dual process approach Uses the characteris-
ing neglect syndrome tend to ignore stimuli located on the tics of the dorsal and ventral streams and suggests that
contralesional (usually the left) side. The terms extraper- they act synergistically so that the dorsal stream is largely
sonal, personal, or representative neglect are used depend- concerned with perception for action and the ventral
ing on whether neglect is observed for stimuli located in stream is essentially concerned with perception for
reaching area, body, or mental images, respectively. recognition.
Neighbouring words Words are said to be neighbours if Normative Normative means ‘relating to an ideal stand-
they are spelled similarly (e.g. wade, jade, spade, made). ard or model’.
Neuroimaging data Images of brain function or brain Novice A person who is beginning to acquire skill and
structure. knowledge in a given domain.
698 GLOSSARY
Object-centred description A mental representation of Partial information Norman and Bobrow (1975) sug-
an object that contains information about what it looks like gested that less than the final output from a process can
from every angle; in other words, the object is represented allow other processes awaiting this information to begin or
fully in three dimensions. may even fully satisfy the requirements of other processes.
Occluding contour The silhouette of an object that is a key Partial report superiority effect When a backward-masked
part of Marr’s theory of object recognition as it allows the visual stimulus contains several items (e.g. 12 letters), peo-
overall shape of an object to be generated. ple may be able to report only, say, four of them. If just
Operationalism The idea that we do not know the mean- after the stimulus is removed, a cue directs the participant
ing of a concept unless we have a method for determining to a subset of items (e.g. one of three rows), people tend to
its presence and measuring its quantity. still report four. Since this works for any cued row it fol-
lows that in total all 12 letters were seen, a figure that is
Operator A legal move or step used in solving a problem.
superior to the four items obtained when attempting a
Optimal viewing position The optimal viewing position is whole report.
the point in a word at which that word can be processed fast-
Parvocellular pathway A distinct ‘stream’ of relatively
est and most efficiently if fixated there. This point is usually
small retinal ganglion cells that connect the retinal cells to
at the centre or slightly to the left of the centre of the word.
the primary visual cortex.
Orthography The orthography of a word is simply the
Pattern associator A simple connectionist network with
written form of the word, referring to how the word is
input units and output units, but no hidden units. The two
spelled or represented using a system of symbols (as in
layers of units are fully connected in the sense that each input
Chinese scripts).
unit is connected to every output unit. By adjustment of the
Outer loop monitoring Monitoring your own speech on weights on the connections during training, the network
the basis of hearing it. learns to associate patterns of activation across the output
Own name effect The phenomenon of noticing that one’s units with patterns of activation across the input units.
name has been spoken by another person, even though one Perception The cognitive processes of analysing sensory
is attending closely to what someone else nearby is saying. information and providing a basic description of the sur-
Ownership paradigm Paradigm whereby the self-concept rounding environment.
is activated in a relatively indirect way through ownership.
Perceptual classification Another term for ‘object recogni-
Parafovea The parafovea refers to the areas in the retina tion’, in which an object is categorized. An object in view is
that surround the fovea. Vision in the parafovea is not as compared to descriptions stored in memory and as a result
clear as in the fovea, but some information can still be is assigned to the appropriate category.
acquired in this region.
Perceptual hypotheses A key component of constructiv-
Parallel The description of a system that is able to run sev- ist, or top-down, theories of perception in which previ-
eral different processes simultaneously. (See Serial.) ously stored knowledge is used to interpret the world
Parallel activation Parallel activation occurs when multi- around us by generating a hypothesis about what a partic-
ple words are activated at the same time when speech is ular object or surface might be.
heard. Perceptual incidental test Test of perceptual implicit
Paresis Partial paralysis, e.g. of one leg. memory that usually requires subjects to resolve displays
Parietal One of the lobes of the brain (one in each hemi- that are perceptually impoverished displays.
sphere), which is involved in sensory processing, spatial Perceptual organization A set of principles developed by
awareness, and object location. the Gestalt approach to perception, and also used in Marr’s
Parsing Parsing involves breaking down a sentence into its theory of vision, that describe how images can be per-
component parts in order to obtain the syntactic/gram- ceived. Examples of principles include closure, good con-
matical structure of the sentence. For example, the sen- tinuation, proximity, and similarity.
tence ‘The girl saw the cat’ can be broken down into three PET Positron emission tomography or PET is another tool,
components: the first noun phrase ‘the girl’; a verb phrase like fMRI, used to measure how blood flow in different
‘saw’; and a second noun phrase ‘the cat’. parts of the brain changes as a function of cognitive state.
GLOSSARY 699
Phoneme A phoneme is a single speech sound, or in other potentially correspond to the edges and texture of objects
words, the speech equivalent of a single letter. Phonemes are are identified, and then used to generate a description of the
normally denoted by surrounding slash marks, for example, outline of any objects in view in the full primal sketch.
e
/k/ and / / are the first two phonemes in ‘confess’. Primary memory The content of consciousness supplied
Phonemic (phonological) Referring to speech sounds. by memory rather than perception.
Phonetic feature Each phoneme within a language can be Priming The improvement in the processing of a target
classified in terms of a set of phonetic features. These fea- stimulus caused by previous or concurrent exposure to a
tures describe how the phoneme is articulated. closely related stimulus (the prime), which may also be the
Phonetics Phonetics is the study of the physical properties target stimulus. At a neural level, this may be reflected in a
of speech sounds, such as pitch and amplitude, and how process of excitation, which makes the neurons that repre-
these properties affect both the production and perception sent the target item more likely to fire if the prime is pre-
of the speech sounds. sented. Priming maybe detected by faster responses, or by
the ability to detect an otherwise subthreshold stimulus
Phonological representation The phonological represen-
(e.g. one that is masked). For example, seeing (or hearing)
tation of a word specifies what the word sounds like, and
the word ‘chair’ increases the speed with which you can
can be written as a string of phonemes. For example, the
respond to the word ‘table’ because these two words are
word cat can be represented as /kæt/.
semantically associated.
Phonology Phonology is the study of the speech sounds
Primitives A form of symbolic representation used to rep-
within a language. Phonologists are interested in how
resent the fundamental properties of a visual image. Marr’s
speech sounds are combined and organized within a lan-
theory of vision made use of four primitives: ‘edge-
guage in order to convey meaning.
segments’, ‘bars’, ‘terminations’, and ‘blobs’.
Phrase structure grammar Phrase structure grammar can
Problem reduction Transforming the problem into another
be used to describe the syntactic structure of a sentence.
problem (or sub-problem) for which a solution exists.
For example, the sentence ‘the girl saw the cat’ can be
described as NP + VP + NP (where NP = noun phrase and Procedural knowledge Skills and habits.
VP = verb phrase). Processing approach Theoretical approach to investigat-
Pneumoencephalogram A low-resolution, poor-contrast ing memory that emphasizes psychological processing.
x-ray. Productivity A language is said to be productive if speak-
Positron emission tomography (PET) A non-invasive ers (and hearers) of the language are able to use (or com-
technique of brain imaging that detects pairs of gamma prehend) sentences that they have not previously
rays emitted indirectly by a positron-emitting tracer, intro- encountered.
duced into the body on a biologically active molecule. Prominence effect A type of bias that people show when
Posterior Behind or after; contrasts with anterior. they are asked to provide a valuation of something using a
numerical scale. They tend to select prominent values such
Pragnanz law of An important part of the Gestalt approach
as 1, 2, 5, 10, 20, 50, 100.
to perception and described by Koffka as: ‘Of several geo-
Property-listing (attribute-listing) Property-listing or
metrically possible organizations that one will actually
attribute-listing is a technique in which participants are
occur which possesses the best, simplest and most stable
asked to generate a list of properties or attributes for a con-
shape’ (Koffka, 1935, p.138).
cept. Psychologists use the technique to investigate peo-
Primacy The tendency for items at the start of a list to be ple’s concepts. Usually lists from many different participants
better remembered than later items. are compared, to generate a further list of the most fre-
Primacy debate The debate focused on the question of quently mentioned properties. Frequency of mention is
whether emotion precedes cognition, or whether cogni- often taken to indicate how central each property is to the
tion precedes emotion. concept.
Primal sketch The second stage in Marr’s theory of visual Proprioception The processes that allow us to know the
perception. It is divided into the raw primal sketch and the locations of our limbs based on combining information
full primal sketch. In the raw primal sketch, areas that could from touch receptors with kinaesthetic information.
700 GLOSSARY
Prosopagnosia A neuropsychological condition in which Receiver operating characteristic (ROC) curve Hit rates
the patient is able to recognize objects but not faces, though plotted against false alarm rates for different response cri-
they may still recognize facial expressions. teria. Usually, response criteria are manipulated by asking
Prospect theory A theory that describes decisions subjects to rate their confidence that each memory probe is
between alternatives that involve risk (i.e. alternatives with a target.
uncertain outcomes) where the probabilities are known. Recognition memory Refers to an explicit memory task
The model is descriptive: it tries to model real-life choices, where study items are re-presented together with foils and
rather than optimal decisions. the subject has to respond ‘yes’ or ‘no’ as to whether an
Protocol analysis A rigorous method for eliciting verbal item was studied or not.
reports of thought sequences as a valid source of data on Recollection A retrieval process underlying recognition,
participants’ thinking as a task is carried out. which takes longer to complete than familiarity and
Prototype view (of concepts) Whether or not an instance benefits from relational processing at encoding. It is also
is a category member can be judged depending on how regarded as a threshold process.
similar it is to a prototype: an instance falls within the cat- Reduced relative clause A reduced relative clause is a
egory if it achieves a certain criterion of similarity. If an relative clause that is not explicitly marked by a rela-
instance is too dissimilar, i.e. it mismatches on too many tive pronoun. Often these sentences result in ambigu-
properties, then it falls outside the category. ity. For example, when processing the sentence ‘The
Prototype A measure of the central tendency of a cate- defendant examined by the lawyer remained silent’, it
gory. Sometimes the prototype may correspond to an is easy to initially assume that the defendant is the per-
actual instance, but in general it is like a ‘best’ category son that is going to do the examining when reading the
member, formed by statistically aggregating over examples first few words of the sentence. This assumption must
of the category one encounters. Rosch believed that it is a be corrected after encountering the phrase ‘by the
feature of the natural world that certain attributes or prop- lawyer’.
erties tend to correlate or cluster together, and it is these Reductio ad absurdum Disproof of a proposition by show-
natural clusters of correlated attributes that prototypes ing that it leads to absurd or untenable conclusions.
describe. For example, the prototype for ‘bird’ might Re-entrant pathway/processing Neurological pathway
describe the cluster of properties such as having feathers, that allows one region of the brain to communicate with
wings, a beak, and an ability to fly. another in response to information being sent by that
Pseudohomophone A pseudohomophone is a non-word region. In other words, the pathway that allows one region
that can be pronounced in a way that sounds like a real of the brain to respond to another. It has been suggested
word (e.g. brane, noyz). that this mechanism could allow a perceptual hypothesis
Qualia A term used by philosophers to describe the quali- to be tested.
tative, subjective, experiential aspects of consciousness. Refractory period This is the brief period just after neu-
Quinean A cognitive process is said to be Quinean if it is rons have fired, during which they are unable to fire
sensitive to properties of a system of knowledge or belief as again. The attentional blink is rather like a refractory
a whole. Confirmation of a scientific hypothesis is Quinean period.
because it is sensitive to properties of whole theories or Reinforcers A stimulus that, if it is presented soon after a
whole systems of belief, such as simplicity. response, increases the relative frequency with which
Rapid serial visual presentation (RSVP) A procedure for pre- that response is emitted in the future. In other words, a
senting a sequence of several visual stimuli in quick suc- ‘reward’ that increases the likelihood of a behaviour
cession, each serving as a mask for the previous item. being repeated.
Reason-based theory of choice An account of preference Relational processing A type of distinctive encoding that
formation, according to which an agent’s preferences are establishes connections between different entity represen-
determined by his or her motivating reasons, together with tations (leading to elaboration).
a ‘weighting relation’ between different combinations of Relative clause A relative clause is a phrase that is intro-
reasons. duced by a relative pronoun (who, whom, whose, that,
GLOSSARY 701
which). For example, ‘The defendant who was examined Retrograde amnesia Difficulty in recalling information
by the lawyer remained silent’. encoded before the brain lesion that caused the amnesia.
Relative distinctiveness The extent to which a stimulus Saccade Saccades occur when the eyes jump from one
item differs from other items on a list. location to another; these can be forward saccades or back-
Remember experience Having a conscious recollection ward (regressive) saccades.
that a test item was presented at study. Schema (plural schemata) A mental representation of
Reminiscence bump A component of the lifespan retrieval some aspect of experience, for example routine sequences
curve when rememberers were aged 10 to 30 years, being of actions or mental operations.
distinguished by an increase in recall of memories relative Self-cue A cue that indicates self-relevance of a stimulus,
to the period that precedes it and those that follow it. for example, a red circle around an object that signifies that
Repetition priming A technique used in cognitive research the object belongs to self. Self-cues usually elicit self-refer-
whereby the presentation of one stimulus will make recog- ential processing.
nition of a related stimulus faster and more accurate. Self-defining experiences Experiences that are distinctive
Representation A hypothetical ‘internal’ cognitive sym- and unique for the self. They are thought to play a crucial
bol that represents some aspect of external reality. role in the final formation of identity and a stable self-
system during late adolescence and early adulthood.
Requisite decision model This is defined as a model
whose form and content are sufficient to solve a particular Self-defining memories Memories for an individual con-
problem. taining critical knowledge of progress on the attainment of
their long-term goals.
Resolution The resolution of a neuroimaging technique
indicates how far away, in space (spatial) or time (tempo- Self-defining moments Highly specific events that were
ral), two events have to be before they can be distinguished ‘turning points’ for an individual; they are typically found
as two separate events. in autobiographical accounts.
Response bias A bias at the stage of making a response, Self-reference effect (SRE) The memorial benefit of self-
which may reveal little or nothing about the nature of prior referencing.
cognitive processing. Self-referencing Encoding information with reference to
Response criterion Indicates a person’s willingness to oneself.
respond ‘yes’. Someone with a liberal response criterion Self-serving attribution bias A bias in which people attrib-
will have a high hit rate and high false-alarm rate. ute good things internally, as something within their con-
Retina The back surface of the eye, which contains light- trol, whereas they attribute bad things externally, to others
sensitive receptor cells known as rods and cones. or to circumstances.
Retinal ganglion cells Connect retinal cells (rods and Semantic Relating to meaning and identity, the term is
cones) to the lateral geniculate nucleus, which is in turn often used to refer to the meaning of a word, or the infor-
connected to the primary visual cortex. The ganglion cell mation that identifies a letter (see Episodic).
axons leave the eye via the ‘blind spot’. Semantic ambiguity Semantic ambiguity occurs when the
Retrieval The way in which information in memory is structure of a sentence remains the same, but the individ-
obtained for use. Retrieval involves finding, activating, and ual words are interpreted in different ways. This often
sometimes further processing pertinent memory repre- occurs when words have more than one meaning (e.g. he
sentations. went to the bank).
Retrieval intentionality criterion This criterion provides a Semantic features Word meanings can be represented as a
way to rule out the influence of intentional retrieval on an set of features of properties that are associated with an
implicit task. item. These features combine to provide the meaning of
Retrieval mode In retrieval mode, attention is directed the word. For example, the word canary has semantic fea-
inwards towards internal representations of knowledge, tures such as ‘has wings’, ‘can fly’, ‘is a bird’, etc.
and conscious awareness becomes dominated by these Semantic memory Semantic memory is our general knowl-
representations. edge store; it contains all the information underlying our
702 GLOSSARY
understanding of the world. No personal experience need Sorting The sorting task involves participants being
accompany information retrieved from semantic memory. shown an array of different items (e.g. words printed on
Sensation The ability of the sense organs to detect various cards) and asked to sort them into groups. A free sort is the
forms of energy (such as light or sound waves). result of such a task where participants can sort the items
into as many or as few categories as they wish.
Sensitivity Indicates how well a person is able to discrim-
inate targets and distractors. Great sensitivity is indexed by Source estimation Source estimation involves trying to
a high hit rate and low false alarm rate. infer, on the basis of the pattern of electrical activity at the
scalp surface (in the case of EEG) where the critical pro-
Sensory neglect Patients who have suffered a lesion in a
cessing occurs inside the brain. This is sometimes known
parietal lobe, particularly in the right hemisphere, display
as the inverse problem.
unawareness of items on the opposite side (i.e. generally
the left) of their body. This neglect can extend to all senses, Spatial smoothing A technique used in fMRI such that the
but is typically detected visually. activation at each point is replaced by a weighted average
of the activation measured not just at that point, but at all
Serial The description of a system that can carry out only
neighbouring points.
one process at a time. (See parallel.)
SPECT Single-photon emission computed tomography
Servomechanism An automatic device that uses error-
or SPECT is much like PET, but with poorer spatial resolution.
sensing negative feedback to correct the performance of a
mechanism. Speech segmentation This is the process by which con-
tinuous speech is broken down into separate words. This is
Shadowing The process of repeating everything one hears
much more difficult than segmenting written language as
spoken, following closely behind the speaker’s words like a
there are not obvious breaks between words.
shadow. Shadowing is often used in dichotic listening to
ensure that attention is directed to one message stream. Spotlight of attention Items sufficiently close to one that is
being attended may also receive processing, as if attention
Short-term memory Refers to the retention of informa-
swings a spotlight and captures everything that is ‘illumi-
tion over seconds to minutes.
nated’ by the imaginary beam.
Signal detection theory (SDT) The SDT originated as a
Stage theories Stage theories of development, of which
theory about decision making. It assumes that all of the
Piaget’s is the best known, rest on the assumption that
events or items to be discriminated differ only in terms of
development is a discontinuous process involving distinct
a continuous (i.e. quantitative), unidimensional measure.
stages that are characterized by qualitative differences in
People make decisions as to whether test items are old or
behaviour. Stage theories can be contrasted with continu-
new based on the items’ strength of evidence and the per-
ous theories, which posit that development is an incre-
son’s own response bias.
mental process.
Similarity Both classical and prototype views are com-
Standardized stereotaxic coordinate system Sometimes
mitted to the idea that similarity explains categorization.
called the Talairach coordinate system, this is a system that
For classical theory, instances fall within a category if
allows any location in the brain to be indexed by values of
they match each and every element of the category’s defi-
three coordinates.
nition, and fall outside the category if they mismatch on
any one. For prototype theories an instance may fall Startle response An eye-blink reflex that protects the eye
within a category even if it mismatches on a number of from a potential threat.
properties. State emotion Also called mood or affect, state emotion
Simple problem solving Solving problems that are small- refers to how you feel right now.
scale and well-defined, and that require no specialist Stereopsis Due to their different positions, the retinal
domain knowledge. images of the left and right eyes will be slightly different.
Somatic markers Physiological responses (‘gut feelings’) This difference, known as stereopsis, can be used to deter-
that Damasio hypothesizes may be used to guide decisions. mine how far away an object is.
They may be particularly influential in circumstances Stimulus onset asynchrony (SOA) The time between the
where it is difficult to arrive at a decision by means of con- start of one stimulus and the start of the next. Normally the
scious deliberation. first would have ended before the second commenced.
GLOSSARY 703
STM span (word span, digit span) The number of items multiple meanings, but from the relationship between
(e.g. words or digits) that can be recalled after being heard words within the sentence. For example, the sentence
or seen once; the capacity of STM. ‘Flying planes can be dangerous’ can be interpreted as
Storage The way in which information is represented in meaning that either (a) the act of flying a plane can be dan-
memory. gerous, or (b) planes that are flying (as compared to sta-
tionary) can be dangerous.
Strength of evidence Target events or items presented
and encoded in an experiment will provide a greater Syntax The principles and rules underlying sentence con-
strength of evidence signal than other events or items in struction and word order within sentences are referred to
memory that were not presented and encoded in the as the syntactic information within the language.
experiment. Systematicity The ability to understand some sentences of
a natural language brings with it the ability to understand
Stroop task The standard Stroop task involves partici-
other sentences. For example, someone who can under-
pants naming the colour of the ink in which colour words
stand ‘The dog chased the cat’ can also understand ‘The cat
are written. When the ink colour conflicts with the colour
chased the dog’. This is known as the systematicity of lan-
word (e.g. the word ‘blue’ written in red ink), participants
guage understanding and it is explained by the fact that the
are slowed down compared with stimuli where the word
sentences have compositional structure and the second
meaning and ink colour match (or are congruent).
sentence is built out of the same constituent parts as the
Structural descriptions An approach to object recogni- first sentence. By extension, a system of representation can
tion designed to cope with objects more complex than be described as exhibiting systematicity when the repre-
simple alphanumeric characters. It is based on describing sentational resources that are used to represent some states
objects through a set of propositions comprised of both of affairs can be recombined to represent other states of
the elements of an object and the structural relation affairs involving the same objects and relations.
between them.
Systems approach Theoretical approach to investigating
Subjective expected utility The expected utility hypothe- memory that emphasizes structures or systems, which are
sis is a theory of utility in which ‘betting preferences’ of frequently assumed to have a distinct location in the brain.
people with regard to uncertain outcomes (gambles) are This approach assumes that memory stores and memory
represented by a function of the payouts (whether in processing are localized in the same part of the brain.
money or other goods), the probabilities of occurrence,
Tachistoscope Literally a ‘fast-viewer’, this device makes it
risk aversion, and the different utility of the same payout to
possible to display a visual stimulus for a very brief but
people with different assets or personal preferences.
accurately measured period of time.
Subliminal Stimuli presented below the participant’s Template matching A theory of object recognition based
level of conscious awareness are said to be presented sub- on comparing the pattern of an object with a series of tem-
liminally. plates stored in memory of all the objects seen previously.
Subtractive designs Experimental designs often used in For example, the letter ‘R’ would be recognized because the
neuroimaging. They are based on an underlying logic that specific pattern of that letter would match the ‘R’ template
assumes tasks can be broken down into component pro- in memory.
cesses. For example, if two experimental conditions, A and Temporal order judgement (TOJ) A task in which a par-
B, are identical except that A requires a particular cogni- ticipant is required to judge which of two events occurred
tive function f while B does not, then one can identify first.
those cortical regions that are involved in f by subtracting Texture gradient An example of what Gibson termed
the pattern of regional cerebral blood flow (rCBF) observed
invariant information. It refers to the fact that apparent
during B from that observed during A.
changes to the individual elements of the environment
Sub-vocal rehearsal (rote rehearsal, sub-vocalization) (e.g. pebbles on the beach) provide information regarding
Rehearsal by silent speech. the distance, orientation, and curvature of a surface.
Syntactic ambiguity Syntactic ambiguity occurs when the The Big Five Five emotions – anger, fear, sadness, disgust,
same sentence can be interpreted in more than one way. and happiness – commonly considered to be basic emo-
This type of ambiguity arises not from single words having tions by theorists adopting the basic emotions approach.
704 GLOSSARY
The representational effect The phenomenon Type 1 reasoning Type 1 reasoning involves analytic pro-
whereby problems with identical structures may be experi- cesses carried out in working memory and is a late evolu-
enced as more or less easy to solve, depending upon the tionary development.
way in which the problem comes to be represented. Type 2 reasoning Type 2 reasoning involves long-term
TMS Transcranial magnetic stimulation or TMS involves memory processes involving association and heuristics.
inducing a brief current in brain tissue through the scalp Typicality ratings Rosch (1973) elicited participants’ rat-
and skull, using a brief magnetic pulse delivered via a coil ings of the typicality or ‘goodness-of-exemplar’ (some-
(about the size of a hairdryer) placed over the head. It times referred to as GOE) of particular instances of a
safely and temporarily disrupts function in a specific brain category – the method is often known as a typicality rat-
region in order to evaluate the importance of that area of ings method.
the brain to performance on a given task.
Uniqueness point The uniqueness point of a word is the
Top-down processing An approach to cognition that
point at which only one word in your mental lexicon
starts with existing knowledge of the environment, which
matches the speech input. For example, if you hear ‘dolf ’,
is then used to guide perception.
only one word in your mental lexicon, dolphin, is consist-
TOTE unit An iterative problem solving strategy based ent with the speech input. According to the cohort model
on feedback loops. this is the point at which the recognition process is
Trait emotion Refers to more stable emotional or person- complete.
ality characteristics, i.e. ‘what kind of person’ you are as Up-regulation Up-regulation refers to an individual’s abil-
opposed to how you are feeling right now. ity to increase an emotional response, and most often
Transcranial magnetic stimulation See TMS. applies to positive emotions (e.g. making an effort to feel
Transfer The capacity to apply acquired knowledge and happy and relaxed when out partying with friends).
skills to new situations. Valence In the context of emotion research, the positive/
Transfer appropriate processing (TAP) TAP focuses on pleasant or negative/unpleasant qualities of a stimulus.
the overlap between the processes engaged at encoding Variable physical realization Functionalist theories
and the processes engaged at retrieval. Specifically, it pre- define things in terms of what they do, rather than in
dicts that best memory performance will be observed terms of what they are. A doorstop, for example, is
when the processes engaged at encoding transfer appropri- defined in terms of the role that it plays, and not in terms
ately to retrieval. of what it is made from or its shape or colour. Thus, the
Transitivity Height provides an example of a transitive role property of being a doorstop has many different pos-
relationship. If Anne is taller than Betty, and Betty is taller sible physical realizations, just as the role property of
than Caroline, then Anne must be taller than Caroline. being Hamlet has been realized by many different actors.
Turing test A test proposed by the mathematician Alan In cognitive psychology, states and processes are defined
Turing in order to answer the question as to whether in terms of their role in the cognitive system and their
machines (computers) can be said to be intelligent. His pro- physical realizations may vary in different individual
posal was that the responses of a machine should be com- human beings, in different creatures, and in different
pared to those of an intelligent human. If they were found non-biological systems.
to be indistinguishable – if a third party could not tell Ventral stream The pathway that projects from the pri-
whether the responses were those of a human or a machine – mary visual cortex to the inferotemporal cortex. It special-
then the computer should be said to be intelligent. A similar izes in pattern discrimination and object recognition.
argument can be made concerning consciousness. Sometimes referred to as the ‘what system’, as it deals with
Type I processing Repetitive processing (as opposed to perception for recognition, or in other words information
processing that proceeds through further levels), for exam- about what an object is.
ple, verbally rehearsing a telephone number to keep it ‘in Ventriloquism effect The tendency for speech sounds to
mind’ before calling the number. appear to come from lips speaking those sounds, even
Type II processing Processing that proceeds through fur- when the actual sound source is displaced from where the
ther levels of increasing depth. face is seen speaking.
GLOSSARY 705
Verbal analysis A method used to gain an understanding of input ‘do’ is heard, the words dog, doll, and dolphin will all
the representation of knowledge used in cognitive perfor- be activated (amongst others).
mance, and how that representation changes with learning. Words and rules model A dual-route model of inflec-
Viewer-centred description A mental representation of tional morphology, specifically the formation of the past
an object that is limited to the particular viewpoint that the tense of English verbs. According to the words and rules
object was seen from. model, formation of the past tense involves two separate
Visual illusions Artwork or other depictions that ‘fool’ the components of the language system. Irregular past-tense
senses into perceiving incorrectly. A key example is the forms are stored in the lexicon, while regular past-tense
Müller–Lyer illusion, in which two lines of equal length forms are generated by application of a default rule that is
appear to be of differing lengths due to the addition of stored in the grammar.
arrowheads pointing in opposing directions. Wordspotting In a wordspotting task you would be asked
Visual or sensory neglect A neuropsychological condi- to detect familiar words embedded within a list of spoken
tion in which the patient is only able to perceive one side of non-words. For example, the word mint might be embedded
an object. in the longer non-word mintayve. This task can be used to
investigate the processes involved in speech segmentation.
Visuo-spatial sketchpad A sub-system of working mem-
ory that functions as a buffer store for visually and spatially Working memory A temporary store for recently acti-
coded information, and possibly also kinaesthetic vated items of information that can be manipulated and
information. moved in and out of short-term memory. Working mem-
Wavelength Waves produce repeating patterns of displace- ory may be thought of as a conduit to consciousness, serv-
ment; in the case of sound waves, small changes in the bunch- ing to bring together information in different modalities
ing together of air molecules. The distance from a point on a from perception and long-term memory into conscious
wave to where it next repeats itself is the wavelength. The representations.
longer the wavelength of a sound, the more slowly the ear- Working memory span (counting span, operation span,
drum vibrates and the deeper the perceived pitch. listening span, reading span) The capacity of a general
Well-defined categories Some categories, like even num- working memory system, underpinning the ability to com-
bers, seem amenable to definition. For these well-defined bine information processing with temporary storage in a
categories, the classical view appears to give a good expla- range of different activities.
nation of category membership, though it does not obvi- Working self A set of hypothesized higher order executive
ously explain how some even numbers are considered processes that are thought to operate in order to construct
more typical than others. autobiographical memories appropriately, to keep irrele-
Wernicke’s aphasia A language impairment mainly con- vant knowledge and memories out of mind, and to ensure
sisting of difficulties with verbal comprehension associated that what is recalled is relevant to the currently active task
with fluent speech. or goal. The working self is hypothesized to control the
construction of autobiographical memories, and is con-
Within-category distinction One form of object recogni-
ceived as a complex hierarchy of interconnected goals, all
tion that is based on recognizing a specific exemplar of a
of which are in varying states of activation, but only some
category. For example, recognizing that an object is your
of which can enter consciousness.
car, rather than just recognizing that the object is a car.
Perhaps the most common form of within-category dis- Yerkes–Dodson Law An empirical relationship between
tinction is face recognition, as the focus is on recognizing arousal and performance, which states that performance
which specific face one is looking at. increases as arousal increases, but only up to a certain level. As
Word-initial cohort The word-initial cohort is the set of arousal increases beyond this level, performance decreases.
words that are activated based on a match between the first Zombie A hypothetical person who is postulated to lack
sounds in the word and the first sounds in the stored rep- full consciousness but nonetheless has the behaviour of a
resentations of the words. For example, when the speech normal human being.
This page intentionally left blank
INDEX
Page numbers in bold indicate the location of key concepts or terms that are either explicitly or implicitly defined in the surrounding text and/
or explained in the glossary.
blood oxygen level dependent central executive 269, 272, cohesion 198–9 consciousness 9, 577–605
contrast 451, 452 279–85, 600 cohort model 173–4, 175 access 579
blood oxygenation 447 central masking 44 coin manipulation altered states of 597–9
BOLD contrast 451, 452 central systems 656–9, 664 problem 314–15 attention 60–1
book bag paradigm 349–51, 352 central workspace 272, 280–1 collinearity 115 cognitive correlates 578
borderline cases 149 cerebellar affective common ground 211–13 cognitive psychology 581–2
bottom-up processing 9, 70, 73, syndrome 473 commonsense theories 155–8 cognitive studies 583–92
82, 95 cerebellar injury 472–3 communal personality 559 cognitive theories 600–2
bottom-up support 175 cerebral cortex 474 comparability 339 defining 578–80
bounded rationality 360 chaining hypothesis 288 compensatory strategies 420–1 detecting 597
box and arrow diagrams 405–6 characteristic-to-defining competition approach 175–6 easy and hard problems 579
box and candle problem shift 158 complex concepts 154–5 explanatory gap 579, 580
308, 313 Cheshire cat illusion 599 component axes 111 functions 593–9
brain chess playing 24, 274, 320–1, components 437 global workspace theory 600,
anatomy and functional 323–4, 325, 329 components of processing 601–2
areas 404 childhood amnesia 550 (COP) account 256–7 higher order thought (HOT)
focal and diffuse injury 470–3 Chinese Room 597 compositional structure theory 600, 602
functional Chomsky, Noam 12–13 649–51 modularity 591–2, 596
reorganization 409–10 chunks 274, 284, 612–13, computation 21–3, 641–51 multiple drafts theory 601
traumatic injury 488–90 619–20, 625 computational level 23–4 neuropsychology 591–2
brain reading 458 classical dissociation 416–17 computational model 6, 287–8 phenomenal 579
brain-stem injury 472–3 classical view of concepts computational model of the philosophical
brain-stem responses 437 146–51 mind (CMM) 642–3 approaches 580–1
Brentano, Franz 20–1 cleft sentence 205 computer analogy 581 stream of 579
bridging inference 201 closure 71 computers 15–16, 18 working memory 600–1
Broadbent, Donald 37 cluster analysis 4 COMT enzyme 479 consensus 215–16
Broca, Paul 404–5 clustering 85 concepts 141–2 consequent 368
Broca’s aphasia 406 coarticulation 171 animals 143 conservatism 351–2
Bruce and Young face cocktail party effect 34 classical view 146–51 constraint relaxation 313
recognition model 123 co-evolution of theories 670–2 cognition 144–6 constructability 245
buffers 612 cognitive appraisals 537, 540 complex concepts 154–5 constructivist approach 87–90
cognitive approach 20–3 different types of 163–4 content words 181
cognitive architectures 610 explaining categorization 143 context and typicality 153–4
C cognitive behaviourists 13 inferences 145 continuous EEG 433
calibration tasks 356–7 cognitive bias 525–6 prototype theories 151–5 contour generator 110–11
candle and box problem 308, Cognitive Bias Modification reasoning 145 contrastive analysis 577
313 (CBM) 525–6 remembering controlled processing 578,
Cannon-Bard theory 536–7 Cognitive Bias Modification for information 145–6 589–91, 593
canonical coordinate frame 109 Attention (CBM-A) 532 semantic memory 145 conversion disorder 496–7
Capgras delusion/syndrome 65, cognitive correlates of theory-theory 155, 157–8 correlational designs 449
128, 482, 483, 522–3 consciousness 578 words and 142, 145 Corsi span 273
capture error 281, 616 cognitive modelling 122–4, conceptual incidental tests 253 cotermination 115
car parking problem 315–16 606–11 conclusion 367–8 counting span 280
Cartesian theatre 591, 601 cognitive modules 385, 388 condition 609 covert recognition 127
categories 142 cognitive neuropsychiatry conditional 368 criterion for satisfactory
categorization 101, 142–4, 145, 468–502 conditional inference 372–9 progress theory 313–16
146–61 cognitive conditional probability 371 cross-linguistic differences,
classical view 146–51 neuropsychology 399– cones 68, 90 memory span 277
commonsense theories 429, 663–8 confabulation 402–3 cross-modal attention 54–5
155–8 assumptions 407–14, 663 confidence intervals 358–9 cross-modal priming 174
development 158 compensatory configural processing 132–3 curvilinear aggregation 85
by different people 164 strategies 420–1 confirmation bias 380 curvilinearity 115
different ways 162–3 historical milestones 404–7 conjunction fallacy 353–4, cut-off frequency 440
exemplar theories 155 inference 664–6 355–6 cybernetics 14
expert opinion 160–1 lesion method 399–404, 432 connectionist modelling 22–3, cyclotron 459
judgements 149 methods 414–20 643–4
language 163 past-tense debate 666–8 category-specific
modes of 162–3 cognitive psychology impairment 6 D
prototype theories 151–5 characteristics 2–8 face recognition 124–5 data analysis 456
psychological history of 8–17 mental representation decision analysis 335, 336–8
essentialism 158–61 sub-disciplines 3 649–51 decision making
similarity 146–55, 156, 163 subject matter 5 past tense 645–7 behavioural decision
category-specific impairment 3, cognitive reframing 485 rules 647–9 research 342–5
4–5, 6 cognitive style 161 connectionist systems 236 descriptive theories 335
category verification 147 cognitive system 122 connections 643 experience 348–9
cause-effect explanations 13 coherence 198–9, 283 connectives 368 fast and frugal 360–1
INDEX 709
knowledge retrieval 230, 243–52 multi-store model 231, 268 massive modularity
expert problem storage 230, 235–43 non-declarative memory hypothesis 661–2
solving 320–4 working memory and 274 systems 237, 238–43 modus ponens 369
perceptual hypotheses 88–90 long-term working personality 559 modus tollens 369
relating language to 202 memory 325–6 procedural 611, 612, 613–15 monism 580
Korsakoff’s syndrome 237, 473 loss aversion 346–7, 348 processing approach 230 monothematic delusions 482–4
loss of activation error 616 recognition 232, 233, 234, ‘monster’ problem 309
low-pass filters 440 246–50 mood 486
L
self 571 mood congruent memory
language self-defining 547, 560 (MCM) 526–8
behaviourist explanation 12 M
self-memory bias 235 mood dependent
categorization 163 macula lutea 68 semantic 145, 238, 240–3, memory 528–9
connectionist models 22 magnetic force 10–11 556–8 morphemes 182
knowledge 202 magnetic resonance imaging short-term 231, 267–9 morphology 182–4
rule-based learning 12–13 (MRI) 449–50 systems approach 230 Moses illusion 204, 205
symbolic models 22 magnetoencephalogram see also autobiographical motion parallax 78
language of thought (MEG) 430, 433–46, 465 memories; long-term moving window
hypothesis 650 basic data analysis 436–40 memory; working memory experiment 181–2
Lashley, Karl 12 recording 435–6 memory span 267, 276–7
late responses 438 resolution 431 Müller-Lyer illusion 65, 66,
memory stores 235–43
lateral geniculate nucleus statistical data analysis 443–4 67, 408
memory systems 235–43, 256
(LGN) 90 magnocellular pathway 90 multinomial processing tree
mental acts 20–1
law of closure 71 mandatory modules 407 model 390
mental arithmetic 267
Law of Pragnanz 72 mapmakers 405–6 multiple comparisons
mental contents 20–1
law of proximity 71–2 Marr, David 23–6, 81–7, 669 correction 456
mental heuristics 352
law of similarity 71–2 Marr and Nishihara’s multiple drafts theory 601
mental lexicon 145, 170, 182–7
Lazarus, Richard 540 theory 109–14 multiple memory systems
mental logic 370, 371, 373,
learning masking 238–43, 256
376–7, 380, 384, 387
ACT-R model 625–32 attention 47–8 multi-store model 231, 268
mental models 202, 370, 371,
behaviourist explanations 11 backward 42, 44, 94–5 must 384
373–4, 377–8, 380–1, 384,
good and poor learners 327 central 44 myopia for the future 494
387–8
implicit 173, 586–9 peripheral 44 mental representation 640,
lesion method 399–404, 431, massive modularity N
649–51
540 hypothesis 661–2 mental states 20–1 N400 186
levels of explanation 23–6, matching bias 380 mentalistic terms 580 naïve sampling model 359
669–70 matching effect 380, 381, 382 mere exposure 539, 586 naming 101, 102
levels of processing (LOP) matchstick algebra 313 metaphor 318–19 nasion 435
231–2, 255, 258 materialists 580 metrical foot 171 near-infrared optical
Lewy bodies 476 maximization heuristic 314 middle latency responses 438 spectroscopy (NIRS)
lexical competition 175–6 may 384 mild cognitive 430–1, 447, 460–1, 465
lexical concepts 145 meaning 370 impairment 476–7 necessary inference 201
lexical decision task 4, 38–9 means-ends 310, 311, 327 mind-body problem 580 Necker cube 65, 66, 67
lexical effects 177 medical diagnosis 145, 305 mind of the reader 199 negative symptoms 479, 480–1
lexical output 125 memory mindfulness-based cognitive neglect syndrome 56–7, 65,
lexical segmentation ACT-R model 618–25 therapy 527 410–11, 412–13
models 170, 172–3 chess skill 325 mirror agnosia 483 neighbouring words 179
Lichtheim’s model 406 declarative 611, 612–13 mirrored-self delusion 483 neurobiology 669, 672, 673–4
lie detectors 39 declarative memory mismatch 45 neurochemicals 457
life scripts 551 system 237, 238–43 mismatch negativity neuroimaging 18–19, 236,
life story 556 echoic 37 (MMN) 444 430–67
lifespan retrieval curve 548–52 emotions 526–9 missionaries and cannibals neuron doctrine 672
lifetime periods 555–6 episodic 229–30, 238, 240–3, problem 309 neuropsychological data 236
likelihood ratio 350 556–8 mobile phones neuropsychology 400–1, 663
Linda problem 353–4, 355–6 explicit 252 texting skills 629–31 neurotransmitters 460
lip-reading 54–5 false 402–3 using when driving 55 Newell Test 635
list memory 618–24 flashbulb 547 modal emotions 518 9-dot problem 307–8, 313–14
listening span 270 iconic 41 modal model nodes 607
literally 201 implicit 252–7, 583–6 expertise 324–6 noise 439–40
living/non-living distinction 3, intrusions 566, 568–9 memory 268 non-accidental properties
4–5, 6 lists 618–24 model development 17–18 115–16
logic 366, 368–70 modal model 268 modules and modularity 82, non-associative models 289
logically valid inference 369 mood congruent 407–8, 640, 651–6, 665, 681 non-declarative memory
long-term memory 229 (MCM) 526–8 central systems 656–9, 664 systems 237, 238–43
compared to short-term mood dependent 528–9 consciousness 591–2, 596 non-deductive reasoning 387
memory 267–9 multiple memory features of modules 407–8, non-demonstrative
encoding 230–5 systems 238–43, 256 652–5 inference 656
712 INDEX
non-literal meaning 200–1 parsing 188, 189–93 positive symptoms 479 production compilation 612,
non-target effects 50 partial information 246 positron emission tomography 614–15, 626–7
normality 3 partial matching 623 (PET) 430, 447, 458–60, production rules 609, 613–14,
normative theories 335, 336–42 partial report superiority 465 620–2
novelty seeking 494 effect 41 emotion processing 515–17 productivity 187
partonomic knowledge 556 living/non-living progress monitoring
O parvocellular pathway 90 distinction 4 theory 313–16
object-centred description 85, past participle 192 phonological loop 279 progressive deepening 311
117 past-tense debate 631, 632–3, resolution 431–2 progressive non-fluent
object recognition 102–4 644–7, 666–8 positrons 458 aphasia 476
Biederman’s theory 114–17 pattern associator 645 post-traumatic stress disorder prominence effect 344
Humphrey and Bruce pattern classification 457 (PTSD) 547, 564–9 property-listing 143–4, 147
model 101 pattern recognition posterior commissure (AC) 454 propositions 368
Marr and Nishihara’s hypothesis 324 posterior odds 350 proprioception 104
theory 109–14 Penrose triangle 89 power law of practice 323 prosopagnosia 65, 126, 127, 130
three-dimensional perception 10, 67 practice 323, 615 prospect theory 346–9
objects 108–18 ACT-R model 616–17 pre-auricular points 435 protocol analysis 304–5
by touch 104–5 approaches to 69–70 prediction 220–1 prototype theories 151–5
two-dimensional for action 69, 91 preference reversal pseudodementia 490
objects 105–7 for recognition 69, 91 phenomenon 343 pseudodepressive 470
viewpoint 107–8 meanings 67 prefrontal cortex 91, 242 pseudohomophones 178, 179
obligation rule 383 sensing 67 pre-lexical segmentation pseudopsychopathic
observation 10 see also visual perception models 170–2 change 470
obsessive compulsive perceptual classification 101, premises 367–8 psychological essentialism
disorder 491–3 144 ‘pre-potent’ responses 282 159–61
occipital lobe injury 472 perceptual hypotheses 87–90 prescriptions 383 psychotic illness 477–84
occluding contours 109 perceptual incidental tests 253 prescriptive approach 335, purposive explanations 13
occlusion 78 perceptual organization 71–2 336–8
Ockham’s Razor 635 perceptual span 181–2 primacy debate 539
Q
oddball paradigm 444–6 peripheral masking 44 primacy effect 415, 618
permission rule 383 primacy model 289 qualia 579
operation span 271, 280
person identity nodes primal sketch 82–5 Quinean 656–7
operationism 11
operators 311 (PINs) 122, 125 primary task 275
personality primary visual cortex 90 R
optic array 74–9
optimal viewing position frontal lobe damage 470 prime 174 raclopride 460
(OVP) 181 memory 559 priming 38–9, 585–6 radial dipoles 436
organization 12–13 perspective in affective 594–5 radical neuron doctrine 672
orthography 178 communication 204, cross-modal priming 174 random generation 282, 593
outer-loop monitoring 213–14 206–7 morphemes 183 rapid serial visual presentation
output layer 607 phantom limb 409 repetition 117 (RSVP) 44–7
overconfident responses 356–9 phenomenal consciousness 579 semantic 185, 481 rational analysis theory 611
own name effect 38, 47 phonemes 171 primitives 84, 111 rationality 367, 389
phonemic similarity 267, 275 principle of pragmatic raw primal sketch 82–5
P phonetic feature 175 modulation 377 reaction time (RT) 530
P300 component 444 phonological loop 272, 274–9 prior odds 350 reading
paediatric autoimmune modelling 287–90 probabilistic approach 371, dual-route models 178–9, 414
neuropsychiatric disorder vocabulary acquisition 285–7 374–5, 378, 381–2, eye movements 180–2
(PANDAS) 491, 492 phonological 384–5, 388 reading span 270, 271, 280
Pandemonium system 106 representation 172 probability 349–51 realigned 454
parafoveal region 181 phonological working problem-reduction 310 reason-based theory of
parahippocampal cortex 241 memory 274–9 problem solving 301–33 choice 345
parallel activation 173–4 phonology 178 ACT-R model 625–32 reasoning 366–92
parallel distributed processing phrase structure grammar 189 analogies 316–19 concepts 145
(PDP) 607–9, 632–4 phrase structure rules 189 complex problems 319–24 deductive 368–70, 387
parallel processing 38, 39, 43 pilot’s headphones 37 defining a problem 303–4 dual process theories 389
parallel search 48–50 place-holder 159 experts 320–4 everyday life 367–8, 375–8
parallelism 115 place tokens 85 individual differences 326–9 individual differences 389
parameter estimates 456 planning 12–13 protocol analysis 304–5 integrative approaches
parametric designs 449 platypus 144 search process 310–11 389–90
parasympathetic ANS 511 pneumoencephalogram 430 simple problems 306–16 non-deductive 387
parietal lobe injury 471–2 poker chip paradigm problem space 310 psychological theories 370–2
parietal region 49, 56, 57, 349–51, 352 procedural knowledge 237 suppression effect 375–8
278, 279 polyglots 286 procedural memory 611, 612, recall-reconstruction
parkinsonian symptoms 476 polysemous words 185 613–15 paradigm 320, 321
Parkinson’s disease 473, 481, positional confusions 623 process accounts 25 receiver operating characteristic
487–8, 494–5 positional hypothesis 288–9 processing approach 230 (ROC) curve 247
INDEX 713
trait emotion 524–5 up-regulation 541 visual system 90–6, 410 word stem completion
transcranial magnetic utilization behaviour 281 visual word recognition 176–82 task 583–4
stimulation (TMS) 93, visuo-spatial sketchpad 273 word superiority effect 177
431, 432, 461–2, 465 V visuo-spatial working words and rules model 644, 647
transfer appropriate processing V1 90 memory 273–4 wordspotting task 172, 176
(TAP) 255–6, 244–5 valence 518 vocabulary acquisition 285–7 working backwards 322
transitivity 339–40 validating search procedure 378 von Neumann machines 15 working forwards 322
transmission of activation 640 values 620 working memory 266–95, 578
transparency 408–10, 663 variable 613 W consciousness 600–1
transposition error 289 variable physical realization 671 Wada test 421–2, 471 executive processes 279–85
traumatic brain injury 488–90 vascular dementia 475 Wason’s selection task long-term 325–6
traumatic events 565–6 vascular depression 487 379–86 multi-component
trials 437 vectors 85 water jar problem 307, 311 model 272–4
truth table 368–9 vegetative state 598 wavelength 35 phonological 274–9
Turing test 15, 16, 597 ventral stream 57, 91–3 weak artificial intelligence 581 span 271, 280–1
2½D sketch 82, 85–6 ventral visual-limbic weight 607, 643 structure 272–85
two-deficit account 483–4 pathway 128 Weiner, Norbert 14 visuo-spatial 273–4
two-dimensional object ventriloquism effect 55 well-defined categories 163 working self 548, 558–60
recognition 105–7 verbal analysis 304 Wernicke’s aphasia 405 written language 198–207
Type I/II processing viewer-centred description 85, ‘what’ system 91 wug test 183
(memory) 231 108, 122 ‘where’ system 91
Type I/II processing visual attention 40–8 winner-takes-all 175–6 X
(reasoning) 389, 390 visual hallucinations 480 within-category
typicality effects 147–9, 153–4 x-ray problem 306–7, 317
visual illusions 65, 66–7, 408 discrimination 102, 117
typicality ratings 147 visual neglect 65 word fragment completion 253
Y
visual perception word-initial cohort 173–4
U approaches to 69–70 word-length effect 274–5 Yerkes-Dodson law 521
understanding 614 constructivist word meanings 184–7, 200 Yonelinas’s theory 248–50
unequal variance model 248 approach 87–90 word recognition Young’s dairy study 121–2
uniqueness point 174 eye 68 spoken words 170–6,
units 607, 643 Gestalt movement 71–2 179–80 Z
universality 663 Gibson’s theory 73–81 visual words 176–82 Zajonc, Robert 539–40
unobservable 10–11 Marr’s theory 81–7 word recognition units 125 zombies 596–7