You are on page 1of 13

How Mental Systems Believe

Daniel T. Gilbert University of Texas at Austin

Is there a difference between believing and merely under- in the broad and colloquial sense, involve both the mental
standing an idea?Descartes thought so. He considered the representation and the positive assessment o f meaningful
acceptance and rejection of an idea to be alternative out- information (for a review, see Bogdan, 1986).
comes of an effortful assessment process that occurs sub- A proposition is believed when the proposition's
sequent to the automatic comprehension of that idea. This meaning is represented, coded, or symbolized in a mental
article examined Spinoza's alternative suggestion that (a) system and when that symbolic representation is treated
the acceptance of an idea is part of the automatic com- as if it was true. It makes little sense to say that we believe
prehension of that idea and (b) the rejection of an idea something o f which we have absolutely no knowledge or
occurs subsequent to, and more effortfully than, its accep- which we, through our words and actions, acknowledge
tance. In this view, the mental representation of abstract to be false. Thus, to believe that armadillos have four
ideas is quite similar to the mental representation of phys- legs, for example, requires that one have the information
ical objects: People believe in the ideas they comprehend, armadillos have four legs coded and stored in one's mental
as quickly and automatically as they believe in the objects system and that one behave as though the information
they see. Research in social and cognitive psychology sug- correctly characterizes some real zoological state of affairs.
gests that Spinoza's model may be a more accurate ac- Whereas the representation c o m p o n e n t o f believing refers
count of human belief than is that of Descartes. merely to the existence o f meaningful information within
a mental system, the assessment c o m p o n e n t refers to the
relation between that information and other information
that already exists within the system.1
Though Truth and Falsehood bee Neare twins, yet Truth a little
elder is. The Cartesian Procedure
- - J o h n Donne, 1635/1930, p. 129 W h e n we think about how the h u m a n m i n d believes, it
Everyone knows that understanding is one thing and be- is only natural that we should immediately think about
lieving is another, that people can consider ideas without how it ought to believe. Because we c a n n o t actually ob-
considering t h e m so, and that one must have an idea be- serve the processes by which comprehension and assess-
fore one can determine its merit. "Everyone knows the m e n t occur, we tend to ask the next best question: H o w
d i f f e r e n c e . . , between supposing a proposition and ac- should they occur? W h a t is the most logical way for these
quiescing in its truth" (James, 1890, p. 283). Nonetheless, things to happen? H o w would we design a device to ac-
this article suggests that what everyone knows m a y be, at complish them? One piece o f the answer to such questions
least in part, wrong. It will be argued that the compre- is obvious and has been obvious for so m a n y centuries
hension and acceptance o f ideas are not clearly separable
psychological acts, but rather that comprehension in- t Such a "coherence theory" of truth is obviously inadequate: One
cludes acceptance o f that which is comprehended. may not define the veracity of a proposition exclusively in terms of its
fit with other propositions (see Tarski, 1969). Nonetheless, propositions
do (somehow) get assessed, and because the actual mechanics of the
The Process of Belief assessment procedure are not crucial to the present discussion, no at-
tempt to define its necessary and sufficient conditions will be made.
Components of Believing
The writing of this article was supported by National ScienceFoundation
"Believing," wrote Bertrand Russell (1921), "seems the Grants BNS-8605443 and BNS-8819836 to Daniel T. Gilbert.
most mental thing we do." (p. 231) Indeed, the problem So many people have provided kind and insightful comments on
versions of this article that I will surely fail to thank them all. Among
o f belief---what it is, how it happens, and what it d o e s - - them, then, are John Bargh, Roy Baumeister, Mark Bickhard, David
constitutes "the central p r o b l e m in the analysis o f m i n d " Cohen, Fred Dretske, Russ Fazio, Susan Fiske, Don Foss, Windflower
(Russell, p. 231). Exactly what does it m e a n to say that Gilbert, Nancy Hazen-Swann, Marcia Johnson, Ned Jones, Stan Klein,
we believe something? W h a t do we m e a n when we say Doug Krull, Mark Lopper, James Liu, Charlie Lord, Pat Malone, Brett
Pelham, Mike Ross, Johnathan Schooler, Dave Schneider, Jim Sherman,
we believe that bald m e n are especially licentious, that Janet Spence, Bill Swann, Romin Tafarodi, Elizabeth Tighe, Yaacov
sharks can swim backwards, or that love is blind and Trope, Barbara Tversky,Dan Wegner, Rich Wenzlaff,Tim Wilson, Jason
justice is not? The answers to these questions are so com- Young, the students in Susan Fiske's and Shelley Taylor's seminars on
plex and varied that no brief discussion can treat t h e m social cognition, and several anonymous reviewers.
fairly. Nonetheless, in all the epistemological talk that Correspondence concerning this article should be addressed to
Daniel Gilbert, Department of Psychology,330 Mezes Hall, University
philosophers and psychologists have p r o d u c e d over the of Texas at Austin, Austin, TX 78712. Electronic mail may be sent to
years, one point o f consensus seems to emerge: Beliefs, PSHU666@UTXVM.BITNET.

February 1991 • A m e r i c a n Psychologist 107


Copyright 1991 by the American PsychologicalAssociation, Inc. 0003-066X/91/$2.00
Vol. 46, No. 2, 107-119
that very few thinkers have challenged it: Obviously, one insisted instead that comprehending and accepting were,
must comprehend an idea before one can assess it. Put in fact, the same operation. Spinoza argued that to com-
another way, before one can consider an idea true, one prehend a proposition, a person had implicitly to accept
must consider it truly. that proposition; only later, if the person realized that this
This simple notion--that comprehension precedes proposition conflicted with some other, might he or she
and is separate from assessment~seems more than change his or her mind. As William James (1890) would
merely agreeable and innocent: It seems to have the force later characterize Spinoza's position, "All propositions,
of logical necessity. Borrowing liberally from the Stoic whether attributive or existential, are believed through
philosophers, Ren6 Descartes was the first modem thinker the very fact of being conceived" (p. 290). Indeed, Spinoza
to formalize this notion by partitioning the mind into argued that one need not even distinguish between mere
relatively active (controlled) and passive (automatic) do- ideas and beliefsmbecause all ideas are beliefs (see Ben-
mains. Comprehension, he claimed, was passive: Ideas nett, 1984).
impressed themselves upon the mind as physical objects It is critical to note that this claim does not mean
might upon soft wax, and just as wax did nothing to re- that persons are incapable of representing falsehoods and
ceive the object's impression, so the mind did nothing to are thus doomed to believe forever that which they com-
comprehend the world around it. prehend: Upon hearing that armadillos make excellent
Although having ideas was effortless and automatic, appetizers, few of us feel compelled to pack our cutlery
accepting or rejecting those ideas was not. Descartes con- and head for Texas. Indeed, having comprehended and
sidered the assessment of an idea's veracity to be the op- accepted an idea, Spinoza considered persons entirely free
eration of the voluntas--the active, conscious, willful force either to unaccept or to certify it. Spinoza's thesis simply
of the psyche. This principle reigned axiomatic in Des- implies that unacceptance is a secondary psychological
cartes's philosophy: "That we have p o w e r . . , to give or act in which the initial accepting that invariably accom-
withhold our assent at will, is so evident that it must be panies comprehension is subsequently undone. Disbelief
counted among the first and most common notions that is by no means an impossibility in Spinoza's scheme;
are innate in us" (1644/1984, p. 205), and "All that the rather, it is merely a deliberate revision of belief.
intellect does is to enable me to perceive, without affirm-
ing or denying anything, the ideas which are subjects for The Mechanics of Belief
possible judgments" (1641/1984, p. 39; see also Bennett, Virtually all current and classical theories of mental rep-
1984, pp. 159-167; Lehrer, 1983; Nuchelmans, 1983, resentation presume that once the truth value of a prop-
p. 45; Price, 1969, pp. 221-240; Russell, 1921, pp. osition is assessed, the mental representation of that
247-249). proposition must somehow be altered or "tagged" to in-
Although his fellow philosophers often took excep- dicate that truth valuemotherwise we would have to
tion with Descartes's epistemology, they generally ac- reassess the validity of our knowledge each time we de-
cepted the basic distinction between comprehension and ployed it. The differences between the Spinozan and
assessment on which it was based. And indeed, that dis- Cartesian procedures may be framed as a disagreement
tinction continues to pervade contemporary views of how not about the nature of mental representation itself, but
mental systems should and do operate. Computers, for about the nature of this tagging system. A familiar met-
example, employ languages and architectures that enable aphor may serve to illustrate the key elements of this
us to distinguish clearly between the mere representation division.
and the subsequent assessment of information. A machine
may represent the proposition armadillos deplore raisin Spinozan and Cartesian Tagging Systems
cookies before or even without assessing the veracity of Imagine a library of a few million volumes, of which only
that proposition. Information can exist inside a machine a small number are fiction. There are (at least) two rea-
in an unassessed form, and it can do so because the ma- sonable methods by which one could tag the spines of
chine's human designers have generally considered this books so that fiction could be distinguished from nonfic-
the most logical and efficient way for machines to think. tion at a glance. One method would be to paste a red tag
Computers, then, are good examples of what one might on each volume of fiction and a blue tag on each volume
call Cartesian belief systems~devices in which the op- of nonfiction. Another method would be to tag the fiction
erations of comprehension and assessment are as separate and leave the nonfiction untagged. Either of these systems
and sequential as everybody knows they should be. would accomplish the goal of allowing a librarian to dis-
tinguish fiction from nonfiction without necessitating that
The Spinozan Procedure
he or she actually reread the book each time such a dis-
That is, almost everybody. Baruch Spinoza was a part- crimination needed to be made.
time lens grinder who never saw a digital computer, but It is only a mild oversimplification to say that Des-
it is clear that he did not think the human mind worked cartes considered the mind to be a library of ideas that
like one. In the 49th proposition of Part 2 of his Ethics used something akin to the red-blue tag system. A new
(1677/1982), Spinoza put forth a thesis that, on the face book (new information) appeared in the library (was rep-
of it, seems simply preposterous: He dismissed Descartes's resented in the mind), its contents were read (assessed),
distinction between comprehension and assessment and and the book was then tagged (recoded or rerepresented)

108 February 1991 • American Psychologist


as either fiction (false) or nonfiction (true). New books Even connectionist or parallel distributed processing
(unassessed ideas) lacked a tag, of course, and thus were models incorporate these serial components (Rumelhart,
not identifiable as either fiction or nonfiction until they Smolensky, McCleUand, & Hinton, 1986, p. 38). Modular
had been read. Such new and unread books were systems, then, pass information from one module to an-
"merely" represented in the library. other, and each module modifies the information in some
Spinoza, however, argued that the mind was more way before passing it along to the next. Virtually all in-
like a library that used a tagged-untagged system. In Spi- formation-processing schemesmfrom those that describe
noza's view, books were represented before they were as- language comprehension (Just & Carpenter, 1977) and
sessed; but because of the particular tagging system that visual pattern recognition (Marr, 1982) to those that
was used to denote the outcome of that assessment, a new model more general problem-solving procedures (Newell
book that appeared without a tag looked exactly like a & Simon, 1972)--contain this information-passing fea-
work of nonfiction. In a Spinozan library, a book's spine ture. Surely, a flowchart with one box and no arrows
always announced its contents; no book could be would be a singularly useless sort of map.
"merely" represented in the library, because the absence All of this information-passing is not without begin-
of a tag was itself informative (or misinformative) about ning or end. Processing is initiated by the introduction
the content of the book. Analogously, ideas whose truth of information into a modular system, that information
had been ascertained through a rational assessment pro- is passed between and modified by various modules, and
cess were represented in the mind in precisely the same finally an informational product is outputted. In some
way as were ideas that had simply been comprehended; systems, outputting can occur only after the last module
only ideas that were judged to be false were unaccepted, has received some information as input. By way of illus-
or given a special tag (cf. Wegner, Coulton, & Wenzlaff, tration, imagine a very simple, boxlike machine whose
1985; see also Clark & Chase, 1972). input is a fuzzy, white tennis ball. The ball rolls into the
Perhaps the most striking feature of these different machine, is shaved, dyed lime green, tattooed with a
systems is how similar they are. Despite the fact that the trademark, and then rolled out of the machine and into
two libraries use somewhat different tagging systems, both its retail canister. Such a machine is an example of a
ultimately accomplish the same end. If, for example, the single exit system: The tennis ball can only emerge after
Cartesian and Spinozan procedures (shown in Figure 1) it has been modified by, and passed to, each of the shaving,
were implemented on a pair of hypothetical machines dying, and tattooing modules in sequence. Until the tennis
that had unlimited processing resources (i.e., time, energy, ball is received by the tattooing module, it cannot exit
and data) then the two machines should end up believing the machine.
precisely the same things, and the particular method by In general, however, sophisticated systems allow in-
which each achieved its beliefs would be largely incon- formational products to exit at a variety of stages (see
sequential. Norman & Bobrow's, 1975, principle of continually
The rub is that no mental system, whether natural available output). Imagine a different contraption: A
or artificial, has unlimited processing resources. On the pancake-making machine whose input is an irregular-
contrary, real mental systems must often operate under shaped pancake. This irregular pancake is modified by
imperfect conditions in which multiple tasks vie for access the first module, a square-cutting device, which cuts a
to a finite pool of resources (Baddeley & Hitch, 1974; square out of the irregular pancake's center. This square
Kahneman, 1973; Norman & Bobrow, 1975), and when
this happens, the procedures these systems execute tend
to break down in predictable ways. As it turns out, Spi-
nozan and Cartesian procedures break down quite dif- Figure 1
ferently, and thus have very different consequences for Two Conceptual Stages of the Spinozan and
the mental systems that employ them. In reality, any pair Cartesian Belief Procedures
of machines that implemented the Spinozan and Carte-
SPINOZAN CARTESIAN
sian belief procedures would, after some time, come to
have very different beliefs. But before examining the par- PROCEDURE PROCEDURE
ticular ways in which these systems react to stress, it is
necessary to discuss briefly a more general principle of
systems breakdown. REPRESENTATION Comprehension Comprehension
STAGE & Acceptance
The Principle of Premature Output
Perhaps the most fundamental feature of mental systems
is that they are modular: Several different subsystems or
modules work in a serial sequence to accomplish the in-
ASSESSMENT
1
Certification
1
Acceptance
formation-processing tasks that presumably underlie hu-
man actions as diverse as raising an eyebrow, watching a
STAGE OR OR
wrestling match, and composing a sonata (e.g., Fodor, Unacceptance Rejection
1983; Garfield, 1987; Gazzaniga, 1985; Minsky, 1985).

February 1991 ° American Psychologist 109


pancake can either exit into a blue box or it can be passed a profound tendency to mistake such new and unassessed
along to a second module, a circle-cutting device, which books for nonfiction. The translation of this metaphor
cuts a circle from the square pancake and then drops a should be clear: When a multiple-exit Spinozan system
circular pancake into a red box. Such a multiple exit is unable to assess the veracity of information, it should
system would be capable of producing output at either consider the information true. In short, the two proce-
of its two processing stages, and would thus be capable dures shown in Figure 1 will produce identical products
of producing a variety of different products. when run to completion, but very different products when
One interesting feature of a multiple exit system is truncated. With this fact in mind, it is possible to begin
this: Because resources are required to send the infor- asking the question toward which this discussion has been
mation (or, in the preceding case, a pancake) from one driving: Are human beings Cartesian or Spinozan sys-
module to the next, any sort of resource depletion will tems? A preliminary answer to this question may be found
cause premature output (see Norman & Bobrow's, 1975, by examining systems in which the belief process has not
principle of graceful degradation; Tversky & Kahne- yet grown up and by examining systems in which the
man's, 1974, anchor-adjust heuristic). In other words, belief process has been broken down.
when multiple exit systems break down they generally do
The Construction of Doubt
so by outputting the product of an early module. The
pancake-making machine is a good example. A resource In The Analysis of Mind(1921), Bertrand Russell spe-
shortage can cause the machine to produce a square pan- cifically denied Spinoza's position, but he did so with
cake (a product of the first module) but not a circular more than a hint of reluctance: "There is a great deal to
pancake (a product of the second module), because cir- be said in favour of this view," wrote Russell, "and I have
cular pancakes depend on the prior manufacture of square some hesitation in regarding it as inadequate" (p. 249).
pancakes but not vice versa. It is worth noting that this Indeed, after denouncing the Spinozan hypothesis, Russell
tendency toward premature output will occur when the proceeded to marshal evidence in its support. In partic-
two modules perform equally complex tasks (i.e., when ular, he noted that the hypothesis "is recommended by
they require equal resources); to the extent that the second the way in which it accords with mental development.
module performs a more complex task than the first, this Doubt, suspense of judgment and disbelief all seem later
tendency will be even further pronounced. and more complex than a wholly unreflecting assent"
This tendency can be codified as a general principle (p. 249).
of systems breakdown: When stressed, modular infor- Indeed, thinkers of all stripe have suggested that
mation-passing systems with multiple exit capabilities will doubt is less quickly and easily acquired than belief (see
often show a bias toward prematurely outputting the Flavell, 1985; Lundholm, 1936; Piaget, 1962). As early
products of early modules. This principle enables very as 1859, Bain contrasted the "primitive credulity" of hu-
clear predictions about the unique ways in which Spi- man beings with their "acquired skepticism" and noted
nozan and Cartesian systems should break down and, that "we begin by believing everything; whatever is, is
therefore, about what these systems should ultimately true" (p. 511). Similar sentiments were expressed by such
come to believe. A stressed or resource-depleted system eminent contemporaries as William James (1890, p. 318),
should represent propositions (a product of the first mod- G. F. Stout (1909a, pp. 11 l-114; 1909b, pp. 258-260),
ule) but should occasionally be unable to assess those and William McDougall (1923), who noted, "It is only
representations (a product of the second module). This gradually that we learn to suspend judgment, to doubt"
means that resource depletion should prevent a Cartesian (p. 375). But it was the Scottish philosopher, Thomas Reid
system from either accepting or rejecting the propositions (1764/1895), who made this point most explicitly:
that it merely comprehends, whereas it should prevent a
Spinozan system from unaccepting or certifying the If credulity were the effect of reasoning and experience,
propositions that it both comprehends and accepts. it must grow up and gather strength, in the same pro-
portion as reason and experience do. But if it is the
The Breakdown of Belief gift of Nature, it will be strongest in childhood, and
limited and restrained by experience; and the most
The principle of premature output suggests that the way
superficial view of human life shews, that the last is
a mental system behaves under stressful conditions may
really the case, and not the first. (p. 197)
be a good clue to the sort of belief procedure it employs.
In the language of the library metaphor, one can imagine Two observations provide some empirical support
placing a book on the library's shelves and stressing the for these contentions. First, the ability to deny proposi-
librarian so that he or she is unable to assess the book's tions (i.e., truth-functional negation) is, in fact, one of
contents and tag its spine. If this were done, then the the last linguistic abilities to emerge in childhood (Bloom,
librarian's response to a subsequent inquiry about the 1970; Pea, 1980). Although very young children may use
book would reveal a great deal about the library's tagging the word no to indicate rejection or nonexistence, the
system. If the library used the red-blue (Cartesian) sys- denial function of the word is not mastered until quite a
tem, then the librarian would claim not to know the bit later. To the extent that linguistic competences reflect
book's contents; but if the library used the tagged-un- underlying cognitive capabilities, this suggests that dis-
tagged (Spinozan) system, then the librarian would show believing propositions may be more demanding than be-

110 February 1991 • American Psychologist


lieving them. Second, young children (who lack truth- The facilitating effects of resource depletion on per-
functional negation) are particularly suggestible--that is, suasion are, of course, more than anecdotal. One common
they are generally prone to accept propositions uncriti- method of depleting processing resources in the labora-
cally (see Ceci, Ross, & Toglia, 1987; cf. Loftus & Davies, tory requires subjects to perform several tasks simulta-
1984). Although such hypersuggestibility is surely exac- neously. Logic dictates that when a person performs two
erbated by the child's inexperience and powerlessness or more resource-consuming tasks at the same time, then
(Dodd & Bradshaw, 1980; Messerschmidt, 1933), young he or she must devote a smaller portion of his or her total
children are more suggestible than older children even processing capacity to each of the tasks. In this vein, Fes-
when such factors are controlled (Ceci et al., 1987). tinger and Maccoby (1964) demonstrated that subjects
Frankly, the ingenuousness of children may seem who listened to a counterattitudinal communication while
too self-evident to warrant extended remark. Yet, a mo- attending to an irrelevant stimulus were particularly likely
ment's reflection reveals that this self-evident fact does to accept the propositions they comprehended (see Baron,
not fit well with Descartes's hypothesis. If acceptance and Baron, & Miller, 1973, for a review of such studies). More
rejection are merely two sides of the same psychological exacting research has replicated this phenomenon and
coin, as the Cartesian perspective asserts, then we should specified its mediators: When resource-depleted persons
expect children to learn to believe and disbelieve at about are exposed to doubtful propositions (i.e., propositions
the same time and with equal ease. Yet, even a "most that they normally would disbelieve), their ability to reject
superficial view" reveals that this simply isn't so. Children those propositions is markedly reduced (see Petty & Ca-
are especially credulous, especially gullible, especially cioppo, 1986, for a review).
prone toward acceptance and belief--as if they accepted Once again, an obvious fact of psychological life de-
as effortlessly as they comprehended but had yet to master serves close scrutiny. Why should resource depletion fa-
the intricacies of doubt. In short, human children do pre- cilitate believing? Why does the fatigued or distracted
cisely what one would expect of immature Spinozan (but individual seem especially susceptible to persuasion?
not Cartesian) systems. Current models of persuasion (e.g., Chaiken, 1987; Petty
& Cacioppo, 1986) have suggested that resource depletion
The Destruction of Doubt specifically disables cognitive elaboration--the tendency
The ontogeny of belief is at least consistent with the idea for persons to attempt logical rejections of the doubtful
that unacceptance is a more difficult operation than is propositions they comprehend. But why should impair-
acceptance. Not only does doubt seem to be the last op- ment of such a mechanism necessarily engender accep-
eration to emerge, but it also seems to be the first to tance? Indeed, if rejection efforts were to follow on the
disappear. Investigations of the experimentally induced heels of "mere" comprehension (i.e., representation of
breakdown of belief offer clear and convincing evidence meaning without acceptance), then the disabling of these
in favor of this view. efforts should leave the person without a belief of any
Persuasive propositions. Throughout the course of sort. Such a person should understand what he or she has
history, governments have routinely practiced the art of heard, but should not be particularly inclined toward or
changing minds. Many of the techniques they have de- against it. In short, resource-depleted Cartesians should
veloped trade on the assumption that beliefs are most be uncertain, uncommitted, but not persuaded.
easily instilled when the believer's cognitive resources have It would seem, then, that for models of persuasion
been depleted. Political prisoners, for example, are com- to make sense, they must implicitly assume that accep-
monly deprived of sleep because it is thought that mental tance occurs prior to or more easily than rejection, or
fatigue will facilitate their rapid indoctrination. As one both, and that as a result, this initial acceptance remains
victim of the Maoist thought-reform programs recalled even when subsequent attempts at rejection are experi-
of his own "reeducation" in China, "You are annihilated, mentally impaired. This assumption is, of course, the very
exhausted, you can't control yourself, or remember what heart of the Spinozan hypothesis: When one disables the
you said two minutes before. You feel that all is lost. assessment mechanism that follows Spinozan compre-
From that moment the judge is the real master of you. hension, one should, in fact, find a person with a belief
You accept anything he says [italics added]" (Lifton, 1961, in the comprehended proposition. One should find a per-
p. 23). son who has been artificially reduced to a state of primitive
The prisoner's acceptance is not, of course, limited credulity, a state of judgmental innocence in which ev-
to those propositions put forth by interrogators or judges. erything that is, is true. And this is what one finds. 2
Indeed, a ubiquitous feature of belief-induction programs
is the forced confession, a remarkably effective technique 2I avoid a discussion of how resource-depletedpersons react to
that requires resource-depleted prisoners to tell them- true propositions. As Figure 1 shows, the Spinozan procedurecertifies
(or further accepts) true propositionsthat are initiallyacceptedat the
selves the propositions that their captors wish them to comprehensionstage.This suggeststhat resource-depletedpersonsshould
embrace. Prisoners are coerced to write and recite the believea true propositionless than should normal persons. In fact,just
appropriate political doctrines and, eventually, even the such an effecthas been documentedby Petty,Wells,and Brock(1976).
most intransigent prisoner begins to experience some dif- It is important to note that in these studies, resourcedepletiondid not
decrease beliefin true propositions;rather, it preventedbelieffrom in-
ficulty doubting his or her own words (Lifton, 1961, pp. creasing as much as it otherwisewould have. I thank Richard Petty for
38-64; see also Bem, 1966). making the raw data from these studies availableto me for reanalysis.

February 1991 • American Psychologist 111


Autobiographical propositions. When an acquain- markedness of a word is usually considered the clearest
tance says that all Democrats are atheists or that squash index of such linguistic complexity, and it can be deter-
is the sport of kings, one may determine not only whether mined by two simple criteria (Greenberg, 1966). First,
these contentions are true, but also whether the acquain- unmarked words (such as happy) tend to have fewer mor-
tance believes them to be true. It may be, for example, phemes than do their marked counterparts (such as un-
that the acquaintance is merely trying to get a rise out of happy). Second, whereas unmarked words may be used
a nearby liberal or a raise out of a squash-playing superior, neutrally, marked words generally cannot. For example,
and that he or she does not really believe either of these the neutral inquiry "How happy are you?" presupposes
claims. In effect, when a speaker asserts that "This is so," no particular degree of happiness on the part of the lis-
he or she also asserts (quite independently) that "I believe tener, whereas the inquiry "How unhappy are you?"
that this is so." Such autobiographical assertions are not clearly reveals the speaker's prior belief that the listener
limited to verbal declarations of belief; virtually any hu- is, in fact, sad. This is because happy (unmarked) and
man action can be construed as inherently containing a unhappy (marked) are thought of as degrees of happiness
propositional description of the actor (e.g., a smile says rather than degrees of unhappiness, just as long (un-
"I am happy," a vote says "I am liberal," and so on). marked) and short (marked) are considered degrees of
How do people react to others' verbal and behavioral length rather than of shortness. Both marked and un-
self-descriptions? After decades of research activity, both marked words describe a particular point on a dimension,
the lie-detection and attribution literatures have inde- but in addition, unmarked words may be used neutrally
pendently concluded that people are particularly prone to describe the dimension itself.
to accept the autobiographical propositions implicit (or Unmarked terms are thought to describe operations
explicit) in others' words and deeds (for reviews of these that are more conceptually basic than their marked
literatures see, respectively, Zuckerman, Depaulo, & Ro- counterparts. The Spinozan hypothesis states that un-
senthal, 1981, and Jones, 1979). What makes this phe- acceptance is a more complex operation than is accep-
nomenon so intriguing is that people accept these asser- tance and, interestingly enough, the English words that
tions even when they know full well that the assertions indicate the acceptance of ideas are generally unmarked
stand an excellent chance of being wrong. So, for example, with respect to their antonyms. Thus, people speak of
when subjects listen to a person read aloud a position propositions as acceptable and unacceptable, but (unless
statement (e.g., "I am in favor of the federal protection one is a neologizing psychologist) not as rejectable and
of armadillos"), they generally assume that the reader's unrejectable. One's statements may be true or untrue, but
autobiographical claim is truemdespite the fact that it they may not be false and unfalse. People hope their ideas
was delivered at the behest of a powerful authority. This are correct, accurate, and credible rather than incorrect,
robust tendency--variously known as the fundamental inaccurate, and incredible, but they cannot grammatically
attribution error (Ross, 1977), the correspondence bias wish to be unwrong. Indeed, people even speak of belief
(Gilbert & Jones, 1986), or the truthfulness bias (Zuck- and disbelief more naturally than they speak of doubt
erman et al.)nis precisely the sort that a resource-de- and undoubt. To the extent that one's words for mental
pleted Spinozan system should display. A Spinozan sys- processes do reveal something about the processes them-
tem should accept another's implicit self-description as selves, the structure of the English lexicon suggests (as
part of the comprehension of the other's action and should did Spinoza, who wrote in Latin) that the rejection of
subsequently unaccept that self-description only if the false ideas is more complex than the acceptance of true
system has both the time and energy necessary to do so. ones.
Gilbert, Pelham, and KruU (1988) have shown that this Verification of propositions. These observations
tendency is, in fact, exacerbated by the experimentally about the structure of words are complemented by studies
induced depletion of resources (see also Gilbert, 1989; of how words are understood. Research on sentence ver-
Gilbert, Krull, & Pelham, 1988; Gilbert & Osborne, ification (i.e., how people decide if a sentence correctly
1989). characterizes its referents) has shown that people are gen-
erally quicker to assess the veridicality of true than false
The Language of Doubt
affirmative sentences (Gough, 1965). Clark and Chase
Despite their considerable differences, both the Cartesian (1972) have explained this finding with a "paramorphic"
and Spinozan positions contend that belief begins with model (i.e., a model that produces the same output as a
the comprehension of propositions. How people compre- human being, but does not necessarily mimic the methods
hend propositions is, of course, a primary province of by which the human being generated that output. See
psycholinguistic research, and several of the phenomena also Carpenter & Just, 1975; Trabasso, Rollins, &
in this area speak to the present concerns. Shaughnessey, 1971). According to Clark and Chase's
Components of propositions. A fundamental as- model, when people process assertions (a) they mentally
sumption of psycholinguistic research is that "complexity represent both the assertion (e.g., the sentence an ar-
in thought tends to be reflected in complexity of expres- madillo's eyes are above its nose) and the state-of-affairs
sion" (Clark & Clark, 1977, p. 523) and, conversely, that it purports to describe (e.g., a picture of an armadillo),
"simplicity in cognition is reflected in simplicity of (lin- and (b) they then compare the two representations and
guistic) form" (Lakoff, 1987, p. 60; cf. Geach, 1980). The compute a "truth index." This simple model makes very

112 February 1991 • American Psychologist


clear predictions about how long it should take a person which is being denied and because Spinozan comprehen-
to verify a variety of logically identical but syntactically sion always entails acceptance of that which is compre-
different sentences, and research has shown that these hended, then a Spinozan listener who comprehends a de-
predictions are excellent approximations of empirical nial should momentarily believe the very state of affairs
data. Yet, what enables this model to work so well is the that he or she is being instructed not to believe--more
asymmetrical fashion in which the comparison stage is so than should someone who is hearing nothing at all.
assumed to be executed: So, for example, upon learning that Homer's armadillo
is not aroused, a Spinozan listener should comprehend
First, people start with the truth index set to t r u e . . . (and thus accept) the core assertion Homer's armadillo
(and) second, they compare the two representations. is aroused, and should only then be able to finish the
If the two match in every respect, the truth index is processing of this self-assessing proposition by rejecting
left alone. If the two do not m a t c h . . . (then) the truth the core assertion. This means that Spinozan listeners
index is changed to its opposite, false. (Clark & Clark, should occasionally end up believing the very assertions
1977, p. 103) they hear denied!
In a series of investigations, Wegner, Wenzlaff, Ker-
In other words, all sentences are initially coded as true, ker, and Beattie (1981) showed that subjects who read
and the comparison stage leads to further mental work denials such as Bob Talbert not linked to Mafia were in
only when the sentence turns out to be false. This feature fact left with more negative impressions of the fictitious
of the Clark and Chase model is what enables it to predict Talbert than were subjects who read a neutral assertion
listeners' reaction times so well. Spinoza would simply such as Bob Talbert celebrates birthday. If this tendency
have added that this model is not paramorphic; it is per- for people to believe denied information is, in fact, a result
fectly descriptive. of their use of the Spinozan procedure, then it should be
Self-assessingpropositions. There is something un- exacerbated by resource depletion. Gilbert, Krull, and
usual about linguistic denials. Homer's armadillo is not Malone (1990) asked subjects to learn a fictitious vocab-
male differs from Homer's armadillo is female in more ulary by reading assertions (e.g., a monishna is an ar-
than superficial structure; indeed, the word not seems to madillo) whose veracity was either affirmed or denied by
be of a different "logical type" than the other words in the subsequent presentation of an assessment word. On
the sentence (Russell, 1919, pp. 131-143; Tarski, 1969) some trials, subjects' resources were momentarily de-
and is probably best thought of as a metalinguistic in- pleted by having them quickly identify a musical tone
struction to the listener to reject the affirmative propo- that followed the assessment word. Whereas a Cartesian
sition that the remainder of the sentence puts forth. Horn learner should have been able to comprehend each as-
(1989) neatly characterized this view: "Every negative sertion and then wait for the assessment word to deter-
statement presupposes a corresponding a f f i r m a t i v e . . . mine whether to accept or reject that assertion, a Spinozan
but not vice versa. Negation is consequently a second- learner should not have had that prerogative. A Spinozan
order affirmation: Negative statements are about positive learner should have accepted the assertion as it was com-
statements, while affirmatives are directly about the prehended and then, if that assertion was denied, unac-
world" (p. 3). Indeed, a linguistic denial is "like an affir- cepted it. Indeed, a unique pattern of errors emerged:
mative supposition and its cancellation all rolled into one" Resource depletion did not cause subjects to believe that
(Clark & Clark, 1977, p. 98). affirmed propositions were false, but it did cause them
All of this means that to comprehend a denial (ar- to believe that denied propositions were true. This is pre-
madillos are not herbivorous), a listener must first com- cisely what one would expect to happen if unacceptance
prehend the core assertion (armadillos are herbivorous) was disrupted by the musical tone task. The Cartesian
and then reject it. As Russell (1948, p. 122) noted, "When model predicts no such asymmetry in response to re-
I say truly 'This is not blue' there is, on the subjective source depletion during assessment.
side, consideration of'This is blue,' followed by rejection"
(p. 122). Tesniere (1959) made the same point: "Before The C o n t r o l o f B e l i e f
denying the contents of a sentence, the mind must first
affirm it" (p. 225). 3 A number of experimental studies Up to this point, evidence for the Spinozan procedure
have substantiated the psychological reality of such phil- has consisted largely of evidence for the precedence of
osophical contentions (see chap. 3 of Horn, 1989, for a acceptance over rejection. Clearly, acceptance is not
review). merely the flip side of rejection. However, the Spinozan
If denials are self-assessing propositions in that they hypothesis is really composed of two separable claims--
offer both a core assertion and an instruction to reject the first concerning the temporal precedence of accep-
that assertion once it is comprehended, then the Spinozan tance over rejection (the asymmetry hypothesis), and the
hypothesis makes a unique prediction about them. Be- second concerning the unity of comprehension and ac-
cause denials require the initial comprehension of that ceptance (the unity hypothesis). These hypotheses are
conceivably independent. It is possible, for example, to
31 thank Benne Willerman for translating this passage from the imagine a system in which acceptance occurs prior to
French. rejection (as it does in the Spinozan system) and yet re-

February 1991 • American Psychologist 113


example, Bransford and Johnson (1973) argued that
Figure 2 comprehension "may involve options such as whether or
Comparison of Cartozan, Spinozan, and Cartesian not to judge the truth value of a statement or presuppose
Belief Procedures its truth value" (p. 433). Such statements suggest that
CARTOZAN SPINOZAN CARTESIAN comprehension without acceptance is, at the very least,
PROCEDURE PROCEDURE PROCEDURE a viable cognitive option. If this is so, then one would
expect people who are faced with erroneous, suspect, un-
substantiated, or otherwise invalid information to exercise
Comprehension Comprehension Comprehension such options; specifically, they should be able to compre-
& Acceptance hend the invalid information without accepting it.
How do people deal with invalid information? Re-

1
Acceptance
1
Unacceptance
1
Rejection
search shows that people often use information that they
clearly recognize as invalid. Ross, Lepper, and Hubbard
(1975) gave subjects feedback about their performance
on an ability-linked task (namely, the discrimination of
actual from bogus suicide notes) and later confessed that
the feedback had been unrelated to the subject's actual
performance. Despite the experimenter's confession,
Unacceptance subjects persisted in believing the invalid feedback. Sim-
ilar results have been documented with many different
kinds of invalid information (e.g., Anderson, Lepper, &
mains distinct and separate from comprehension (as it Ross, 1980; Valins, 1972; Walster, Berscheid, Abrahams,
does in the Cartesian system). & Aronson, 1967). Interestingly, one of the few effective
A hybrid "Cartozan" processor of this sort is illus- methods for ameliorating belief in such false propositions
trated in Figure 2. Such a system would display virtually is to ask subjects to comprehend the false proposition's
all of the effects documented hitherto. Specifically, the logical opposite (Anderson, 1982).
principle of premature output would cause such a system These findings fit with a larger body of research that
to show a bias toward accepting whatever propositions it suggests that people are particularly poor at ignoring, for-
assessed; however, the Cartozan system would not nec- getting, rejecting, or otherwise failing to believe that which
essarily assess those propositions it comprehended! In they have comprehended (Bjork, 1972; Schul & Burn-
short, the fact that assessment is asymmetric does not stein, 1985; Wyer & Budesheim, 1987; Wyer & Unverzagt,
mean that acceptance is an automatic consequence of 1985). Yet, in virtually all such investigations, subjects
comprehension. As such, the research discussed thus far have used information whose invalidity was revealed only
may impugn the Cartesian model, but by and large it after it was comprehended. Cartozan, Spinozan, and even
supports the Cartozan and Spinozan models equally well. Cartesian systems are all capable of displaying such ef-
The question then remains: Can mere comprehension fects. Spinozan systems are unique, however, in that they
occur? That is, can one understand a proposition without should occasionally believe and use information even
representing it as true? when they have prior knowledge of the information's in-
According to some theorists, the answer is by defi- validity.
nition no. Comprehension is the process by which the Wegner et al.'s (1985) extension of the Ross et al.
meaning of a proposition is mentally represented, and (1975) study suggested that being forewarned in this way
many theorists have found it difficult to define this process is not necessarily to be forearmed. Rather than confessing
without reference to the veracity of the proposition. Thus, to subjects after giving them phony feedback on a suicide-
Johnson-Laird (I 988) noted that to comprehend a prop- note detection task, Wegner et al. (1985) told subjects
osition one must "imagine how the world should be about the invalidity of the feedback before the subjects
granted its truth" (p. 110), and Dowty, Wall, and Peters received it. Despite this clear forewarning, subjects be-
(198 l) argued that "to give the meaning of a sentence is lieved the arbitrary feedback they were given (cf. Fleming
to specify its truth conditions" (p. 4). Rips and Marcus & Arrowood, 1979; Kiesler & Kiesler, 1964). Similarly,
(1977) were even more explicit in claiming that the com- Gilbert et al. (1990) showed subjects a series of smiling
prehension of a sentence involves "creating a temporary faces (i.e., icons of the proposition I am happy) and told
context in which the sentence is true" (p. 192). Indeed, subjects that each face was expressing either true or false
many of us feel that the meaning of an aphorism such as happiness. On some trials subjects received these assess-
oppression is the mother of liberty is not clear until we ments before seeing the face, and on other trials they
have represented the aphorism in a way that renders it received the assessment only after seeing the face. As the
true ("Ah yes--the yearning for freedom becomes acute Spinozan hypothesis predicted, resource depletion caused
when freedom is denied"). In some sense, to generate a subjects to misidentify false faces as true, but not vice
proposition's meaning is to consider it so. versa. Moreover, the timing of the assessment made ab-
Nonetheless, other theorists have offered definitions solutely no difference whatsoever. Resource-depleted
that preserve the possibility of mere comprehension. For subjects mistook false faces for true ones, and they were

114 February 1991 • American Psychologist


just as likely to do so when informed of the face's falseness ceptance and rejection--until decisive evidence can be
before seeing it as when informed only after seeing it. In acquired. A Spinozan system, of course, cannot enjoy
both of these experiments, then, subjects were apparently this particular convenience. As Spinoza (1677/1982)
unable to merely comprehend; rather, they seemed to himself argued:
accept invalid information whose invalidity was known
prior to its comprehension. A Spinozan, but not a Carte- Experience seems to tell us most indisputably that we are able
sian or Cartozan, system should behave in just this way. to suspend judgment so as not to assent to things that we perceive
(and) that the will, that is, the faculty of assenting, is free,
It is important to note that in each of the afore-
• . .

and different from the faculty of understanding... (but) I reply


mentioned studies, subjects were notified that they were by denying that we have free power to suspend judgment• (pp.
to receive invalid information, and this presumably mo- 97 and 99)
tivated them to exercise their cognitive option and with-
hold acceptance if they could. Gilbert et al. (1990) took The unity hypothesis, then, suggests that a mental
a more direct approach to this problem. Subjects first system must believe that which it comprehends, and that
learned about an imaginary animal called a glark, and it may not abstain. If people are Cartesian or Cartozan
then tried to decide if some new propositions about #arks systems, then they should be able to avoid both accepting
were true or false. As they did this, subjects were occa- and rejecting when an "internal audit" provides incon-
sionally asked to quickly read a statement about glarks, clusive evidence. If, on the other hand, people are Spi-
but not to assess it. Thus, rather than motivating subjects nozan systems, then they should retain their original ac-
to withhold acceptance by presenting them with invalid ceptance of a proposition when the results of a subsequent
information, subjects in this experiment were asked to assessment do not provide information with which to un-
merely read a few statements--and a premium was put accept the proposition. So what happens when people
on the speed with which they could do so. Reaction-time comprehend propositions whose veracity they cannot
data indicated that subjects responded to this premium evaluate?
and did not assess the propositions that they were in- Researchers who have investigated the ways in which
structed merely to read. Yet, when later asked about the human beings entertain "mere possibilities" have docu-
veracity of the statements they had merely read, subjects mented a robust tendency for people to seek information
tended to regard them as true (cf. Tousignant, Hall, & that confirms those possibilities (Snyder &Swann, 1978;
Loftus, 1986). These data suggest that subjects were un- see Klayman & Ha, 1987, for a review). Although this is
able to represent the statements in a truth-neutral fashion, not an optimal strategy under most circumstances, there
even when directly motivated to do so. is an exception: A confirmatory search is reasonable when
one already believes the hypothesis to be tested because,
The Suspension of Belief under such circumstances, confirmatory searches usually
The unity hypothesis is clearly the more difficult of the prove more informative than do other kinds of searches
two Spinozan postulates. The hypothesis states that ac- (Trope & Bassock, 1982). For example, it is quite rea-
ceptance is part of comprehension, and therefore when sonable to ask questions about a person's extroversion if
one represents the meaning of a proposition, that prop- one already has reason to suspect that the person is an
osition is immediately believed. But how can one dem- extrovert because (a) such questions can help one deter-
onstrate this hypothesis? There are, in general, two strat- mine just how extroverted the person is, and (b) inter-
egies. First, one can show that when people comprehend rogating an extrovert about the details of his or her shyness
information that they are motivated not to believe (either is generally a poor way to gain information. In short,
because they know the information is false or because confirmatory information is subjectively more informa-
they have been given reason not to linger), they act as tive than neutral information. It is interesting to note in
though the information was true anyway. This would this regard that when Swann and Giuliano (1987) asked
suggest that people are unable to decouple acceptance people to entertain a hypothesis and then to rate the di-
and comprehension, even when it would be propitious to agnosticity of relevant information, they found "direct
do so. Evidence of this sort was just discussed, and al- support for the notion that simply entertaining a belief
though it is not voluminous, what evidence there is tends elevates the perceived informativeness of evidence that
to support the Spinozan hypothesis. may confirm that belief" (p. 522). This suggests that in
A second strategy is to show that when people com- the process of entertaining a hypothesis, subjects may
prehend information whose truth value cannot be deter- actually embrace it--thus raising the perceived diagnos-
mined via assessment, they act as though they believe the ticity of confirmatory evidence.
information to be true. For example, upon hearing that If people seek confirmatory evidence because they
armadillos relish imported cheese, most people will find embrace the hypotheses they are testing (and not because
in memory neither evidence for nor evidence against this they are simply inept at testing them), then this tendency
proposition and thus may simply wish to reserve judgment should be annulled when people are led to entertain both
about the matter. If assessment revealed no evidentiary a hypothesis and its contrary. If, for example, a person is
basis for the acceptance or rejection of a proposition, then asked merely to comprehend the proposition John's ar-
both Cartesian and Cartozan systems should be able to madillo is an introvert before testing the proposition
hold that proposition in abeyance--to suspend both ac- John's armadillo is an extrovert, then the person should

February 1991 ° American Psychologist 115


not conduct a confirmatory search. Lord, Lepper, and construes objects, so cognition construes ideas. In both
Preston (1984) have demonstrated just such a phenom- cases, the representation of a stimulus (an object or idea)
enon. When subjects were led to think about another is believed that is, empowered to guide behavior as if it
person as an introvert before testing the possibility that were true--prior to a rational analysis of the represen-
the person was an extrovert, they showed no tendency to tation's accuracy. But perception is not merely a conve-
conduct a confirmatory search. In fact, this simple ma- nient metaphor for cognition; indeed, the two processes
nipulation was far more effective than was a straightfor- may be similar because one (namely, the propositional
ward appeal to hypothesis testers to be fair and accurate. system of representation that underlies cognition) is an
evolutionarily outgrowth of the other (namely, the imag-
Conclusions inal system of representation that underlies perception).
If this were so, then the cognitive system (which represents
The foregoing review of research on human belief attests ideas about reality) could be expected to retain vestiges
to the truth of Bain's (1859) dictum: "The great master of the perceptual system (which represents features of
fallacy of the human mind is believing too much" (p. reality), for example, the tendency initially to treat all
513). People are especially prone to accept as true the representations as if they were true. In other words, a
things they hear and seembut why is this so? The expla- newly evolved cognitive system might treat socially com-
nation examined here is that people are Spinozan systems municated propositions as if they were visually trans-
that, when faced with shortages of time, energy, or con- mitted images, believing what it comprehends (Life is a
clusive evidence, may fail to unaccept the ideas that they bowl of cherries) just as immediately and thoroughly as
involuntarily accept during comprehension. Evidence for
it believes what it sees (This is a bowl of cherries). Perhaps
the asymmetry hypothesis (which distinguishes the Spi- it is not entirely absurd to think of human understanding
nozan and Cartozan models from the Cartesian model) as a sensory system that uses the propositional assertions
is quite strong: Acceptance and rejection are not merely of others as data--a kind of"vicarious observation" that
alternative outcomes of a single assessment process, but is "the first and greatest human device for stepping up
rather, acceptance is psychologically prior. Evidence for the observational intake" (Quine & Ullian, 1978, p. 51).
the unity hypothesis (which distinguishes the Spinozan Of course, a system that believes its representations
from the Cartozan model) is somewhat harder to come prior to assessing them (e.g., the perceptual system) can
by, but at least it is consistent: It is not unreasonable to only work if those representations are largely accurate. It
suggest that the temporary acceptance of a proposition is certainly true that human societies impose a moral
is part of the nonvoluntary process of comprehension onus on lying (Bok, 1978), which results in a strong ten-
itself. dency for persons to communicate information that they
Yet, even if one endorses the Spinozan hypothesis, believe to be accurate (Clark, 1984; Grice, 1975) and for
there is no denying that this method of accepting and persons to assume that others will do the same (Swann,
then unaccepting false ideas is a somewhat awkward one, Giuliano, & Wegner, 1982). As Dennett (1981) noted:
in terms of both its procedural redundancy and its sus- "The faculty of communication would not gain ground
ceptibility to errors. Why do human beings use this un- in evolution unless it was by and large the faculty of
gainly belief procedure rather than its esthetically superior transmitting true beliefs" (p. 18). Thus, just as perceptual
alternatives? systems enable timely action by capitalizing on the fact
that most percepts are faithful, cognitive systems may
The Origin o f Belief achieve similar efficiency by capitalizing on the fact that
"My thinking," wrote William James (1890), "is first and most propositions are true. One might even argue that
last and always for the sake of my doing" (p. 333). What the savings of time and energy outweighs the intellectual
James said of cognition is even truer of perception. Or- deficits of inaccurate beliefs (Swann, 1984).
ganisms are immersed in a world of activity, and the per- In the scheme of things, however, the laws of light
ceptual system enables them to play their parts quickly reflectance should prove a great deal more reliable than
and well. One of the ways in which the system accom- the convention of truth telling, and thus a cognitive system
plishes this end is by using the outputs of early stages of (unlike a perceptual system) would have to develop some
processing to guide urgent action. Organisms immediately extra machinery for rejecting the representations it has
believe what they see and only question their percepts accepted. If one were designing a cognitive system from
subsequently and occasionally (see Bargh, 1989). Percep- scratch, then a perfectly rational Cartesian assessor might
tion can afford to work this way because the correlation well be the optimal sort of machinery to build. But nature
between a perceptual representation (i.e., one's mental does not start from scratch; rather, she is an inveterate
image of an object) and the presence of that object is jury rigger who rarely invents a new mechanism to do
nearly perfect. Organisms need not question percepts, splendidly what an old mechanism can be modified to
because percepts are for the most part faithful represen- do tolerably well. The Spinozan belief procedure may be
tations of reality. just such a jury-rigged mechanismma cognitive proce-
Perception, then, is quintessentially Spinozan, and dure that retains some features of the perceptual proce-
it would probably be fair to say that this article has been dures from which it emerged (acceptance upon compre-
a meditation on one simple suggestion: As perception hension) and adds some new features of its own (subse-

116 February 1991 • American Psychologist


quent unacceptance). Is the cognitive system Spinozan REFERENCES
because it arose f r o m the perceptual system? N o one can Anderson, C. A. (1982). Inoculation and counter-explanation: Debiasing
say. But the commonalities are certainly suggestive. It may techniques in the perseverance of social theories. Social Cognition, 1,
126-139.
not be merely coincidental that the language o f visual Anderson, C. A., Lepper, M. R., & Ross, L. (1980). Perseverance of
perception is so easily used to describe the comprehension social theories:The role of explanation in the persistence of discredited
o f ideas, if y o u see the point (Lakoff & Johnson, 1980, information. Journal of Personality and Social Psychology,, 39, 1037-
p. 48). 1049.
Baddeley, A. D., & Hitch, G. (1974). Working memory. In G. H. Bower
(Ed.), The psychology of learning and motivation:Advances in research
Summary and Reflection and theory (Vol. 7, pp. 47-89). San Diego, CA: Academic Press.
Bain, A. (1859). The emotions and the will. London: Longmans, Green.
R e n t Descartes did not think that G o d should be re- Bargh, J. A. (1989). Conditional automaticity: Varieties of automatic
sponsible for h u m a n folly, and so he reasoned that people influence in social perception and cognition. In J. S. Uleman & J. A.
must exercise free will when they choose to accept an Bargh (Eds.), Unintended thought (pp. 3-51). New York:Guilford.
Baron, R. S., Baron, P., & Miller, N. (1973). The relation between dis-
erroneous idea. Baruch Spinoza, a Jewish scholar who traction and persuasion. PsychologicalBulletin, 80, 310-323.
was excommunicated for his trouble, was not so charitable Bem, D. J. (1966). Inducing belief in false confessions. Journal of Per-
toward the designer o f the h u m a n mind. Spinoza argued sonality and Social Psychology, 3, 707-710.
that comprehending an idea did entail accepting that idea, Bennett, J. (1984). A study of Spinoza's Ethics. Indianapolis, IN: Hackett.
Bjork, R. A. (1972). Theoretical implications of directed forgetting. In
however briefly. "Will and intellect are one and the same A. W. Melton & E. Martin (Eds.), Codingprocesses in human memory
thing," he wrote, and thus, "I deny that a m a n makes no (pp. 217-235). New York: Wiley.
affirmation in so far as he has a perception" (1677/1982, Bloom, L. (1970). Languagedevelopment: Formandfunction in emerging
pp. 97 and 99). Although Descartes's assumptions about grammars. Cambridge, MA: MIT Press.
the s y m m e t r y o f acceptance and rejection and the disunity Bogdan, R. J. (1986). The importance of belief. In R. J. Bogdan (Ed.),
Belief Form, content, andfunction (pp. 1-16). Oxford, England: Clar-
o f c o m p r e h e n s i o n and belief have silently dominated sci- endon Press.
entific thinking about these issues, psychological evidence Bok, S. (1978). Lying. New York: Random House.
suggests that Spinoza's hypotheses m a y have been closer Bransford, J. D., & Johnson, M. K. (1973). Consideration of some prob-
to the truth. Findings from a multitude o f research lit- lems in comprehension. In W. G. Chase (Ed.), Visual information
processing (pp. 383-438). Sarr Diego, CA: Academic Press.
eratures converge on a single point: People are credulous Carpenter, P. A., & Just, M. A. (1975). Sentence comprehension: A
creatures who find it very easy to believe and very difficult psycholinguisticprocessingmodel of verification. PsychologicalRevie~,
to doubt. In fact, believing is so easy, and perhaps so 82. 45-73.
inevitable, that it m a y be m o r e like involuntary compre- Ceci, S. J., Ross, D. E, & Toglia, M. P. (1987). Suggestibilityof children's
hension than it is like rational assessment. As Reid (1764/ memory: Psycholegal implications. Journal of Experimental Psy-
chology: General 116, 38-49.
1895) wrote: Chaiken, S. (1987). The heuristic model of persuasion. In M. P. Zanna,
J. M. Olson, & C. P. Herman (Eds.), Social influence: The Ontario
symposium (Vol. 5, pp. 3-39). Hillsdale, NJ: Erlbaum.
W h e n I perceive a tree before me, m y faculty o f seeing Clark, H. H. (1984). Language use and language users. In G. Lindzey
gives m e not only a notion or simple apprehension o f & E. Aronson (Eds.), Handbook of social psychology (3rd ed., Vol. 2,
the tree, but a belief o f its existence, and o f its figure, pp. 179-231). Reading, MA: Addison-Wesley.
distance, and magnitude; and this j u d g m e n t or belief Clark, H. H., & Chase, W. G. (1972). On the process of comparing
sentences against pictures. Cognitive Psychology, 3, 472-517.
is not got by c o m p a r i n g ideas, it is included in the Clark, H. H., & Clark, E. V. (1977). Psychology and language. New
very nature o f the perception. (p. 209) York: Harcourt, Brace, Jovanovich.
Dennett, D. C. (1981). Brainstorms: Philosophical essays on mind and
psychology. Cambridge, MA: MIT Press.
Such m a n d a t o r y and immediate affirmation may Descartes, R. (1984). Fourth meditation. In J. Cottingham, R. Stoothoff,
make evolutionary sense when the mental representation & D. Murdoch (Eds. and Trans.), The philosophical writings of Des-
concerns only the physical presence and properties o f a cartes (Vol. 2, pp. 37-43). Cambridge, England:Cambridge University
Press. (Original work published 1641)
stone, an animal, or a tree. The h u m a n eye is an excep- Descartes, R. (1984). Principles of philosophy. In J. Cottingham, R.
tionally reliable i n s t r u m e n t and it would be expensive, Stoothoff, & D. Murdoch (Eds. and Trans.), The philosophical writings
even foolhardy, to regularly question what it tells us. of Descartes (Vol. 1, pp. 193-291). Cambridge, England: Cambridge
Nonetheless, the tendency to accept our mental repre- University Press. (Original work published 1644)
Dodd, D. H., & Bradshaw,J. M. (1980). Leading questionsand memory:
sentations o f things before we assess t h e m may spill over Pragmatic considerations. Journal of VerbalLearning and VerbalBe-
into the process by which we c o m p r e h e n d ideas as well. havior, 21, 207-219.
Just as we are compelled to believe immediately that Donne, J. (1930). Satyre III. In J. Hayward (Ed.), John Donne: Complete
which we see, so too m a y we be compelled to believe that poetry and selected prose (pp. 127-130). New York: Random House.
which we hear and say. In either case, our belief may last (Original work published 1635)
Dowty, D. R., Wall, R. E., & Peters, S. (1981). Introduction to Montague
for only a m o m e n t before it is unraveled by reason: Is semantics. Boston: Reidel.
that really water in the road ahead, or is it just a mirage? Festinger, L., & Maccoby, N. (1964). On resistance to persuasive com-
Does she really love me, or did she merely say so? If we munications. Journal of Abnormal and Social Psychology, 68, 359-
c o m p r e h e n d words o f love as we see the gloss o f dark 366.
Flavell, J. H. (1985). The development of children's knowledge about
water, then we m a y thinkingly reject the reality o f either. the appearance-reality distinction. American Psychologist, 41, 418-
But only after we have first accepted them as so. 425.

February 1991 • A m e r i c a n Psychologist 117


Fleming, J., & Arrowood, A. J. (1979). Information processing and the the ages of six and sixteen. Journal of Genetic Psychology, 43, 422-
perseverance of discredited self-perceptions. Personality and Social 437.
Psychology Bulletin, 5, 201-205. McDougall, W. (1923). Outline of psychology. New York: Scribner.
Fodor, J. A. (1983). The modularity of mind. Cambridge, MA: MIT Minsky, M. (1985). The society of mind. New York: Simon & Schuster.
Press. Newell, A., & Simon, H. (1972). Human problem solving. Engiewood
Garfield, J. L. (1987). (Ed.). Modularity in knowledge-representation Cliffs, NJ: Prentice-Hall.
and natural-language understanding. Cambridge, MA: MIT Press. Norman, D. A., & Bobrow, D. G. (1975). On data-limited and resource-
Gazzaniga, M. S. (1985). The social brain. New York: Basic Books. limited processes. Cognitive Psychology, 7, 44-64.
Geach, P. T. (1980). Logic matters. Berkeley: University of California Nuchelmans, G. (1983). Judgment and proposition: From Descartes to
Press. Kant. Amsterdam: North-Holland.
Gilbert, D. T. (1989). Thinking lightly about others: Automatic com- Pea, R. D. (1980). The development of negation in early child language.
ponents of the social inference process. In J. Uleman & J. A. Bargh In D. R. Olson (Ed.), The socialfoundations of language and thought
(Eds.), Unintended thought (pp. 189-211). New York: Guilford. (pp. 156-186). New York: Norton.
Gilbert, D. T., & Jones, E. E. (1986). Perceiver-induced constraint: In- Petty, R. E., & Cacioppo, J. T. (1986). The elaboration likelihood model
terpretations of self-generated reality. Journal of Personality and Social of persuasion. In L. Berkowitz (Ed.), Advances in experimental social
Psychology, 50, 269-280. psychology (Vol. 19, pp. 123-205). San Diego, CA: Academic Press.
Gilbert, D. T., Krull, D. S., & Malone, P. S. (1990). Unbelieving the Petty, R. E., Wells, G. L., & Brock, T. C. (1976). Distraction can enhance
unbelievable: Some problems in the rejection of false information. or reduce yielding to propaganda: Thought disruption versus effort
Journal of Personality and Social Psychology, 59, 601-613. justification. Journal of Personality and Social Psychology,, 34, 874-
Gilbert, D. T., Krull, D. S., & Pelham, B. W. (1988). Of thoughts un- 884.
spoken: Social inference and the self-regulation of behavior. Journal Piaget, J. (1962). Play, dreams, and imitation in childhood (C. Gattegno
of Personality and Social Psychology, 55, 685-694. & E M. Hodgson, Trans.). New York: Norton.
Gilbert, D. T., & Osborne, R. E. (1989). Thinking backward: Some Price, H. H. (1969). Belief. London: Allen & Unwin.
curable and incurable consequences of cognitive busyness. Journal of Quine, W. V., & UUian, J. S. (1978). The web of belief (2nd ed.). New
Personality and Social Psychology, 57, 940-949. York: Random House.
Gilbert, D. T., Pelham, B. W., & Krull, D. S. (1988). On cognitive bu- Reid, T. (1895). Inquiry into the human mind. In W. Hamilton, (Ed.),
syness: When person perceivers meet persons perceived. Journal of The philosophical works of Thomas Reid (Vol. 1, 8th ed., pp. 95-
Personality and Social Psychology, 54, 733-740. 214). London: Longmans, Green. (Original work published 1764)
Gough, P. B. (1965). Grammatical transformations and speed of un- Rips, L. J., & Marcus, S. L. (1977). Suppositions and the analysis of
derstanding. Journal of VerbalLearning and VerbalBehavior, 4, 107- conditional sentences. In M. A. Just & P. A. Carpenter (Eds.), Cognitive
111. processes in comprehension (pp. 185-220). Hillsdale, NJ: Erlbaum.
Greenberg, J. H. (1966). Language universals. The Hague, The Neth- Ross, L. (1977). The intuitive psychologist and his shortcomings. In L.
erlands: Mouton. Berkowitz (Ed.), Advances in experimental social psychology (Vol. 10,
• Grice, H. P. (1975). Logic and conversation. In P. Cole & J. L. Morgan pp. 173-220). San Diego, CA: Academic Press.
(Eds.), Syntax and semantics: Vol 3. Speech acts (pp. 41-58). New Ross, L., Lopper, M. R., & Hubbard, M. (1975). Perseverance in self-
York: Seminar Press. perception and social perception: Biased attribution processes in the
Horn, L. R. (1989). A natural history of negation. Chicago: University debriefing paradigm. Journal of Personality and Social Psychology,
of Chicago Press. 32, 880-892.
James, W. (1890). The principles of psychology (Vol. 2). New York: Holt. Rumelhart, D. E., Smolensky, P., McClelland, J. L., & Hinton, G. E.
Johnson-Laird, P. N. (1988). How is meaning mentally represented? In (1986). Schemata and sequential thought processes in PDP models.
U. Eco, M. Santambrogio, & P. Viloli (Eds.), Meaning and mental In D. E. Rumelhart & J. L. McClelland (Eds.), Parallel distributed
representations (pp. 99-118). Bloomington: Indiana University Press. processing: Explorations in the microstructure of cognition (Vol. 2,
Jones, E. E. (1979). The rocky road from acts to dispositions. American pp. 7-57). Cambridge, MA: MIT Press.
Psychologist, 34, 107-117. Russell, B. (1919). Introduction to mathematical philosophy. London:
Just, M. A., & Carpenter, P. A. (Eds.). (1977). Cognitive processes in Allen & Unwin.
comprehension. Hillsdale, N J: Erlbaum. Russell, B. (1921). The analysis of mind. New York: McMiUan.
Kahneman, D. (1973). Attention and effort. Englewood Cliffs, N J: Pren- Russell, B. (1948). Human knowledge, its scope and limits. New York:
tice-Hall. Simon & Schuster.
Kiesler, C. A., & Kiesler, S. B. (1964). Role of forewarning in persuasive Schul, Y., & Burnstein, E. (1985). When discounting fails: Conditions
communications. Journal of Abnormal and Social Psychology, 8, 547- under which individuals use discredited information in making a
549. judgment. Journal of Personality and Social Psychology, 49, 894-903.
Klayman, J., & Ha, Y. (1987). Confirmation, disconfirmation, and in- Snyder, M., &Swann, W. B., Jr. (1978). Hypothesis testing processes in
formation in hypothesis-testing. PsychologicalReview, 94, 211-228. social interaction. Journal of Personality and Social Psychology, 36,
Lakoff, G. (1987). Women, fire and dangerous things: What categories 1202-1212.
reveal about the mind. Chicago: University of Chicago Press. Spinoza, B. (1982). The Ethics and selected letters (S. Feldman, Ed. and
S. Shirley, Trans.). Indianapolis, IN: Hackett. (Original work published
Lakoff, G., & Johnson, M. (1980). Metaphors we live by, Chicago: Uni-
1677)
versity of Chicago Press. Stout, G. E (1909a). Analytic psychology (3rd ed., Vol. 1). New York:
Lehrer, K. (1983). Belief, acceptance, and cognition. In H. Parret (Ed.), Macmillan.
On believing:Epistemological and semiotic approaches (pp. 172-183). Stout, G. E (1909b). Analytic psychology (3rd ed., Vol. 2). New York:
Berlin, FRG: Walter de Gruyter. Macmillan.
Lifton, R. J. (1961). Thought reform and the psychology of totalism. Swann, W. B., Jr. (1984). Quest for accuracy in person perception: A
New York: Norton. matter of pragmatics. Psychological Review, 91, 457-477.
Loftus, E. E, & Davies, G. M. (1984). Distortions in the memory of Swann, W. B., Jr., & Giuliano, T. (1987). Confirmatory search strategies
children. Journal of Social Issues, 40, 51-67. in social interaction: How, when, why, and with what consequences.
Lord, C. G., Lopper, M. R., & Preston, E. (1984). Considering the op- Journal of Social and Clinical Psychology, 5, 511-524.
posite: A corrective strategy for social judgment. Journal of Personality Swann, W. B., Jr., Giuliano, T., & Wegner, D. M. (1982). Where leading
and Social Psychology, 47, 1231-1243. questions can lead: The power of conjecture in social interaction.
Lundholm, H. (1936). The psychology of belief. Durham, NC: Duke Journal of Personality and Social Psychology, 42, 1025-1035.
University Press. Tarski, A. (1969). Truth and proof. Scientific American, 220, 63-77.
Marr, D. (1982). Vision. San Francisco: Freeman. Tesniere, L. (1959). Elements de syntaxe structurale [Elements of struc-
Messerschmidt, R. (1933). The suggestibility of boys and girls between tural syntax]. Paris: Klincksieck.

1 18 F e b r u a r y 1991 • A m e r i c a n P s y c h o l o g i s t
Tousignant, J. P., Hall, D., & Lofius, E. E (1986). Discrepancy detection Wegner, D. M., Coulton, G., & Wenzlaff, R. (1985). The transparency
and vulnerability to misleading post-event information. Memory & of denial: Briefing in the debriefing paradigm. Journal of Personality
Cognition, 14, 329-338. and Social Psychology, 49, 338-346.
Trabasso, T., Rollins, H., & Shaughnessey, E. (1971). Storage and ver- Wegner, D. M., Wenzlaff, R., Kerker, R. M., & Beattie, A. E. (1981).
ification stages in processing concepts. Cognitive psychology, 2, 239- Incriminationthrough innuendo: Can media questions become pubfic
289. answers? Journal of Personality and Social Psychology, 40, 822-832.
Trope, Y., & Bassock, M. (1982). Confirmatory and diagnosing strategies
in social information gathering. Journal of Personality and Social ~A~yer,R. S., & Budesheim, T. L. (1987). Person memory and judgments:
Psychology, 43, 22-34. The impact of information that one is told to disregard. Journal of
Tversky, A., & Kahneman, D. (1974). Judgments under uncertainty: Personality and Social Psychology, 53, 14-29.
Heuristics and biases. Science, 185, 1124-1131. Wyer, R. S., & Unverzagt, W. H. (1985). The effects of instructions to
Valins, S. (1972). Persistent effects of informationabout internal reactions: disregard information on its subsequent recall and use in making
Ineffectiveness of debriefing. In H. London & R. E. Nisbett (Eds.), judgments. Journal of Personality and Social Psychology, 48, 533-
Thought and feeling: The cognitive alteration of feeling states (pp. 549.
116-124). Chicago: Aldine. Zuckerman, M., Depaulo, B. M., & Rosenthal, R. (1981). Verbal and
Walster, E., Berscheid, E., Abrahams, D., & Aronson, E. (1967). Effec- nonverbal communication of deception. In L. Berkowitz (Ed.), Ad-
tiveness of debriefing following deception experiments. Journal of vances in experimental social psychology (Vol. 14, pp. 1-59). San
Personality and Social Psychology, 6, 371-380. Diego, CA: Academic Press.

F e b r u a r y 1991 • A m e r i c a n Psychologist 119

You might also like