Professional Documents
Culture Documents
ANNUAL
REVIEWS Further Learning: From Association
Click here for quick links to
Annual Reviews content online,
including:
to Cognition
• Other articles in this volume
• Top cited articles David R. Shanks
• Top downloaded articles
• Our comprehensive search
Annu. Rev. Psychol. 2010.61:273-301. Downloaded from www.annualreviews.org
273
ANRV398-PS61-11 ARI 5 November 2009 13:5
274 Shanks
ANRV398-PS61-11 ARI 5 November 2009 13:5
(hypotheses or cognitive maps) are formed be- contributions from the areas of associative and
tween stimuli or events as a result of contiguity contingency learning, and implicit learning
and organizational principles (see the review and memory. A guiding question is whether our
Conditioning: in
of learning by Melton 1950, in the very first explanatory scope for explaining the richness classical or Pavlovian
Annual Review of Psychology). Debate between of learning would be seriously curtailed if con- conditioning, a
S-R and field theories, and the importance of cepts such as excitation and reinforcement were conditioned stimulus
phenomena such as latent learning, dominated abandoned. Plainly, it is not sufficient to reject (CS; e.g., a tone)
predicts an
much of experimental psychology up until the traditional S-R theory. Instead, cognitive the-
unconditioned
cognitive revolution (see Holland 2008). ories that dispense with associative constructs stimulus (US; e.g.,
By the time Brewer (1974) came to review must be contrasted with those modern theories food or shock). As a
the literature, it was abundantly plain that the that incorporate cognitive constructs such as result of learning, the
traditional S-R theory of conditioning, includ- attention and awareness while also assigning response normally
evoked by the US
ing core notions such as the automatic and a fundamental role to association formation.
(e.g., salivation or
unconscious stamping in (i.e., reinforcement) of Extraordinarily rich explanations of learning
Annu. Rev. Psychol. 2010.61:273-301. Downloaded from www.annualreviews.org
freezing) or a similar
by University of South Carolina - Columbia on 07/31/13. For personal use only.
associative links, was not appropriate for either phenomena have been achieved by models built response comes to be
classical or operant (instrumental) condition- out of automatic link machinery (i.e., connec- evoked by the CS
ing, nor did it provide an adequate framework tionist, neural network, or parallel distributed CS: conditioned
for such important applied problems as processing accounts) in which representations stimulus
understanding the development of phobias are coded subsymbolically (McClelland & US: unconditioned
(Rachman 1977). Evidence that conditioning Rumelhart 1986, Rumelhart & McClelland stimulus
of autonomic, motor, as well as more complex 1986, Thomas & McClelland 2008). Such
responses only occurs in parallel with expectan- models demonstrate massive “emergentism,”
cies and awareness convinced Brewer that all in that processes that seem cognitive and high
conditioning is the result of cognitive process- level emerge from the operations and inter-
ing, in particular of the formation and testing actions of very elementary processing units.
of conscious hypotheses. Although tension has These processes yield knowledge structures
existed between associative and cognitive views and states of activation which, when sufficiently
of learning for a century, the topic has received strong and stable, constitute the contents of
renewed attention in the past few years. The consciousness (see Maia & Cleeremans 2005).
considerable evidence that awareness necessar- It is against this contemporary associationist
ily accompanies learning has been challenged framework that the present review compares
recently as the study of implicit learning has the alternative propositional-cognitive theory.
gained momentum. The present article reviews
some of the current evidence from this area
and asks whether Brewer’s position remains ROLE OF COGNITION
the most viable interpretation: Is learning IN LEARNING
intrinsically a conscious process? On the other Should we think of learning as the automatic
hand, much recent research has retained the formation of a mental link or bond between a
strongly antiassociationist perspective, which cue (or CS) and an outcome (or US), or instead
Brewer championed, regarding concepts like as the acquisition of a propositional belief
reinforcement as superfluous. Recent evidence representing the relationship between them?
bearing on this issue is also reviewed. One counterintuitive but well-documented
In exploring the relationship between empirical observation forcefully captures the
associative and cognitive processing, this paradox of learning and cognition. This is
article examines a fundamental theme that has the finding that verbal instructions seem to
remained unresolved since the early days of be largely interchangeable with experienced
experimental psychology. Recent research is re- events. The mere instruction that a tone will
viewed, mostly published since 2000, covering be followed by shock is sufficient to cause an
increase in skin conductance that is indistin- history of learning theory and has been central
guishable from that obtained when the tone in the debate between proponents of associative
is actually paired with shock (e.g., Cook & and cognitive theories. Blocking is the funda-
Blocking: the
fundamental Harris 1937, McNally 1981). In more recent mental demonstration that learning about the
demonstration of cue research, Lovibond (2003) has shown that relationship between two events depends on not
selection in learning. this interchangeability extends to more subtle just their frequency of pairing, but also on the
When a pair of cues A designs including blocking (described below). extent to which one provides information about
and B predicts an
The paradox is that if true conditioning, with the other. Consider the pairing of a cue and an
outcome, the degree of
learning about the events that are actually experienced, engages outcome, or of a conditioned stimulus (CS) with
A-outcome (Brewer notwithstanding) an automatic and an unconditioned stimulus (US). When cues A
relationship is reduced unconscious learning mechanism, then how and B are paired together and predict an out-
(blocked) if B has can verbal, cognitive, conscious instructions come, the extent to which learning accrues to
previously on its own
make contact with that mechanism? Contrary A is diminished if B has previously, in the ab-
predicted that
to commonly held belief, we seem to be faced sence of A, been paired with the outcome (see
Annu. Rev. Psychol. 2010.61:273-301. Downloaded from www.annualreviews.org
outcome
by University of South Carolina - Columbia on 07/31/13. For personal use only.
with the conclusion that conditioning in fact Table 1). Thus blocking refers to a two-stage
gives rise to conscious, cognitive, propositional design in which B is established as a reliable pre-
representations rather than to automatic, un- dictor of the outcome in stage 1 (denoted B+),
conscious ones. This is precisely the position with A and B occurring together and jointly pre-
adopted by many contemporary researchers dicting the outcome in stage 2 (denoted AB+).
(De Houwer 2009, Mitchell et al. 2009), in As a concrete example, laboratory studies with
which associative processes are jettisoned. human participants might describe a hypothet-
In the past few years, the cognitive approach ical individual suffering from allergic reactions
(now commonly referred to as propositional to some foods but not others. On day 1 the indi-
or inferential) has kindled renewed attention vidual eats tomatoes and suffers an allergic re-
and emphasis. To what extent, then, do cogni- action, and on day 2 she eats tomatoes together
tive processes penetrate learning? Should con- with pasta and again suffers a reaction. The par-
structs such as reinforcement and excitation ticipant’s task is to judge the extent to which
play any role in our explanatory frameworks? pasta is associated with the reaction, and block-
ing refers to the fact that the initial tomatoes-
allergy pairing will weaken the perceived pasta-
Blocking: Associative Accounts allergy connection.
The signature phenomenon of blocking Standard associationist accounts of block-
(Kamin 1969) has played a key role in the ing rely on concepts such as excitation,
276 Shanks
ANRV398-PS61-11 ARI 5 November 2009 13:5
reinforcement, associability, and surprise ciative theories have placed great emphasis on
(Dickinson 1980, Mackintosh 1983, Rescorla attentional, controlled processing and related
& Wagner 1972). In the classic Rescorla- concepts such as limited-capacity working
Wagner theory, for instance, an excitatory memory (Mackintosh 1975, Pearce & Hall
association is assumed to form in stage 1 1980, Wagner 1981), and the role of attention in
between B and the outcome, with the latter human as well as animal conditioning has been
playing the role of reinforcer. In stage 2, recognized for many years (Dawson & Schell
the reinforcing power of the outcome is 1982). The important question, of course, is
diminished because its occurrence is no longer whether cognitive concepts such as these, and
surprising—it is predicted by the presence of the evidence for their role, ultimately require
cue B. Thus the outcome does not serve as a abandoning the associationist perspective.
reinforcer of the A-outcome association, and
little learning accumulates to A. This theory,
whose history and influence is reviewed by Blocking: Cognitive Accounts
Annu. Rev. Psychol. 2010.61:273-301. Downloaded from www.annualreviews.org
by University of South Carolina - Columbia on 07/31/13. For personal use only.
Miller et al. (1995), has played such a central Waldmann & Holyoak (1990, 1992) were the
role in recent learning theory that it has in instigators of the cognitive challenge to the as-
effect acted as the departure point for almost sociationist account of blocking. Their key ob-
all subsequent theories. Its influence arose in servation was that associations have no seman-
considerable part from its ability to explain the tic properties, whereas human learning seems
blocking effect Kamin discovered. to be highly sensitive to such properties. For
Although subject to numerous theoretical instance, on the associationist theory, it should
subtleties (Mackintosh 1975, Pearce & Hall not matter whether cues and outcomes are de-
1980), this explanatory framework is supported scribed as causes and effects, respectively, or
by a wealth of evidence (Mackintosh 1983), in- as effects and causes. Imagine an experimen-
cluding such diverse findings as that learning is tal task in which the participant is shown in-
retarded for a blocked cue that is subsequently formation about substances in the blood of a
paired with an entirely new outcome (Le hypothetical patient together with information
Pelley et al. 2007), that blocking occurs in or- about whether the patient is suffering from a
ganisms not generally assumed to be endowed target disease. From an associative perspective,
with cognitive capacities (including the marine the task involves learning connections between
mollusc Hermissenda; Rogers & Matzel 1996), the substance (cue or CS) and the disease (out-
and that the dopamine system in the brain ap- come or US). However, the substance could be
pears to provide a reinforcing mechanism with described as a cause of or as an effect of the dis-
just the required formal properties (Fletcher ease, and Waldmann & Holyoak (1990, 1992)
et al. 2001, Waelti et al. 2001). Although the showed that from a rational perspective these
modern associationist perspective differs in nu- interpretations can have radically different im-
merous ways from the classic S-R theories of plications. Indeed, they argued that blocking
Tolman, Guthrie, Hull, and others, in its fun- would only be expected in a cause-effect sce-
damental form it incorporates many of the con- nario and not in an effect-cause scenario, and
cepts Brewer was so determined to reject (for a they presented experimental evidence consis-
review of the intellectual transition from early tent with this prediction.
to contemporary learning theories, see Mowrer Later research has confirmed that the inter-
& Klein 2001). pretation of events, over and above their simple
It is also important to note that associa- pairing, can substantially modulate blocking,
tive models of learning have often inaccurately but this research has also shown that learning
been described as assuming automatic trans- is sometimes quite immune to the way events
fer of activation from the CS representation to are described (e.g., Cobos et al. 2002, López
the US representation. In reality, modern asso- et al. 2005, Waldmann 2000). For example,
López et al. (2005) presented participants with AB+ in stage 2). It has been known for many
a simulated device in which switches and lights years (Dickinson et al. 1984) that associative or
on one side of a box were connected to lights causal judgments for A will be low in compar-
on the other side of the box. Participants ei- ison to a control condition in which the initial
ther saw trials in which the cue played the role B+ trials are omitted (see Table 1). But studies
of a cause and the outcome the role of an ef- have also shown that judgments of the proba-
fect, or vice versa. The main finding was that bility of the outcome given cue A will manifest
this causal interpretation had no effect except a blocking-like effect (De Houwer et al. 2007,
in conditions where López et al. (2005) went to Lagnado & Shanks 2002, López et al. 1998,
extreme lengths to emphasize the causal nature Price & Yates 1993). This is a striking result
of the task to participants. Thus there do seem because the probability of the outcome given
to be conditions in which the associationist the- cue A, P(O/A), is unaffected by whether or not
ory provides an appropriate account of partici- B+ trials are presented in stage 1. Associative
pants’ behavior, although we are some way from theories explain this effect by proposing that
Annu. Rev. Psychol. 2010.61:273-301. Downloaded from www.annualreviews.org
by University of South Carolina - Columbia on 07/31/13. For personal use only.
a full understanding of the boundary conditions A’s associative weight, which is reduced in the
for such an account. blocking condition, is part of the evidence used
In related work, Matute and her colleagues to make a probability judgment. Even though
(Matute et al. 2002, Vadillo et al. 2005) have ex- the probabilities are objectively the same in the
tensively studied aspects of the precise format of two conditions, the cue much more strongly
questions probing associative knowledge. Sup- makes us think of the outcome in the control
pose participants observe trials in which vari- than in the blocking condition, and this men-
ous medicines are related to allergic reactions. tal activation unavoidably biases our probability
Probe questions might ask to what extent a judgment. Explaining the bias in terms of infer-
medicine causes the allergic reaction, the extent ential processes appears difficult. Similar effects
to which it predicts or indicates the reaction, emerge in terms of memory for the relation-
or the extent to which medicine and allergy ship between a blocked cue and its associated
co-occur. Contrary to the simple idea that a outcome (discussed below).
single associative connection underlies all such De Houwer et al. (2002) took a different
judgments, these studies reveal qualitative dif- approach to explore cognitive influences in
ferences between different judgment questions. blocking. They proposed that blocking arises
For example, Vadillo et al. (2005) found that from a chain of reasoning from the premise
causal and prediction judgments could be dis- “the outcome is as probable and intense after B
sociated. Yet as Vadillo et al. themselves noted, a as after AB” to the conclusion “therefore A is
slightly more subtle associative account would not a cause of the outcome.” They also noted,
have no difficulty accounting for this finding. however, that such an inference is valid only if
Such an account would assume that causal judg- the effect is not occurring at its maximal pos-
ments are assessed by simply probing the asso- sible level. The inference only follows if there
ciative strength of the target cue on its own, is room for the outcome to occur with greater
while prediction judgments are based on the probability or intensity. To test this analysis,
combined associative strength of the target cue they described the outcome in a blocking
plus the context. design as occurring with an intensity of 10
Recall that the essence of associative ap- on a scale from 0–10 (maximal condition). De
proaches is that they assume that presentation Houwer et al. (2002) speculated that if blocking
of a cue calls to mind (given sufficient atten- arises as a result of reasoning, rather than from
tional resources and so on) the outcome with associative processes, then their participants
which it was associated. Now consider a situ- should be unsure about the status of the blocked
ation in which a cue competition effect such cue A under these conditions. In stage 1 they
as blocking occurs (B+ in stage 1 followed by learned that cue B predicted the outcome, and
278 Shanks
ANRV398-PS61-11 ARI 5 November 2009 13:5
then in stage 2 they observed A and B occur- effects in conventional conditioning procedures
ring together with the same outcome. Such with rats and concluded that similar inferential
information is insufficient to distinguish reasoning processes and “remarkable cognitive
Maximality:
between A having no relationship with the abilities” (p. 100) are employed. In their stud- information (e.g.,
outcome versus it having a strong relationship ies, both subadditivity (C+, D+, CD+) and ad- 20/20) implying that
that is masked by a ceiling effect. If B is already ditivity (C+, D+, CD++, where ++ denotes an outcome is
causing the outcome with maximal intensity, a US with higher magnitude) pretraining in- occurring at its ceiling
level. Contrast with
then A cannot increase or alter that outcome, fluenced blocking, the former reducing it and
submaximality (e.g.,
even if it does have a causal relationship with the the latter enhancing it. Moreover, maximality 10/20)
outcome. De Houwer et al. (2002) contrasted pretraining also had an influence: specifically,
Additivity: trials (e.g.,
the maximal condition with a submaximal one a pretreatment in which the animals received C+, D+, CD++,
in which the same events were presented, but unsignaled large magnitude (++) as well as where ++ denotes a
the outcome was always described as occurring smaller (+) shocks led to an enhancement of high-magnitude
with intensity 10/20. Hence, in this case the blocking, consistent with the inference that the outcome) that imply
Annu. Rev. Psychol. 2010.61:273-301. Downloaded from www.annualreviews.org
by University of South Carolina - Columbia on 07/31/13. For personal use only.
was sensitive to a number of manipulations Schmajuk & Larrauri (2008) also tested a
typically found to impair generalization. For connectionist model with the events of a typical
example, a change of context from the pretreat- additivity design. In their model, associative
ment to the blocking phase reduced the impact connections are updated by a reinforcement
of the subadditivity trials. This suggests the pos- process, and the connections have no sym-
sibility that the effect emerges not because of bolic reference. Although different from
controlled inference, but rather because the Haselgrove’s (2009) model in some important
pretreatment allows the formation of some as- respects, it also reproduced the additivity
sociative structures that generalize (or fail to effect. Schmajuk & Larrauri (2008) conclude
generalize under a context switch) to the block- that it is not necessary to interpret additivity
ing phase. effects in terms of propositional reasoning.
The nature of this putative generalization Another line of research has considered the
mechanism has been explored by Haselgrove possibility that maximality and additivity effects
(2009). One common way of building gen- have their influence not via changing hypothe-
Annu. Rev. Psychol. 2010.61:273-301. Downloaded from www.annualreviews.org
by University of South Carolina - Columbia on 07/31/13. For personal use only.
eralization into associative theories is to as- ses and reasoning about cue combinations but
sume that stimuli are composed of multiple el- rather by inducing shifts between elemental and
ements and that some of these elements may configural processing. There is now a consider-
be shared between nominally distinct stimuli. able body of evidence suggesting that organisms
Consider the additivity design employed by (both human and nonhuman) can represent
Beckers et al. (2006) and Wheeler et al. (2008) stimuli in rather flexible ways (Melchers et al.
in which blocking of A after B+ and AB+ trials 2008). In particular, the same nominal stimulus
is attenuated if subadditivity is demonstrated in can be coded either as an irreducible configu-
a previous learning phase with C+, D+, and ration or as the sum of a set of elements. For
CD+ trials. Haselgrove (2009) noted that most instance, in a human Pavlovian conditioning
of the stimuli used in these experiments came study by Melchers et al. (2004a), participants
from the same modality (auditory) and sug- initially saw either a feature-neutral discrim-
gested that this might enhance generalization ination or a matched control discrimination.
between them. To model this, Haselgrove con- The control discrimination (A+, AB+, C−,
ducted a simple simulation of this experimen- CB−) afforded an elemental solution: Correct
tal design using the Rescorla-Wagner theory, responses are made on all trials if the participant
but assuming that one additional element or learns a strong positive association between cue
cue was present on every trial. Surprisingly, this A and the US, with all other cues having associa-
simple model reproduced the key finding that tive weights of zero, and assuming additivity of
the pretreatment stage reduced blocking, and cue weights. Despite being almost identical, the
the reason for this was that the common ele- feature-neutral discrimination (A−, AB+, C+,
ment accrued asymptotic associative strength in CB−) cannot be solved this way; there is no set
the pretreatment stage, such that when A was of weights for the individual elements that yield
presented in the blocking test (with the com- correct responses across all trial types. Hence
mon element assumed also to be present), a high this problem requires a more complex solution,
level of responding was predicted. Haselgrove such as the formation of configural representa-
(2009) also showed that the model predicted tions in which AB and CD are represented as
the contrasting effect of an enhancement of distinct from the sum of their constituent parts.
blocking after additivity pretraining (i.e., C+, To test the hypothesis that participants in-
D+, CD++), as observed by Beckers et al. deed solved these discriminations in qualita-
(2006), as well as after submaximality pretrain- tively different ways, Melchers et al. (2004a)
ing, and concluded that the inferential basis for next gave both groups a new discrimination
the additivity effect, at least in rats, is far from (EX+, FX−, followed by test trials with E
proven. and F) and found very different behavior as a
280 Shanks
ANRV398-PS61-11 ARI 5 November 2009 13:5
Building on this idea, Livesey & Boakes incompatible with associationism. In an elegant
(2004; see also Williams et al. 1994) reported analysis, for instance, Ghirlanda (2005) showed
that a range of manipulations thought to en- that a range of retrospective effects including
hance elemental processing increased blocking backward blocking are in fact entirely compati-
(in much the same way as additivity instruc- ble with the Rescorla-Wagner theory, provided
tions), whereas manipulations assumed to en- a suitable scheme for stimulus representation
hance configural processing decreased blocking is employed. Traditional applications of the
(as with subadditivity instructions). Strikingly, theory simply assume that each stimulus is rep-
by presenting the cues in a configural manner, resented by a single unit or node in a network.
Livesey & Boakes (2004) were able to elimi- Under such circumstances, it is true that back-
nate blocking even when an additivity pretreat- ward blocking cannot be predicted. However,
ment stage was provided. Such a result raises the Ghirlanda (2005) showed that this conclusion
strong possibility that maximality and additiv- does not hold when each cue is instead rep-
ity effects have some of their influence via shift- resented via a pattern of activity distributed
ing the balance between elemental and config- over a large number of units. Ghirlanda
ural processing. However, whether this account (2005) reported simulations in which arrays of
can explain all of the relevant results is unclear. 50 units coded each elemental stimulus, yield-
Beckers et al. (2005) found, for example, that ing backward blocking (reduction of judgments
additivity information affected blocking even for A after AB+, B+ training) as well as its con-
when it was presented after the target trials, an verse, unovershadowing (increase in judgments
outcome difficult to reconcile with the idea that for A after AB+, B− training) and backward
the locus of additivity effects resides solely in conditioned inhibition (negative judgments
their influence on the way the blocking stimuli for A after AB−, B+ training). A key element
are coded. Lastly, a subtractivity pretreatment of distributed coding schemes is that they
employed by Mitchell et al. (2005b) affected allow distinct cues to activate overlapping sets
blocking in the way predicted by a reasoning of elements, thus capturing the fundamental
account. principle of stimulus generalization. Kruschke
(2008) has reported similar theoretical de-
velopments for dealing with retrospective
Retrospective Revaluation revaluation, but in the context of models
Cognitive interpretations have also been of- driven by Bayesian considerations. Kruschke
fered for the phenomenon of backward block- assumes that knowledge is not captured by a
ing (Dickinson & Burke 1996, Shanks 1985, single strength of association, but instead by a
Van Hamme & Wasserman 1994) and other distribution of degrees of belief over a range of
hypotheses, with these beliefs being optimally reported that retrospective changes are related
adjusted in response to learning feedback. to the strength of the critical within-compound
Another prominent development is association. In another set of tests, Melchers
Dickinson & Burke’s (1996) proposal that the et al. (2004b, 2006; see also Vandorpe et al.
formation of a within-compound association 2007) found that the magnitude of the ret-
between cues A and B in a backward blocking rospective change was related to participants’
design plays a key role in the retrospection memory for the trial pairings and proposed that
effect. In the first stage, these cues are com- it is only if the AB pairing can be recalled that
bined and jointly predict the outcome (AB+). downward adjustments in A’s strength can be
It is assumed that participants not only learn induced. Importantly, Melchers et al. (2004b,
associations between each of the cues and the 2006) and Vandorpe et al. (2007) also found
outcome, but also between the cues themselves. that there was no corresponding correlation be-
In the second stage, B is presented in isolation tween forward blocking and participants’ mem-
and predicts the outcome (B+). Dickinson ory for the compound trials. This is as expected
Annu. Rev. Psychol. 2010.61:273-301. Downloaded from www.annualreviews.org
by University of South Carolina - Columbia on 07/31/13. For personal use only.
& Burke’s (1996) revised associative theory by standard associative theories, because for-
proposes that B activates the representation of ward blocking (B+ followed by AB+) is driven
A in the second stage via the within-compound simply by competition between A and B on the
association formed in the first stage. While AB trials. Any association between A and B is
the physically presented cue, B, undergoes a irrelevant for such competition.
normal increment in associative strength when As noted by Mitchell et al. (2005a) and
the outcome is presented, the associatively ac- Vandorpe et al. (2007), however, these retro-
tivated representation of A undergoes a change spective revaluation effects are also consistent
of the opposite polarity. Hence the B+ trials with cognitive accounts. Having observed AB+
lead to a reduction in A’s associative strength. trials, participants can infer that A has some
Learning is governed by associative processes predictive value, but when they subsequently
and by reinforcement as conceptualized in the observe B+ trials, they should now alter that
traditional theory. conclusion because they have information
Melchers et al. (2004b) proposed an alterna- indicating that A adds nothing beyond what B
tive account based more on memory retrieval signals. Such a chain of inference assigns an im-
processes than on associative activation. On portant role to memory in that the adjustment
this account, participants access trial types from of belief about A requires recollection of the AB
memory and replay them mentally [a similar no- pairing. On the other hand, forward blocking
tion is central to McClelland et al.’s (1995) con- is not expected to be similarly dependent on
nectionist theory of the relationship between memory. In this case (B+ followed by AB+),
the hippocampal and neocortical memory sys- individuals can infer during the AB trials that
tems]. Hence AB+ trials are recalled and re- A is nonpredictive so long as they remember
hearsed during stage two when B+ trials are the B+ trials, and there is no necessity for
observed. If such replayed trials function much memory of the conjunction of A and B. Hence
like experienced trials, then backward block- the asymmetry observed by Melchers et al.
ing would emerge as a simple result of the on- (2004b, 2006) and Vandorpe et al. (2007),
going adjustment of associative strengths and where backward but not forward blocking
would not be the product of true reasoning. correlates with memory for the cue compound,
The concepts of within-compound associations is compatible with a cognitive account.
(Dickinson & Burke 1996) and memory-based Indeed, Mitchell et al. (2005a) and Vandorpe
rehearsal (Melchers et al. 2004b) are obviously et al. (2007) have argued that the patterns of
closely related. behavior in the retrospective case are better ex-
These associative accounts are supported plained by inference than by associative mech-
by a range of evidence. Aitken et al. (2001) anisms. In an ingenious experiment, Mitchell
282 Shanks
ANRV398-PS61-11 ARI 5 November 2009 13:5
et al. (2005a) succeeded in reversing the & Beckers (2002a,b). The occurrence of the
normal backward blocking effect such that B+ allergy in the presence of banana (B+) led to
trials presented subsequent to AB+ ones actu- a concomitant increase in the judged relation-
ally caused an increase rather than a decrease ship between cheese (C) and the allergy, while
in ratings for cue A. They achieved this re- conversely its nonoccurrence led to a decrease.
sult by employing a method akin to the ad- Although it is true that such a result might sig-
ditivity manipulation described previously, in nal the importance of reasoning in blocking-
which they pretrained participants to believe like designs, Melchers et al. (2004b) found that
that compounds predictive of the outcome must the magnitude of the retrospective change in
be composed of elements with equivalent pre- second-order blocking was again related to par-
dictive values. Mitchell et al. (2005a) thus con- ticipants’ memory for the trial pairings and ar-
cluded that their participants solved the task via gued that the data were therefore compatible
deliberate inference, akin to that observed in with an alternative account based on associa-
other rule-learning designs (Shanks & Darby tive reinforcement combined with rehearsal of
Annu. Rev. Psychol. 2010.61:273-301. Downloaded from www.annualreviews.org
by University of South Carolina - Columbia on 07/31/13. For personal use only.
A-outcome relationship is strongly recalled. accounts. The basic extinction result (on con-
Participants are assumed to reason roughly as tingency judgments) can be explained very eas-
follows: “If A predicts the outcome, then the ef- ily by assuming that participants compute some
fect of AB would have been greater than that of measure of the statistical contingency between
B alone. B and AB predicted the same outcome, the cue and the outcome. For example, an in-
thus A is not predictive.” Intrinsic to this chain ferential account might incorporate rules based
of inference is that participants must remember on the metric P [defined as the difference be-
that AB predicted the outcome, which is to say tween the probability of the outcome given the
they must code the fact that A (in conjunction cue, P(O/C), and the probability of the out-
with B) was paired with the outcome. come in the absence of the cue, P(O/∼C)],
This hypothesis has been tested in recent which would yield a lower measure for an ex-
experiments. Mitchell et al. (2006) devised a tinguished cue compared to a control cue be-
blocking task with many different foods as the cause the extinction (A−) trials reduce P(O/C).
cues and with allergies as the outcomes, such (For discussion of the possible psychological re-
Annu. Rev. Psychol. 2010.61:273-301. Downloaded from www.annualreviews.org
by University of South Carolina - Columbia on 07/31/13. For personal use only.
that recall could be tested. In addition to re- ality of these and similar rules, see Cheng 1997;
vealing blocking on judgments, the results were Cheng & Holyoak 1995; Perales & Shanks
clear in showing that recall of the outcome as- 2007, 2008). However, such an account pro-
sociated with cue A was poor in comparison vides no reason to anticipate poor memory for
with appropriate control cues. This pattern is the initial A+ pairings. Indeed, to the extent
exactly as predicted by the associative account. that the calculation of P(O/C) requires a record
A further important aspect of Mitchell et al.’s of the history of trial outcomes, good recollec-
(2006) experiments was that these results were tion of the pairings would seem to be necessary.
obtained in a task in which subadditivity pre- Of course, inferential accounts could be supple-
training was employed. Recall that such pre- mented with additional processes to accommo-
training ought to eliminate or at least reduce date memory failure, but these processes would
blocking. In providing evidence that the out- have to include precisely the sorts of interfer-
come is no larger following a compound of ence mechanisms that associative theory has de-
predictive cues than with the cues in isolation, voted much effort to developing (Bouton 1993).
subadditivity pretraining leaves the predictive Whereas the Mitchell et al. (2006) study de-
status of B ambiguous. The fact that forward scribed above assessed memory for the extent to
blocking (on both predictive judgments and re- which a blocked cue can prompt recall of its as-
call measures) was observed thus seems to offer sociated outcome, other research has asked the
strong support for the associative analysis and is related question of whether a weakened mem-
difficult to reconcile with inferential accounts, ory representation is formed for the blocked
although other data involving more complex cue itself. It was noted above that some (but not
designs have favored the latter (Mitchell et al. all) associative analyses assume that blocking
2005c, 2007). arises from a failure adequately to process the
Scully & Mitchell (2008) conducted a sim- blocked cue (Mackintosh 1975, Pearce & Hall
pler test of cue memory in the context of ex- 1980). Griffiths & Mitchell (2008) devised an
tinction rather than blocking. After pairing a ingenious modification of a blocking task again
cue with an outcome (A+), the cue was then using foods as the cues and allergies as the out-
extinguished (A−). In a subsequent test, ratings come, but added the feature that categories of
of the A-outcome relationship were reduced as foods (e.g., fruits) played the role of cues A and
a result of the extinction phase. More impor- B in a blocking design. These categories were
tantly, cued recall of the outcome paired with composed of instances (e.g., apples, bananas)
A in the first stage was significantly impaired in such that each actual instance only appeared
comparison to a nonextinguished control cue. once in the training stage. At test, new and
Such a result is again problematic for inferential old instances from the critical categories were
284 Shanks
ANRV398-PS61-11 ARI 5 November 2009 13:5
presented, and participants rated the likelihood a middle way between the extreme cognitivism
of each instance causing the food allergy, as well of inferential accounts and the equally extreme
as making a conventional old/new recognition reductionism of S-R theory.
memory judgment. Blocking of predictive
ratings was, as usual, observed. Griffiths &
Mitchell’s (2008) most striking finding, how- AWARENESS AND LEARNING
ever, was that recognition of the instances of the Brewer’s (1974) view of conditioning was that
blocked category was significantly poorer than in humans it is invariably accompanied by con-
that of appropriate control cues, consistent tingency awareness. There has been a wealth
with associative theories that attribute blocking of research on this topic since the 1970s, so it
to a reduction in attention to and processing is natural to ask whether a contemporary per-
of the blocked cue. In sum, then, these studies spective would lead us to revise this conclusion.
examining memory in the context of blocking The outcome of one recent review (Lovibond
designs provide quite strong support for the in- & Shanks 2002) tended to confirm Brewer’s
Annu. Rev. Psychol. 2010.61:273-301. Downloaded from www.annualreviews.org
by University of South Carolina - Columbia on 07/31/13. For personal use only.
to gauge, however, because a subsequent at- sponding only occurred to perceived CSs. In
tempt to replicate the key findings yielded no the delay condition that replicated the earlier
evidence whatsoever of unaware conditioning. Knight et al. (2003) study, statistical analysis
Lovibond and colleagues (P.F. Lovibond, J.J.C. found that differential CRs to unperceived CSs
Loo, G. Weidemann, and C.J. Mitchell, yielded a t value of 1.86, significant at 0.05 (one-
manuscript submitted) reported two experi- tailed, df = 12). A comparable analysis found
ments that used the same methods and pro- that differential expectancy ratings yielded a t
cedure and in addition introduced some fur- value of 1.68 which is nonsignificant at 0.05. In
ther variables (e.g., contrasting short versus a neuroimaging study employing the same pro-
long awareness questionnaires). Even for par- cedure, Knight et al. (2009) obtained similar re-
ticipants treated identically to those of Smith sults, with CR differentiation yielding a reliable
et al. (2005), awareness was a necessary con- t value of 2.46 compared to expectancy ratings
dition for the observation of differential con- reported to be nonsignificant at t = 2.05 (df =
ditioning. Plainly, whatever the basis of these 14 in both cases, though this latter effect is sig-
discrepant findings, it would be premature to nificant one-tailed). Hence, the conclusion of
abandon the conclusion from earlier studies unaware conditioning in these two replications
that awareness and conditioning tend to be as- rests on one effect falling on just one side of the
sociated rather than dissociated. critical t value and the other effect falling on
just the other side. Firmer replication evidence
is needed to allow the Knight et al. (2003) result
Fear Conditioning to be properly evaluated.
In studies of fear conditioning, the US is typ- Moreover, in a careful study employing sig-
ically a shock or loud noise, and the CR is nal detection methods, unperceived CSs in fear
a change in skin conductance. The literature conditioning did not elicit differential skin con-
on awareness and fear conditioning has been ductance responses (Cornwell et al. 2007), and
supplemented by a handful of recent studies. other research has found that fear conditioning
Knight et al. (2003) devised a novel delay con- in delay as well as trace procedures is dependent
ditioning procedure for studying unconscious on awareness. For instance, Weike et al. (2007)
fear conditioning. One tone CS (CS+) pre- used a conventional procedure in which faces
dicted the US (loud noise), whereas another served as CS+ and CS− and shock as the US
tone (CS−) did not, but during acquisition in trace and delay conditioning preparations.
the intensity of the CSs was varied to render Differential skin conductance conditioned re-
some of them imperceptible. Participants in- sponses only occurred in participants classi-
dicated whenever they heard a tone and also fied by a postconditioning test as contingency
286 Shanks
ANRV398-PS61-11 ARI 5 November 2009 13:5
aware. As Weike et al. (2007, p. 178) noted, More recent studies serve to confirm this
“electrodermal conditioning seems to primarily conclusion. For example, Pleyers et al. (2007)
index cognitive learning of the rules or circum- and Stahl et al. (2009) paired images (e.g., con-
stances in which a specific stimulus is signal- sumer products; the CSs) with positively or neg-
ing an aversive event, which is a declarative and atively valenced US pictures. Evaluative condi-
explicit memory.” Weike et al. (2007) did re- tioning only occurred for those CSs for which
port that a different measure of fear, potentiated participants were contingency aware. Dawson
startle responses, developed in participants un- et al. (2007) used faces as their CSs and USs
aware of the CS-US contingency in delay con- and embedded CS-US pairings in a short-term
ditioning, but this result is hard to interpret as visual memory test. Instead of measuring evalu-
it occurred only on trials administered prior to ative conditioning via explicit ratings, they mea-
the awareness questionnaire and not on ones sured skin conductance. Again, evaluative con-
presented after it. Dawson et al. (2007), in con- ditioning only occurred when participants were
trast, found a good association between startle aware of the CS-US pairings.
Annu. Rev. Psychol. 2010.61:273-301. Downloaded from www.annualreviews.org
by University of South Carolina - Columbia on 07/31/13. For personal use only.
distributed random number, for example be- her liking ratings for red drinks as a result of
tween −40 and 40. The critical point is that red-banana-polysorbate pairings. At the end of
the conditioning and awareness scores are both the experiment, awareness for the various CS-
based on the same underlying knowledge, x. US contingencies can be assessed by present-
The only difference is that noise is added to ing colorless flavors or flavorless colors without
generate the awareness score. If one now selects any US. Although Dickinson & Brown (2007)
all the participants who score at or below zero introduced a number of procedural improve-
on the awareness measure, what is their aver- ments on the original Baeyens et al. (1990)
age conditioning score? The answer is that it is procedure, they nonetheless replicated the key
about 10 (SD ≈ 15), reliably greater than zero. observation, namely evidence of flavor eval-
This in statistical terms is just a regression-to- uative conditioning in the absence of aware-
the-mean effect (the expected value of a normal ness. More specifically, liking ratings of the fla-
variable x conditional upon x + e < 0, where e vors changed as a consequence of their pairings
is a random variable with mean 0, is not con- with sugar/polysorbate. Strikingly, participants
Annu. Rev. Psychol. 2010.61:273-301. Downloaded from www.annualreviews.org
by University of South Carolina - Columbia on 07/31/13. For personal use only.
strained to be less than or equal to zero), but were able to recall the color-US pairings but
it illustrates that the practice of looking at con- not the flavor-US ones. Thus participants did
ditioning (or any other measure) in a sample show some degree of contingency awareness,
of participants selected post hoc as scoring at but it was not related to evaluative conditioning:
or below chance on an awareness measure is They knew the color contingencies and not the
a very dangerous practice. Above-chance con- flavor ones, but showed conditioning of flavors.
ditioning may be evident in such a subsample Wardle et al. (2007) introduced some further
even though conditioning and awareness derive procedural improvements such as counterbal-
solely (except for random noise) from the same ancing the order of presentation of the evalu-
underlying source. ative conditioning and contingency awareness
As mentioned above, there were a small tests and using a better format for the aware-
number of studies (e.g., Baeyens et al. 1990) ness questions. Whereas Dickinson & Brown
on evaluative conditioning with tastes that (2007) asked participants to identify which fla-
Lovibond & Shanks (2002) highlighted as pro- vor went with a particular US, in Wardle et al.’s
viding tantalizing evidence of unaware learn- procedure they tasted a flavor and rated their
ing and thus meriting further research. Two confidence that it went with sugar or polysor-
studies have indeed followed up this earlier bate. Under such circumstances, Wardle et al.
work. Dickinson & Brown (2007) replicated the (2007) found high levels of flavor-US and color-
Baeyens et al. (1990) procedure, which involves US awareness, as well as evaluative condi-
presenting participants with compound drinks tioning of the flavors (but not of the colors).
that are both flavored (e.g., vanilla) and col- Thus the key evidence of unaware condition-
ored (e.g., blue) as well as being pleasant or un- ing was no longer observed. When Wardle
pleasant. Pleasant tastes were created by adding et al. (2007) broke down their data according to
sugar; unpleasant ones had the bitter substance contingency awareness, they found that flavor
polysorbate 20 added to them. From a condi- evaluative conditioning was confined to those
tioning perspective, pleasantness can be consid- participants who demonstrated awareness.
ered the US and the flavors and colors as CSs, Notwithstanding the earlier cautions expressed
and evidence of evaluative conditioning would about such analyses, the results revealed no ev-
comprise pairing-dependent changes in likabil- idence of evaluative conditioning in unaware
ity ratings for the flavors or colors when pre- participants. Moreover, when Wardle et al.
sented in isolation. Thus a participant might (2007) reanalyzed Dickinson & Brown’s (2007)
come to increase her liking of vanilla as a re- data by separating aware from unaware partic-
sult of blue-vanilla-sugar pairings, or decrease ipants, they obtained the same pattern. Thus,
288 Shanks
ANRV398-PS61-11 ARI 5 November 2009 13:5
whatever the final picture to emerge from this showed the gambler’s fallacy pattern, RTs be-
intriguing line of research, it seems safe to came slower with runs of CS-alone trials and
conclude that it has not as yet yielded strong faster with runs of CS-US ones.
Perruchet effect:
evidence of unconscious learning. Recent follow-up studies on this intriguing while CRs increase
phenomenon have raised as many questions as across a run of CS-US
they have answered, however. Both the gam- trials, US expectancy
The Perruchet Effect bler’s fallacy aspect of the results (the changes ratings decrease, and
vice versa for a series
In the Lovibond & Shanks (2002) review, one in conscious expectancy with run length) and
of CS-alone trials
other empirical result was highlighted as pro- the behavioral part of the results are matters
RT: reaction time
viding potentially convincing evidence of un- of dispute. The circumstances for assessing ex-
aware learning. This is the Perruchet effect, pectancy are hardly ideal. In Perruchet et al.’s
which arises in conditions of partial reinforce- (2006) studies, participants moved a pointer on
ment. Perruchet (1985) used an eyeblink con- a dial to indicate their moment-by-moment ex-
ditioning preparation in which the CS was pectancy that the target would occur on the next
Annu. Rev. Psychol. 2010.61:273-301. Downloaded from www.annualreviews.org
by University of South Carolina - Columbia on 07/31/13. For personal use only.
reinforced on 50% of trials. In the trial se- trial. These expectancies, measured at a point
quence, runs of CS-alone or CS-US trials oc- just before presentation of the target, were the
curred. When a run comprised CS-alone trials, primary data. But suppose the participant only
Perruchet found that the likelihood of the con- changed his/her expectancy rating every few
ditioned response declined across trials. For seconds. With a very short cue (<1 sec) and
example, if there happened to be a sequence a stimulus-onset asynchrony of only 500 msec,
of four CS-alone trials, the likelihood of a the participant has virtually no time to register
CR would tend to decline across these four any CS-dependent change in expectancy. Sup-
trials. Conversely, in a run of CS-US trials, pose that, for whatever reason, expectancy of
the likelihood of the CR would tend to in- the target is not the same in the intertrial in-
crease across trials. Such changes are consis- terval as it is when the CS is actually present.
tent with the increments and decrements in The method would provide almost no chance of
associative strength that would be predicted detecting such changes. Perruchet et al. (2006)
by any reinforcement-based learning theory. acknowledged this issue and took some steps
Perruchet (1985) reported, however, that par- to ameliorate it, but without a much longer
ticipants’ expectation of the US showed exactly stimulus-onset asynchrony it is hard to be con-
the opposite pattern. In a run of CS-alone tri- fident in their results. In short, although the
als, expectation of the US increased the longer gambler’s fallacy is unquestionably observed in
the run, consistent with the well-known gam- many situations, it is difficult to accept uncrit-
bler’s fallacy. In a run of CS-US trials, expec- ically the claim that it occurs here and that ex-
tation of the US decreased the longer the run. pectancy ratings are largest after runs of cue-
Thus, the Perruchet effect comprises a striking alone trials.
dissociation between conditioned responding Turning to the other part of the dissociation,
and awareness, and hence evidence for unaware recall that CRs and speeded button-presses
learning. Participants seem to have thought that show a pattern whereby responses are less likely
the next trial must contain an outcome different or rapid after a run of CS-alone trials than a
from the preceding ones in order to maintain run of CS-US trials. A key question is whether
the 50% reinforcement probability. Perruchet these changes in responding are genuinely as-
et al. (2006) obtained a similar pattern in a re- sociative in nature. If they are not, then the
action time (RT) experiment. Here, the CS was result may have less to do with learning and
a warning tone and the US an imperative stim- more to do with performance aspects of the
ulus to which participants had to respond with task, such as US-recency effects. To investigate
a rapid button-press. While expectancy ratings whether the effect is truly associative, Mitchell
et al. repeated the Perruchet et al. (2006) RT dependencies in speeded RT settings, and the
study but arranged backward pairings or ran- learning of contextual cues in visual search.
dom occurrences of the warning stimulus (CS) We now turn to a brief review of some of this
and imperative stimulus (US). Under such cir- evidence.
cumstances, participants have no opportunity
to use the warning stimulus to prepare for the
US. Despite this, Mitchell et al. (2009) saw Sequence Learning
the same behavioral effect as in the standard Nissen & Bullemer (1987) devised a simple pro-
forward-pairing condition. They also observed cedure in which a visual target appeared on
the typical pattern when the CSs were omitted each trial at one of four locations in a display,
entirely. The obvious conclusion is that changes and the participant’s task was to press the ap-
in RT to the imperative stimulus have nothing propriate key for that location as fast as pos-
to do with learning predictive relationships, but sible. Targets moved from location to location
rather are a consequence of runs of motor re- according to a fixed, but nonsalient, sequence
Annu. Rev. Psychol. 2010.61:273-301. Downloaded from www.annualreviews.org
by University of South Carolina - Columbia on 07/31/13. For personal use only.
sponses. When there is a run of CS-US trials, (later studies have employed noisy or proba-
for example, then the frequency of the US (and bilistic sequences). Although participants were
hence of responses to the imperative stimulus) not instructed about the presence of the se-
is high, whereas when there is a run of CS-alone quence, they nonetheless showed evidence of
trials, the frequency of the US declines. It seems sequence learning in that their RTs were faster
that in the RT experiment it is variation in the than in a control condition with random target
frequency of responses that determines reac- locations, an effect that has been replicated in
tion times, unconnected to learning anything numerous subsequent studies. This task, with
about the relationship between the CS and its heavy emphasis on perceptual-motor speed,
US. provides an ideal method for studying implicit
Weidemann et al. (2009) reported a similar learning: If participants readily learn the target
analysis in the context of eyeblink condition- sequence as evidenced by speeded RTs, are they
ing rather than speeded button pressing. In this also aware of the sequence? Or can procedural
case, the associative basis of the effect seems learning occur even in the absence of sequence
more secure. They found that the behavioral awareness?
effect (fewer CRs after a run of CS-alone trials To avoid the likelihood that verbal responses
than a run of CS-US trials) was not the conse- to postexperimental questions underestimate
quence of US (airpuff) recency. Thus, there is awareness, researchers have developed alter-
some reason to believe that the Perruchet effect native tests to assess awareness. In one such
in eyeblink conditioning represents genuine ev- test, participants are asked to report their
idence of unaware learning, in that conditioned conscious sequence knowledge by reproducing
eyeblink responses follow a pattern that is com- or generating the training sequence or parts
pletely opposite to the pattern displayed in ex- of it. In another test, they observe sequence
pectancy ratings. However, the effect in other chunks and signal whether they are old (that
behavioral preparations such as speeded button is, from the learned sequence) or new. With
pressing seems much less secure. Plainly this such tests, Gaillard et al. (2009), Jiménez et al.
is an area where more research is needed and (2006), Norman et al. (2006, 2007), Perruchet
where firm conclusions must await the outcome & Amorim (1992), Perruchet et al. (1997),
of that research. Shanks & Johnstone (1999), Shanks et al.
What of other experimental procedures (2003, 2005, 2006), Stefaniak et al. (2008),
within the broad domain of implicit learning? and Wilkinson & Shanks (2004) have all re-
Numerous tasks have been developed and ex- ported clear associations between learning and
plored over the past few years, such as artificial awareness, and indeed Perruchet et al. (1997)
grammar learning, the learning of sequential and Shanks & Johnstone (1999) have shown
290 Shanks
ANRV398-PS61-11 ARI 5 November 2009 13:5
participants. Yet, in one experiment, the older ing trained for only about half as many trials.
group did show awareness. Fu et al. (2008) re- Until more is known about the basis of these
ported that after short amounts of sequence discrepant results, null results such as those of
training, participants lacked awareness in that Vandenberghe et al. (2006) should be treated
they generated the learned sequence even when with caution.
instructed to avoid doing so. Taking control Also relevant are data from brain imaging
as an index of awareness ( Jacoby 1991), Fu studies of implicit and explicit learning. Plainly,
et al. (2008) concluded that under these cir- data showing that different neural networks are
cumstances, sequence knowledge was not con- activated under implicit and explicit learning
sciously accessible. However, in a subsequent conditions would provide powerful support
report, Fu et al. (2009) failed to observe this ef- for the idea that learning can be dissociated
fect when they used a slightly different genera- from awareness. In fact, this does not seem to
tion test for assessing awareness, although they be the case. In a careful functional magnetic
did obtain other apparent evidence of implicit resonance neuroimaging study, Willingham
learning. et al. (2002) defined an implicit condition as
Vandenberghe et al. (2006) trained both am- one in which recognition was at chance and
nesic and control participants with a determin- an explicit condition as one above chance in
istic sequence comprising a fixed 12-location recognition. These investigators found that
sequence or with a probabilistic sequence in the same neural systems (e.g., left prefrontal
which the majority of targets appeared at pre- cortex, left inferior parietal cortex, and right
ordained locations while the minority appeared putamen) were activated in both conditions but
at unexpected locations. Vandenberghe et al. that additional regions were activated in the
(2006) concluded that although control par- explicit condition (e.g., premotor cortex). This
ticipants were able to learn both types of seems to challenge the idea of distinct implicit
sequences, amnesics could learn only the de- and explicit learning processes. Even under
terministic ones (although learning of prob- implicit conditions, Willingham et al. (2002)
abilistic sequences in amnesia is possible: see did find a difference (albeit nonsignificant)
Shanks et al. 2006). On subsequent tests (gen- between recognition ratings for old and new
eration and recognition) of sequence awareness, test sequences of a comparable magnitude to
there was evidence that participants in the con- those typically found. Thus, it seems reason-
trol group trained on a deterministic sequence able to conjecture that Willingham et al.’s
were conscious of that sequence (replicating the implicit and explicit groups merely represented
findings of Wilkinson & Shanks 2004), whereas participants with weaker and stronger sequence
controls trained on a probabilistic sequence and knowledge.
Visual Search and Contextual Cuing displays and asked to report which ones they
had seen previously. This test once again re-
Another task that has gained some popularity
vealed above-chance levels of awareness. Such
for the study of implicit learning involves the
above-chance recognition was also observed by
contextual cuing of target locations in a visual
Preston & Gabrieli (2008) and Vaidya et al.
search setting. Suppose that a target such as a
(2007, Exp. 2). In the influential study by Chun
horizontal letter T appears among a set of hor-
& Phelps (1999), contextual cuing was observed
izontal L distracters, and the participant’s task
in control but not amnesic individuals. The
is to indicate the orientation of the T. Suppose
authors argued that the task assesses implicit
also that on some trials the configuration of dis-
learning because recognition was statistically at
tracters is repeated from earlier trials, and that
chance. Yet, the mean recognition hit and false-
in these repeated displays the location of the tar-
alarm rates (0.37 versus 0.32 for the controls,
get is constant. If the participant is able to learn
0.64 versus 0.42 for the amnesics) for old and
about the repeated displays, and that the loca-
new displays suggest the alternative possibility
Annu. Rev. Psychol. 2010.61:273-301. Downloaded from www.annualreviews.org
292 Shanks
ANRV398-PS61-11 ARI 5 November 2009 13:5
scoring at or below chance on the explicit nevertheless implied by some of the key find-
measure will score above chance on the im- ings considered here.
plicit one, and likewise for configurations se- An important question is the extent to
lected post hoc on the same basis. Indeed, these which so-called dual-process theories have util-
models can even predict correlations of zero ity in helping us to understand learning. These
between implicit and explicit measures, despite theories (Broadbent et al. 1986, Evans 2008,
them arising from the same underlying repre- Kahneman 2003, Sloman 1996) propose that
sentation (Berry et al. 2006, Kinder & Shanks the mind is composed of two systems, one au-
2003). tomatic, implicit, nonrational, and unconscious
Thus the evidence is rather compelling that and the other slow, effortful, rational, explicit,
awareness is a necessary condition for learning and conscious. Thus the first system is consis-
across a wide range of experimental prepara- tent with unconscious learning and the second
tions. On this substantial issue, Brewer (1974) with inferential reasoning. The present review
seems to have been correct in his conclusion. should make it clear that the need for two sys-
Annu. Rev. Psychol. 2010.61:273-301. Downloaded from www.annualreviews.org
by University of South Carolina - Columbia on 07/31/13. For personal use only.
conclusions to be drawn about the limits of un- meaningful (e.g., linguistic: Leow & Bowles
conscious processing. 2005) materials and numerous perceptual and
The phenomenon of blocking has been cen- motor as well as cognitive tasks, without yield-
tral to the research reviewed here. It is of course ing stronger evidence.
possible that what appear to be instances of The major alternative to the inferential and
the same phenomenon in fact arise for differ- dual-process perspectives derives both from
ent reasons. For instance, blocking might be traditional associative learning theory but also
a single name for a set of related outcomes from the success of the connectionist project
that arise from overlapping or even indepen- in human cognition (McClelland & Rumelhart
dent processes. It was mentioned above that 1986, Rumelhart & McClelland 1986, Thomas
blocking can be observed in marine molluscs & McClelland 2008). It is not possible to re-
as well as in humans and numerous species in view this project in detail here, but its essential
between; plainly that does not imply that it oc- components are the critical role played by asso-
curs for the same reason. Perhaps associative ciative processes together with the appreciation
Annu. Rev. Psychol. 2010.61:273-301. Downloaded from www.annualreviews.org
by University of South Carolina - Columbia on 07/31/13. For personal use only.
principles are more important in some species that when such processes operate across dis-
or circumstances, and cognitive ones in others. tributed representations, high-level reasoning-
Although such a possibility must be borne in like behavior may emerge. The simulation by
mind, it must also be recognized that the sim- Ghirlanda (2005) described above is a striking
ilarities between blocking in different species illustration of this, in that it showed how ret-
run very deep. In both humans and rats, for rospective revaluation (the apparently inferen-
example, blocking is sensitive to manipulations tial readjustment of the weight assigned to a
of additivity information. Indeed, it has proven cue) may result from activation and incremental
quite difficult to find any associative learning learning within a simple network of neuron-like
phenomena that appear to be qualitatively dif- processing units. Although connectionist mod-
ferent across species or across contexts within els are in principle consistent with unconscious
a species (such as across implicit and explicit learning, it is often assumed that stable states of
learning conditions in humans). Thus, support- activation within the brain, subject to selective
ers of dual-process theories face the important attention, are precisely those states of which we
challenge in future work of demonstrating such are conscious (Maia & Cleeremans 2005).
qualitative differences more convincingly than Although the present review has focused on
has been achieved so far. studies explicitly designed to test and compare
It is also entirely reasonable to take the view associative and inferential accounts, other find-
that whereas unconscious learning has proven ings not reviewed here continue to defy expla-
hard to demonstrate in the sorts of preparations nation in anything other than associative terms.
reviewed here (e.g., eyeblink conditioning), it Principle among these is the nonrational aspect
does nonetheless occur in other circumstances. of many conditioned behaviors, a point made
Typical experimental procedures for studying forcefully by Dickinson (1980, 2009; see also
implicit learning tend to employ single labo- Shanks 1990). In a procedure such as fear con-
ratory sessions with meaningless stimuli (tones ditioning, for example, presentation of a CS that
and lights), so perhaps forms of more gradual predicts an aversive US such as shock evokes a
learning with meaningful stimuli are being ig- range of responses including sweating and el-
nored. It is undoubtedly important that future evated heart rate, yet there is no rational basis
work attempts to extend beyond simple labo- for these responses. Or consider the even more
ratory tasks. Yet a good deal of research has striking example of pigeon autoshaping, a ma-
been undertaken in which learning is studied jor source of evidence in the study of condi-
over quite prolonged periods during which ex- tioned behavior. If a keylight signals the pre-
pertise is established (e.g., 10,000 repetitions sentation of food, the pigeon will approach and
in table tennis: Koedijker et al. 2008) and with peck it. Although the approach behavior might
294 Shanks
ANRV398-PS61-11 ARI 5 November 2009 13:5
be the product of rational inference—if the pi- item for the research agenda is to gain a fuller
geon “believes” that approach will cause food to understanding of the limits of associative prin-
be obtained—it is hard to see any chain of infer- ciples in explaining additivity and related ef-
ences that would cause the pigeon to peck the fects on blocking. As described in this review, it
keylight. Such pecking does not affect the de- has been clearly demonstrated that the outcome
livery of food, and indeed pigeons will continue of a blocking experiment, in both humans and
to peck even when pecking causes omission of animals, can be radically altered by pretreat-
the food. The form of the response (the pigeon ments designed to demonstrate the additivity
appears to try to eat a keylight that predicts food or nonadditivity of cues. Yet the precise locus of
and drink one that predicts water) strongly sug- these effects is still unknown. It is possible that
gests Pavlov’s original mechanism of stimulus they operate by altering the beliefs that form
substitution, whereby the CS becomes associ- the basis for inferences about predictive value,
ated with and takes the place of the US. It is but it is also possible that configural process-
very hard to see any involvement of cognitive ing or generalization are the key mechanisms
Annu. Rev. Psychol. 2010.61:273-301. Downloaded from www.annualreviews.org
by University of South Carolina - Columbia on 07/31/13. For personal use only.
or inferential operations in this type of learning that are affected by such manipulations. These
and behavior. and related questions will surely feature promi-
Many gaps remain in our knowledge of the nently in future research seeking to under-
contributions of cognitive and associative pro- stand the inferential and associative aspects of
cesses to learning. Perhaps the most important learning.
SUMMARY POINTS
1. A review of the literature illustrates that although they are based on radically different
principles, cognitive and associative accounts of learning can both encompass a broad
range of empirical phenomena. Decisive tests are difficult to devise.
2. Forty years after its discovery, the phenomenon of blocking continues to lie at the heart
of theoretical debate. Explanations in terms of the automatic formation of associations
are certainly inadequate.
3. Learning is strongly influenced by pretreatments that provide information about the
additivity or nonadditivity of cue weights and by other manipulations of beliefs relevant
to inferential reasoning.
4. There is a substantial body of results, including the effects of cue competition on memory
and judgment, that provides evidence for associative processes such as activation and
reinforcement.
5. Robust and replicable instances of unconscious learning have failed to emerge in the
experimental literature, consistent with the view that awareness is a necessary condition
for all forms of learning, including conditioning.
6. Although its basis is not yet fully understood, the Perruchet effect represents perhaps the
most clear-cut current evidence for independent implicit and explicit learning systems.
DISCLOSURE STATEMENT
The author is not aware of any biases that might be perceived as affecting the objectivity of this
review.
LITERATURE CITED
Aitken MRF, Larkin MJW, Dickinson A. 2001. Re-examination of the role of within-compound associations
in the retrospective revaluation of causal judgements. Q. J. Exp. Psychol. 54B:27–51
Baeyens F, Eelen P, Van den Bergh O, Crombez G. 1990. Flavor-flavor and color-flavor conditioning in
humans. Learn. Motiv. 21:434–55
Beckers T, De Houwer J, Pineño O, Miller RR. 2005. Outcome additivity and outcome maximality influence
cue competition in human causal learning. J. Exp. Psychol.: Learn. Mem. Cogn. 31:238–49
Argues that inferential Beckers T, Miller RR, De Houwer J, Urushihara K. 2006. Reasoning rats: forward blocking in Pavlo-
causal reasoning vian animal conditioning is sensitive to constraints of causal inference. J. Exp. Psychol.: Gen.
underlies blocking in 135:92–102
animal conditioning. Bellebaum C, Daum I. 2004. Effects of age and awareness on eyeblink conditional discrimination learning.
Behav. Neurosci. 118:1157–65
Berry CJ, Henson RNA, Shanks DR. 2006. On the relationship between repetition priming and recognition
memory: insights from a computational model. J. Mem. Lang. 55:515–33
Annu. Rev. Psychol. 2010.61:273-301. Downloaded from www.annualreviews.org
Bouton ME. 1993. Context, time, and memory retrieval in the interference paradigms of Pavlovian learning.
by University of South Carolina - Columbia on 07/31/13. For personal use only.
296 Shanks
ANRV398-PS61-11 ARI 5 November 2009 13:5
Dennis NA, Howard JH, Howard DV. 2006. Implicit sequence learning without motor sequencing in young
and old adults. Exp. Brain Res. 175:153–64
Dickinson A. 1980. Contemporary Animal Learning Theory. London: Cambridge Univ. Press
Dickinson A. 2009. What are association formation models? Learn. Behav. 37:21–24
Dickinson A, Brown KJ. 2007. Flavor-evaluative conditioning is unaffected by contingency knowledge during
training with color-flavor compounds. Learn. Behav. 35:36–42
Dickinson A, Burke J. 1996. Within-compound associations mediate the retrospective revaluation of Illustrates the role of
causality judgements. Q. J. Exp. Psychol. 49B:60–80 within-compound
Dickinson A, Shanks DR, Evenden JL. 1984. Judgement of act-outcome contingency: the role of selective associations in
retrospective
attribution. Q. J. Exp. Psychol. 36A:29–50
revaluation.
Evans JSBT. 2008. Dual-processing accounts of reasoning, judgment, and social cognition. Annu. Rev. Psychol.
59:255–78
Field AP, Davey GCL. 1999. Reevaluating evaluative conditioning: a nonassociative explanation of condition-
ing effects in the visual evaluative conditioning paradigm. J. Exp. Psychol. Anim. Behav. Process. 25:211–24
Fletcher PC, Anderson JM, Shanks DR, Honey R, Carpenter TA, et al. 2001. Responses of human frontal
Annu. Rev. Psychol. 2010.61:273-301. Downloaded from www.annualreviews.org
by University of South Carolina - Columbia on 07/31/13. For personal use only.
cortex to surprising events are predicted by formal associative learning theory. Nat. Neurosci. 4:1043–48
Fu QF, Dienes Z, Fu XL. 2009. Can unconscious knowledge allow control in sequence learning? Conscious.
Cogn. In press
Fu QF, Fu XL, Dienes Z. 2008. Implicit sequence learning and conscious awareness. Conscious. Cogn. 17:185–
202
Gaillard V, Destrebecqz A, Michiels S, Cleeremans A. 2009. Effects of age and practice in sequence learning:
a graded account of ageing, learning and control. Eur. J. Cogn. Psychol. 21:255–82
Gawronski B, Hofmann W, Wilbur CJ. 2006. Are “implicit” attitudes unconscious? Conscious. Cogn. 15:485–99
Ghirlanda S. 2005. Retrospective revaluation as simple associative learning. J. Exp. Psychol.: Anim. Demonstrates that
Behav. Process. 31:107–11 retrospective
Griffiths O, Mitchell CJ. 2008. Selective attention in human associative learning and recognition memory. revaluation effects can
be simulated by a simple
J. Exp. Psychol.: Gen. 137:626–48
associative network,
Haselgrove M. 2009. Reasoning rats or associative animals? A common-element analysis of the effects of
with a suitable stimulus
additive and subadditive pretraining on blocking. J. Exp. Psychol.: Anim. Behav. Process. In press
coding scheme.
Holland PC. 2008. Cognitive versus stimulus-response theories of learning. Learn. Behav. 36:227–41
Howard JH, Howard DV, Dennis NA, Yankovich H, Vaidya CJ. 2004. Implicit spatial contextual learning in
healthy aging. Neuropsychology 18:124–34
Jacoby LL. 1991. A process dissociation framework: separating automatic from intentional uses of memory.
J. Mem. Lang. 30:513–41
Jiménez L, Vaquero JMM, Lupiáñez J. 2006. Qualitative differences between implicit and explicit sequence
learning. J. Exp. Psychol.: Learn. Mem. Cogn. 32:475–90
Kahneman D. 2003. A perspective on judgment and choice: mapping bounded rationality. Am. Psychol. 58:697–
720
Kamin LJ. 1969. Selective association and conditioning. In Fundamental Issues in Associative Learning, ed.
NJ Mackintosh, WK Honig, pp. 42–64. Halifax: Dalhousie Univ. Press
Kinder A, Shanks DR. 2003. Neuropsychological dissociations between priming and recognition: a single-
system connectionist account. Psychol. Rev. 110:728–44
Knight DC, Nguyen HT, Bandettini PA. 2003. Expression of conditional fear with and without awareness.
Proc. Natl. Acad. Sci. 100:15280–83
Knight DC, Nguyen HT, Bandettini PA. 2006. The role of awareness in delay and trace fear conditioning in
humans. Cogn. Affect. Behav. Neurosci. 6:157–62
Knight DC, Waters NS, Bandettini PA. 2009. Neural substrates of explicit and implicit fear memory.
NeuroImage 45:208–14
Knuttinen M-G, Power JM, Preston AR, Disterhoft JF. 2001. Awareness in classical differential eyeblink
conditioning in young and aging humans. Behav. Neurosci. 115:747–57
Koedijker JM, Oudejans RRD, Beek PJ. 2008. Table tennis performance following explicit and analogy learning
over 10,000 repetitions. Int. J. Sport Psychol. 39:237–56
Kruschke JK. 2008. Bayesian approaches to associative learning: from passive to active learning. Learn. Behav.
36:210–26
Lagnado DA, Shanks DR. 2002. Probability judgment in hierarchical learning: a conflict between predictive-
ness and coherence. Cognition 83:81–112
Le Pelley ME, Beesley T, Suret MB. 2007. Blocking of human causal learning involves learned changes in
stimulus processing. Q. J. Exp. Psychol. 60:1468–76
Leow RP, Bowles MA. 2005. Attention and awareness in SLA. In External and Internal Factors in Adult SLA,
ed. C Sanz, pp. 179–203. Washington, DC: Georgetown Univ. Press
Livesey EJ, Boakes RA. 2004. Outcome additivity, elemental processing and blocking in human causality
judgements. Q. J. Exp. Psychol. 57B:361–79
López FJ, Cobos PL, Caño A. 2005. Associative and causal reasoning accounts of causal induction: symmetries
and asymmetries in predictive and diagnostic inferences. Mem. Cogn. 33:1388–98
López FJ, Cobos PL, Caño A, Shanks DR. 1998. The rational analysis of human causal and probability
judgment. In Rational Models of Cognition, ed. M Oaksford, N Chater, pp. 314–52. London: Oxford Univ.
Press
Annu. Rev. Psychol. 2010.61:273-301. Downloaded from www.annualreviews.org
by University of South Carolina - Columbia on 07/31/13. For personal use only.
Lovibond PF. 2003. Causal beliefs and conditioned responses: retrospective revaluation induced by experience
and by instruction. J. Exp. Psychol.: Learn. Mem. Cogn. 29:97–106
Lovibond PF, Been S-L, Mitchell CJ, Bouton ME, Frohardt R. 2003. Forward and backward blocking of
causal judgment is enhanced by additivity of effect magnitude. Mem. Cogn. 31:133–42
Lovibond PF, Shanks DR. 2002. The role of awareness in Pavlovian conditioning: empirical evidence and
theoretical implications. J. Exp. Psychol.: Anim. Behav. Process. 28:3–26
Mackintosh NJ. 1975. A theory of attention: variations in the associability of stimuli with reinforcement.
Psychol. Rev. 82:276–98
Mackintosh NJ. 1983. Conditioning and Associative Learning. Oxford, UK: Clarendon
Maia TV, Cleeremans A. 2005. Consciousness: converging insights from connectionist modeling and neuro-
science. Trends Cogn. Sci. 9:397–404
Maia TV, McClelland JL. 2004. A reexamination of the evidence for the somatic marker hypothesis: what
participants really know in the Iowa gambling task. Proc. Natl. Acad. Sci. USA 102:16075–80
Matute H, Vegas S, De Marez PJ. 2002. Flexible use of recent information in causal and predictive judgments.
J. Exp. Psychol.: Learn. Mem. Cogn. 28:714–25
McClelland JL, McNaughton BL, O’Reilly RC. 1995. Why there are complementary learning systems in the
hippocampus and neocortex: Insights from the successes and failures of connectionist models of learning
and memory. Psychol. Rev. 102:419–57
McClelland JL, Rumelhart DE. 1986. Parallel Distributed Processing: Explorations in the Microstructure of Cogni-
tion. Vol. 2: Psychological and Biological Models. Cambridge, MA: MIT Press
McNally RJ. 1981. Phobias and preparedness: instructional reversal of electrodermal conditioning to fear-
relevant stimuli. Psychol. Rep. 48:175–80
Melchers KG, Lachnit H, Shanks DR. 2004a. Past experience influences the processing of stimulus compounds
in human Pavlovian conditioning. Learn. Motiv. 35:167–88
Melchers KG, Lachnit H, Shanks DR. 2004b. Within-compound associations in retrospective revaluation and
in direct learning: a challenge for comparator theory. Q. J. Exp. Psychol. 57B:25–53
Melchers KG, Lachnit H, Shanks DR. 2006. The comparator theory fails to account for the selective role of
within-compound associations in cue selection effects. Exp. Psychol. 53:316–20
Melchers KG, Shanks DR, Lachnit H. 2008. Stimulus coding in human associative learning: flexible repre-
sentations of parts and wholes. Behav. Process. 77:413–27
Melton AW. 1950. Learning. Annu. Rev. Psychol. 1:9–30
Miller RR, Barnet RC, Grahame NJ. 1995. Assessment of the Rescorla-Wagner model. Psychol. Bull. 117:363–
86
Mitchell CJ, De Houwer J, Lovibond PF. 2009. The propositional nature of human associative learning.
Behav. Brain Sci. 32:183–246
Mitchell CJ, Killedar A, Lovibond PF. 2005a. Inference-based retrospective revaluation in human causal
judgments requires knowledge of within-compound relationships. J. Exp. Psychol.: Anim. Behav. Process.
31:418–24
298 Shanks
ANRV398-PS61-11 ARI 5 November 2009 13:5
Mitchell CJ, Livesey E, Lovibond PF. 2007. A dissociation between causal judgement and the ease with which
a cause is categorized with its effect. Q. J. Exp. Psychol. 60:400–17
Mitchell CJ, Lovibond PF. 2002. Backward and forward blocking in human electrodermal condition- Early demonstration of
ing: blocking requires an assumption of outcome additivity. Q. J. Exp. Psychol. 55B:311–29 additivity effects in
Mitchell CJ, Lovibond PF, Condoleon M. 2005b. Evidence for deductive reasoning in blocking of causal human blocking.
judgments. Learn. Motiv. 36:77–87
Mitchell CJ, Lovibond PF, Gan CY. 2005c. A dissociation between causal judgment and outcome recall.
Psychon. Bull. Rev. 12:950–54
Mitchell CJ, Lovibond PF, Minard E, Lavis Y. 2006. Forward blocking in human learning sometimes reflects
the failure to encode a cue-outcome relationship. Q. J. Exp. Psychol. 59:830–44
Mitchell CJ, Wardle SG, Lovibond PF, Weidemann G, Chang BPI. 2009. Is Perruchet’s dissociation between
cued reaction time and outcome expectancy evidence for two separate associative learning processes?
J. Exp. Psychol.: Learn. Mem. Cogn. In press
Mowrer RR, Klein SB. 2001. The transitive nature of contemporary learning theory. In Handbook of Contem-
porary Learning Theories, ed. RR Mowrer, SB Klein, pp. 1–21. Mahwah, NJ: Erlbaum
Annu. Rev. Psychol. 2010.61:273-301. Downloaded from www.annualreviews.org
by University of South Carolina - Columbia on 07/31/13. For personal use only.
Nisbett RE, Wilson TD. 1977. Telling more than we can know: verbal reports on mental processes. Psychol.
Rev. 84:231–59
Nissen MJ, Bullemer P. 1987. Attentional requirements of learning: evidence from performance measures.
Cogn. Psychol. 19:1–32
Norman E, Price MC, Duff SC. 2006. Fringe consciousness in sequence learning: the influence of individual
differences. Conscious. Cogn. 15:723–60
Norman E, Price MC, Duff SC, Mentzoni RA. 2007. Gradations of awareness in a modified sequence learning
task. Conscious. Cogn. 16:809–37
Pearce JM, Hall G. 1980. A model for Pavlovian learning: variations in the effectiveness of conditioned but
not of unconditioned stimuli. Psychol. Rev. 87:532–52
Perales JC, Shanks DR. 2007. Models of covariation-based causal judgment: a review and synthesis. Psychon.
Bull. Rev. 14:577–96
Perales JC, Shanks DR. 2008. Driven by power? Probe question and presentation format effects on causal
judgment. J. Exp. Psychol.: Learn. Mem. Cogn. 34:1482–94
Perruchet P. 1985. A pitfall for the expectancy theory of human eyelid conditioning. Pavlov. J. Biol. Sci.
20:163–70
Perruchet P, Amorim M-A. 1992. Conscious knowledge and changes in performance in sequence learning:
evidence against dissociation. J. Exp. Psychol.: Learn. Mem. Cogn. 18:785–800
Perruchet P, Bigand E, Benoit-Gonin F. 1997. The emergence of explicit knowledge during the early phase
of learning in sequential reaction time tasks. Psychol. Res. 60:4–13
Perruchet P, Cleeremans A, Destrebecqz A. 2006. Dissociating the effects of automatic activation and Demonstration of the
explicit expectancy on reaction times in a simple associative learning task. J. Exp. Psychol.: Learn. Perruchet effect in a
Mem. Cogn. 32:955–65 human reaction time
task.
Pleyers G, Corneille O, Luminet O, Yzerbyt V. 2007. Aware and (dis)liking: Item-based analyses reveal that
valence acquisition via evaluative conditioning emerges only when there is contingency awareness. J. Exp.
Psychol.: Learn. Mem. Cogn. 33:130–44
Postman L. 1962. Rewards and punishments in human learning. In Psychology in the Making: Histories of Selected
Research Problems, ed. L Postman, pp. 331–401. New York: Knopf
Preston AR, Gabrieli JDE. 2008. Dissociation between explicit memory and configural memory in the human
medial temporal lobe. Cereb. Cortex 18:2192–207
Price PC, Yates JF. 1993. Judgmental overshadowing: further evidence of cue interaction in contingency
judgment. Mem. Cogn. 21:561–72
Rachman S. 1977. The conditioning theory of fear-acquisition: a critical examination. Behav. Res. Ther. 15:375–
87
Rescorla RA, Wagner AR. 1972. A theory of Pavlovian conditioning: variations in the effectiveness of rein-
forcement and nonreinforcement. In Classical Conditioning II: Current Theory and Research, ed. AH Black,
WF Prokasy, pp. 64–99. New York: Appleton-Century-Crofts
Rogers RF, Matzel LD. 1996. Higher-order associative processing in Hermissenda suggests multiple sites of
neuronal modulation. Learn. Mem. 2:279–98
Rumelhart DE, McClelland JL. 1986. Parallel Distributed Processing: Explorations in the Microstructure of Cogni-
tion. Vol. 1: Foundations. Cambridge, MA: MIT Press
Schmajuk N, Larrauri J. 2008. Associative models can describe both causal learning and conditioning. Behav.
Process. 77:443–45
Scully AL, Mitchell CJ. 2008. Extinction in human learning and memory. Q. J. Exp. Psychol. 61:1472–78
Shanks DR. 1985. Forward and backward blocking in human contingency judgement. Q. J. Exp. Psychol.
37B:1–21
Shanks DR. 1990. On the cognitive theory of conditioning. Biol. Psychol. 30:171–79
Shanks DR, Channon S, Wilkinson L, Curran HV. 2006. Disruption of sequential priming in organic and
pharmacological amnesia: a role for the medial temporal lobes in implicit contextual learning. Neuropsy-
chopharmacology 31:1768–76
Shanks DR, Darby RJ. 1998. Feature- and rule-based generalization in human associative learning. J. Exp.
Psychol.: Anim. Behav. Process. 24:405–15
Annu. Rev. Psychol. 2010.61:273-301. Downloaded from www.annualreviews.org
by University of South Carolina - Columbia on 07/31/13. For personal use only.
Shanks DR, Dickinson A. 1990. Contingency awareness in evaluative conditioning: a comment on Baeyens,
Eelen, and Van den Bergh. Cogn. Emot. 4:19–30
Shanks DR, Johnstone T. 1999. Evaluating the relationship between explicit and implicit knowledge in a
sequential reaction time task. J. Exp. Psychol.: Learn. Mem. Cogn. 25:1435–51
Shanks DR, Perruchet P. 2002. Dissociation between priming and recognition in the expression of sequential
knowledge. Psychon. Bull. Rev. 9:362–67
Shanks DR, Rowland LA, Ranger MS. 2005. Attentional load and implicit sequence learning. Psychol. Res.
69:369–82
Shanks DR, Wilkinson L, Channon S. 2003. Relationship between priming and recognition in deterministic
and probabilistic sequence learning. J. Exp. Psychol.: Learn. Mem. Cogn. 29:248–61
Sloman SA. 1996. The empirical case for two systems of reasoning. Psychol. Bull. 119:3–22
Smith CN, Clark RE, Manns JR, Squire LR. 2005. Acquisition of differential delay eyeblink classical condi-
tioning is independent of awareness. Behav. Neurosci. 119:78–86
Smyth AC, Shanks DR. 2008. Awareness in contextual cuing with extended and concurrent tests. Mem. Cogn.
36:403–15
Stahl C, Unkelbach C, Corneille O. 2009. On the respective contributions of awareness of unconditioned stim-
ulus valence and unconditioned stimulus identity in attitude formation through evaluative conditioning.
J. Personal. Soc. Psychol. 97:404–20
Stefaniak N, Willems S, Adam S, Meulemans T. 2008. What is the impact of the explicit knowledge of sequence
regularities on both deterministic and probabilistic serial reaction time task performance? Mem. Cogn.
36:1283–98
Thomas MSC, McClelland JL. 2008. Connectionist models of cognition. In The Cambridge Handbook of
Computational Psychology, ed. R Sun, pp. 23–58. London: Cambridge Univ. Press
Thorndike EL. 1931. Human Learning. New York: Century
Vadillo MA, Miller RR, Matute H. 2005. Causal and predictive-value judgments, but not predictions, are
based on cue-outcome contingency. Learn. Behav. 33:172–83
Vaidya CJ, Huger M, Howard DV, Howard JH. 2007. Developmental differences in implicit learning of spatial
context. Neuropsychology 21:497–506
Van Hamme LJ, Wasserman EA. 1994. Cue competition in causality judgments: the role of nonpresentation
of compound stimulus elements. Learn. Motiv. 25:127–51
Vandenberghe M, Schmidt N, Fery P, Cleeremans A. 2006. Can amnesic patients learn without awareness?
New evidence comparing deterministic and probabilistic sequence learning. Neuropsychologia 44:1629–41
Vandorpe S, de Houwer J, Beckers T. 2007. The role of memory for compounds in cue competition. Learn.
Motiv. 38:195–207
Waelti P, Dickinson A, Schultz W. 2001. Dopamine responses comply with basic assumptions of formal
learning theory. Nature 412:43–48
Wagner AR. 1981. SOP: a model of automatic memory processing in animal behavior. In Information Processing
in Animals: Memory Mechanisms, ed. NE Spear, RR Miller, pp. 5–47. Hillsdale, NJ: Erlbaum
300 Shanks
ANRV398-PS61-11 ARI 5 November 2009 13:5
Waldmann MR. 2000. Competition among causes but not effects in predictive and diagnostic learning. J. Exp.
Psychol.: Learn. Mem. Cogn. 26:53–76
Waldmann MR, Holyoak KJ. 1990. Can causal induction be reduced to associative learning? Proceedings 12th
Ann. Conf. Cogn. Sci. Soc., pp. 190–97. Hillsdale, NJ: Erlbaum
Waldmann MR, Holyoak KJ. 1992. Predictive and diagnostic learning within causal models: asymme- Contrasts learning
tries in cue competition. J. Exp. Psychol.: Gen. 121:222–36 about cause-effect
Walther E, Nagengast B. 2006. Evaluative conditioning and the awareness issue: assessing contingency aware- (predictive) and
ness with the four-picture recognition test. J. Exp. Psychol.: Anim. Behav. Process. 32:454–59 effect-cause (diagnostic)
relationships.
Wardle SG, Mitchell CJ, Lovibond PF. 2007. Flavor evaluative conditioning and contingency awareness.
Learn. Behav. 35:233–41
Weidemann G, Tangen JM, Lovibond PF, Mitchell CJ. 2009. Is Perruchet’s dissociation between eyeblink
conditioned responding and outcome expectancy evidence for two learning systems? J. Exp. Psychol.:
Anim. Behav. Process. 35:169–76
Weike AI, Schupp HT, Hamm AO. 2007. Fear acquisition requires awareness in trace but not delay condi-
tioning. Psychophysiology 44:170–80
Annu. Rev. Psychol. 2010.61:273-301. Downloaded from www.annualreviews.org
by University of South Carolina - Columbia on 07/31/13. For personal use only.
Wheeler DS, Beckers T, Miller RR. 2008. The effect of subadditive pretraining on blocking: limits on gen-
eralization. Learn. Behav. 36:341–51
Wilkinson L, Shanks DR. 2004. Intentional control and implicit sequence learning. J. Exp. Psychol.: Learn.
Mem. Cogn. 30:354–69
Williams DA, Sagness KE, McPhee JE. 1994. Configural and elemental strategies in predictive learning.
J. Exp. Psychol.: Learn. Mem. Cogn. 20:694–709
Willingham DB, Salidis J, Gabrieli JDE. 2002. Direct comparison of neural systems mediating conscious and
unconscious skill learning. J. Neurophysiol. 88:1451–60
Wilson TD. 2002. Strangers to Ourselves: Discovering the Adaptive Unconscious. Cambridge, MA: Belknap
Annual Review of
Psychology
Prefatory
Annu. Rev. Psychol. 2010.61:273-301. Downloaded from www.annualreviews.org
by University of South Carolina - Columbia on 07/31/13. For personal use only.
vi
AR398-FM ARI 7 November 2009 7:47
Comparative Psychology
Evolving the Capacity to Understand Actions, Intentions, and Goals
Marc Hauser and Justin Wood p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p 303
Human Development: Processes
Child Maltreatment and Memory
Gail S. Goodman, Jodi A. Quas, and Christin M. Ogle p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p 325
Emotional, Social, and Personality Development
Patterns of Gender Development
Carol Lynn Martin and Diane N. Ruble p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p 353
Adulthood and Aging
Social and Emotional Aging
Susan T. Charles and Laura L. Carstensen p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p 383
Development in Societal Context
Human Development in Societal Context
Aletha C. Huston and Alison C. Bentley p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p 411
Genetics and Psychopathology
Epigenetics and the Environmental Regulation
of the Genome and Its Function
Tie-Yuan Zhang and Michael J. Meaney p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p 439
Social Psychology of Attention, Control, and Automaticity
Goals, Attention, and (Un)Consciousness
Ap Dijksterhuis and Henk Aarts p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p 467
Contents vii
AR398-FM ARI 7 November 2009 7:47
Robert G. Lord, James M. Diefendorff, Aaron C. Schmidt, and Rosalie J. Hall p p p p p p p p 543
by University of South Carolina - Columbia on 07/31/13. For personal use only.
Cognition in Organizations
Creativity
Beth A. Hennessey and Teresa M. Amabile p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p 569
Work Attitudes ( Job Satisfaction, Commitment, Identification)
The Intersection of Work and Family Life: The Role of Affect
Lillian T. Eby, Charleen P. Maher, and Marcus M. Butts p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p 599
Human Factors (Machine Information, Person Machine Information,
Workplace Conditions)
Cumulative Knowledge and Progress in Human Factors
Robert W. Proctor and Kim-Phuong L. Vu p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p 623
Learning and Performance in Educational Settings
The Psychology of Academic Achievement
Philip H. Winne and John C. Nesbit p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p 653
Personality and Coping Styles
Personality and Coping
Charles S. Carver and Jennifer Connor-Smith p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p p 679
Indexes
viii Contents