You are on page 1of 13

Joulmalof Experimental Psychology: Copyright 1998 by the American PsychologicalAssociation,Inc.

Animal Behavior Processes 0097-7403/98/$3.00


1998, VoL 24, No. 1, 47-59

Transfer Across Delayed Discriminations:


II. Differences in the Substitutability of Initial Versus Test Stimuli
Peter J. Urcuioli and T h o m a s B. DeMarse T h o m a s R. Zentall
Purdue University University of Kentucky

In 2 experiments, pigeons were trained on, and then transferred to, delayed simple
discriminations in which the initial stimuli signalled reinforcement versus extinction
following a retention interval. Experiment 1 showed that discriminative responding on the
retention test transferred to novel test stimuli that had appeared in another delayed simple
discrimination but not to stimuli having the same reinforcement history off-baseline. By
contrast, Experiment 2 showed that performances transferred to novel initial stimuli whether
they had been trained on-baseline or off-baseline. These results suggest that the test stimuli in
delayed simple discriminations acquire control over responding only in the memory task itself.
On the other hand, control by the initial stimuli, if coded as outcome expectancies, does not
require such task-specific training.

Comparing performances across different delayed discrimi- necessary to respond appropriately on the retention test (i.e.,
nations has been a popular way to identify what animals to peck the test stimulus on reinforced trials and not to peck
remember during the retention interval of a working memory it on nonreinforced trials). Compare this with a delayed
task. This comparison has been frequently driven by the conditional discrimination involving the same stimuli but in
belief that animals not only code the physical attributes of which the reinforcement contingencies are determined by
stimuli appearing prior to the retention interval (retrospec- particular combinations of initial and test stimuli. For
tive coding) but also anticipate events occurring with example, with a red initial stimulus, reinforcement might be
predictable regularity after the retention interval (prospec- delivered for responding to the vertical but not to the
tive coding; cf. Honig & Thompson, 1982; Wasserman, horizontal test stimulus, and vice versa following a green
1986). Indeed, there are considerable data supporting this initial stimulus. In this task, red and green do not, by
position (e.g., Capaldi, Birmingham, & Alptekin, 1995; themselves, signal whether or not reinforcement is available
Cook, Brown, & Riley, 1985; Peterson, 1984; Roitblat, after the retention interval. That can be determined only
1980; Urcuioli & Zentall, 1990, 1992). The present experi- when the test stimulus appears.
ments were designed in part to make this prospective- Typically, delayed simple discrimination performances
retrospective distinction even clearer. are much more accurate over longer retention intervals than
A good example of the distinction can be found in studies delayed conditional discrimination performances (Cohen,
of delayed simple discriminations (e.g., Honig & Wasser- Galgan, & Fuerst, 1986; Honig & Wasserman, 1981; Ur-
man, 1981; Urcuioli & Zentall, 1990). In this task, the cuioli & Zentall, 1990; Weisman, Bruce, & Beninger, 1987).
stimuli appearing prior to the retention interval (the initial Given the same stimuli and stimulus sequences across tasks,
stimuli) signal, by themselves, the reinforcement contingen- this has been taken as evidence for different working
cies on the forthcoming retention test. In a go/no-go delayed memory codes (Honig & Dodd, 1986; Wasserman, 1986). In
simple discrimination with pigeons, for instance, a red initial particular, it has been argued that in delayed simple discrimi-
stimulus might signal that pecks will be reinforced to nations, animals prospectively code the initial stimuli in
whichever line orientation (or test stimulus) appears after the terms of the end-of-trial outcomes that they signal (viz., food
retention interval, whereas a green initial stimulus might versus none). By contrast, in delayed conditional discrimina-
signal that the trial will end in nonreinforcement (i.e., that tions, the memory codes must be something other than
pecking the line-orientation test stimulus will be extin- differential outcome expectancies because outcomes are
guished). Note that red and green carry all of the information uncorrelated with the initial stimuli.
This prospective coding or outcome expectancy interpre-
tation of delayed simple discrimination performances is
Peter J. Urcuioli and Thomas B. DeMarse, Department of supported by other data in the literature. For instance, the
Psychological Sciences, Purdue University; Thomas R. Zentall, usual advantage of simple over conditional discrimination
Department of Psychology, University of Kentucky. performances disappears if all trials end in reinforcement,
This research was supported in part by National Institute of albeit contingent on either responding or not responding to
Mental Health Grant 1 RO1 MH45979 (subcontract).
the test stimuli (Urcuioli & Zentall, 1990). Under these
Correspondence concerning this article should be addressed to
Peter J. Urcuioli, Department of Psychological Sciences, 1364 conditions, the same expectancy (i.e., of food) would always
Psychology Building--Room 3180, Purdue University, West Lafay- be generated by the initial stimuli; thus, there would be no
ette, Indiana 47907-1364. Electronic mail may be sent via Internet differential expectancies to cue responding on the retention
to uche @psych.purdue.edu. test. More convincingly, perhaps, animals trained on delayed

47
48 URCUIOLI, DEMARSE, AND ZENTALL

simple discriminations in which trials end in either reinforce- green), it should not peck following the retention interval.
ment or extinction (i.e., in different outcomes) readily This alternative seems quite plausible given that the test
transfer their discriminative performances to novel initial stimuli, unlike the initial stimuli, are uncorrelated with the
stimuli with the same outcome associations as the initial reinforcement contingencies. If it is correct, then the finding
stimuli they replace (Urcuioli & Zentall, 1992, Experiment that discriminative performances continue to be maintained
1). This transfer-of-control effect resembles findings used to at or near baseline levels following a swap in initial stimuli
establish that outcome expectancies play a role in other is hardly surprising. In other words, if performance is
delayed discrimination paradigms (Edwards, Jagielo, Zen- independent of the test stimulus presented on each trial, then
tall, & Hogan, 1982; Honig, Matheson, & Dodd, 1984; substituting the initial stimuli from one delayed simple
Peterson, 1984; Urcuioli, 1990), and its origins were the
discrimination to another creates, from the animal's perspec-
main focus of the present study.
tive, a task no different from one on which they have already
Table 1 schematically illustrates the procedure for demon-
strating such transfer. In each of two training phases, been trained.
animals learn a delayed simple discrimination in which the Nonetheless, other aspects of the previously reported
initial stimuli presented at the beginning of a trial (desig- transfer results do not easily fit this retrospective coding
nated S1-S4) signal whether responding to individual test explanation. For instance, it has been found that perfor-
stimuli (designated T1-T4) will ( + ) or will not ( - ) be mances during testing were maintained at baseline levels
reinforced. Note that the two training tasks involve different only following long retention intervals and deteriorated
initial stimuli and different test stimuli. In the transfer-test considerably when the retention interval was very short (see
phase, the initial stimuli from the first task replace those Figure 2 in Urcuioli & Zentall, 1992). There is no obvious
used in the second, thus creating novel combinations of reason to expect this difference if an animal simply responds
initial and test stimuli. In previous research (Urcuioli & (or does not respond) to whatever stimulus appears after the
Zentall, 1992), it has been found that at long retention delay. Furthermore, transfer is not obtained if the initial
intervals, go versus no-go responding to the test stimuli stimuli from the two training tasks do not share the same
transfers virtually without decrement across initial stimuli. differential outcome associations. For example, if one set of
This finding is consistent with the idea that the same initial stimuli signals reinforcement versus extinction whereas
working memory codes mediate performances in the two the second set signals reinforcement contingent on respond-
training tasks and, more specifically, that each set of initial ing versus not responding to the test stimuli, then the two
stimuli gives rise to differential outcome expectancies (viz., sets of initial stimuli are not interchangeable. This too seems
food vs. no food). It is these differential outcome expectan-
contrary to the altemative hypothesis because if animals
cies that ostensibly determine whether or not animals
merely learn to retrospectively code the initial stimuli of a
respond to the retention-test stimuli. Stated in another
delayed simple discrimination and to effectively treat the test
fashion, for any set of test stimuli, it does not appear to
matter what initial stimuli generate the outcome expectan- stimuli as irrelevant, then their go versus no-go perfor-
cies. mances should transfer across initial stimuli in this situation
An alternative interpretation of the positive transfer too.
observed in this design, however, is that animals learn in Nevertheless, a formal evaluation of the impact of the test
training to retrospectively code the initial stimuli and, on stimuli in transfer of delayed discriminations is important
that basis, to then respond (or not respond) to whatever test because the discrepant data mentioned above could probably
stimulus appears after the retention interval. For example, be accomodated by ad hoc arguments. Experiment 1 pro-
the animal might learn in Phase 1 that when remembering $1 vided such an evaluation.
(e.g., red), it should peck at the next stimulus appearing after
the retention interval, whereas when remembering $2 (e.g.,
Experiment 1
If transfer across delayed simple discriminations occurs
Table 1 because responding on the retention test is independent of
A Delayed Simple Discrimination Design Producing what test stimulus appears there, then the substitution of any
Positive Transfer of Performance familiar stimuli for the test stimuli used in training should
Training not disrupt performances. Specifically, this view predicts
immediate positive transfer of performance to trials consist-
Phase 1 Phase 2 Testing
ing of initial stimuli trained within a delayed simple
S1--*Ti+ S3--*T3+ SI--~T3+ discrimination and of test stimuli with which the animal has
SI~T2 + $3-'*T4+ S1---*T4+ had experience but which have never appeared in such a
$2"-"T1- S4--~T3 - S2--*T 3 -
52---~T2- S4--*T4- $2--*T4-
task. By contrast, if the properties by which the test stimuli
support discriminative performances are acquired only in the
Note. SI~S4 = initial stimuli; T r T 4 = test stimuli; + and -
indicate end-of-trial food presentation and no food, respectively,
task itself, then replacing them with stimuli that have not
for responding to the test stimuli. Arrows indicate the retention been trained in a delayed discrimination should cause
interval. performances to collapse.
TRANSFER ACROSS DELAYED DISCRIMINATIONS 49

Me~od with the square and the X elements on the photographic film
(Pattern No. 696) mounted inside the projector. The reason for
Anima~ presenting the latter two forms as blue (instead of the usual white)
was to make them as distinct as possible from the other form
Sixteen White Carneaux pigeons (Columba livia; retired breed- stimuli.
ers) obtained from the Palmetto Pigeon Plant (Sumter, SC) were A 5.0-cm × 5.8-cm opening in each panel provided access to a
used in the experiment. All had previous experience in two-choice rear-mounted grain magazine, which when operated was illumi-
matching-to-sample and were randomly assigned to groups in a nated by an ESB-28 lightbulb located in a metal cover surrounding
manner that balanced those histories. The pigeons were housed the magazine. General chamber illumination was provided by a
individually in stainless-steel cages in a common colony room on a General Electric No. 1829 lightbulb located inside a small metal
14:10-hr light-dark cycle. Grit and water were always available in housing 7.6 cm above the center key. The opening in this housing
the home cages, but food availability was restricted to maintain was positioned to direct light toward the ceiling. A continuously
each pigeon's body weight at approximately 80% of its free- running exhaust fan attached to the outside of the chambers
feeding value. Typically, the pigeons obtained enough food in each provided ventilation and masking noise. All experimental events
experimental session to maintain those weights. When they did not, were controlled and recorded by individual Cromemco Z-2D
supplemental feedings were provided in the home cage. In addi- microcomputers. One half of the pigeons in each group described
tion, each pigeon was fed in the home cage on the 1 day per week below were assigned to each chamber.
that the experiment was not conducted.
Procedure
Apparatus
The experiment proper consisted of two delayed simple discrimi-
The two experimental chambers used for this experiment were nation training phases and a transfer test phase (see Table 2). Each
identical to those used by Urcuioli and Zentall (1992). Each training phase was preceded by preliminary training sessions not
chamber (Model SEC-002; BRS/LVE Inc., Laurel, MD) contained shown in the table but described below.
a panel with three equally spaced pecking keys 2.5 cm in diameter Preliminary training for Phase 1. Because all pigeons had
(Model PIP-016), although only the center response key was used. previous experimental experience, magazine training and shaping
Behind the center key was a BRS/LVE in-line stimulus projector of the keypeck response was not required. The first part of
(Model IC-901-IDD), which could display the following stimuli: preliminary training, then, consisted of reinforcing single pecks to
red, green, yellow, and white homogeneous fields; a single white the stimuli that would later appear in the delayed simple discrimina-
vertical or horizontal line on a black background; an open white tions. Every pigeon initially received one session during which
triangle or white circular annulus on black backgrounds; and an pecking red and green hues on the center key was reinforced by 3-s
open blue square or blue X on black backgrounds. The latter two access to grain. The center-key stimuli for the next four sessions
stimuli were constructed by inserting a blue Wratten filter in line were yellow and white hues, vertical and horizontal lines, triangle

Table 2
Design of Experiment I
Training
Group Phase 1 Phase 2 Testing Phase 3
P R ---, VFI 5s T ---4 YFI 5s R ---* YFI 5s
R---. HFI 5s T ---, WFI 5s and b S - F I 5s/EXT R --* WFI 5s
G ---* V EXT C ---* Y EXT b X - F I 5s/EXT G ---* Y EXT
G ---" H EXT C ~ W EXT G --* W EXT

PC R---~ VFI 5s T ---* bSFI 5s R ---, YFI 5s


R---* HFI 5s T ---. bXFI 5s and Y-FI 5s/EXT R ~ WFI 5s
G---* V EXT C ~ bS EXT W - F I 5s/EXT G ---- Y EXT
G - - . H EXT C ---, bX EXT G ---* W EXT

N R -...¢ VFI 5s T ----. YFI 5s R --~ Y EXT


R - - . HFI 5s T ---. WFI 5s and b S - F I 5s/EXT R ---. W EXT
G---" V EXT C ~ Y EXT b X - F I 5s/EXT G --~ YFI 5s
G---* H EXT C ~ W EXT G ---* WFI 5s

NC R ---* VFI 5s T --, bSFI 5s R ---* Y EXT


R ---* HFI 5s T ---4 bXFI 5s and Y - F I 5s/EXT R ~ W EXT
G ~ V EXT C --~ bS EXT W - F I 5s/EXT G ---. YFI 5s
G --. H EXT C --* bX EXT G --- WFI 5s
Note. P = positive; PC = positive control; N = negative; NC = negative control; R = red; G =
green; V = vertical lines; H = horizontal lines; T = triangle; C = circle; Y = yellow; W = white;
bS = blue square; bX = blue X. FI = fixed-interval schedule; EXT = extinction. Arrows denote
retention interval separating initial stimuli (on the left) and test stimuli (on the right). Counterbalanc-
ing of initial stimuli and reinforcement schedules has been omitted. See text for further details.
50 URCUIOLI, DEMARSE, AND ZENTALL

and circle forms, and blue square and blue X color-form com- described above except that the blank-key delay separating the
pounds, in that order. Each stimulus in a session appeared 30 times initial stimuli from the test stimuli was either 0, 5, or l0 s. Each
in random order, and successive stimulus presentations were retention interval occurred equally often with each combination of
separated by a 10-s intertrial interval (ITI). initial and test stimuli.
During the next five sessions, pecking red and green on the Preliminary training for Phase 2. Next, each pigeon received
center key was reinforced on modified fixed-interval (FI) sched- preliminary training to peck the stimuli that would later appear in
ules. A single peck to the hue appearing on each trial started the FI, the second delayed simple discrimination task. For the first five of
and the first peck after the interval expired produced food these sessions, pecking triangle and circle forms on the center key
reinforcement. The FI value was 2 s for the first, 3 s for the second, was reinforced according to the modified FI schedules described in
and 5 s for the third session, and 10 s for the fourth and fifth Preliminary training for Phase 1. All trials with these stimuli ended
sessions. In all sessions, each hue appeared 30 times in random with food, and the sequence of FI values across sessions was
order with the restriction that neither appeared more than three identical to that used for preliminary training with the red and green
times in a row. Successive trials were again separated by a 10-s ITI, hues. Each pigeon then received two sessions of partial-
the first 9 s of which was spent with the houselight off. The reinforcement training with yellow and white center-key hues
houselight was turned on for the last 1 s of the ITI and remained on followed by two similar sessions with the blue square and blue X
until the end of the reinforcement cycle. Reinforcement duration compounds. These latter sessions were run in the same fashion as
was constant within a session but was varied from 2-5 s across both the corresponding ones that preceded the Phase 1 delayed simple
subjects and sessions to maintain each pigeon's body weight at or discrimination.
near its 80% value. Phase 2 training. In Phase 2, all pigeons learned another
Pecking vertical and horizontal center-key lines was reinforced delayed simple discrimination involving initial and test stimuli
during the final two preliminary training sessions by using the different from those used in Phase 1. In addition, each training
modified FI 2-s and FI 5-s schedules, respectively. These sessions session alternated over days with sessions during which pecking
were identical to those described above except that only one half of two other stimuli was partially reinforced. As shown in the middle
the trials with each stimulus ended in food. On the remaining trials, column of Table 2, all groups were trained with the same initial
the line stimulus (and the houselight) went off automatically after stimuli in their Phase 2 delayed simple discrimination (viz., the
the fixed interval had expired. Then, following a dark interval equal triangle and circle forms) but were exposed to different test stimuli
in duration to the reinforcement cycle, the ITI began. Partial and to different stimuli during the alternating off-baseline sessions.
reinforcement was used with the lines to mimic the overall For the positive group (Group P) and the negative group (Group
schedule of food presentation that the pigeons would later experi- N), yellow and white hues served as test stimuli in the delayed
ence following these same stimuli in the Phase 1 delayed simple simple discrimination. For half of the pigeons in these two groups,
discrimination. the first test-stimulus peck after 5 s produced food when the
Phase 1 training. Following preliminary training, all pigeons preceding initial stimulus was the triangle, whereas test-stimulus
learned a delayed simple discrimination with red and green initial pecking was extinguished (i.e., the test stimulus went off automati-
stimuli and vertical and horizontal test stimuli. Each delayed cally after 5 s with no food reward) when the initial stimulus was
simple discrimination trial began with a 10-s presentation of either the circle. These contingencies were reversed for the remaining
red or green on the center key, which was timed from the first peck subjects. During the alternating off-baseline sessions, pecking the
to the initial stimulus. The first key peck after the 10-s interval had blue square and blue X compounds was reinforced after 5 s on one
elapsed turned off the initial stimulus and produced either the half of all trials. The remaining trials ended automatically after 5 s
vertical or horizontal line on the same key following an intervening without food (i.e., in extinction). Each color-form compound
blank interval of 500 ms (hereafter referred to as the 0-s retention appeared 30 times in random order during these sessions.
interval). For half of the pigeons, the trial ended in reinforcement For two control (C) groups, Group PC and Group NC, the blue
(i.e., the first peck after 5 s to whatever test stimulus appeared square and blue X compounds served as the test stimuli in the
produced food) if the initial stimulus had been red, whereas the trial delayed simple discrimination with the reinforced initial stimulus-
ended in nonreinforcement (i.e., the test stimulus went off automati- test stimulus combinations balanced across subjects. The alternat-
cally after 5 s) if the initial stimulus had been green. The remaining ing off-baseline sessions for Groups PC and NC consisted of 30
pigeons experienced the opposite contingencies. Training for each presentations each of yellow and white hues on the center key with
pigeon in this Phase 1 delayed simple discrimination continued food occurring after 5 s on one half of each trial type. Extinction
until the pigeon reached a criterion of five of six consecutive was in effect on the remaining trials.
sessions in which 90% or more of all test-stimulus responses For all four groups, training on the Phase 2 discrimination was
occurred on reinforced trials. initially conducted with a 0-s retention interval and was continued
The four possible combinations of the red and green initial until each pigeon reached a criterion of five of six consecutive
stimuli and the vertical and horizontal test stimuli occurred 15 sessions in which 90% or more of its test-stimulus responses
times in random order in each session. Each session also contained occurred on reinforced trials. At that point, 15 additional sessions
10 additional trials, 5 with red and 5 with green, which ended of mixed-delay training with 0-, 5-, and 10-s retention intervals
immediately with food reinforcement following offset of the hue were provided. The mixed-delay sessions continued to alternate
(i.e., there was no test-stimulus presentation). These extra trials with each pigeon's respective off-baseline task.
were scattered throughout each session and were included to Because of difficulties in the acquisition of the Phase 2 task, the
maintain comparable rates of key pecking to both initial stimuli (cf. alternating session procedure was discontinued for 1 pigeon in each
Honig & Wasserman, 1981). All trials were separated from one group after 30 sessions. Two of these pigeons eventually reached
another by a 10-s ITI of which the first 9 s was spent in darkness. the 90% criterion. Two others, however, did not reach this criterion
The houselight came on for the last 1 s of the ITI and remained on after 10 to 20 additional consecutive training sessions; however,
until the end of food presentation on reinforced trials or until they were advanced to the mixed-delay procedure because their
stimulus offset on nonreinforced trials. discriminative performances were consistently and highly accurate
After reaching criterion with the 0-s retention interval, each (i.e., more than 80% of their test-stimulus responses occurred on
pigeon then received 15 additional sessions of mixed-delay train- reinforced trials). For all of these pigeons, the alternating session
ing. These sessions were conducted in exactly the same fashion as routine was reinstituted once mixed-delay training began.
TRANSFER ACROSS DELAYED DISCRIMINATIONS 51

Refresher training and Phase 3 testing. Immediately prior to substantial performance difference between Groups P and N but
testing, subjects received refresher training on their Phase 1 and none between Groups PC and NC.
Phase 2 tasks to ensure that both baseline delayed simple discrimi- Alternatively, if pigeons learn in training to respond or not
nation performances were intact. The sequence of refresher ses- respond independently of what stimuli appear on the retention test,
sions was as follows: (a) training on the Phase 1 delayed simple then Group PC should, like Group P, show positive transfer in
discrimination with 0-s delays until the 90% performance criterion testing, and Group NC should, like Group N, show negative
was met for a single session, (b) mixed-delay training on the Phase transfer. The rationale here is that for both Groups P and PC, red
2 delayed simple discrimination until delay performances recov- and green continue to signal the same end-of-trial reinforcement
ered to levels comparable to those observed at the end of Phase 2, contingencies for responding in transfer as they did in Phase 1
(c) a single partial-reinforcement session with the off-baseline training, and those signalling properties alone should determine for
stimuli, and (d) mixed-delay training on the Phase 1 delayed simple the pigeons whether to peck after the retention interval. On the
discrimination until delay performances on this task likewise other hand, the reinforcement contingencies vis-~i-vis the red and
recovered to levels comparable to those at the end of Phase 1. If the green initial stimuli for Groups N and NC in testing are the opposite
mixed-delay performances on the latter task did not fully recover of what they were in Phase 1 training, so these pigeons should
within three sessions, then the last three components of the entire respond more to the retention-test stimuli on nonreinforced than on
refresher sequence were repeated in that order until such recovery reinforced trials (at least initially).
was obtained.
Finally, each pigeon was tested on a new delayed simple Results
discrimination involving red and green initial stimuli (from Phase
1) and yellow and white test stimuli (from Phase 2). The Baseline (Training) Performances
mixed-delay procedure was used throughout the five test sessions,
with trial sequencing, stimulus durations, and so on identical to Acquisition of the common Phase 1 task proceeded at
those used in training. Note that for Groups P and N, yellow and comparable rates in all groups. The average number of
white hues had previously appeared as test stimuli in another training sessions needed to reach the .90 DR criterion ranged
delayed simple discrimination, whereas for Groups PC and NC, between 10.0-12.5 sessions and did not differ significantly
they had not. Note also that for Groups P and PC, the relations between groups, F(3, 12) = 0.22. Likewise, the four groups
between the red versus the green initial stimulus and the end-of-
performed similarly during the mixed-delay sessions follow-
trial outcomes (i.e., reinforcement versus extinction) were identical
to those in effect during the baseline delayed simple discrimination ing acquisition. The DRs averaged over the last five
in which these stimuli had originally appeared (i.e., the Phase 1 mixed-delay sessions, shown in the left half of Table 3, were
task). By contrast, this relation was reversed for Groups N and NC. very near to or above .90 at all three delays in all groups. A n
analysis of variance (ANOVA) showed no significant group
effect, F(3, 12) = 0.09, nor a Group × Delay interaction,
Data Analysis and Predictions
F(6, 24) = 0.22. Only the overall effect of delay was
The primary dependent measure was a discriminationratio (DR) significant, F(2, 24) --- 12.34.
calculated by dividing the total number of key pecks to the test For the various groups, the Phase 2 delayed simple
stimuli on reinforced trials by the total number of key pecks to the discrimination involved the same initial stimuli (triangle and
test stimuli over all trials. Little or no discrimination is indicated by circle) but different test stimuli (either yellow and white
DRs in the vicinity of .50 (i.e., pecking occurs as often on hues or blue square and blue X compounds). Despite this
nonreinforced as on reinforced trials). The DR approaches a difference, acquisition of the Phase 2 task was comparable
maximum of 1.00 as performances become more and more
across groups: The average number of sessions needed to
discriminative (i.e., as test-stimulus responding becomes increas-
reach a .90 DR ranged from 20.0-25.2 and did not differ
ingly confined to reinforced trials). A DR less than .50 indicates
discriminative performance opposite to that reinforced by the significantly among groups, F(3, 12) = 0.13. Phase 2
contingencies (i.e., pecking the test stimuli more often on nonrein- acquisition was slower than in Phase 1, but part of the reason
forced than on reinforced trials). For all statistical analyses, Type I for this may have been that the delayed simple discrimina-
error rate was set as .05 on a per-decision basis by using the tabled tion sessions in Phase 2 were not run consecutively as they
values reported by Rodger (1975a). were in Phase 1. Instead, each session alternated with
Different predictions regarding how the various groups should off-baseline partial-reinforcement training with two other
perform in testing were derived from the different views concern-
ing the role of the test stimuli in delayed simple discriminations. If
the test stimuli play an integral part in supporting delayed simple Table 3
discrimination performances and if their function is acquired Discrimination Ratios by Delay for Each Group in
within that context, then Group P should show positive transfer of Experiment 1 Averaged Over the Last Five Sessions
performance to the new task (i.e., its DRs should be greater than of Their Phase 1 and Phase 2 Delayed
.50) given that their red and green initial stimuli continued to signal Simple Discriminations (DSDs)
the same reinforcement contingencies as they had in Phase 1. On
the other hand, Group N should initially show negative transfer Phase 1 DSD: Delay Phase 2 DSD: Delay
(i.e., its DRs should be below .50) because their red and green Group 0s 5s 10 s 0s 5s 10 s
initial stimuli signalled the opposite contingencies in the transfer
test. By contrast, although the corresponding initial stimulus- P .97 .94 .90 .93 .94 .92
outcome relations held for Groups PC and NC, neither positive nor PC .97 .94 .92 .83 .85 .86
negative transfer, respectively, should be apparent in their test N .96 .92 .88 .93 .93 .91
performances (i.e., their DRs should be near .50) because the NC .97 .92 .90 .85 .85 .83
yellow and white test stimuli had not previously appeared in a Note. P = positive; PC = positive control; N = negative; NC =
delayed simple discrimination. In short, this view predicts a negative control.
52 URCUIOLI, DEMARSE, AND ZENTALL

stimuli. Also, the triangle and circle initial stimuli were all three delays, with performances at the longer delays as
probably more difficult for pigeons to discriminate than the accurate in testing as they were on the last baseline refresher.
red and green hues in Phase 1 (cf. Carter & Eckerman, 1975; By contrast, none of the other groups showed a similar
Urcuioli & Zentall, 1986). effect. Indeed, for them, the average DRs clustered around
Mixed-delay performances for the Phase 2 task are .50 with somewhat lower DRs in Group N than in Groups
summarized in the right half of Table 3. Once again, PC and NC. An ANOVA on the combined Day 1 test data
discriminative performances were highly accurate across revealed that all three factors--group, delay, and their
delays in all four groups, and an ANOVA showed no interactioniwere significant, F(3, 12) = 142.26, F(2, 24) =
significant effects, all Fs < 1.31. 11.48, and F(6, 24) = 12.21, respectively.
Separate ANOVAs compared first-session test perfor-
Transfer-Test Performances mances in Group P with those in Group PC and in Group N
with those in Group NC. For the former pair, the relation
The right panel of Figure 1 shows DRs on the first Phase 3
between the red and green initial stimuli and the end-of-trial
test session for each group. For comparison purposes,
outcomes was the same in testing as it was in the Phase 1
performances on the last Phase 1 mixed-delay refresher
(baseline) task (cf. Table 1). For the latter pair, this relation
session (baseline) are shown in the left panel.
was reversed. An ANOVA on the data from the two positive
Baseline performances were comparable across groups as
confirmed by an ANOVA, which revealed no significant groups confirmed that discriminative performances were
effects of group or delay. There was a significant Group X significantly more accurate overall in Group P than in Group
Delay interaction, F(6, 24) = 1.70, which apparently arose PC, F(1, 6) = 142.40. The Group × Delay interaction was
from the slightly lower DR in Group PC at the 5-s delay. also significant, F(2, 12) = 14.62. An ANOVA on the data
Nevertheless, this represents a minor variation in discrimina- from the two negative groups also revealed a significant
tive performances that were otherwise uniformly high in all group effect. In this case, the average DRs in Group N were
four groups. significantly lower than they were in Group NC, F ( l , 6) =
In contrast, very substantial between-group differences 7.08. The Group × Delay interaction was also significant,
were apparent on the first Phase 3 test session. Specifically, F(2, 12) = 3.79, indicative of the fact that the lower DRs in
Group P showed strong positive transfer of its delayed Group N were apparent at the 5- and 10-s delays but not at
simple discrimination performance to the new task consist- the 0-s delay (compare the open circles with the open
ing of red and green hues (from Phase 1) as initial stimuli triangles in Figure 1).
and yellow and white hues (from Phase 2) as the retention- To evaluate whether the positive transfer seen in Group P
test stimuli. The DRs for this group were well above .50 at was apparent from the outset of testing and to evaluate

1.0
BASELINE PHASE 3 TEST - DAY 1
1.0

.9 .9

©
~ .8 .8

z
~ .7 .7

OP .6
r~ ON
• PC
A NC

.4 .4
"f i i t "f I I i
0 5 10 0 5 10
DELAY (sec)

Figure 1. Discrimination ratios by delay for the four groups in Experiment 1 on the mixed-delay
Phase 1 (baseline) refresher session preceding transfer (left panel) and on the first session of Phase 3
transfer (fight panel). P = positive group; N = negative group; PC = positive control group; NC =
negative control group.
TRANSFER ACROSS DELAYED DISCRIMINATIONS 53

whether Group N, Group NC, or both may have shown Group N) during transfer varied as a function of the retention
initial negative transfer, we computed discriminative perfor- interval. For Group P, DRs were much higher at the two
mances for the first 12 delayed simple discrimination test longest retention intervals than at 0 s, which replicates a
trials for each group. These DRs were .84, .52, .34, and .44 previously reported result from an experiment that used a
for Groups P, PC, N, and NC, respectively. Clearly, Group P design similar to that used here (see Urcuioli & Zentall,
showed immediate positive transfer of performance. Addi- 1992, Experiment 1; cf. Group EE). Again, there was no
tionally, the very low DR for Group N (.34) indicates reason to anticipate such a difference if pigeons simply
negative transfer: These pigeons tended to peck the yellow responded or did not respond on the retention test solely on
and white test stimuli more often following the initial the basis of the prior initial stimulus.
stimulus now associated with extinction (but formerly Clearly, then, the test stimuli play an integral role in
associated with reinforcement) than following the initial delayed simple discrimination performances despite the fact
stimulus now associated with reinforcement (but formerly a that they are uncorrelated with reinforcement. Moreover, the
signal for extinction). By contrast, the data for Groups PC degree of control they exert varies as a function of the
and NC indicate that these pigeons responded about equally retention interval. The latter finding--that discriminative
often to the test stimuli on both reinforced and nonreinforced control gets stronger (rather than weaker) as the retention
trials. Post hoc contrasts (Rodger, 1975a) on these data interval is lengthened---seems peculiar at first glance. How-
showed that the DRs were not significantly different in ever, it is understandable given the training procedure and
Groups PC and NC, F(3, 11) = 0.54, but they were the nature of the working memory code that is thought to
significantly greater in Group P than in Group N, F(3, 11) = govern performance.
17.3. Moreover, the average DR for Groups PC and NC It has been previously argued (Urcuioli & Zentall, 1990,
combined did not differ significantly from the average for 1992) that when the initial stimuli of a delayed simple
Groups P and N, F(3, 11) = 1.78. Together, these statistical discrimination are correlated with the presence versus
results imply that the DRs for the first 12 test trials were absence of end-of-trial reinforcement, those initial stimuli
ordered from highest to lowest as follows: Group P > Group give rise to differential outcome expectancies, which in turn
PC = Group NC > Group N (see Rodger, 1975b, Equation provide a discriminative cue for whether to respond to the
23). test stimuli. In other words, the working memory code is an
expectancy of food versus no food. This assertion is
Discussion consistent with the fact that delayed simple discrimination
performances are more accurate when the end-of-trial out-
The results of this experiment show very clearly that come is differential with respect to the initial stimuli than
transfer across delayed simple discriminations does not when all trials end in food, albeit contingent on different
occur simply because pigeons learn during training to patterns of test-stimulus responding (Urcuioli & Zentall,
respond on the retention test independently of the test 1990). It is also consistent with the ability of other stimuli
stimulus that appears. Two findings in particular are inconsis- with similar differential outcome associations to readily
tent with this inattention account. substitute for the initial stimuli used in training (Urcuioli &
The first is the failure of the two control groups, PC and Zentall, 1992).
NC, to show the same transfer effects as those exhibited by The poorer and seemingly anomalous transfer at the 0-s
Groups P and N, respectively. Indeed, there was no evidence delay probably arises because differential outcome expectan-
of transfer in Groups PC and NC. This result occurred cies cannot fully develop until shortly after the initial stimuli
despite the fact that these two groups had received just as go off, The reason for this is that our training procedure
much delayed simple discrimination training during Phases included a small proportion of trials in which food immedi-
1 and 2 as Groups P and N and, more important, that their ately followed the presentation of either initial stimulus.
history of partial reinforcement for responding to the test Thus, the initial stimuli by themselves were not consistent
stimuli used in transfer was identical to that for Groups P and signals for food versus no food. It was only after their offset,
N. In short, the difference in performance between the and after the absence of immediate food, that they reliably
control and experimental groups cannot be explained either signalled upcoming reinforcement versus extinction for
by differences in the amount of delayed simple discrimina- responding to the test stimuli. In short, the primary working
tion training they received or by differences in familiarity memory code on 0-s delay trials was likely to be different
with the test stimuli used in transfer. With these two from the code on longer delay trials; it may have been based
variables controlled, the data indicate instead that transfer on the physical attributes of the initial stimuli at 0 s (a
across delayed discriminations is precluded unless the test retrospective code), but based on an outcome expectancy at
stimuli in transfer have been previously trained in another longer delays (a prospective code).
delayed simple discrimination. This is clearly contrary to the Of course, why there should be an interaction between the
inattention account: If discriminative performances on the nature of the working memory code and the nature of the test
retention test are independent of the test stimuli, the stimuli in transfer remains to be answered. First, however,
performances in Groups PC and NC should have mirrored we were interested in determining whether the on- versus
those observed in Groups P and N. off-baseline training effects seen here were unique to test
The second inconsistent result was the finding that stimuli or whether they would also occur with the initial
discriminative performances by Group P (and less so by stimuli.
54 URCUIOLI, DEMARSE, AND ZENTALL

Experiment 2 of this experiment balanced as closely as possible those prior


histories. The apparatuses and stimuli were the same as those used
E x p e r i m e n t 1 s h o w e d that transfer across delayed discrimi- in Experiment 1.
nations occurs o n l y if the test stimuli h a v e p r e v i o u s l y
appeared in a d e l a y e d simple discrimination. S i m p l y arrang-
ing off-baseline r e i n f o r c e m e n t o f those stimuli, e v e n in a
Procedure
fashion identical to that o c c u r r i n g within a d e l a y e d simple The design of the experiment, summarized in Table 4, consisted
discrimination, does not suffice to m a k e t h e m substitutable of two training phases followed by two transfer tests. Training and
for other test stimuli. In E x p e r i m e n t 2, w e asked w h e t h e r the testing are described below along with preliminary training ses-
s a m e rule applies to the initial stimuli. In other words, does sions not depicted in the table.
transfer across d e l a y e d discriminations also require that the Preliminary training. Each pigeon was first trained to peck the
substituted initial stimuli be trained within a delayed simple center-key stimuli that would later appear as initial or test stimuli in
discrimination, or w o u l d off-baseline training suffice to the delayed simple discriminations. The stimuli for these sessions,
e m p o w e r t h e m w i t h the properties r e q u i r e d for transfer? the order in which the sessions were conducted, and all other details
were exactly the same as those described for the corresponding
C o n s i d e r i n g that d e l a y e d simple discriminations with
sessions in Experiment 1.
r e i n f o r c e m e n t versus extinction are differential o u t c o m e
All pigeons were then trained for five sessions to peck triangle
tasks (Urcuioli & Zentall, 1990), w e anticipated that transfer and circle center-key stimuli on the modified FI interval schedules
to n e w initial stimuli w o u l d o c c u r e v e n if those stimuli w e r e previously described in Preliminary training for Phase 1. As in
trained outside the d e l a y e d simple discrimination context. Experiment 1, the FI value was increased from 2 to 10 s across
This prediction was based on findings f r o m other differential sessions with food presentation occurring after the completion of
o u t c o m e studies that showed, for e x a m p l e , that in two- every interval. For the last two preliminary training sessions,
c h o i c e tasks such as m a t c h i n g - t o - s a m p l e , pigeons i m m e d i - pecking yellow and white hues on the center key was partially
ately transfer their m a t c h i n g p e r f o r m a n c e s to stimuli trained reinforced on the FI 2-s and FI 5-s schedules, respectively.
off-baseline with the s a m e o u t c o m e associations as the Approximately one half of the trials with each stimulus ended with
food.
samples they replace (e.g., Peterson, 1984; Urcuioli, 1990;
Phase ] training. Next, all pigeons received delayed simple
U r c u i o l i & D e M a r s e , 1996). T h e c o r r e s p o n d i n g manipula-
discrimination training with triangle and circle initial stimuli and
tion o f substituting off-baseline stimuli for the initial stimuli yellow and white test stimuli. Acquisition of this task was
in a d e l a y e d s i m p l e discrimination, h o w e v e r , has not been conducted with a 0-s retention interval separating the initial stimuli
done. E x p e r i m e n t 2 thus p r o v i d e s important c o m p a r a t i v e from the test stimuli, until each pigeon reached a criterion of five of
data to c o m p l e m e n t those obtained in E x p e r i m e n t 1. six consecutive sessions in which 90% or more of its test-stimulus
responses occurred on reinforced trials. At that point, each pigeon
Method received 15 additional sessions of mixed-delay training with
retention intervals of 0, 5, and 10 s occurring equally often in each
Animals and Apparatus session. Two pigeons, both in the initial-stimulus training group
(Group IST; see below), did not reach criterion after 40 and 50
Eight White Carneaux retired breeder pigeons (Columba livia) sessions, respectively, but were moved to the mixed-delay proce-
from the Palmetto Pigeon Plant (Sumter, SC) served in this dure nonetheless because their DRs were consistently high (e.g.,
experiment. They were housed and maintained in the same fashion they averaged .83 and .92, respectively, over the last five acquisi-
as the pigeons in Experiment 1. Each pigeon had previously tion sessions). The details of both the acquisition and mixed-delay
participated in a matching-to-sample study (see DeMarse & sessions were identical in every respect to those for the correspond-
Urcuioli, 1993, Experiment 2). Their assignment to the two groups ing sessions in Experiment 1.

Table 4
Design of Experiment 2
Training Testing
Group Phase 1 Phase 2 Phase 3 Phase 4
IST T ---* YFI 5s R ~ bSFI 5s R --* YFI 5s V ~ YFI 5s
T--.WFI5s V---* ( + ) and R---~bXFI5s R--,WFI5s V---~WFI5s
C --~ Y EXT H ~ (-) G --4 bS EXT G ---* Y EXT H ---* Y EXT
C --~ W EXT G ~ bX EXT G ---* W EXT H ~ W EXT

OB T ---* YFI 5s V~ bSFI 5s R --~ YFI 5s V --~ YFI 5s


T --, WFI 5s R --~ (+) and V ~ bXFI 5s R - 4 WFI 5s V ---. WFI 5s
C ---* Y EXT G ~ (-) H~ bS EXT G -~ Y EXT H ---* Y EXT
C ~ W EXT H~ bX EXT G ~ W EXT H ~ W EXT
Note. IST = initial-stimulus training; OB = off-baseline training; T = triangle; C = circle; Y =
yellow; W --- white; R = red; G = green; V = vertical lines; H = horizontal lines; bS = blue square;
bX = blue X; FI = fixed-interval schedule; EXT = extinction. Arrows denote retention interval
separating initial stimuli (on the left) and test stimuli or end-of-trial food presentation ( + ) versus no
food ( - ) (on the right). Counterbalancing of initial stimuli and reinforcement schedules has been
omitted. See text for further details.
TRANSFER ACROSS DELAYED DISCRIMINATIONS 55

Phase 2 training. During Phase 2, pigeons learned a new green hues matched those associated with either (a) the red and
delayed simple discrimination, which alternated over days with green initial stimuli in the Phase 2 delayed simple discrimination
sessions involving two other center-key stimuli not appearing in the (Group IST), or (b) contingencies in effect during the off-baseline
delayed simple discrimination. For Group IST, the Phase 2 delayed sessions with these same stimuli (Group OB). In other words, if red
simple discrimination consisted of trials with red and green hues as had preceded the delivery of food during Phase 2 and green had not
initial stimuli and the blue square and blue X color-form com- (or vice versa), the same thing was true during Phase 3 testing. All
pounds as test stimuli. The stimuli appearing during the alternating other details of the delayed simple discrimination transfer task
sessions for this group were vertical and horizontal lines. For the were identical to those for the delayed simple discriminations used
off-baseline group (Group OB), the Phase 2 delayed simple in the prior training phases. Note too that the Phase 3 transfer task
discrimination consisted of trials with vertical and horizontal lines in this experiment was identical to the corresponding task in
as initial stimuli and the two color-form compounds as test stimuli. Experiment 1.
The alternating sessions for this group involved red and green Refresher training and Phase 4 testing. The second transfer
center-key stimuli. The group labels reflect the fact that in the test involved substituting vertical and horizontal lines for the
Phase 3 transfer test that followed, the initial stimuli from the Phase triangle and circle as initial stimuli in the Phase 1 delayed simple
2 delayed simple discrimination were substituted for those in Phase discrimination. The five Phase 4 test sessions were otherwise
1 for Group IST, whereas the corresponding substitution for Group identical to all other mixed-delay sessions and were preceded by
OB involved the two stimuli trained off-baseline. the following refresher sequence: (a) training on the Phase 1
For both groups, delayed simple discrimination acquisition in mixed-delay task until performances recovered for a single session
Phase 2 was conducted with a 0-s retention interval and with the to the level observed at the end of Phase 1, (b) training on the Phase
same criterion as in Phase 1. Once each pigeon reached criterion, it 2 mixed-delay task until a similar recovery was achieved, (c) a
received 15 additional sessions of mixed-delay training. As in single session with the off-baseline stimuli, and (d) a second
acquisition, the mixed-delay sessions continued to alternate with recovery of Phase 1 delayed simple discrimination performances
off-baseline training involving either the vertical and horizontal with mixed delays.
lines (Group IST) or the red and green hues (Group OB). The Phase 4 test differed in one notable respect from the Phase 3
The off-baseline sessions in this experiment were run differently test: It reversed the type of initial stimulus substitution that each
from those of Experiment 1 to compensate for the fact that transfer group received. In other words, for Group IST, the initial stimuli in
involved the initial stimuli rather than the test stimuli. During these the Phase 1 delayed simple discrimination were replaced by the
70-trial sessions (35 with each off-baseline stimulus), the first peck off-baseline stimuli from Phase 2, whereas for Group OB, those
to the stimulus appearing on a trial started a 10-s interval that ended same initial stimuli were replaced by the delayed simple discrimi-
with the first peck after the interval had expired. On 10 trials (5 with nation task stimuli from Phase 2.
each stimulus), food was presented immediately following stimu-
lus offset. On the remaining 60 trials, offset of the center-key Results
stimulus was followed by a delay of either 0, 5, or 10 s during
which the houselight remained on. At the end of the delay, food was Baseline (Training) Performances
presented response independently if the trial had begun with one
stimulus, or the houselight simply went off without food (i.e., the Initial acquisition and m i x e d - d e l a y p e r f o r m a n c e s on the
ITI began) if the trial had begun with other stimulus. These c o m m o n Phase 1 task w e r e v e r y similar in the t w o groups.
contingencies are represented in second column of Table 4 by the For e x a m p l e , the average n u m b e r o f sessions n e e d e d to
plus and minus signs, respectively, following vertical and horizon- reach a D R criterion o f .85 (to c o m p e n s a t e for the 2 pigeons
tal lines or red and green hues. The stimulus followed by food on that failed to reach the .90 criterion) was 13.2 and 15.2 for
delay trials was counterbalanced across the 4 pigeons in each Groups I S T and OB, respectively, F ( 1 , 6) = 0.14. T h e left
group. Note that for both groups, the delivery of food (or lack h a l f o f Table 5 s h o w s that the D R s for the last five
thereof) during the off-baseline sessions was structured in the same m i x e d - d e l a y sessions w e r e at or a b o v e .90 at e v e r y delay in
way as in the mixed-delay delayed simple discrimination task: (a)
both groups. A n A N O V A s h o w e d no significant effects, all
on most trials, food was presented some time after the initial
F s < 1.13.
stimulus had gone off but only on trials beginning with one initial
stimulus and not the other; and (b) on the remaining trials, food was The Phase 2 delayed simple discrimination was also
contingent on the first peck to either stimulus after 10 s. acquired at similar rates e v e n though the initial stimuli w e r e
Refresher training and Phase 3 testing. In preparation for the not the same for both groups. T h e n u m b e r o f sessions n e e d e d
first substitution test, each pigeon received the following sequence to reach the .90 D R criterion in Phase 2 was 17.0 and 15.8 in
of refresher sessions: (a) training on the Phase 1 delayed simple G r o u p s I S T and OB, respectively, a nonsignificant differ-
discrimination with 0-s delays until the DR was at or above .90 for
a single session, (b) refreshers on the Phase 2 delayed simple
discrimination with mixed delays until performances recovered for
a single session to the level observed at the end of Phase 2, (c) a Table 5
single session with the off-baseline stimuli and contingencies, and Discrimination Ratios by Delay for Each Group in
(d) refreshers on the Phase 1 delayed simple discrimination with Experiment 1 Averaged Over the Last Five Sessions
mixed delays until performances recovered for a single session to of Their Phase 1 and Phase 2 Delayed
the level observed at the end of Phase 1. If more than three sessions Simple Discriminations (DSDs )
were required to recover performances on this last task, then the
Phase 1 DSD: Delay Phase 2 DSD: Delay
last three components of the entire refresher sequence were
repeated prior to testing. Group 0s 5s 10 s 0s 5s 10 s
During the five Phase 3 transfer sessions, pigeons in both groups
IST .90 .90 .90 .93 .92 .88
were tested on a delayed simple discrimination with red and green
OB .94 .94 .91 .94 .97 .95
initial stimuli and yellow and white test stimuli. For all subjects, the
end-of-trial reinforcement contingencies associated with red and Note. IST = initial-stimulus training; OB = off-baseline training.
56 URCUIOLI, DEMARSE,AND ZENTALL

ence, F(1, 6) = 0.04. The average DRs for the last five response rates to the subsequently reinforced line (2.54
mixed-delay sessions, shown in the right half of Table 5, pecks/s) than to the nonreinforced line (3.90 pecks/s),
again depict uniformly high discriminative performances. although this difference was not significant, F(1, 3) = 3.36.
Here, an ANOVA revealed a significant effect of delay and a Finally, pecking during the 5- and 10-s delay intervals (i.e.,
Group x Delay interaction, Fs(2, 12) = 5.48 and 4.36, at a dark center key) was generally infrequent in both
respectively, the latter no doubt reflecting the higher DRs at groups. For the 3 pigeons that did peck noticeably during the
the 5- and 10-s delays in Group OB than in Group IST. Once delays, all pecked more often when food was forthcoming
again, however, this variation seems rather minor. than when it was not.
Table 6 shows how each pigeon responded to the off-
baseline stimuli in Phase 2, both during presentation of the
Transfer Performances
stimuli themselves and during the subsequent delay inter-
vals. The data represent average response rates over the last Figure 2 shows the Day 1 test data for both the Phase 3
five off-baseline sessions during Phase 2 training (i.e., and Phase 4 transfer tests (right panel) and the delayed
during the last five sessions that alternated with the mixed- simple discrimination performances for the last baseline
delay task). The stimulus that signalled that food would be refresher session preceding each test (left panel). The filled
presented after the delay is indicated by an asterisk. and open circles plot the Phase 3 results, and the filled and
The off-baseline contingencies for Group OB produced open triangles plot the Phase 4 results. Note that the
moderate rates of pecking to both the red and green stimuli, conditions for the Phase 3 test reflect the original group
although rates to the stimulus signalling food after a delay labels (cf. Table 4): for Group IST, the substitution that
were slightly, but consistently and significantly, higher (3.34 created the transfer task involved initial stimuli trained
pecks/s) than to the stimulus signalling no food (2.67 within a delayed simple discrimination, whereas for Group
pecks/s), F(1, 3) = 17.09. The overall rates to the vertical OB, the substitution involved the off-baseline stimuli. On
and horizontal lines in Group IST showed more variability the other hand, the group legend in Figure 2 for the Phase 4
across subjects, but interestingly, the pattern was for lower test reflects the fact that the nature of the substitution was
reversed relative to Phase 3 (i.e., OB-IST indicates that
Group OB was tested in Phase 4 with initial stimuli trained
Table 6 within a delayed simple discrimination, whereas IST-OB
Response Rates (in Peck~s) to the Off-Baseline Stimuli indicates that Group IST was tested with its off-baseline
During Presentation and During the Delay Intervals stimuli).
Following Their Presentation in Experiment 2 Baseline performances on the refresher sessions immedi-
Response rate ately preceding each test were similar in the two groups. On
neither refresher was there a significant overall difference
Group and During After presentation between groups, Fs(1, 6) = 2.59 and 0.00 for the Phase 3
pigeon Stimulus presentation 5-s delay 10-s delay and Phase 4 baselines, respectively, nor a significant Group x
Group OB Delay interaction, Fs(2, 12) = 0.18 and 1.76 for Phase 3 and
1 R* 3.20 0.03 0.01 Phase 4 baselines, respectively.
G 2.66 0.04 0.03 By contrast, there was a substantial and significant
between-group difference on the first Phase 3 transfer test.
2 R 2.19 0.01 0.00 Specifically, although both groups showed positive transfer
G* 2.66 0.02 0.02
of performance to the novel initial stimuli (i.e., their DRs
3 R* 3.74 0.01 0.00 were greater than .50), the effect was greater in Group OB
G 2.59 0.06 0.04 than in Group IST, F(1, 6) = 8.09. There was also a
significant overall effect of delay, F(2, 12) = 39.42, but no
4 R 3.25 0.20 0.12 Group X Delay interaction, F(2, 12) = 1.19.
G* 3.76 1.80 1.93 The Phase 4 transfer test showed the same trend. The
Group IST group for which the novel initial stimuli in the delayed
1 V* 2.39 1.95 2.00 simple discrimination had been trained off-baseline (Group
H 2.92 0.22 0.18
IST-OB) showed stronger positive transfer of performance
2 V* 1.32 0.00 0.00 than the group for which those same stimuli had been
H 1.39 0.00 0.01 previously trained as initial stimuli in a delayed simple
discrimination (Group OB-IST). However, this difference,
3 V 5.24 0.30 0.15 although numerically large, was not significant in an ANOVA,
H* 3.82 0.09 0.08 F(1, 6) = 1.26. The overall effect of delay and the Group x
Delay interaction also were not significant, Fs(2, 12) = 0.72
4 V 6.03 0.18 0.10 and 0.69, respectively.
H* 2.61 1.29 1.42
Note. Data are averaged over the last five off-baseline sessions of
Phase 2 training. OB = off-baseline training; IST = initial-stim- Discussion
ulus training; R = red; G = green; V = vertical lines; H =
horizontal lines; * = stimulus followed by food after the delay The results of the first (Phase 3) test session showed that
interval. delayed simple discrimination performances transferred to
TRANSFER ACROSS DELAYED DISCRIMINATIONS 57

1.0 -~ BASELINE
1.0
TESTING - DAY 1

.9 .9
©

2.8
z

• IST - (Phase 3)
r...) .6 (3 O B - (Phase 3)
r~ • O B - I S T - (Phase 4)
I S T - O B - (Phase 4)

I I I I I I
0 5 10 0 5 10
DELAY (sec)

Figure 2. Discrimination ratios by delay for the two groups in Experiment 2. The left panel plots
performances on the last mixed-delay Phase 1 (baseline) refresher sessions preceding testing. The
right panel plots performances on the first Phase 3 transfer test (circles) and the first Phase 4 transfer
test (triangles). The conditions of testing for each group reversed from the Phase 3 to the Phase 4 test.
IST = initial-stimulus training group; OB = off-baseline training group; OB-IST = Group OB was
tested with initial stimuli trained within a delayed simple discrimination; IST-OB = Group IST was
tested with its off-baseline stimuli.

new initial stimuli in both groups. Replacing the initial cues governing performance on the retention test are much
stimuli from one delayed simple discrimination either with the same as those in two-alternative forced-choice tasks:
the initial stimuli from another (Group IST) or with stimuli namely, the outcome expectancies to which the initial
trained off-baseline but with similar outcome associations (sample) stimuli give rise. The proposed parallel is all the
(Group OB) disrupted the go versus no-go performances more compelling given that Honig et al. (1984, Experiment
relative to baseline but nonetheless maintained those discrimi- 2) showed that pigeons showed immediate positive transfer
nations well above the level expected by chance alone (i.e., of their go/no-go delayed conditional discrimination perfor-
.50). Moreover, and in contrast to Experiment 1, the mances to novel initial stimuli trained off-baseline if those
substitution of initial stimuli trained off-baseline did not stimuli were associated with the same outcomes as the ones
produce weaker transfer than the substitution of the same they replaced. Honig et al. also found immediate negative
stimuli trained within another delayed simple discrimina-
transfer if the off-baseline stimuli were substituted for those
tion. Indeed, the Phase 3 transfer test showed a significant
having the opposite outcome associations.
effect in the opposite direction: Stimuli trained off-baseline
What is not immediately clear is why the transfer
were better able to maintain delayed simple discrimination
observed here was somewhat stronger to initial stimuli
performances in testing than those trained on-baseline. The
trained off-baseline than to those same stimuli trained within
same general pattern of results was reproduced in the second
(Phase 4) test, although in this case the on- versus off- a task like that used in testing. One possibility is that
baseline training effect was not significant. differential outcome expectancies develop more fully or
The finding that initial stimuli trained off-baseline are more strongly when discrete events, such as the test stimuli
effective substitutes for those that have acquired their in a delayed simple discrimination, do not intervene between
properties in a delayed simple discrimination itself is not the presentation of the signalling stimuli and the end-of-trial
surprising given the transfer effects reported elsewhere in outcomes. Another possibility is that the between-group
the differential outcome literature. In matching-to-sample effect is more apparent than real given that the level of
paradigms, for instance, pigeons immediately transfer their transfer by Group IST was lower than that which has been
choice performances at high levels of accuracy to novel observed in similar groups in previous experiments (cf.
samples, which, through off-baseline Pavlovian pairings, Group P in Experiment 1 of the present study; also cf. Group
share the same food versus no-food associations as the EE in Urcuioli & Zentall, 1992, Experiment 1). Neverthe-
samples they replace (Peterson, 1984; Urcuioli, 1990; Ur- less, this ambiguity should not obscure the main finding:
cuioli & DeMarse, 1996). Apparently, in go/no-go delayed namely, that on- versus off-baseline training does not have
simple discrimination tasks such as those studied here, the the same effect on transfer to novel initial stimuli as it does
58 URCUIOLI, DEMARSE, AND ZENTALL

on transfer to novel test stimuli in delayed simple discrimina- the prior context in which the test stimuli were trained--
tions. resembles similar findings in the Pavlovian literature on
occasion setting. For example, in both serial feature-positive
and serial feature-negative discriminations, the enhance-
General Discussion
ment and suppression, respectively, of conditioned respond-
The two experiments of the present study reveal substan- ing to the target by the feature does not transfer to new
tial differences in the substitutability of new (but familiar) targets that have been partially reinforced off-baseline
stimuli for the initial and test stimuli of a delayed simple (Holland, 1986, Experiment 3; Lamarre & Holland, 1987,
discrimination. Experiment 1 showed that accurate go/no-go Experiment 2; Wilson & Pearce, 1990). By contrast, these
delayed simple discrimination performances could be main- same studies have shown that transfer to new targets will
tained when the test stimuli were replaced by others that had occur if the target stimuli have been trained within other
been trained in another delayed simple discrimination but feature-positive or feature-negative discriminations. One
not by stimuli with an equivalent reinforcement history exception to this pattern of results was reported by Rescorla
acquired off-baseline. Experiment 2, on the other hand, (1989) in a serial feature-negative autoshaping experiment
showed that delayed simple discrimination performances with pigeons. Rescorla found that the feature did transfer its
transferred immediately to novel initial stimuli with the suppressive properties to a new target that was reinforced
same differential outcome associations as the initial stimuli (continuously) off-baseline. However, this discrepant result
they replaced and, more important, that this transfer did not could have arisen from generalization between the character-
depend on whether those associations were acquired within istics shared by the training and transfer targets (i.e., both
another delayed simple discrimination or off-baseline. appeared as lights on the top as opposed to the bottom half of
The results of Experiment 1 mean that transfer of delayed the pecking key).
simple discriminations cannot be explained by a combina- Indeed, it is worthwhile to consider the similarities and
tion of retrospective coding of the initial stimuli plus differences between the Pavlovian occasion-setting para-
inattention to the test stimuli. In other words, performances digm and the delayed simple discrimination task. For
in these tasks depend on the particular stimuli appearing on example, in a serial feature-positive task, the target stimulus
the retention test even though the retention-test stimuli are is reinforced if preceded by another stimulus (the feature)
completely irrelevant to the reinforcement contingencies. By but not otherwise. In a delayed simple discrimination,
contrast, the results of Experiment 2 indicate that following responding to the test stimulus is reinforced if it is preceded
training on a delayed simple discrimination with differential by one initial stimulus but not if it is preceded by another.
outcomes, it does not matter what initial stimuli signal those Thus, the delayed simple discrimination task becomes a
outcomes nor does it matter how the to-be-substituted serial feature-positive discrimination if the initial stimulus
stimuli have been trained (viz., on- or off-baseline). To- on the nonreinforced trials is omitted. Conversely, omitting
gether, the combined results provide further support for a the initial stimulus on the reinforced trials would change a
prospective coding (outcome expectancy) interpretation of delayed simple discrimination into a serial feature-negative
delayed simple discrimination performances. What remains discrimination (i.e., reinforcement would follow the test
to be determined is the precise mechanism by which the test stimulus unless it was preceded by the initial stimulus or
stimuli allow those outcome expectancies to exert appropri- feature). Could it be, then, that these procedural differences
ate discriminative control on the retention test. are inconsequential and that the processes governing perfor-
The present findings also have parallels in other areas of mances in the two paradigms are similar if not identical?
the conditioning and memory literatures. Regarding initial The parallel between the on- versus off-baseline effects on
stimulus substitutability, for example, we have already transfer to new test or target stimuli clearly encourages such
mentioned a number of other differential outcome studies a view. But there also seem to be important differences in
using two-choice and go/no-go paradigms in which transfer regard to the substitutability of the initial stimuli or features.
of performance was observed to novel initial or sample For example, in the occasion-setting literature, serial feature-
stimuli that acquired differential outcome associations out- positive performances do not transfer to novel features that
side of the general task in which they were tested (e.g., have been trained as simple Pavlovian CS + s (e.g., Rescorla,
Honig et al., 1984; Peterson, 1984; Urcuioli, 1990). Further- 1985, 1987). In other words, even though the feature in
more, transfer has also been observed when the initial or training uniquely signals upcoming reinforcement, other
sample stimuli used in testing were trained within the stimuli with a similar association acquired off-baseline do
context of the target task (e.g., Edwards et al., 1982). not augment responding to the target stimulus. This indicates
Together, this entire collection of results indicates that when that responding to the target in the training task is not
discriminative performances come under control of the controlled by any reinforcement expectancy that might be
animal's differential outcome expectancies, it does not conditioned to the feature. If it were, then any stimulus
matter in what context those expectancies develop. As long producing a similar expectancy ought to readily substitute
as the initial or sample stimuli reliably signal different for that feature. Although features are interchangeable with
end-of-trial outcomes, the animal's anticipation of those one another if all are trained in feature-positive tasks
outcomes can continue to guide performances that have (Rescorla, 1985, 1987; see also Davidson, Aparicio, &
previously developed in their presence. Rescorla, 1988), this effect is apparently confined to such
The contrasting dependence of continued discriminative on-baseline conditions. The same is clearly not true for the
responding on the nature of the test stimuli--in particular, initial stimuli in the delayed simple discriminations studied
TRANSFER ACROSS DELAYED DISCRIMINATIONS 59

here and in a variety of other differential outcome tasks. Honig, W. K., & Thompson, R. K. R. (1982). Retrospective and
These initial stimuli readily substitute for the ones used in prospective processing in animal working memory. In G. H.
training independently of whether their differential associa- Bower (Ed.), The psychology of learning and motivation:
tion to reward is the result o f on- or off-baseline training. Advances in research and theory (Vol. 16, pp. 239-283). New
This difference does not preclude overlapping associative York: Academic Press.
Honig, W. K., & Wasserman, E. A. (1981). Performance of pigeons
mechanisms, of course. It could very well be, for instance,
on delayed simple and conditional discriminations under equiva-
that outcome expectancies that are known to be effective lent training procedures. Learning and Motivation, 12, 149-170.
discriminative cues in many working memory tasks might Jenkins, H. M., & Moore, B. R. (1973). The form of the auto-
also act as occasion setters in Pavlovian paradigms if the shaped response with food or water reinforcers. Journal of the
conditions of training promoted such control. To take a Experimental Analysis of Behavior, 20, 163-181.
simple example, if two feature-positive discriminations were Lamarre, J., & Holland, P. C. (1987). Transfer of inhibition after
trained concurrently such that one feature indicated that its serial feature negative discrimination training. Learning and
target would be followed by one reinforcer (e.g., food), Motivation, 18, 319-342.
whereas the other feature indicated that its target would be Peterson, G. B. (1984). How expectancies guide behavior. In H. L.
followed by a different reinforcer (e.g., water), responding to Roitblat, T. G. Bever, & H. S. Terrace (Eds.), Animal cognition
(pp. 135-147). Hillsdale, NJ: Erlbaum.
each target might be specifically augmented by (i.e., transfer
Rescorla, R. A. (1985). Conditioned inhibition and facilitation. In
to) new features that have been trained as Pavlovian CS + s R. R. Miller & N. E. Spear (Eds.), Information processing in
for those same reinforcers (cf. Brodigan & Peterson, 1976; animals: Conditioned inhibition (pp. 299-326). Hillsdale, NJ:
Jenkins & Moore, 1973). Such a demonstration, if success- Erlbaum.
ful, would suggest that the associative as well as the physical Rescorla, R. A. (1987). Facilitation and inhibition. Journal of
attributes of stimuli can serve as occasion setters in Pavlov- Experimental Psychology: Animal Behavior Processes, 13,
ian situations. 250-259.
Rescorla, R. A. (1989). Simultaneous and sequential conditioned
inhibition in autoshaping. Quarterly Journal of Experimental
References
Psychology, 41B, 275-286.
Brodigan, D. L., & Peterson, G. B. (1976). Two-choice conditional Rodger, R. S. (1975a). The number of non-zero, post hoc contrasts
discrimination performance of pigeons as a function of reward from ANOVA and error rate. I. British Journal of Mathematical
expectancy, prechoice delay, and domesticity. Animal Learning and Statistical Psychology, 28, 71-78.
& Behavior, 4, 121-124. Rodger, R. S. (1975b). Setting rejection rate for contrasts selected
Capaldi, E. J., Birmingham, K, M., & Alptekin, S. (1995). post hoc when some nulls are false. British Journal of Mathemati-
Memories of reward events and expectancies of reward events cal and Statistical Psychology, 28, 214-232.
may work in tandem. Animal Learning & Behavior, 23, 40-48. Roitblat, H. L. (1980). Codes and coding processes in pigeon
Carter, D. E., & Eckerman, D. A. (1975). Symbolic matching by short-term memory. Animal Learning & Behavior, 8, 341-351.
pigeons: Rate of learning complex discriminations predicted Urcuioli, P. J. (1990). Some relationships between outcome expect-
from simple discriminations. Science, 187, 662-664. ancies and sample stimuli in pigeons' delayed matching. Animal
Cohen, J. S., Galgan, R., & Fuerst, D. (1986). Retrospective and Learning & Behavior, 18, 302-314.
prospective short-term memory in delayed response tasks in rats. Urcuioli, P. J., & DeMarse, T. B. (1996). Associative processes in
Animal Learning & Behavior, 14, 38-50. differential outcome discriminations. Journal of Experimental
Cook, R. G., Brown, M. F., & Riley, D. A. (1985). Flexible memory Psychology: Animal Behavior Processes, 22, 192-204.
processing by rats: Use of prospective and retrospective informa- Urcuioli, P. J., & Zentall, T. R. (1986). Retrospective coding in
tion in the radial maze. Journal of Experimental Psychology: pigeons' delayed matching-to-sample. Journal of Experimental
Animal Behavior Processes, 11, 453-469. Psychology: Animal Behavior Processes, 12, 69-77.
Davidson, T. L., Aparicio, J., & Rescorla, R. A. (1988). Transfer Urcuioli, P. J., & Zentall, T. R. (1990). On the role of trial outcomes
between Pavlovian facilitators and instrumental discriminative in delayed discriminations. Animal Learning & Behavior, 18,
stimuli. Animal Learning & Behavior, 16, 285-291. 141-150.
DeMarse, T. B., & Urcuioli, P. J. (1993). Enhancement of matching Urcuioli, E J., & Zentall, T. R. (1992). Transfer across delayed
acquisition by differential comparison-outcome associations. discriminations: Evidence regarding the nature of prospective
Journal of Experimental Psychology: Animal Behavior Pro- working memory. Journal of Experimental Psychology: Animal
cesses, 19, 317-326. Behavior Processes, 18, 154-173.
Edwards, C. A., Jagielo, J. A., Zentall, T. R., & Hogan, D. E. Wasserman, E. A. (1986). Prospection and retrospection as pro-
(1982). Acquired equivalence and distinctiveness in matching to cesses of animal short-term memory. In D. E Kendrick, M. E.
sample by pigeons: Mediation by reinforcer-specific expectan- Rilling, & M. R. Denny (Eds.), Theories of animal memory (pp.
cies. Journal of Experimental Psychology: Animal Behavior 53-75). Hillsdale, NJ: Erlbaum.
Processes, 8, 244-259. Weisman, R. G., Bruce, R., & Beninger, R. J. (1987). Simple and
Holland, P. C. (1986). Transfer after serial feature positive discrimi- conditional discrimination in rats: The effects of delay and
nation training. Learning and Motivation, 17, 243-268. scopolamine. Learning and Motivation, 18, 274-287.
Honig, W. K., & Dodd, P. W. D. (1986). Anticipation and intention Wilson, E N., & Pearce, J. M. (1990). Selective transfer of
in working memory. In D. E Kendrick, M. E. Rilling, & M. R. responding in conditional discriminations. Quarterly Journal of
Denny (Eds.), Theories of animal memory (pp. 77-100). Hillsdale, Experimental Psychology, 42B, 41-58.
NJ: Erlbaum.
Honig, W. K., Matheson, W. R., & Dodd, P. W. D. (1984). Outcome Received September 18, 1996
expectancies as mediators for discriminative responding. Cana- Revision received March 28, 1997
dian Journal of Psychology, 38, 196-217. Accepted March 31, 1997 •

You might also like