You are on page 1of 6

JOURNAL OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR VOLUME 5, NUMBER 3 JULY, 1962

THE EFFECT OF MULTIPLE SA PERIODS ON RESPONDING


ON A FIXED-INTERVAL SCHEDULE'
P. B. DEWS
HARVARD MEDICAL SCHOOL

The effect of repeated interruption of FI responding by short SA presentations on the pattern


of increasing frequency of responding through the interval has been studied. Although the
SA profoundly changed the pattern of responding during their presentation, the general scal-
loped pattern of Fl responding survived. The implication of these findings for understanding
the role of chaining of responses in FT patterns is discussed. It is suggested that chaining is
not a necessary condition for the scalloped pattern.

This is the first of a series of papers on mediating behavior is generally considered


behavior maintained by fixed-interval (FI) to be comprised of chained responding, and
schedules of positive reinforcement (Ferster & the early members of a chain of responses
Skinner, 1957, Chapter 5). affect the later members because the interven-
When organisms are exposed to Fl sched- ing members constitute mediating behavior.
ules of reinforcement, a pattern of responding T'o establish a sequence of responses as being
commonly emerges in which the frequency chained or as constituting mediating behavior,
of responding increases through the interval however, it is not sufficient to demonstrate that
(Ferster 8c Skinner, 1957, Chapter 5). This in- the sequence is consistent and could so func-
crease gives rise to a scalloped appearance of tion; it must be explicitly demonstrated that
the cumulative responses: time curves. In changes in the sequence disrupt the chain or
discussions as to the genesis and maintenance prevent mediation. This paper is concerned
*of this pattern, recourse has been made to the with the role of chained responding as mediat-
concepts of chained responding and mediating ing behavior in the maintenance of a pro-
behavior. A chain of responses is a sequence gressive increase in rate through the interval.
in which each response functions as a dis- If the orderly progression of rates of re-
criminative (or eliciting) stimulus changing sponding on Fl were mediated by chaining of
the probability of occurrence of a further re- the recorded response, the rate in any short
sponse. Mediating behavior is a sequence of period, ti to ti + at, in the interval should be
responses between two events that serves to primarily determined by the rate in the pre-
transmit the behavioral influence of one event ceding short period, ti - At to ti. Under these
to that of the other. The events may be re- circumstances, any influence that disrupts the
sponses, and the influence may be "trans- responding for an appreciable period during
mitted" in time forward (as in the postulated the interval should destroy the orderly pro-
mediating behavior between recorded re- gression of rates through the interval. It was
sponses on a DRL schedule) or backward (as arranged that an SA was repeatedly presented
when mediating behavior is suggested to during each Fl. This came to disrupt the pat-
"transmit" to a particular response the rein- tern of key-pecking responses during the
forcing effects of a delayed reinforcement) presentation of SA. It has been found that
(Ferster & Skinner, 1957, p. 729). The two the statistical increase in the tendency' to
concepts of chained responding and mediating respond through the interval, and even the
behavior are, of course, closely related. Most general scalloped pattern of individual in-
tervals, survived this program of repeated
'The experiments described were in collaboration interruptions. Therefore, the chaining of key-
with W. H. Morse, and with the help of Mrs. B. Booth
and Mrs. C. Jackson, under Grants M-2094 and 2165 pecking responses must not be necessary for
from the National Institute of Mental Health, USPHS, the maintenance of this common character-
and the Eugene Higgins Trust. istic of Fl responding.
369
370 P. B. DEWS
alternate 60-sec periods through the interval;
MATERIALS, METHODS, AND specifically, the HL periods were 2, 4, 6, 8,
PROCEDURE and 10. At the end of the 10th period, which
The subjects were four male White coincided with the end of the interval, the HL
Carneaux pigeons, maintained in the usual continued until a response occurred. This
way at close to a "running weight" of about response was reinforced, of course. Thus, no
80% of their weight on free feeding. The response made in the absence of the HL was
apparatus, response, and food reinforcer were reinforced; and so the periods without HL
standard. The key was transilluminated by may be referred to properly as SA periods. This
white lights. The "houselight" (HL) was a procedure was continued for a number of
25-watt GE type 101 F bulb projecting from sessions: Bird 40, 34 sessions; Bird 44, 22
the top of the rear wall (i.e., that opposite to sessions; Bird 152, 37 sessions; and Bird 204,
the wall carrying the manipulandum and 35 sessions.
magazine) of the pigeon compartment. All On both procedures, there was no clear
birds had had extensive and varied exposure trend in the day-to-day changes in perform-
to a variety of schedules before these experi- ance after the first few sessions. Ordinarily,
ments; they had all been subjected to Fl pro- the birds were subjected to five daily sessions
cedures for protracted periods. per week. Definitive information was assem-
The basic schedule was Fl 500 sec TO 250 bled from the last 10 "control" days, a "con-
sec. That is, the first response made after the trol" day being defined as one that was pre-
key had been transilluminated for 500 sec led ceded by a day on which an identical session
to presentation of food; following food presen- had been run. At least 10 sessions on each
tation, there was a 250-sec period during which procedure had occurred before the first of the
there were no lights in the chamber; then the last 10 control days, except for Bird 204 on
key was transilluminated, and another cycle the simple Fl 500 sec TO 250 sec. For this
was in progress. (A 900-sec, limited-hold contin- bird, the 10th session was included.
gency was included in the program; but be-
cause this apparently was never actually
operative in concluding an interval during RESULTS
this series of experiments, it will not be con- On the simple Fl 500 sec to 250 sec pro-
sidered further.) The daily session consisted cedure, all birds developed the characteristic
of 11 Fl TO cycles. Responses made in the
- Fl performance (Fig. 1). Following introduc-
first cycle were not used for computational tion of alternative periods with HL, the rate
purposes. Thereafter, responses were cumu- of responding gradually fell in the absence
lated over the 10 fixed intervals in 50-sec of the HL (Fig. 1).
compartments; that is, all responses occurring Figure 2 shows the mean rates of responding
in the first 50 sec following onset of transillu- in the successive 50-sec compartments during
mination of the key in all 10 intervals were the last 10 control days. Since there were 10
recorded on one digital counter, then all intervals per session, each bar is the mean of
occurring in the second 50 sec on a second 100 periods of 50 sec. Responding is clearly
counter, and so on through the 10 compart- suppressed in the no-HL periods of Proce-
ments comprising the 500-sec fixed interval. dure 2. In spite of this, the overall tendency to
These compartments and the corresponding respond in the successive HL periods shows a
time periods will be referred to by the ordinal progressive increase highly similar to that in
numbers of their chronological sequence. the corresponding periods during operation
of Procedure 1 when there were no interven-
Procedure ing SA periods. There is even a progressive in-
In the first part of the experiment (Pro- crease in mean responding during consecutive
cedure 1), there was no HL. The birds were SA periods. If the rates of responding in the
subject to the Fl 500 sec TO 250 sec for: Bird SA periods are multipled by 3.5, the pattern
40, 64 sessions; Bird 44, 66 sessions; Bird 152, of the bar graph becomes as shown in Fig. 3.
26 sessions; and Bird 204, 22 sessions. It crudely reproduces the pattern with no SA
In the second part of the experiment periods. The figure 3.5 was obtained from a
(Procedure 2), the HL was present during proportionality formula:
4~s<,>tBoS~ J.
EFFECT OF MULTIPLE SA 371

2 (R's in periods 1, 3, 5, 7, 9 on Procedure 1)


compared to corresponding periods of inter-
z (R's in periods 2, 4, 6, 8, 10 on Procedure 1)= vals on Procedure 1 such as those occurring
when SA periods are superimposed on a VI
I (R's in periods 1, 3, 5, 7 on Procedure 2) X [SA] base line (Ferster, 1958; Reynolds, 1961). On
I (R's in periods 2, 4, 6, 7, 10 on Procedure 2)
the contrary, the rate in corresponding
where [SA] is the SA factor; it is an estimate (non-SA) 50-sec periods averages slightly lower
of the extent to which the stimuli correlated
with nonreinforcement suppress the tendency O's
x
wol4 Y Pm_ONoolh
to respond. This formula assumes that the
effect of SA is linearly multiplicative with the
tendency to respond, that is, that the SA re-
rs goo
roe soo g oo or low0 so *oo a"
Twime (SecondO

L IUTES

/I A

yL 4H 1/
o goo ooo o o Soo o

:S A-j.~
-/-

/i
-j -j
-j
?
li /i .j
"li" 7,.. rv

.,-!
rj

6..

Fig. 1. Tracings of comprete sessions on Procedure 1 mea


e000 n

and on Procedure 2 for all four birds. For each bird,


the session on Procedure 1 is shown above the session
for Procedure 2. The presence of the houselight on
Procedure 2 is indicated by the downward off-setting of
the cumulative record. The pairs of records are, from
above down, respectively, from Birds 40, 44, 152, and
204.
Fig. 2. Mean rates in successive 50-sec compartments
of Fl. The bar graphs show each bird singly, as la-
duces the frequency of responding by a fixed belled; the bottom row shows the simple arithmetic
percentage irrespective of the absolute rate of means, period by period, for the four birds.
responding. The justification for this assump-
tion is the faithfulness with which the con- than that on Procedure 1 (Fig. 2). The
stant factor converts the bar graph of Pro- individual 50-sec HL periods tended to show
cedure 2 to resemble that of Procedure 1 at "miniature" Fl patterns of responding, as the
all periods through the interval. enlarged sample in Fig. 4 shows, particularly
There was po general increase in rate of for Birds 40 and 204. The rates in the terminal
responding in the presence of the HL as parts of the later (in interval) 50-sec periods
372 P. B. DEWS
were frequently higher than any on Proce- niscent of a "goal-gradient" (Hull, 1932) type
dure 1 (Fig. 1). This increase in rate may be of hypothesis. It should be noted that here
related to that on other schedules when time we are concerned specifically with a temporal
outs are introduced. gradient that should be susceptible to quanti-
tative validation.
DISCUSSION
The general pattern of Fl responding is
not disrupted by the interposition of repeated
SA periods during the interval. Therefore,
chaining of responses from moment to mo-
ment consecutively through the interval is
not necessary for maintenance of the over-
all scalloped pattern characteristic of Fl
responding.

Fig. 4. Two consecutive intervals from the final ses-


sion on Procedure 2 for each of the four birds to show
details of distribution of responses within 50-sec com-
0 partments. Conventions as in Fig. 1. Note the miniature
FI scallops in individual HL periods (shown most
b. clearly in the record of Pigeon 204) and the desultory
n responding in individual SA periods. Note also the high
0
terminal rates of individual HL periods late in the FI;
06 these rates exceed any seen on Procedure 1 (cf. Fig. 1).
to 500.
tn It may be argued that the Fl pattern does
a,
0 depend on "response chaining" but that the
a- response involved is not, or is not only, key
tA pecking. This view would necessitate the
0 further postulate that the response(s) com-
.I I
prising the continuous chain through the in-
terval is compatible with, and uninfluenced
100 300 500
by, rate of pecking, while being competent
Time (Seconds) to determine rate of pecking. This is rendered
Fig. 3. Bar graph of mean rates on Procedure 2 when untenable by examination of local changes in
SA rates have been multiplied by 3.5. This bar graph rate during the successive periods of the Fl.
should be compared with those of the bottom row of
Fig. 2. There is a clear indication of scalloping in
the SD periods; miniature Fl's emerge. During
The rate of responding during the period SA periods, responding tends to be irregular,
ti + at is not determined predominately by with some tendency for the rate to fall. A
the rate of responding in period ti At,; for
- second type of mediating behavior would have
many values of ti, it is much more importantly to be postulated for the miniature Fl and a
determined by the absolute position of t, in third for control of SA responding. All these
the interval. In other words, there appears mediating behaviors would have to be mutu-
to be an underlying gradient of increasing ally independent except for their effects on
tendency to respond that continues through key-pecking behavior. This stretches the cre-
the interval; this gradient is manifest in the dulity; surely, the burden of proof rests with
responding both in the presence and absence anyone postulating such a collection of
of the HL, even though the absolute response behaviors.
rates differ by a factor of several-fold depend- How could Fl contingencies operate directly
ing on the stimulus conditions. This is remi- to produce a progressive increase in tendency
EFFECT OF MULTIPLE SA 373
to respond through the interval? It has been all subsequent responses in the FR are to
shown that presentation of reinforcing stimuli reinforcement, and, therefore, the greater the
can have a retroactive enhancing effect on retroactive enhancing effect of that reinforce-
responses (in the sense of making those re- ment. This will tend to increase the rate of
sponses more likely to occur in the future) responding, which in turn will tend to bring
that occurred as long as 100 sec previously the responses closer to reinforcement, which
(Dews, 1960). In those experiments, the tend- will increase the rate further. Thus, there is,
ency to respond was severely suppressed by in effect, a positive feedback situation, in
reinforcement postponing contingencies in which random increases in rate will tend to
the schedule. The experiments point to the be self-enhancing. Similar interpretations can
possibility that reinforcement following a re- be given to other schedule performances that
sponse by periods even longer than 100 sec may have been described; but their validation
lead to the miaintenance of substantial rates depends on specific quantitative information
of responding, provided the tendency to re- that is not now available. Further speculation
spond was not opposed by other factors. This is not merited at the present time.
sort of situation obtains under Fl schedules Second, they emphasize the danger of casual
of reinforcement. If reinforcement occurs at attribution of mediating properties to be-
time T, responding during the period T - havior. In the desire to present a continuous
ti- At to T - ti is reinforced, after a delay causal account, there has been considerable
of ti, by presentation of the reinforcing stim- tendency to "fill in" intervals of time with
uli; and so, responding during the correspond- behavior presumed to bridge the gap. Much
ing period is maintained in subsequent in- supposed "mediating behavior" has the status
tervals. If this view is correct, the progressive of a hypothetical intervening variable or, at
increase in rate of responding through the best, as for "proprioception," of an intervening
fixed interval would be based on a declining variable with hypothetical properties as a
retroactive rate-enhancing effect of the rein- discriminative stimulus. It should be remem-
forcing stimuli as the delay between response bered that it is not enough to establish a
and reinforcement is increased (Dews, 1960). mediating role to show that behavior occurs
Of course, in any particular interval the fixed and that it could so function. It must be
reference point for the organism must be the shown that disruption of that behavior abol-
start of the interval rather than the future ishes or seriously impairs the consistent re-
reinforcement; but under ordinary conditions, lationship of the events between which the
t1 see from the beginning of the Fl uniquely behavior is supposedto mediate. Responding
defines an instant that is T - ti before through the Fl could plausibly function as
reinforcement. mediating behavior, but apparently it does
Two matters of rather general importance not do so importantly.
arise out of these findings. First, the view of The information in this paper is based on
the basis of the Fl scallop just presented is a single value of Fl and a single pattern of
contrary to the general opinion that accords introduction of SA periods. The fact that with
overwhelming importance to the terminal these particular values the pattern of Fl
inter-response time (the inter-response time responding persists in the face of interruptions
concluded by the reinforced response) in de- is competent to controvert the proposition
termining the pattern of responding engen- that the Fl performance is always dependent
dered by a schedule. It suggests a re-examina- on "response - chaining"; yet, it would be
tion of the interpretations of the modus desirable to have information on other dura-
operandi of other schedules that have been tions of Fl and other patterns of interruptions.
based on the assumption of the pre-eminent Such information will be presented later.
importance of the final inter-response time. A final point of interest, unrelated to Fl,
For example, the possibility should be con- concerns the information the data presented
sidered that the high rates of responding give on the operation of stimulus control. It
engendered by fixed-ratio schedules (FR) may was noted that the bar graph for Procedure 2
come about as follows: The higher the average could be made to resemble that for Proce-
rate of responding on an FR schedule, the dure I by multiplying the rate of responding in
closer, temporally, the initial response and the HL periods by a constant factor of 3.5.2
374 P. B. DEWS
It is as though the "SA properties" of the HL REFERENCES
reduced the tendency to respond to 1/3.5 of
its value in the absence of the HL, more or Dews, P. B. Free-operant behavior under conditions of
delayed reinforcement. I. CRF-type schedules. J. exp.
less independently of what the absolute value Anal. Behav., 1960, 3, 221-234.
of that tendency to respond might be-at any Ferster, C. B. Control of behavior in chimpanzees and
rate over the range from its value at the be- pigeons by time out from positive reinforcement.
ginning of the interval to that at the end. It Psychol. Monogr. 1958, 72, No. 8 (Whole No. 461).
would be of great interest to know whether Ferster, C. B., and Skinner, B. F. Schedules of rein-
forcement. New York: Appleton-Century-Crofts,
this simple multiplicative effect of SA control, 1957.
and, indeed, other varieties of stimulus con- Hull, C. L. The goal gradient hypothesis and maze
trol, is generally applicable. learning. Psychol. Rev. 1932, 39, 25-43.
Reynolds, G. S. Behavioral contrast. J. exp. Anal.
Behav., 1961, 4, 57-71.
Received August 19, 1961

You might also like