Professional Documents
Culture Documents
Three human subjects detected unpredictable signals by pressing either of two telegraph
keys. The relative frequencies with which detections occurred for the two alternatives
were varied. The procedure included a changeover delay and response cost for letting go
of a key. All subjects matched the relative time spent holding each key to the relative num-
ber of detections for that key, in conformity with the matching law. One subject's per-
formance, which at first deviated from the relation, came into conformity with it when
response cost was increased. Another subject's performance approximated matching more
closely when the changeover delay was increased. The results confirm and extend the no-
tions that choice consists in time allocation and that all behavior can be measured on the
common scale of time.
Experiments on human vigilance suggest animals, the frequencies B1 and B2 have been
that detection of an uncertain signal rein- measured as numbers of brief, discrete re-
forces the behavior that makes it possible sponses (lever presses, key pecks) per unit of
(Holland, 1958; Rosenberger, 1973; Schroeder time. Some experiments, however, have stud-
and Holland, 1968, 1969). Schroeder and Hol- ied continuous activities, such as staying in a
land (1969) found that, when such detections location and staying in the presence of a light
could be made at two sites, the proportion of of a certain color (Baum, 1973; Baum and
responses (eye movements) at each site matched Rachlin, 1969; Brownstein, 1971; Brownstein
the proportion of detections at the site, just and Pliskoff, 1968). In these experiments, the
as the proportion of an animal's responses at frequencies of the alternative activities were
a choice alternative matches the proportion measured as the proportion of time spent in
of reinforcement obtained at the alternative them.
(see Herrnstein, 1970, for overview). In both Baum and Rachlin (1969) and Premack
types of experiment, the matching law ap- (1965; 1971) independently argued that all
pears to hold: activities can be measured on the common
scale of time. Both arguments point out that
B1 - counts of discrete responses translate into
B1 + B2 r + r2 (1) times spent responding as long as the time re-
quired per response remains constant.
where B1 and B2 are the frequencies of re- To extend the notion of time-based mea-
sponding at Alternatives 1 and 2, and ri and surement to human vigilance, the present ex-
r2 are the frequencies of reinforcement (or periment took up a suggestion of Premack
detection) produced by responding at Alter- and Collier (1966), that the time human sub-
natives 1 and 2. jects spend viewing stimuli can be a sensitive
In the experiment of Schroeder and Hol- measure of performance. Instead of requir-
land (1969), and in most experiments with ing discrete button pushes or eye movements,
the procedure allowed the subjects to watch
continuously for uncertain signals at either
1Supported by National Science Foundation Grant of two alternatives. The relative frequencies
GB-28493 to Harvard University. I thank D. J. Farley with which the signals occurred for the two
for his invaluable assistance. Reprints may be obtained
from the author, Department of Psychology, Harvard alternatives were varied, to see whether the
University, William James Hall, Cambridge, Massachu- relative times spent at the alternatives con-
setts 02138. formed to the matching relation.
45
WILLIAM M. BAUM
to equal the number of changeovers, except a slope close to 1.0. Doug produced a slope
for the most extreme distributions of time. slightly greater than 1.0, due primarily, as
with the bias, to the aberrant point in the
The Matching Relation lower-left corner of the graph. The addi-
Figure 1 shows the ratio of time holding the tional conditions with a 10-sec COD (trian-
left key (T1) to time holding the right key gles) produced preferences closely conform-
(T2) as a function of the ratio of the num- ing to the matching relation. In the first series
ber of signals detected with the left key (N1) (circles), John's preferences showed definite
to the number of signals detected with the undermatching (fitted slope = 0.67). Length-
right key (N2), in logarithmic coordinates. ening the COD to 10 sec (triangles) failed to
The matching relation appears as a broken correct the tendency. When the probability of
line of slope 1.0, passing through the point response cost [p(hit)] for releasing a key was
(1,1). The solid lines were fitted by the increased to 1.0 (squares), however, John's
method of least squares to the points from preference conformed to a line with a slope
the first series (circles) and John's second close to 1.0.
complete series (squares). The equation of Comparing the sequences of increasing and
each line appears beside it. The variable e, the decreasing preference for the left key re-
proportion of variance unaccounted for, esti- vealed little evidence of hysteresis ("lagging
mates goodness of fit. In no graph was less behind"; Stevens, 1957; Baum, 1974a). In-
than 90% of the variance accounted for. deed, Doug and Noa show the opposite tend-
If the fitted line fails to pass through the ency, which might be called "running ahead".
point (1,1), its intercept differs from zero, The aberrant point in Doug's graph resulted
and the preferences were biased in favor of from this tendency.
one side or the other. The generalized match-
ing relation predicts that bias should take this Changing Over
form (Baum, 1974b). It produces a value of Experiments in which the duration of the
w different from 1.0 in the equation: COD has been varied have shown that increas-
ing the COD produces preferences closer to
T= N2 (2). the matching relation (Brownstein and Plisk-
off, 1968; Fantino, Squires, Delbruck, and Pe-
The value of w, the antilogarithm of the in- terson, 1972; Herrnstein, 1961; Schroeder and
tercept, appears in each graph. Noa and John Holland, 1969; Shull and Pliskoff, 1967). Fig-
showed virtually no bias in the first series. ure 1 confirms this relation for Doug, but not
Doug showed a small bias in favor of the for John (compare triangles and circles). Pre-
right key, primarily due to the unusually low vious research has revealed another effect of
point in the lower-left corner of the graph. increasing the COD: decreasing the frequency
In the additional conditions with a 10-sec of changeover (Brownstein and Pliskoff,
COD (triangles), Doug showed no such bias. 1968; Herrnstein, 1961; Pliskoff, 1971; Schroe-
John showed a definite bias in favor of the der and Holland, 1969; Shull and Pliskoff,
left key in his second series of conditions (tri- 1967; Silberberg and Fantino, 1970; Stubbs
angles and squares). When asked at the end and Pliskoff, 1969). Besides the duration of
whether he enjoyed one colored floodlight the COD, frequency of changeover depends
more than the other, he replied that he pre- also on the degree of preference between the
ferred the red, the right key's light. This pref- alternatives: the greater the preference, the
erence would lead to a bias opposite to that lower the frequency of changeover (Baum,
observed. The anomaly might be explained, 1973, 1974a).
however, if the color preference extended to Figure 2 shows rate of changeover as a
the red signals. function of preference, the ordinate of Fig-
If the slope of the fitted line failed to ure 1. For Noa, John, and, to a lesser extent,
equal 1.0, then preferences were either stronger Doug, the expected inverted U-shaped rela-
than matching (overmatching; slope greater tion is apparent. The greatest rates of change-
than 1.0) or weaker than matching (under- over generally occurred near indifference, and
matching; slope less than 1.0). (See Baum, rate of changeover declined as preference for
1974b, for a fuller discussion.) Noa produced either alternative increased.
TIME ALLOCATION IN HUMAN VIGILANCE
10
6
4
2
.8
.4
.2
.1
.08
.04
20
T1
10
T2
6
4
2
.8
.4
.2
.1
.08
.04
.02
.01
.1 .2 .3 4 .6.81.0 2 34 6 8 .2 .3 4 .6.81.0 2 34 6 810 15
Ni
N2
Fig. 1. Ratio of time spent holding the left key (T1) to time spent holding the right key (T2) as a function of
the ratio of detections with the left key (N1) to detections with the right key (N2), in logarithmic coordinates.
Broken lines represent the matching relation. Solid lines were fitted either to circles or squares by the method
of least squares. The equation of the fitted line appears in each graph. See text for further explanation.
WILLIAM M. BAUM
10
6 NOA
2 -
O
1.0 0 co
0.6 0
04 -
Q2 -
0
2.0 -
DOUG 0 0
10 00 A0
0.6
2-04
AO00C
A
0.4
%%% 0.2 -
LU 0.1 _
0
w~~~~~~~~~
o 2t J
A
.06 0A 0
04- LF
0.2 -
T,
Fig. 2. Rate of changeover as a function of preference (ordinate of Figure 1), in logarithmic coordinates.
TIME ALLOCATION IN HUMAN VIGILANCE
Increasing the COD from 2 sec (circles) to ternative and measured for each alternative
10 sec (triangles) appears to have slightly de- the time from changing over to the alterna-
creased Doug's rate of changeover, but had tive until a changeover to the other alternative
no noticeable effect on John's. In contrast, in- -i.e., the cumulated interchangeover time.
creasing the probability of response cost from Graphing the proportion of responses and
0.33 (circles) to 1.0 (squares), which brought proportion of time as a function of the pro-
John's preferences into conformity with the portion of reinforcement, they found that
matching relation (Figure 1), noticeably de- the response counts seemed to produce a closer
creased his rate of changeover as well. approximation to the matching relation. Re-
plotting their data, however, in the coordi-
Subjects' Reports nates of Figure 1 reveals that the distribution
The subjects all reported finding the task of time closely paralleled the distribution of
boring. The procedure appeared to lose its responses (Baum, 1974b). The two functions
differed systematically
game-like quality after the first few sessions. ratios were biased in favor only in that the time
The competition for bonuses, however, ap- val schedule. The pigeons oftended the fixed-inter-
peared to retain interest throughout. to pause
more after pecking the key associated
Despite the absence of overt explanation fixed-interval schedule than the one associated with the
during the experiment, Noa and Doug re- with the fixed-ratio schedule. The bias took
vealed in the briefing at the end of the first the form predicted by the generalized match-
series that they had guessed several of the con- ing law (Equation 2).
tingencies-notably, the time-based scheduling In contrast, an experiment by Hollard and
of signals and the COD. John reported no Davison (1971) failed to confirm matching
awareness of the contingencies at the end with
of the first series, but was able to recall the responses while obtaining matching with
substance of the briefing at the end of the interchangeover times. They studied pigeons
second series, nearly five months later. choosing between food and electrical stimula-
tion of the brain, arranged according to con-
current variable-interval schedules. Their ex-
periment may constitute the only published
DISCUSSION confirmation of the notion that choice con-
The results support and extend the notion sists in allocation of time rather than response
that choice can be viewed as distribution of counts.
time between alternatives. Since all behavior Since the subjects in the present experiment
involves choice, in the sense that an organism spent virtually all of the session holding the
engaging in one activity is omitting another keys, no possibility arose of distinguishing re-
(Herrnstein, 1970; 1974), it may be that the sponse allocation from time allocation. Unless
most basic measure of the frequency of any there are periods in which the subject engages
activity is the time spent in that activity. in neither alternative activity, the response
Herrnstein (1974) has pointed out that gen- counts remain trivial. Only when the times
eralization of the matching law requires that and counts can vary independently can the
the various activities occurring in a situation superiority of one of the other measure be es-
be commensurate. Considerable evidence sug- tablished. Even when the two can vary inde-
gests that the common behavioral scale need pendently, they may covary nonetheless. One
be nothing more complicated than time subject, in a pilot experiment without re-
(Baum and Rachlin, 1969; Brownstein, 1971; sponse cost, produced such results when al-
Brownstein and Pliskoff, 1968; Premack, lowed to read a newspaper during the experi-
1965). I know of no data that contradict this ment; his responses tended to be of brief,
notion. constant duration. Accordingly, his distribu-
The one set of data that has been taken to tions of time and responses both approxi-
contradict it was gathered by LaBounty and mately matched the distribution of signals de-
Reynolds (1973), studying pigeons key peck- tected. If such covariance proved typical, it
ing for food on a concurrent fixed-interval would imply that continuous activities are in-
fixed-ratio schedule. These experimenters terrupted according to characteristic cycles.
both counted the number of pecks at each al- Further research might explore this possibility.
52 WILLIAM M. BAUM
The variations in rate of changeover with of the present experiment were designed to
COD and response cost observed in this exper- bring the subjects to a level of performance
iment (Figure 2) may shed some light on the comparable to a pigeon's after preliminary
role of the COD. For Doug, the increase in training to eat from a grain hopper and peck
COD both lowered the rate of changeover a key for grain.
(Figure 2) and improved approximation to The question remains, however, whether ex-
matching (Figure 1). The increase in COD planation of the procedure and purposes of
may have failed to affect John's performance the experiment influences the performance of
because it was too small. Afterwards, he re- human subjects. In this experiment, it seems
ported having noticed only the shortening of to have made little difference. Although Doug
the COD back to its original length. In con- was able to describe all the main features of
trast, he reported having noticed the increase the procedure by the end, still his approxima-
in response cost almost at once. An increase in tion to matching improved when the COD
COD long enough to be reported might have was lengthened. This suggests that his match-
affected John as the change to a 10-sec COD ing depended on more than verbalization of
affected Doug. On the other hand, the absence the necessity of changing keys and the time-
of an effect on John's performance and the based schedule of the signals. Likewise, John
smallness of the effect on Doug's suggest the began his second series with no better approxi-
possibility that response cost alone might have mation to matching, even though not only the
been sufficient to produce the results observed. procedure, but the purpose of the experiment
The use of response cost here may be com- had been explained to him at the end of the
pared with Todorov's (1971) use of electric first series. Neither this nor the lengthened
shock to punish pigeons' changeovers. Todo- COD appeared to affect his performance.
rov found that punishment decreased the rate
of changeover, and, for some intensities, pro-
duced better approximation to matching. REFERENCES
Both in the present experiment and Todorov's,
better matching seems to have depended on Azrin, N. H. and Holz, W. C. Punishment. In W. K.
Honig (Ed.), Operant behavior: areas of research
lowering the rate of changeover. and application. New York: Appleton-Century-
Killeen (1972) likened a concurrent sched- Crofts, 1966. Pp. 380-447.
ule to a multiple schedule in which the animal Baum, W. M. Time allocation and negative reinforce-
changes the components. In such a view, the ment. Journal of the Experimental Analysis of Be-
COD, by decreasing the rate of changeover, havior, 1973, 20, 313-322.
Baum, W. M. Chained concurrent schedules: rein-
would function to increase the durations of forcement as situation transition. Journal of the
the components. In this way, the COD may Experimental Analysis of Behavior, 1974, 22, 91-
achieve a temporal separation of the compo- 101. (a)
nents that allows them to be treated indepen- Baum, W. M. On two types of deviation from the
dently. Without this separation, discrimina- matching law: bias and undermatching. Journal of
the Experimental Analysis of Behavior, 1974, 22,
tion between them fails, resulting in under- 231-242. (b)
matching (Baum, 1974b), as in John's initial Baum, W. M. and Rachlin, H. C. Choice as time allo-
data (Figure 1, "JOHN-I"). cation. Journal of the Experimental Analysis of Be-
In research with humans, the experimenter havior, 1969, 12, 861-874.
Brownstein, A. J. Concurrent schedules of response-
inevitably faces the problem of choosing the independent reinforcement: duration of a rein-
correct method of instructing the subjects. forcing stimulus. Journal of the Experimental Anal-
Should one simply explain all the contingen- ysis of Behavior, 1971, 15, 211-214.
cies? This approach may liken the experiment Brownstein, A. J. and Pliskoff, S. S. Some effects of
to many real-life situations. Often, however, relative reinforcement rate and changeover delay in
response-independent concurrent schedules of rein-
possibly much more often, people find them- forcement. Journal of the Experimental Analysis of
selves faced with contingencies they can dis- Behavior, 1968, 11, 683-688.
cover only through experience. This and a Fantino, E., Squires, N., Delbruck, N., and Peterson, C.
desire to make the procedure as nearly com- Choice behavior and the accessibility of the rein-
forcer. Journal of the Experimental Analysis of Be-
parable as possible to procedures used with havior, 1972, 18, 35-43.
animals lead most researchers to minimize in- Fleshler, M. and Hoffman, H. S. A progression for
struction of human subjects. The instructions generating variable-interval schedules. Journal of
TIME ALLOCATION IN HUMAN VIGILANCE 53
the Experimental Analysis of Behavior, 1962, 5, 529- Premack, D. and Collier, G. Duration of looking and
530. number of brief looks as dependent variables. Psy-
Herrnstein, R. J. Relative and absolute strength of chonomic Science, 1966, 4, 81-82.
response as a function of frequency of reinforce- Rosenberger, P. B. Concurrent schedule control of
ment. Journal of the Experimental Analysis of Be- human visual target fixations. Journal of the Ex-
havior, 1961,4, 267-272. perimental Analysis of Behavior, 1973, 20, 411-416.
Herrnstein, R. J. On the law of effect. Journal of the Schroeder, S. R. and Holland, J. G. Operant control
Experimental Analysis of Behavior, 1970, 13, 243- of eye movements. Journal of Applied Behavior
266. Analysis, 1968, 1, 161-168.
Herrnstein, R. J. Formal properties of the matching Schroeder, S. R. and Holland, J. G. Reinforcement of
law. Journal of the Experimental Analysis of Be- eye movement with concurrent schedules. Journal
havior, 1974, 21, 159-164. of the Experimental Analysis of Behavior, 1969, 12,
Holland, J. G. Human vigilance. Science, 1958, 128, 897-903.
61-67. Shull, R. L. and Pliskoff, S. S. Changeover delay and
Hollard, V. and Davison, M. C. Preference for quali- concurrent schedules: some effects on relative per-
tatively different reinforcers. Journal of the Experi- formance measures. Journal of the Experimental
mental Analysis of Behavior, 1971, 16, 375-380. Analysis of Behavior, 1967, 10, 517-527.
Killeen, P. A yoked-chamber comparison of concur- Silberberg, A. and Fantino, E. Choice, rate of rein-
rent and multiple schedules. Journal of the Experi- forcement, and the changeover delay. Journal of the
mental Analysis of Behavior, 1972, 18, 13-22. Experimental Analysis of Behavior, 1970, 13, 187-
LaBounty, C. E. and Reynolds, G. S. An analysis of 197.
response and time matching to reinforcement in Stevens, S. S. On the psychophysical law. Psychological
concurrent ratio-interval schedules. Journal of the Review, 1957, 64, 153-181.
Experimental Analysis of Behavior, 1973, 19, 155- Stubbs, D. A. and Pliskoff, S. S. Concurrent respond-
166. ing with fixed relative rate of reinforcement. Jour-
Pliskoff, S. S. Effects of symmetrical and asymmetrical nal of the Experimental Analysis of Behavior, 1969,
changeover delays on concurrent performances. 12, 887-895.
Journal of the Experimental Analysis of Behavior, Todorov, J. C. Concurrent performances: effects of
1971, 16, 249-256. punishment contingent on the switching response.
Premack, D. Reinforcement theory. In D. Levin (Ed.), Journal of the Experimental Analysis of Behavior,
Nebraska symposium on motivation. Lincoln: Uni- 1971, 16, 51-62.
versity of Nebraska Press, 1965. Pp. 123-180.
Premack, D. Catching up with common sense, or two Received 3 May 1974.
sides of a generalization: reinforcement and punish- (Final Acceptance 15 August 1974.)
ment. In R. Glaser (Ed.), The nature of reinforce-
ment. New York: Academic Press, 1971. Pp. 121-150.