You are on page 1of 8

Perception &: Psychophysics

1992. 51 (5), 465-472

The role of attention


in different visual-search tasks
MARY J. BRAVO and KEN NAKAYAMA
Smith-Kettlewell Eye Research Institute, San Francisco, California

Observers viewed displays containing a variable number of distractors of one color and a tar·
get of another color. In some experiments, the target and distractors maintained their color from
trial to trial; in others, they reversed unpredictably. Observers made a speeded two-choicejudg·
ment concerning either the presence, the color, or the shape of the odd-colored target. With only
one exception, all of these conditions produced the same pattern of results: reaction times reo
mained constant as the number of distractors increased. The exceptional result occurred when
observers judged the shape of the odd-colored target and the color of the target and distractors
reversed unpredictably. In this case, reaction times decreased as the number of distractors in-
creased. These results are interpreted in terms of the attentional requirements of the different
judgments and the mechanisms that guide attention.

Figure 1 shows an odd target located among homoge- models are incorrect or that they do not apply to target
nous distractors. Two observations have been made con- detection.
cerning such displays. First, the odd element' 'pops out, " Our hypothesis is that the models of attentional guidance
that is, it immediately attracts attention. And second, the are correct, but that they do not apply to detection. In other
target is readily detected regardless of the number of words, detection does not require attention to be focused
distractors in the display (Donderi & Zelnicker, 1969; on the target. Of course, some decisions do require selec-
Egeth, Ionides, & Wall, 1972; Neisser, 1963; Treisman tive attention to be directed to the target, and it is these
& Gelade, 1980). It has been assumed that these two ob- tasks that should show the pattern of reaction time data
servations are causally related: the target is easy to de- predicted by the models of attentional guidance. We tested
tect because it immediately summons attention (Duncan this conjecture by comparing the predictions of these
& Humphreys, 1989; Koch & Ullman, 1985; Yantis & models with the pattern of search times for various tasks
Ionides, 1984). performed with identical displays. Our expectation was
If we compare the predictions of models of attentional that these different tasks would produce different reac-
guidance with the results of detection experiments, this tion time results and that only tasks requiring focal atten-
relationship is less clear. As detailed below, these models tion would produce the results predicted by the models.
predict that under some circumstances the target should Before describing our experiments, we will discuss some
become easier to find as more distractors are added to models of how an odd target attracts attention.
the display. However, the results of detection experiments
do not support this prediction. When the target and dis- ATTENTION-GUIDING MECHANISMS
tractors have very different features, as in Figure 1, de-
tection times are found to be unaffected by increasing There are two general ways in which attention may be
numbers of distractors. When the target and distractors directed to an odd target (Duncan & Humphreys, 1989;
have similar features, detection times are found to in- LaBerge & Brown, 1989; Wolfe, Cave, & Franzel, 1989).
crease with increasing numbers of distractors (Duncan & When observers are looking for a particular target (say,
Humphreys, 1989). Thus, the slope of detection times a red diamond), they can use their knowledge of the tar-
plotted against number of distractors is usually either zero get's characteristics to guide attention; the control of at-
or positive, but rarely negative (for an exception, see tention has a large top-down component. When observers
Bacon & Egeth, 1991). Since the models predict a nega- are looking for an odd element but do not know its charac-
tive slope, these empirical results indicate that either the teristics, then the stimulus must playa greater role in guid-
ing attention. In this case, the control of attention is largely
bottom-up. Although we will use the terms top-down and
This work was supported by Grant IF32 EY06155 from the NEI and bottom-up to label these two types of attention-guiding
Grant 83-0320 from the AFOSR. We are indebted to Jeremy Wolfe and mechanisms, we do not mean to imply that one relies
Vera Maljkovic for their comments on an earlier version of this manu- solely on cognitive information and the other solely on
script. K. Nakayama is now in the Department of Psychology at Harvard
University. Correspondence should be addressed to M. J. Bravo, Smith-
stimulus information. Rather, the labels refer to the relative
Kettlewell Eye Research Institute, 2232 Webster St., San Francisco, weights of these two sources of information. Below we
CA 94115; e-mail: mary@skivs.ski.org. describe these two types of attention-guiding mechanisms.

465 Copyright 1992 Psychonomic Society, Inc.


466 BRAVO AND NAKAYAMA

Top-Down Mechanisms bottom-up models predict that for tasks that require focal
Treisman and Gelade (1980) suggested that the visual attention to be directed to a target with an unknown unique
system represents the distrib!ltion of each perceptual fea- feature, search times should decrease as the number of
ture in a functionaIfy separate map of visual space. There distractors increases.
are maps for vertical, green, movement to the right, etc. We now summarize our predictions for search tasks in-
Drawing on this notion, LaBerge and Brown (1989) pro- volving a target with a unique feature. (1) Two patterns
posed that if an observer knows the target's unique fea- of results are predicted for tasks requiringfocal attention:
ture, then he/she could use the appropriate feature map (a) When the target's unique feature is known, reaction
to guide attention. For example, if the target is known times should be independent of the number of distractors.
to be the only red element in the display, then the locus (b) When this feature is not known, reaction times should
of activity among red detectors may guide attention. The decrease with increasing numbers of distractors. (2) The
activity in other feature maps is ignored. Thus, if the tar- models mentioned above make no predictions for tasks
get and distractors are so different as to stimulate differ- that require distributed attention. We suggest that detec-
ent sets of feature maps, then this strategy will work tion is one of these tasks, and we know from previously
equally well regardless of the number of distractors in the reported detection experiments that whether the target is
display. However, this strategy requires that the observer known or unknown, reaction times will be unaffected by
know the target's unique feature. The following bottom-up distractor number.
mechanisms can operate in the absence of such knowledge.
EXPERIMENT 1
Bottom-Up Mechanisms Five Search Tasks
Koch and Ullman (1985) suggested that local inhibi-
tion within feature maps is responsible for the conspicuity This series of experiments (Experiments 1A-I E) exam-
of the target and its subsequent status as the focus of at- ines the pattern of reaction times for several search tasks.
tention. A similar idea has been proposed by Treisman So that they can be readily compared, the search experi-
(1988) in her revised feature-integration model of visual ments used the same displays and the same observers. The
search. If several distractors share a feature (say, the same experiments differed only in the task the observer per-
color), the activity they generate in the corresponding fea- formed. The tasks varied in two ways. First, they dif-
ture map will be suppressed through some form of mutual fered in the two-<:hoice judgment the observer made about
inhibition. (For a review of the physiological evidence the odd~olored target; the observer judged either the odd-
for such inhibition see Allman, Miezen, & McGuiness, colored target's presence, its color, or its shape. These
1985.) No such suppression will occur to the activity three judgments are based on information at different spa-
generated by the target's unique feature because it is not tial resolutions and so are likely to differ in their require-
subject to inhibition generated by other elements sharing ments for distributed versus focal attention. Second, we
this feature. The activity at each location is then summed changed the observer's prior knowledge of the target's
across maps, and attention is directed to the most active distinguishing feature. We accomplished this by keeping
location. Since the inhibitory connections between detec- the target and distractor colors the same from trial to trial
tors in each feature map are thought to be local, it is rea- in some experiments and by reversing them unpredictably
sonable to suppose that this process is most effective when in others. These two conditions are termed consistent map-
the distractors are close together. ping and variable mapping, after Schneider and Shiffrin
An alternative bottom-up mechanism comes from (1977). These two methods for sorting the displays might
Julesz's proposal that pop out is the result of processes produce a variation in the strategy the observer used to
that detect feature gradients, or differences in the features search for the target. In the consistent-mapping condition,
of neighboring elements (Julesz, 1986). This idea posits the observer could search for a particular feature, whereas
mechanisms that compare the features of neighboring ele- in the variable-mapping condition, the observer must search
ments and then direct attention to the location of feature for the odd element. As depicted in Table I, the two map-
gradients. Because the gradient detectors operate only over ping conditions combined with the three judgments pro-
a limited region of space, this process is most effective duced a total of five experiments. Note that the cell cor-
when the physical distance between distractor and target responding to consistent mapping/color judgment is blank
elements is small. because the color judgment is meaningless when the ob-
Since both bottom-up mechanisms involve local com- server knows beforehand the target's color.
putations (between target and distractor in one case and
between distractors in the other), they both operate most Table 1
effectively when the spacing between elements is small. Five Search Tasks
Thus, when attention must be directed to an unknown tar- Mapping
get, search times should depend on the spacing between Judgment Variable Consistent
elements in the display. If display size is held constant, Shape a b
as in these experiments, then the average spacing will Color c
decrease as the number of distractors increases. These Detection d e
ROLE OF ATTENTION IN VISUAL SEARCH 467

Method repeated later in the session. Reaction times less than 200 rnsec or
Observers. Three practiced I psychophysical observers volun- greater than 2 sec were also discarded, and such trials were repeated
teered for these experiments. Only one of the observers, K.N., was later. Each experiment included an initial practice period involv-
aware of the purpose of the experiments. ing typically 240 trials. An experiment consisted of 480 correct trials
Stimuli. The displays contained red and green elements drawn (80 per level of distractor number) and was run in blocks of 80
on the black background of a computer monitor. The approximate trials, with 4 practice trials preceding each block.
luminance of the elements was 10 cd/m' , and that of the background The experiments differed in the following ways. Within an ex-
was 0.7 cd/m' . To ensure that the red and green elements were es- periment, the colors red and green were assigned to the target and
sentially equiluminant so as not to bias the detection of one or the distractors with either variable or consistent mapping. In the variable-
other, we used heterochromatic flicker photometry. Before par- mapping condition, displays with a red target and green distraetors
ticipating in the experiments, each observer viewed a I ° square were randomly interleaved among displays with a green target and
that alternated in color between red and green. While fixating a red distractors. Thus, on any given trial, the observer did not know
spot 3 ° from the square, the observer adjusted the luminance of beforehand the color of the target or the distraetors. In the consistent-
the red to minimize the perceived flicker of the square. The ob- mapping condition, these two display types were run in separate
server's equiluminance setting was then used to color the red and blocks so that before each trial the observer knew the color of the
green elements for that observer. target and distractors. In addition to the different mapping condi-
The colored elements were diamonds (0.8° x 1°) with 0.25° cut tions, the experiments differed in the speeded forced-ehoice deci-
off of either the right or left comer. To ensure that these two shapes sion the observer was asked to make. The decision was always be-
(left cut and right cut) were discriminable when presented at the tween two alternatives: either (1) present or absent in the detection
eccentricities used in this experiment (4.75°-8.4°), we presented experiment, (2) red or green in the color-identification experiment,
two observers with the experimental displays and monitored their or (3) left cut or right cut in the shape-identification experiment.
eye movements. Both observers were able to confine their eye move- The observers pressed the left mouse button to signal "present,"
ments to within I ° of a central fixation spot and at the same time "red," or "left cut" and the right mouse button to register "ab-
perform the shape discrimination with high accuracy (>95%). sent," "green," or "right cut."
The colored elements were drawn in randomly selected cells of
a 6 x 8 array (15.2" x 12.6°). The position of the elements within Results
the cells was jittered by 0.33°. Each display contained 3, 5, 9, 13,
The results for each of the three observers in the five ex-
25, or 48 elements, and all but one (the target) had the same color.
The position of the target was chosen randomly with the restric- periments are shown in Figure 2. Results from consistent-
tion that it not occur in the two columns closest to fixation. Fig- mapping experiments are plotted with open circles; results
ure I shows schematic representations of two such displays. The from variable-mapping experiments are plotted with filled
detection-task experiments required generating additional displays circles. The top two curves show the data from the shape-
in which the target was replaced by a distraetor on 50% of the trials. identification task, the middle curve shows the data from
In all five experiments, the number of distraetors was varied from the color-identification task, and the bottom two curves
trial to trial. Display size was held constant, so this variation in
the number of distraetors also resulted in a variation in the average
show the data from the target-detection task when the tar-
distance between elements in the display. get was present. We include the data from each subject
Procedure. The same procedure was used in the five search exper- to show the remarkable consistency of the results across
iments, with the only differences among experiments being (I) the observers. The pertinent observation concerns the shape
rule for mapping red and green onto the target and distractors and of these curves. Reaction times decrease as the number
(2) the two-alternative forced-ehoice judgment the observer was to of distractors increases for the shape-identification,
make. The procedural similarities are described first.
In all five experiments, the observers viewed the computer-
variable-mapping condition (top curve), and reaction times
generated displays from a distance of 70 em. A small fixation cross remain constant for all other tasks. Figure 3 Oeft) shows
was always visible at the center of the display screen, and the ob- the average for the three observers.
servers were asked to maintain fixation throughout each experiment. Figure 3 (middle) shows the averaged results for the
Stimuli were presented with a variable interstimulus interval (lSD, target-detection task when the target was absent. These
and the observers responded via a two-button mouse. The display data are plotted in a separate graph because search for
was presented until the observer responded. When the observer was
an absent target is logically very different from search
correct, the reaction time was recorded. When the observer was
incorrect, feedback was given and an error was recorded. Reac- for a present target.
tion times on incorrect trials were discarded, and the trials were Figure 3 (right) shows the average error rates for the
three observers. To determine whether a speed-accuracy
tradeoff is responsible for the decrease in reaction time
seen in the topmost curve in Figure 3 Oeft), we exam-


•• •• •••
<)
•• • ••
•• ined the correlation between error rates and reaction times
for this condition. No correlation was found, which indi-
•• .+. • •
•• •• ••• •••
cates that the observed reaction-time effect is not due to

• ••
+
() observers trading speed for accuracy as the number of
()
• • • ••••••••••• distractors changed.

Discussion
Our main finding is that when observers are asked to
Figure I. Schematics of representative stimuli for two distractor judge the shape of the odd-eolored target and the colors
densities. Actual stimuli consisted of red and green shapes drawn of the target and distractors reverse unpredictably, reac-
on a black background. tion times decrease as the number of distractors increases.
468 BRAVO AND NAKAYAMA

700
AR 700 ,
KN
~ shape
g +-
\
t ..
600 i... 600 't----.. ------_.
~
~ \ -6--------.
OO-o,~::::~-------Q
00- (H~---o-- - -- ---0
color
.g 500 +tt... --~------ ... 500 •
...... ---. ---- _--I

~
~
400
.. ,+----6--------.
&>-l.o----o--------\l 400
....... --.. - ------.
00.0-0-
-
0--------0
.
400 • ~ _--.. ------.. detection
..... 0--------<)
oo-u a ---
300 ..........~-~~-~~
3000 10 20 30 40 SO o 1020 3040 SO 3000 10 20 30 40 SO
Number of Distraetors Number of Distractors Number of Distractors

Figure 2. Average reaction time data for each of the three observers in the five different tasks. In each graph, the top
two curves show data from the shape-identification judgment, the middle curve shows data from the color-identification
judgment, and the bottom two curves show data from the target-cietection judgment. Open circles correspond to
COIL'Iistent-mapping experiments and filled circles to variable-mapping experiments. Error bars show one standard error.

This effect is found only when the task involves the ment under the variable-mapping condition, where the tar-
variable-mapping condition and the shape-discrimination get and distractor colors are reversing unpredictably.
judgment. What is unique about the variable-mapping con- Here, the target is defined in relation to the other elements
dition of the shape judgment? We will argue first, that in the display: the target is odd because it is different from
the spatial resolution required to perform the shape judg- the other elements in the display, which are all the same.
ment requires focal attention, and second, that the un- Simply noting the presence of an odd target could be done
predictable changes in the target's unique feature neces- without focusing attention on the target. In fact, focusing
sitate a largely bottom-up guidance of attention. attention on the target gives no additional information for
There is considerable empirical evidence suggesting that this task. Similarly, the color-identification judgment could
selective attention may trade off resolution and spatial ex- logically be accomplished without directing attention to
tent. That is, it is possible to attend to a large visual area the target. For example, if observers base this decision
with low resolution or a small visual area with fme reso- on a comparison of the number of occurrences of the dif-
lution (Bergen & Julesz, 1983; Eriksen & St. James, ferent colors, there is no obvious benefit in focusing atten-
1986). The necessity for this tradeoff is attributed to the tion on the target. However, in the shape-discrimination
limited amount of information that may be selected by at- experiment, the observer must determine which element
tention for higher level processes like pattern recognition. is the target and report about a second feature of that ele-
We assume that different judgments require different ment. In this case, there would be a benefit in focusing
amounts of spatial resolution. Consider the detection judg- attention on the target.

0.2
shape

0.1 ~ /·------~::::::::== ••• o


rP,I'·..••····
700 ~ O.O'--'--'-............~.........--'--...L-J
~. shape 0.2

:::~~~~~~~:~~~~:::::::::::::~
color

~
§.
~... ....-•........~~~~
_
detection
.. detection
(target absent)
0.1.\ ,......


-e.-

0.0L................-..-.........

-L-..........~...J

'Q 0.2
~ 400 .
~ cP:.()'·······Qo·················O 1P :::i'::::: ..
0.1
• ~. ..~===:=:::::::- ...
300 L...o.-J..~.L-<--..L~-'- ........ '0:1" -..
01020304050 o 10 20 30 40 50 0.0 10 20 30 40 50

Number of Distractors Number of Distractors Number of Distractors

Figure 3. Left: Reaction time data shown in Figure 2, averaged across observers. Open circles correspond to
consistent-mapping experiments and filled circles to variable-mapping experiments. Error bars show one standard
error. Middle: Average reaction time for the detection task when the target was absent from the display. Right:
Average error rates for the three observers.
ROLE OF ATTENTION IN VISUAL SEARCH 469

But the effect cannot simply be ascribed to the involve- EXPERIMENT 2


ment of a small attentional aperture in shape discrimination Replication of Set-Size Effect
since the effect did not appear under a different condition With Gabor-Patch Stimuli
involving this judgment. When the shape-discrimination
judgment was made under the consistent-mapping condi- The data from the first set of experiments show that
tion, reaction times were unaffected by the number of dis- the effect of distractors on visual search may depend on
tractors. Thus, the other critical requirement for the the observer's task. This suggests that "finding" a fea-
distractor-number effect is that the observer not know the ture target in a detection experiment is different from
target's color before the trial. We believe that the signif- "finding" a feature target in order to identify a subtle
icance of this requirement relates to the two classes of feature. We have argued that this difference has to do with
attention-guiding mechanisms discussed in the introduc- whether the task requires focal attention to be directed
tion. Recall that top-down guidance can direct attention to the target. Our results also suggest that different
to the target when the target's unique feature is known, attention-guiding mechanisms may be invoked depend-
and that the effectiveness of this mechanism is expected ing on the observer's prior knowledge of the target's
to be independent of the number of distractors. Bottom- characteristics. To examine the generality of our results,
up guidance is required when the target's unique feature we repeated the variable-mapping and consistent-mapping
is not known, and this mechanism depends on the num- experiments using different stimuli. Observers were again
ber of distractors. asked to make a fine spatial judgment concerning a non-
Thus, we claim the variable-mapping/shape-judgment unique feature of the odd element.
task is unique because it requires an attention-guiding
mechanism that is driven by largely bottom-up informa- Method
tion. However, the shape judgment may have also been We generated new stimuli consisting of Gabor patches 2 of either
unique in that the relatively high resolution required to high or low spatial frequency and with a vernier offset to the left
or right. Spatial frequency replaced color as the unique feature,
make this judgment may have caused the subjects to make
and the direction of a vernier offset replaced shape as the second,
eye movements. Since we did not monitor fixation dur- nonunique feature of the target. Observers were required to deter-
ing these search tasks, it is possible that our observers mine whether the vernier offset was to the right or left in the patch
made eye movements during the shape-judgment experi- with the odd spatial frequency. Figure 4 shows schematic repre-
ment but not during the other experiments. Thus, it could sentations of two of these displays. The procedure was the same
be argued that the different reaction-time pattern obtained as in Experiment I, and the details of the stimuli are given below.
The target and distractor elements were vertically oriented Gabor
for these judgments is related to the occurrence of eye
patches with spatial frequency centered on 3 cycles per degree or
movements for the shape judgments and the absence of on I cycle per degree. Each patch had a vernier offset 4 min to
eye movements for the other judgments. the left or right. These patches were drawn in the cells of a 4 x 3
Would this alter our interpretation ? We think not. If we array (15.2° x 12.6°) with a jitter of 0.66°. Displays contained 2,
assume for purposes of argument that the subjects made 3, 4, 6, or 12 elements.
saccades to the target location only when asked to judge Two observers participated in this experiment, one of whom had
the shape of the target, we need to consider if this would been involved in the previous experiment. 1lte other observer, R.O.,
was paid to participate. R.O. did not know the purpose of the ex-
change our explanation of the distractor-number effect. periment and had never before acted as an experimental observer.
First, we know that the observed effect of distractor
number cannot simply be due to the putative eye move- Results and Discussion
ment itself, since there was no such effect when the sub- The results of the two observers are given in Figure 5.
ject made a saccade to a target whose distinguishing fea- Although the two observers have very different reaction
ture was known. The effect must instead be related to times, possibly due to different levels of experience in
directing a saccade to an unknown target. Previously, we psychophysical tests, both show the same pattern of
had assumed that because the shape-discrimination task results. As with the previous experiment, reaction times
requires relatively high resolution, it involves a shift in decrease as the number of distractors increases only when
focal attention to the target. If we replace this assump- the distinguishing features of the target and distractor are
tion with the assumption that saccades involve a shift in
focal attention to the target, then we are left with our origi-
nal conclusion: tasks that require focal attention give the

,'~ 'I' 'I' '1'


pattern of results predicted by the attention-guiding mech-
anisms. Our new assumption, that saccades are preceded
by a shift in focal attention, is commonly made and has +
some empirical support (Fischer & Breitmeyer, 1987;
Groner & Groner, 1989; Mayfrank, Mobashery, Kimmig,
& Fischer, 1986; Posner, 1980; Remington, 1980). For
""f ,'~ ,'~
the remainder of this paper, we will assume that the ob-
servers were not making eye movements, but our interpre- Figure 4. Schematic of two stimuli composed of Gabor funcdons.
tation of these experiments would not change substantially In the actuaI experiment, luminance varied more smoothly as It was
if we were to assume the opposite. the product of a sinusoId and a Gaussian waveform.
470 BRAVO AND NAKAYAMA

700 900 0.125

U 650
KN
850
RO
0.100
...... - ..... _--
Q /0......... - ..

!6OO t.
"''t--+------ i
800
0.G75
\
\
~"CJ'
I
I .......
.......
'0
~
.;:: 550 750
0.050
§ 500 c>~'O'/o-------~ 700

~ 450
6SO 0.025

4OO0'--~2~4-""'6~8-1""'0---'12 600
0 2 4 6 8 10 12
O.OOO'--~~~~-~~
o 2 4 6 8 10 12
Number of Distractors Number of Distractors Number of Distraetors

Figure S. Left, middle: Reaction time to judge the direction of the vernier offset of the odd-spatial-frequency
target plotted apinst the number of dimactors in the display. Note the different values on the y-axes of these graplLoi.
Open circles represeut data from the comistent-mapping experiment; filled circles represent data from the variable-
mapping experiment. Error bars show one standard error. Right: Average error rates for the three observers.

interchanged unpredictably from trial to trial. And again, identification tasks, and in the following paragraphs, we
this effect cannot be ascribed to a speed-accuracy tradeoff consider the processes that might be involved in these tasks.
since there is no significant correlation between error rate We consider first the task of determining the color of
and reaction time. the odd-colored target. There are several strategies that
This second pair of experiments employed very differ- an observer could use to judge the color of the target. One
ent stimuli than did the previous experiments, and yet the strategy is to determine which color has the smaller num-
same overall pattern of results was obtained. When the ber of occurrences in the display. Increasing the number
unique feature of the target was consistent across trials, of distractors in the display would increase the difference
reaction times to identify a subtle feature of the target were in the number of occurrences of the two colors and
unaffected by the number of distractors. When the unique presumably facilitate this decision. A similar strategy is
feature of the target reversed unpredictably with the dis- to determine which color has more than one occurrence
tractor feature, reaction times decreased as the number in the display and then to choose the other color. Again,
of distractors increased. it is reasonable to expect that increasing the number of
distractors in the display would facilitate this decision.
GENERAL DISCUSSION However, we found that the reaction times to judge the
color of the target were unaffected by the number or
The pattern of our reaction time results reveals fun- distractors.
damental differences in the processes invoked by differ- It is also not clear how observers detected the presence
ent visual-search tasks. One difference can be seen in the of an odd target in the detection experiments. Processes
results of the three experiments involving different judg- similar to the attention-guiding mechanisms outlined in
ments under the variable-mapping condition. Reaction the introduction have been suggested. In the consistent-
times for the discrimination of a subtle feature of the tar- mapping/detection experiment, the observer could respond
get decrease as the number of distractors increases, while on the basis of the presence or absence of activity in the
reaction times to detect the target or identify its unique appropriate feature map (freisman & Gelade, 1980). And
feature are unaffected by the number of distractors. This in the variable-mapping/detection experiment, observers
discrepancy, we believe, is due to the involvement of fo- could use one of the bottom-up models to detect the
cal attention in the first case and distributed attention in presence of an odd element (Julesz, 1986; Koch & Ullman,
the others. A second difference among the processes in- 1985). But if the computations involved in these bottom-
volved in different visual-search tasks can be seen in the up mechanisms are local, then search times should be sen-
results of the two experiments involving shape identifi- sitive to the number of distractors in the display. Although
cation under different mapping conditions. If we assume there are numerous reports that the number of distractors
that the shape judgment requires focal attention, then these has no effect on searching for a readily segregated tar-
results suggest the existence of two classes of mechanisms get, Bacon and Egeth (1991) recently reported that de-
by which focal attention can be directed to the target. tection times may decrease as the number of distractors
These are (l) a largely top-down mechanism that requires increases. In our experiments, however, the same condi-
knowledge of the target and (2) a largely bottom-up mech- tions that produced a large effect for the shape judgment
anism that can operate without such knowledge. As dis- produced no effect for the detection judgment. Thus, our
cussed earlier, current models of bottom-up mechanisms observers are not using the same processes to find the tar-
predict our finding that reaction times falloff sharply as get for detection and shape identification. It also appears
the number of distractors increases. The models do not that the process they use for detection is insensitive to the
predict the results of the detection- and unique-feature- number of distractors.
ROLE OF ATTENTION IN VISUAL SEARCH 471

We favor an alternative explanation of the detection and In closing, we refer the reader to a general framework
unique-feature-identification results that relates to coarse- of vision proposed by Nakayama (1990) that has greatly
scale pattern matching. We assume that each of our tasks influenced our thinking about these experiments. The
involves the postattentive processes of pattern recogni- model has three components, as depicted in Figure 6. On
tion but that the particular pattern that is to be recognized the left of this figure, incoming sensory information is
depends on the observer's judgment. Sometimes the pat- encoded by a massively parallel system that represents
tern is that of an individual element, as in the shape judg- multiple features at multiple scales. This system has a
ment; other times it is that of the whole display, as in the pyramid-like structure, with each level in the pyramid re~
detection and unique-feature-identificationjudgment. Be- resenting the visual field at a different spatial scale. The
cause it is the attentional window that selects the infor- base of the pyramid is a very fine scale representation,
mation for pattern recognition, these different tasks re- and the apex is a very coarse representation. The amount
quire attention to operate in different ways. It is these of information contained at any level is directly related
different attentional operations that are reflected in the to the resolution of that level.
reaction time results. When the display as a whole is used On the right in Figure 6 is visual memory, an associa-
for pattern recognition, reaction time is unaffected by the tive network of icons or templates. Pattern recognition
number of distractors in the display. When only a part is accomplished by activating an icon in visual memory.
of the display is used, then attention must be directed to It is assumed that individual icons have a low informa-
the appropriate part. tion content. This assumption is based in part on the results
There are several ways attention may be directed, and of reading studies that assess the amount of information
each is associated with a characteristic pattern of reac- that is processed simultaneously (Legge, Pelli, Rubin, &
tion time results. We have already discussed top-down Schleske, 1985; Rayner, 1978).
mechanisms, which guide attention to a particular feature In the middle in Figure 6 is selective attention, the link
(flat-search function), and bottom-up mechanisms, which between the massive amount of information in the pyramid
guide attention to an odd target (negative-search function). and the small amount of information in an icon. Atten-
There is a third type of attentional guidance that we did tion can be thought of as an information bottleneck through
not see in these experiments but that has been reported which only a small set amount of information may pass.
by many others. A serial search through all elements in Attention-guiding mechanisms are required to select the
the display is required if discriminating between the tar- appropriate information from the pyramid to be passed
get and distractor requires focal attention. This type of on to visual memory.
search produces positive search functions (Estes & Wessel, This model offers an explanation of how the tradeoff
1966; Treisman & Gelade, 1980). between spatial extent and resolution is accomplished prior

Pyramid Attention Visual Memory

"·••
.--
o 0
00
attention is guided by
top-down and bottom-up
mechanisms
o
o
o

Figure 6. A schematic of the model proposed by Nakayama (1990) applied to the present results. Sensory
infonnation is encoded in a multiresolution pyramid. Attention selects the infonnation from the pyramid
that is to be used for pattern matching. The continUOWlIine depicts the selection of infonnatioD for the shape-
discrimination judgment. Attention-guiding mechanisms are required to direct attention to the appropriate
location within a high-resolution level of the pyramid. The hatched line indicates the selection of infonna-
tion for the detection judgment.
472 BRAVO AND NAKAYAMA

to pattern recognition. Depending on the observer's task, LEGGE, G., PELLI, D., RUBIN, G. S., '" ScHLESKE, M. M. (1985).
detailed information about a small spatial region may be Psychophysics of reading. I. Normal vision. Vision Research, 25,
239-252.
selected from a lev"l close t(1. the base of the pyramid or,
MAYFRANK, L., MOBASHERY, M., KIMMlG, H., '" FISCHER, B. (1986).
alternatively, information about the coarsest scene fea- The role of fixation and visual attention in the occurrence of express
tures may be selected from a level close to the apex. In saccades in man. European Archives of Psychiatry & Neurological
our experiments, observers knew before every trial the Sciences, 235, 269-275.
judgment, and thus the resolution, that would be required. NAKAYAMA, K. (1990). The iconic bottleneck and the tenuous link be-
tween early visual processing and perception. In C. Blakemore (Ed.),
This allowed them to select the appropriate level within Vision: Coding and efficiency (pp. 411-422). Cambridge: Cambridge
the pyramid before each trial. However, they did not know University Press.
the location of the target within the stimulus, and thus NEISSER, U. (1963). Decision-time without reaction time: Experiments
when high resolution was required, they had to draw on in visual scanning. American Journal of Psychology, 76, 376-385.
attention-guiding mechanisms to select the appropriate lo- POSNER, M. (1980). Orienting of attention. Quanerly Journal of Ex-
perimental Psychology, 32, 3-25.
cation within the high-resolution level of the pyramid. It RAYNER, K. (1978). Eye movements in reading and information pro-
is this latter step that is reflected in the unusual reaction cessing. Psychology Bulletin, 85, 618-660.
time results reported here. REMINGTON, R. W. (1980). Attention and saccadic eye movements. Jour-
nal ofExperimental Psychology: Human Perception & Performance,
6,726-744.
REFERENCES
ScHNEIDER, W., '" SHIFFRIN, R. M. (1977). Controlled and automatic
human information processing. I. Detection, search, and attention.
ALLMAN, J., MIEZEN, F., Ill: McGUINESS, E. (1985). Stimulus specific
Psychological Review, 84, 1-66.
responses from beyond the classical receptive field: Neurophysiological
TREISMAN, A. (1988). Feature and objects: The fourteenth Bartlett me-
mechanisms for local-global comparisons in visual neurons. Annual
morial lecture. Quanerly Journal ofExperimental Psychology, 4OA,
Review of Neuroscience, 8, 407-430.
201-237.
BACON, W., Ill: EGETH, H. (1991). Local processes in preattentive fea-
TREISMAN, A., Ill: GELADE, G. (1980). A feature-integration theory of
ture detection. Journal ofExperimental Psychology: Human Percep-
attention. Cognitive Psychology, 12, 97-136.
tion & Performance, 17,77-90.
WOLFE, J. M., CAVE, K. R., Ill: FRANZEL, S. L. (1989). Guided search:
BERGEN, J., Ill: JULESZ, B. (1983). Rapid discrimination of visual pat-
An alternative to the feature integration model of visual search. Journal
terns. I. E. E.E. Transactions on Systems, Man & Cybernetics, SMC-13,
of Experimental Psychology: Human Perception & Performance, 15,
857-863.
419-433.
DoNDERI, D. C., Ill: ZELNICKER, D. (1969). Parallel processing in visual
YANTIS, S., Ill: JONIDES, J. (1984). Abrupt visual onsets and selective
same-different decisions. Perception & Psychophysics, 5, 197-200.
visual attention: Evidence from visual search. Journal ofexperimen-
DUNCAN, 1., Ill: HUMPHREYS, G. W. (1989). Visual search and stimu-
tal Psychology: Human Perception & Performance, 10, 601-621.
lus similarity. Psychological Review, 96, 433-458.
EGETH, H., JONIDES, J., Ill: WALL, S. (1972). Parallel processing of multi-
element displays. Cognitive Psychology, 3, 674-698.
ERIKSEN, C. W., Ill: ST. JAMES, J. D. (1986). Visual attention within NOTES
and around the field of focal attention: A zoom lens model. Percep-
tion & Psychophysics, 40, 225-240. I. By practiced observers, we mean observers who have participated
EsTES, W. K., '" WESSEL, D. L. (1966). Reaction time in relation to in a variety of experiments and are familiar with psychophysical proce-
display size and correctness of response in forced-ehoice visual sig- dures. We have not included the observations from M.B. (the first author)
nal detection. Perception & Psychophysics, I, 369-373. because in the process of developing the test described in the present
FISCHER, B., '" BREITMEYER, B. (1987). Mechanisms of visual atten- research, she had large and differing amounts of practice on each task.
tion revealed by saccadic eye movements. Neuropsychologia, 25, In addition, in using her as an observer over many trials, we found that
73-83. some of the differences in reaction time described in this paper decrease
GRONER, R., '" GRONER, M. T. (1989). Attention and eye movement with very prolonged practice.
control: An overview. European Archives ofPsychiatry & Neurological 2. Gabor patches are spatially localized sine-wave gratings, whose
Sciences, 239, 9-16. modulation envelope is a two-dimensional Gaussian function. The Gauss-
JULESZ, B. (1986). Texton gradients: The texton theory revisited. Bio- ian window of the Gabor patches had a width of 0.62° when the enve-
logical Cybernetics, 54, 245-251. lope's amplitude was lie, and the suprathreshold area of the Gabor
KOCH, C., '" ULLMAN, S. (1985). Shifts in selective visual attention: patches subtended approximately 2°.
Towards the underlying neural circuitry. Human Neurobiology, 4,
219-227.
LABERGE, D., Ill: BROWN, V. (1989). Theory of attentional operations (Manuscript received August 19, 1991;
in shape identification. Psychological Review, 96, 101-124. revision accepted for publication December 27, 1991.)

You might also like