Professional Documents
Culture Documents
This research was supported by Grants GB 40313 and BNS 73-00956 A01 from the Na-
tional Science Foundation to the second author.
Requests for reprints should be sent to Gordon Pitz, Department of Psychology, Southern
Illinois University at Carbondale, Carbondale, IL 62901.
i Experiment 2 was presented as a thesis by the first author in partial fulfillment of the
requirements for the MA degree at Southern Illinois University at Carbondale.
184
Copyright© 1977 by AcademicPress, Inc.
All rights of reprodnctionin any form reserved. ISSN 0030-5073
E N C O D I N G AND R E C O G N I T I O N IN A DECISION TASK 185
received relatively little study, except for the special case of information
that consists of event frequencies. The problem of how probabilistic in-
formation of a quantitative kind is interpreted (encoded), and what inter-
nal representation of this information is stored, is the focus of the present
paper.
In one kind of decision task, subjects are presented with information
from two or more data-generating processes; they are then shown addi-
tional items of information, and asked to decide from which process the
new information has been generated. In a second kind of task, information
about a single process is given, and subjects may be asked to predict
further values for information generated from that process. Interestingly,
these two experimental paradigms are similar to tasks used in other areas
of psychology. For example, in the study of pattern recognition, subjects
may be presented with randomly varying patterns and asked to identify
the source of these patterns. The pattern recognition task is thus similar in
many respects to the first kind of decision task. Examples are the studies
by Posner and Keele (1968) that used random dot patterns, and a
study by Reed (1972) of the classification of schematic faces. Analogs of
the second kind of decision task are found in some studies of memory.
Subjects may be presented with information based on a single underlying
theme, and later tested for recognition of related information. Examples
are the studies of memory for geometric patterns (Franks & Bransford,
1971) and for sequences of symbols (Reitman & Bower, 1973).
We have made the assumption that the tasks described above are suffi-
ciently like decisions with uncertain information that processes observed
in studies of categorization and recognition memory are likely to be found
in studies of decision making. In particular, suggestions concerning the
encoding process in a decision task can be derived from studies in these
other areas. For example, a theoretical concept common to all of the
studies mentioned above is that of a "prototype," which is assumed to be
some kind of central tendency or underlying structure that is abstracted
from the original information. It is assumed that new information is then
evaluated in terms of its similarity to one or more prototypes. The concept
of a prototype is potentially valuable for explaining the encoding of prob-
abilistic information and its use in a decision task. For example, one
recent hypothesis concerning the process by which subjects make deci-
sions, proposed by Kahneman and Tversky (1972), is that of "representa-
tiveness." Kahneman and Tversky proposed that the probability of an
event is evaluated by judging the degree to which the event is representa-
tive of some underlying population. Posner (1973) has suggested that the
concept of representativeness is closely related to that of a prototype; an
event is representative of a population if it is similar to the prototype that
describes the population. If a prototype is taken to be a central tendency
186 HAMILOS AND PITZ
EXPERIMENT 1
In studying encoding processes, it is important to distinguish between
encoding that takes place automatically, as a consequence of trying to
store the inforraation, and those strategies of encoding that are affected by
the task for which the information is later to be used, Pitz (1976) showed
that a person's encoding of probabilistic information depends on the task
to be performed. In a simple memory task, all of the stimulus information
188 HAMILOS AND PITZ
ter than X. For the first decision, X was set to be tz + e, where tz was the
mean of the parent distribution and E was a randomly chosen value be-
tween -40 and 40. Following each decision, an iterative technique was
used to modify X. A decision that the next value would be less than X was
followed by a ~eduction in X; a decision that the next value would be
greater than X was followed by an increase in X. The magnitude of the
change in X was gradually reduced so that X would converge on an indif-
ference point, in effect the median of a person's subjective probability
distribution. That is, after a sequence of predictions, X should have
reached a value where the subject found that he was equally sure that the
next value would be less than or greater than X. The average value of X
over the final four decision trials was taken as a measure of the subjective
median.
Recognition task. For the recognition test, six targets were selected
from the original set of nine items. The selected targets were chosen so as
to provide information concerning both serial position effects and the
effect of rank c~rder on recognition responses. Three targets were used for
evaluating serial position effects, either the first or second item presented,
either the eighth or ninth item presented, and either the fourth, fifth, or
sixth item pre,~ented. The choice of specific items was random on each
trial. To evaluate rank order effects, the presented items were rank or-
dered from smallest to largest, and three items were selected as targets.
Those chosen were either the smallest or largest value (first or ninth in
rank order), ei~Lherthe third or seventh in the rank order, and the fifth item
in the rank order (the sample median). With this procedure, some targets
were occasionally presented twice on one trial.
In addition to the six targets, six distractor items were chosen. Distrac-
tors for each target had the following properties: (a) they were not equal to
any target or ~.ny other distractor, and (b) the distance between the target
and its distractor was equal to or less than that for any other possible
distractor. A distractor item was generally one unit greater or less than its
associated target.
The 12 probes (six targets and six distractors) were presented sepa-
rately in random order. Subjects were told to respond " Y e s " if a recogni-
tion probe was an original sample value and " N o " if it was not. Subjects
also gave corffidence ratings of either 1, 2, or 3 for each response. A
confidence rating of 1 indicated that a subject was not certain of the
validity of his response; a confidence rating of 3 indicated that the subject
was certain of his response; a rating of 2 indicated an intermediate level of
confidence.
Procedure. During the first session, the nature of the experiment was
explained to subjects. Three practice trials were given, followed by as
many trials a,; would fit into the one-hour session. There was a minimum
190 HAMILOS AND PITZ
Results
Recognition data were analyzed in terms of average confidence for each
target and its associated distractor. The confidence ratings were used in
such a way that zero indicates a "Certain N o " response and 5 a "Certain
Yes" response. Data were analyzed using analysis of variance, and ef-
fects significant at the .01 level will be reported. In addition, Bayesian
likelihood ratios will be reported as a posteriori measures of the believa-
bility of the null hypothesis, using the method of Jeffreys (1961). This
method gives the ratio of the likelihood of the data given the null
hypothesis to the likelihood of the data given a diffuse alternative
hypothesis. Jeffreys gives an equation that is a good large-sample approx-
imation to the likelihood ratio.
Figure 1 shows average confidence ratings as a function of serial posi-
tion. The data show a typical serial order effect; targets early or late in the
sequence were recognized with increased confidence, while there were no
differences in average confidence for the distractors (which of course, had
no serial position except insofar as they were numerically similar to items
presented early or late). The data were analyzed for all four groups of
subjects. For the effect of serial position on the target-distractor differ-
ences, F(2, 104) = 5.35. The quadratic component of this effect is a
ENCODING AND RECOGNITION I N A D E C I S I O N TASK 191
0 ,,0 TARGETS
~ DISTRACTORS
3.6-
N_) 3 . 4 -
Z
3.2-
13
U- 3 . 0 -
Z
~2.8-
9 2,6-
2.4-
I/J
> 2.2-
2,0-
1.8-
--4-- I I
OR 2 4,5 OR 6 8 OR 9
SERIAL ORDER POSITION
FIG. 1. Average confidence for targets and distraetors as a function of serial order posi-
tion, Experiment 1.
measure of the deviation of the central value from the two extreme values?
For this effect the likelihood ratio was .13, roughly 8 to 1 against the
null hypothesis. A more important question is whether there was any
indication of an interaction between the serial order effect and task condi-
tion. The data for the incidental decision/recognition group exhibited
hardly any serial position effect when plotted separately. The overall
interaction, however, was not significant. For differences between groups
among the quadratic components of the serial position effect (the one
component of the interaction that might be important), t(104) --- 2.06,
giving an equivocal likelihood ratio of 1.61. We concluded tentatively that
the basic processes underlying serial position effects were present, re-
gardless of the task condition, and leave open the possibility that some
combination of task conditions may eliminate the serial position effect.
Rank order effects are shown in Fig. 2. These are the data that indicate
the presence of prototype abstraction and learning of extreme values.
Note first the data for the recognition only group. Average confidence
was greater for items that were near the median and was depressed for
extreme items, F(2, 26) = 5.55. The linear portion of the effect provides a
suitable test of the ordering of average confidence values as a function of
the deviation of an item from the median. The likelihood ratio for the
2 B y u s i n g a test of the quadratic effect, we do not mean to imply that the serial order
positions in Fig 1 form an interval scale. Rather, quadratic (and linear) effects have been
used as measures of rank order relationships among averages.
192 HAMILOS AND PITZ
TARGETS
0 0 TARGETS 0-----0 Decision-recognition
~- DISTRACTOR~ 0-.--.-0 recognition-Decision
3.8, 3.8- 0 0 decision-Recognition
3,6- 3.6-
3,4- 3.4-
~J 3 . 2 - ~) 3.2-
Z Z
~ 3.0- uJ
¢t 3 . 0 -
FIG. 2. Average confidence for targets and distractors as a function of rank order position,
Experiment 1. Capitalized terms represent the primary task; terms in lower case are the
incidental tasks.
linear effect was .21, roughly 5 to 1 against the null hypothesis. While
recognition confidence was clearly greater for targets than for distractors,
there was no difference in the shape of the functions. For the interaction,
F(2, 26) = 0.14; for the linear portion of the interaction effect, the likeli-
hood ratio was 4.83 (in favor of the null hypothesis). This result portrays a
prototypical prototype effect: an increased confidence that items near the
sample median had been seen earlier, but no difference in discriminability
of items. The same data were subjected to a signal detection analysis
(Green & Swets, 1966), computing d' and response criteria separately for
each subject. This analysis showed a lowered average response criterion
for items near the median, (i.e., a greater proportion of "Yes" responses),
but no difference in d' values. An analysis of the accuracy of the Y e s - N o
recognition responses gave results equivalent to those using confidence
ratings.
Data for the other three groups were similar to each other, except that
performance for the incidental recognition/decision group was somewhat
superior to performance for the others. Comparison of that group with the
other two combined gave a nonsignificant t(39) = 2.37, likelihood ratio =
.57. For the most part, average confidence for the distractors exhibited
the prototype effect seen for the recognition only group. Average confi-
ENCODING AND RECOGNITION IN A D E C I S I O N TASK 193
dence was depressed for extreme distractors; if distractors came from the
middle of the distribution, subjects were relatively more confident that
they had been seen before. With targets, however, the effect was differ-
ent. There was generally an increased confidence for extreme targets.
Data for the three decision groups were analyzed using repeated-
measures ANOVA. The difference in confidence between targets and
distractors clearly increased as items became more extreme, F(2, 78) =
11.72, likelihood ratio = .002. This result provides strong evidence for the
extreme values hypothesis, indicating a greater ability to discriminate
extreme sample items from similar but new distractors. When the data
were analyzed using signal detection theory, there was an increase in d'
for extreme items. The effect was the same for all three groups involved in
the decision task; for the interaction effect with groups, F(2, 78) = 0.36,
with likelihood ratios for components of the interaction greater than 9.0 in
favor of the null hypothesis.
Performance in the decision task was only of incidental interest. How-
ever, an analysis of decision performance was carried out to look for
differences between the groups. The analysis used the estimated median
of the subjective probability distribution (the final value of X in the deci-
sion task), and related the final value to the set of nine sample items. Two
questions may be asked of the analysis: First, what characteristics of the
sample items best predict the estimated subjective median? Second, how
good is such a prediction? The analysis used a multiple regression
technique, conducted separately for each subject. The details of the pro-
cedure have been given by Pitz et al. (1976). Several sample statistics
were used te, predict the estimated subjective median; the best predictor
(in terms of r 2, the proportion of common variance) was the mean of the
sample items, as was the case in the Pitz et al. study, and the three
decision groups all gave similar results. The sample mean was compared
as a predictor with the sample median and sample midrange, using r 2 as
the dependent variable. There was no interaction effect between the three
predictors and the three groups, F(4, 78) = 2.30; no component of the
interaction suggested any systematic difference between groups.
The accuracy of prediction can be taken as a measure of the reliability
of a subject's decision performance. It was evaluated by computing stan-
dard errors of prediction for each subject. The average standard error for
the incidental decision/recognition group was larger than that for the other
two decision groups. However, it was not sufficiently large to justify a
strong concJ_usion that performance was less orderly for the incidental
decision group. Comparing that group with the other two gave t(39) =
1.57, likelihood ratio = 2.45. We concluded that the incidental decision
group was probably performing the decision task about as well as the
groups for whom the decision task was important. It was also clear that,
194 H A M I L O S A N D P1TZ
3 Variance and skewness were varied in Experiment 1, but randomly, and the results were
not separable by variance magnitude or skewness.
196 HAMILOS AND PITZ
Recognition rusk. Only rank order effects were examined during the
recognition stage. The nine sample items were rank ordered, and the first,
third, fifth, seventh, and ninth items were used as targets. Five distractors
were chosen, one for each target, according to the same principles used in
Experiment 1. The recognition task for the subject was identical to that
used in Experiment 1.
Procedure. During the first session, the nature of the experiment was
explained to subjects, and they were given 20 trials on the median estima-
tion task. For one group of subjects, the recognition test was given prior
to the decision task; for the second group, the decision task was given
first. In order to minimize any carryover effects, there was a delay of one
week between the first and second session. During the second session, the
procedure was identical except that the tertile estimation task was used.
Additional details concerning the procedure have been given by Hamilos
(Note 1).
Results
In examining the average confidence judgments, a significant task order
by probe-type interaction showed that discrimination between targets and
distractors was better when the recognition task preceded the decision
task, as would be expected. Otherwise, there was no evidence of any
effects due to task order or the decision task, and the data were pooled
across levels of these variables. Average confidence as a function of rank
order is shown in Fig. 3 for targets and distractors and for positively and
negatively skewed distributions. Two significant interactions were ob-
served and are illustrated in Fig. 3, a probe type by rank order interaction,
F(4, 88) = 7.48, and a distribution skew by rank order interaction, F(4, 88)
= 6.63. The triple interaction involving all three variables was not sig-
nificant, F(4, 88) = 0.46.
The major results of Experiment 1 were replicated in Experiment 2.
Since both minimum and maximum values were used as targets, the dis-
tractor data exhibit a quadratic effect. For the quadratic component of the
confidence function for distractors, F(1, 88) = 57.85, with a likelihood
ratio of less than .0001. Average confidence was approximately constant
for targets, rather than increasing for extreme targets as in Experiment 1.
However, the discrimination between targets and distractors was greater
for extreme items, as shown by the probe type by rank order interaction.
An analysis of the quadratic component of the interaction gave a likeli-
hood ratio less than .0001. These data provide further evidence for both
the abstraction of prototypes and the noting of extreme values.
The interaction effect involving distribution skew was the result of an
increase in confidence towards the mode of the distribution. Differences
in the linear components of the functions in Fig. 3 for positive and nega-
198 HAMILOS AND PITZ
2.2-
ILl
,> 2.0-
1,8"
1.6"
\
1.4-
1" I I I I I
1 3 5 7 9
RANK ORDER POSITION
FIG. 3. Average confidence for targets and distractors from positively and negatively
skewed distributions as a function of rank order position, Experiment 2.
4 We were not able to perform this analysis for the tertile task because of the limited space
available in the computer controlling the experiment, and the larger space required by the
tertile estimation program.
ENCODING AND RECOGNITION IN A DECISION TASK 199
REFERENCES
Anderson, N. HI. Information integration theory: a brief survey. In D. H. Krantz, R. C.
Atkinson, R. D. Luce, & P. Suppes (Eds.), Measurement, psychophysics, and neural
information processing. San Francisco: W. H. Freeman, 1974. Vol. 2.
Barresi, J., Robbins, D., & Shaii~ K. Role of distinctive features in the abstraction of related
concepts. Journal of Experimental Psychology, 1975, 104, 360-368.
Bransford, J. D., & Franks, J. J. The abstraction of linguistic ideas. Cognitive Psychology,
1971, 2, 331-350.
Franks, J. J., & Bransford, J. D. Abstraction of visual patterns. Journal of Experimental
Psychology, 1971, 90, 65-74.
Green, D. M., & Swets, J. A. Signal detection theory andpsyehophysics. New York: Wiley,
1966.
Huttenlocher, J. Constructing spatial images: a strategy in reasoning. Psychological Review,
1968, 75, 550-560.
Jeffreys, H. Theory of probability. Oxford: Clarendon Press, 1961. 3rd ed.
Kahneman, D., & Tversky, A. Subjective probability: a judgment of representativeness.
Cognitive Psychology, 1972, 3, 430-454.
Neumann, P. G. An attribute frequency model for the abstraction of prototypes. Memory
and Cognition, 1974, 2, 241-248.
Peterson, C. R., & Beach, L. R. Man as an intuitive statistician. Psychological Bulletin,
1967, 68, 29-46.
Pitz, G. F. Memory and frequency estimation processes in decision making. Memory and
Cognition, 1976, 4, 132-138.
Pitz, G. F., Leung, L. S., Hamilos, C., & Terpening, W. The use of probabilistic information
in making predictions. Organizational Behavior and Human Performance, 1976, 17,
1-18.
Posner, M. I. Cognition: an introduction. Glenview, Ill.: Scott Foresman, 1973.
202 HAMILOS AND PITZ
Posner, M. I., & Keele, S. W. On the genesis of abstract ideas. Journal of Experimental
Psychology, 1968, 77, 353-363.
Potts, G. R. Storing and retrieving information about ordered relationships. Journal of
Experimental Psychology, 1974, 103, 431-439.
Reed, S. K. Pattern recognition and categorization. Cognitive Psychology, 1972, 3,
382-407.
Reitman, J. S., & Bower, G. H. Storage and later recognition of exemplars of concepts.
Cognitive Psychology, 1973, 4, 194-206.
Restle, F. Speed of adding and comparing numbers. Journal of Experimental Psychology,
1970, 83, 274-278.
Rosch, E., & Mervis, C. B. Family resemblances: studies in the internal structure of
categories. Cognitive Psychology, 1975, 7, 573-605.
Slovic, P., & Lichtenstein, S. Comparison of Bayesian and regression approaches to the
study of information processing in judgement. Organizational Behavior and Human
Performance, 1971, 6, 649-744.
Tversky, A., & Kahneman, D. Judgement under uncertainty: Heuristics and biases. Sci-
ence, 1974, 185, 1124-1131.
REFERENCE NOTE
1. Hamilos, C. A. The encoding and recognition of probabilistic information in decision
tasks. Unpublished M.A. thesis, Southern Illinois University at Carbondale, 1976.
RECEIVED: December 6, 1976