Professional Documents
Culture Documents
Correspondence to: Nancy L. Etcoff, Department of Brain and Cognitive Sciences, El@237,
assachusetts Insitute of Technology, Cambridge, MA 02139, USA.
*Supported by NH-I grant DC00565 to the first author. We thank Susan Carey, Paul Ekman,
Steven Pinker, and Gregg Solomon for comments, and Brian Kellner for technical assistance. Parts Gf
this research wet: txesented at the Fifth Conference of the International Society for Research on
Emotion, New Brunswick, New Jersey, July, 1990.
Subjects
Materials
tracted lips merged). This yielded two models for the continua anchored by an
angry face and three each for the other continua.
Facial expressions 231
Figure 1. Examples of stimuli from each emotion continuum. From /eft to right: angry-sad; angry-
afraid; angry-disgusted; happy-sad; happy-neutral; sad-neutral; happy-surprised; and
surprised-afraid.
232 N. L. Etcoff and J. J. Magee
ecause the stimuli consist of line drawings, some may argue t ings
are compromised because judg ade on ote,
however, that artificial stimuli are unavoidable: the design of a categorical
percepiion experiment requires a series of stimuli with eq
separating them, and such stimuli are not found in nature.
research on the categorical erception of speech, for
artificial synthesized speech. is also important to note
produced by the digitization program are quite detailed a
famous individuals have been found to be recognizabl
re exemplars of facial expressions (see t
nson and Perrear (1991) confirms th
ion: using the softwar
from experiments that had just used line drawings (Rhodes et al., 1987).
Procedure
category boundaries i
‘Pilot testing revealed that some subjects treated angry and disgusted as synonyms, so the terms
were distinguished for subjects by defining anger in terms of “injustice” and disgust as “repulsion.”
Facial expressions 233
&21%24364%5-708792-10
_-
Figure 2. For each emotion pair, the percentage of trials a face was ident@ed with a given emotion label (top), and the percentage of trials a pair of faces
was successfully discriminated (bottom). The dashed vertical lines show the category boundaries, estimated from the identification percentage.
Facial expressions 235
clay, 1972; MacMillan, Kaplan, & Creelman, 1977; reviewed in Harnad, 1987).
As Eimas, Miller, and Jusczyk (1987) argue, this does not weaken the basic
concept of categorical perception. Rather, it suggests that categorical perception
is not simply the result of an inability to discriminate the low-level physical
properties of the stimuli, but is the result of further processing whose effects sum
with the results of the lower-level discriminations. Thus our results are entirely
consistent with current definitions of categorical perception as a discontinuity in
discrimination at the category boundary of a continuum, with greater difficulties
in discriminating members of the same category than members of different
categories even though the amount of physical differences between both pairs is
the same (e.g., Cutting & Rosner, 1974; Harnad, 1987).
Interestingly, categorical boundaries are perceived not just between emotions
*The different degrees of freedom associated with the F-tests reflect the fact that some analyses
were done on 2-step and some on 3-step discriminations, and that slightly different numbers of
subjects discriminated the different continua: 13 subjects discriminated the angry-afraid and the
angry-sad continua, 12 subjects discriminated the happy-neutral, sad-neutral, afraid-surprised, and
happy-surprised continua, 9 subjects discriminated the anger-disgust continua, and 8 subjects
discriminated the happy-sad continua.
‘Note that some of the within-category pairs near the boundary involved faces in the no-man’s land
between clear categories. If they were seen by some subjects in some trials as belonging to one
category, those trials would have effectively been between-category comparisons. The contrasts
indicating categorical perception come out despite this diluting effect. When only within-category pairs
with meinbers in each of the clear categories are analyzed, the between-within contrasts are even
stronger for all pairs except those involving surprised, which remain nonsignificant.
236 N. L. Etcoff and J. J. Magee
but between emotions and non-emotions (neutral faces). This suggests that an
emotionally neutral face does not just correspond to a low degree of emotionality
but is perceived as its own category, and the point where an emotion becomes too
weak to have signal value is sharply perceived.
Although s&Sects could clearly labe! the surprised faces in the identification
task, they did not show categorical perception when discriminating them from
happy or afraid faces: pairs straddling the category boundaries were no easier to
discriminate than pairs within a category. The noncategoricality is due to surprise
itself; happiness and fear were categorically discriminated from other e
such as neutrality, sadness, and anger. Although surprised faces are
similar to afraid ones and are commonly confused with them, this does not
explain the noncategoricality, because it also occurs when s
nated from happiness, an expr ion which is physically dis
seldom confused with, surprise. oreover anger and
confused but are discri mated categorically.
surprise expression s gests that it is pe
emotions, combining with an emotion in perception rather than defining a
category that is mutually exclusive with it. This finding is consistent with the lack
of unequivocal evidence that surprise expressions are universally labeled as such,
and with arguments that surprise may not be an emotion at all but a cognitive
state that easily combines with true, valenced emotions such as fear
(see Ekman, 1984; Oatley & Johnson-Laird, 1987). Lazarus captures
ship in describing surprise as a “p emotion” (Lazarus, 1991).
Note that it is unlikely that e categorical discrimination observe was
mediated by subjects’ use of verbal labels. Faces at t er to
name and showed much more variation in the were
discriminated more accurately. as as easy to label as a
emotion and showed the same identification task, yet t
e boundary was no easier to discriminate. The tende
ressions categorically was striking: no subject realiz
series contained gradations between expressions, and in the free naming task,
descriptions in which two emotions were mentioned were virtually nonexistent,
even though use of multiple labels of the subjects’ choosing was encourage
Barclay, J.R. (1972). Noncategorical perception of a voiced stop: A replication. Perceptive and
Psychophysics, 11, 269-273.
Benson, P.J., & Perrett, D.I. (1991). Perception and recognition of p~ot~g~ap~ic quality facial
caricatures: Implications for the recognition of natural images. European Journal of Cognitive
Psychology, 3, 105-135.
Bornstein, M.H. (1973). Color vision and color naming: A psychophysiological hypothesis of cultural
difference. Psychological Bulletin, 80, 257-285.
Facial expressions 239
Brennan, SE. (1982). Caricature generator: Dynamic exaggeration of faces by computer. teonardo,
18, 170-178.
Bt-uyer, R. y Later% C.. SeTon, X., Feyereisen, P., Strypstein, E., Pienard, E., & Rectem, D. (1983).
A case of prosopagnosia with some preserved covert remembrance of familiar faces. Brain and
Cognition, 2, 257 -284.
Campbell, R., Landis, T., & Regard. M. (1986). Face recognition and lipreading: A neurological
dissociation. Brain, 109, 509-521.
Caron, R.F., Caron, A.J., & Myers, R.S. (1982). Abstraction of invariant face expressions in infancy.
Child Development, 53, 1009-1015.
Cutting, J.E., & Rosner, B.S. (1974). Categories and boundaries in speech and music. Perception and
Psychophysics, 16, W-570.
Darwin, C. (1872). The expression o,~the emotions in man and animals. London: Murray. Reprinted
1965, Chicago: University of Chicago Press.
Dimberg, U. (1990). Facial electromyography and emotional reactions. Psychophysiology, 27, 48l-
494.
Eimas, P.D., er, J.L., & Jusczyk, P.W. (1987). Infant speech perception. In S. Hamad (Ed.),
Catego perception. Cambridge, UK: Cambridge University Press.
Ekman, P. (1984). Expression and the nature of emotion. In K. Scherer & P. Ekman (Eds.),
Approaches to emotion (pp. 319-343). Hillsdale, NJ: Erlbaum.
Ekman, P., & Friesen, WV. (1971). Constants across cultures in the face and emotion. Journal of
Personality and Social Psycholqy, 17, 124-129.
Ekman, P., & Friesen, WV. (1974). Detecting deception from the body or face. Journal of Personality
and Social Psychology, 29, 288-298.
Ekman, P., & Friesen, W.V. (1975). Pictures of facial affect. Palo Alto, CA: Consulting Psychologists
Press.
Ekman, P., Friesen, W.V., & Ellsworth, P. (1982). What emotion categories or dimensions can
observers judge from facial behavior ? In P. Ekman (Ed. j, Emotion in the human face (pp.
39-55). Cambridge, UK: Cambridge University Press.
Ekman, P., Friesen, W.V., & O’Sullivan, M. (1988). Smiles when lying. Journal of Personality and
Social Psychology, 29, 288-298.
Ekman, P., Friesen, WY., O’Sullivan, M., Chan, A., Diacoyanni-Tarlatzis, I., Heider, K., Krause,
R., Lecompte, W.A., Pitcairn, T., Ricci-Bitti, P.E., Scherer, K.R., Tomita, M., & Tzavaras,
A. (1987). Universals and cultural differences in the judgments of facial expressions of
emotion. Journal of Personality and Social Psychology, 53, 712-717.
Etcoff, N.L. (1984). Selective attention to facial identity and facial emotion Neuropsychologia, 22,
281-295.
Etcoff, N.L. (1989). Asymmetries in recognition of emotion in F. Bolier & J. Grafman (Eds.),
Handbook of neuropsychology (Vol. 3, pp. 363-382). Amsterdam: Elsevier, Amsterdam.
Fried, I., Mateer, C., Ojemann, G., Wohns, R., & Fedio, P. (1982). Organization of visuospatial
functions in the human cortex. Brain, 105, 349-371.
Harnad, S. (1987). Categorical perception. Cambridge, UK: Cambridge University Press.
Hasselmo, ME., Rolls, E.T., & Baylis, G.C. (1989). The role of expression and identity in the
face-selective responses of neurons in the temporal visual cortex of the monkey. Behavioural
Brain Research, 32, 203-218.
Hochschild, A.R. (1983). The managed heart: Commercialization of human feeling. Berkeley, CA:
University of California Press.
Izard, C.E. (1971). The face of emotion. New York: Appleton-Century-Crofts.
!zard, C.E. (1977). Human emotions. New York: Plenum.
). Emoticn and adaptation. Oxford: Oxford University Press.
Liberman, A.M., arris, K.S., Hoffman, H.S., & Griffith, B.C. (1957). The discrimination of speech
sounds within and across phoneme boundaries. Journal of Experimental Psychology, 5%
358-368.
MacMillan, N.A., Kaplan, H.L., & Creelman, C.D. (1977). The psychophysics of categorical
perception. Psychological Review, 84, 452-471.
240 N. L. Etcoff and J. J. Magee
Meltzoff, A.N., & Moore, M.K. (1977). Imitation of facial and manual gestures in human neonates.
Science, 198, 75 -78.
Qatley, K., & Johnson-Laird, P.N. (1987). Towards a cognitive theory of emotion. Cognition and
Emotion, 1, 29-50.
Ohman, A., Sr Dimberg, LJ. (1978). Facial expressions as conditioned stimuli for electrodermal
responses: A case of “preparedness”’ ! Journal of Personality and Social Psychology, 36,
1251-125s.
Perrett, D.I., Smith, P.A.J., Potter, D.D., Mistlin, A.J., ead, AS., Milner, A.D., & Jeeves, M.A.
(1984). Neurones responsive to faces in the temporal cortex: Studies of functional organization,
sensitivity to identity and relation to perception. Human Neurobiology, 3, 197-208.
Rhodes, G., Brennan, S.E., & Carey, S. (1987). Identification and ratings of caricatures: Implications
for mental representations of faces. Cognitive Psychology, 19. 473-497.
Russell, J.A. (1980). A circumflex model of affect. Journal of Personality and Social Psychology, 39,
1161-1178.
Sackett, G.P. (1966). Monkeys reared in isolation with pictures as visual input: Evidence for an innate
releasing mechanism. Science, 154, 1468-1473.
Sorce, J.F., Emde, R.N., Camprs, J.J., & Klinnert, M.D. (1985). Maternal emotional signaling: Its
effect on the visual cliff behavior of l-year-olds. Developmental Psychology, 21, 195-200.
Studdert-Kennedy, M., Liberman, A.M., J-Jarris. K.S., & Cooper, F.S. (1970). Motor theory of
speech perception: A reply to Lane’s critical review. Psychological Review, 77, 234-249.
Tomkins, S.S. (296211963). Aflect, i,magery, consciousness (‘Vols. 1 and 2). New York: SpPEnger.
Walker-Andrews, A.S. (1986). Intermodal perception of expressive behaviors: Relation of eye and
voice? Developmental Psychology, 22, 373-377.
Watson, D., Br Tellegen, A. (1985). Toward a consensual structure of mood. Psychological Bulletin,
98, 219-235.