You are on page 1of 15

doi:10.

1093/scan/nsr090 SCAN (2013) 8, 285^299

The social evaluation of faces: a meta-analysis


of functional neuroimaging studies
Peter Mende-Siedlecki,1 Christopher P. Said,2 and Alexander Todorov1,3
1
Department of Psychology, Princeton University, Princeton, NJ, USA, 2Department of Psychology and Center for Neural Science, New York
University, New York, NY, USA, and 3Department of Psychology, Behavioural Science Institute, Radboud University, Nijmegen,
The Netherlands

Neuroscience research on the social evaluation of faces has accumulated over the last decade, yielding divergent results.
We used a meta-analytic technique, multi-level kernel density analysis (MKDA), to analyze 29 neuroimaging studies on face
evaluation. Across negative face evaluations, we observed the most consistent activations in bilateral amygdala. Across positive
face evaluations, we observed the most consistent activations in medial prefrontal cortex, pregenual anterior cingulate cortex
(pgACC), medial orbitofrontal cortex (mOFC), left caudate and nucleus accumbens (NAcc). Based on additional analyses compar-
ing linear and non-linear responses, we propose a ventral/dorsal dissociation within the amygdala, wherein separate populations
of neurons code for face valence and intensity, respectively. Finally, we argue that some of the differences between studies are
attributable to differences in the typicality of face stimuli. Specifically, extremely attractive faces are more likely to elicit
responses in NAcc/caudate and mOFC.

Keywords: meta-analysis; fMRI; social cognition; face perception; face evaluation; trait judgments; trustworthiness; attractiveness

INTRODUCTION personality have been shown to predict important outcomes


Within a single glance of a face, people automatically ap- in domains ranging from politics (Todorov et al., 2005;
praise face attractiveness and make a host of social attribu- Ballew and Todorov, 2007; Olivola and Todorov, 2010b),
tions (Olson and Marshuetz, 2005; Bar et al., 2006; Willis law (Zebrowitz and McDonald, 1991; Blair et al., 2004;
and Todorov, 2006; Rule et al., 2009; Todorov et al., 2009). Eberhardt et al., 2006), mate choice (Olivola et al., unpub-
For example, 33-ms exposure to a face is sufficient for people lished data), business (Hamermesh and Biddle, 1994; Rule
to make trustworthiness decisions (Todorov et al., 2009). and Ambady, 2008) and the military (Mazur et al., 1984).
Additional time exposure simply increases confidence in Despite the importance of first impressions for social
these decisions (Willis and Todorov, 2006). As one of the interactions, research on their neural basis is in its infancy.
founding fathers of modern social psychology, Solomon Researchers began to use social neuroscience methods to
Asch (1948, p. 258), put it, ‘We look at a person and imme- investigate this basis only a decade ago (Adolphs et al.,
diately a certain impression of his character forms itself in 1998; Nakamura et al., 1998; Aharon et al., 2001; Winston
us. A glance, a few spoken words are sufficient to tell us a et al., 2002). Although a number of neuroimaging studies
story about a highly complex matter. We know that such have been published on the topic, many of the results have
been inconsistent (Todorov et al., 2011). The objective of
impressions form with remarkable rapidity and with great
this article is to provide a quantitative summary of the
ease. Subsequent observations may enrich or upset our view,
major findings across studies on face evaluation.
but we can no more prevent its rapid growth than we can
avoid perceiving a given visual object or hearing a melody’.
The neural basis of face evaluation
Recent research confirms Asch’s insights (Zebrowitz, 1999;
Todorov et al., 2008a,b; Zebrowitz and Montepare, 2008). Neuroimaging research on the social evaluation of faces has
People rapidly and effortlessly form impressions from facial usually focused on evaluations along the trait dimensions of
appearance. Although the validity of such impressions is low trustworthiness and attractiveness. Although these are sep-
(Olivola and Todorov, 2010a), inferences of character and arable dimensions, psychometric studies of social judgments
from faces show that these judgments are highly
Received 21 January 2011; Accepted 27 November 2011 inter-correlated with each other, with correlations ranging
Advance Access publication 27 January 2012 from 0.60 to 0.80 (Oosterhof and Todorov, 2008; Todorov
We thank Hedy Kober and Bryan Denny for assistance with the MKDA toolbox, Tor Wager for making the
MKDA toolbox available online, and Jenny Porter and Katie Hansen, who provided the behavioral data for et al., 2008a,b). For example, principal components analyses
Figure 5B. We also thank Jamil Zaki, Adam Hampshire, and Leigh Nystrom for their assistance in obtaining show that (i) the first component, which indicates general
analyses not reported in their original papers. This research was supported by National Science Foundation face valence, accounts for >60% of the variance of judg-
grant BCS-0823749 (to A.T.), National Science Foundation grant DGE 1148900 (to P.M.-S.), and the Russell
Sage Foundation. ments; and (ii) trustworthiness and attractiveness judgments
Correspondence should be addressed to Peter Mende-Siedlecki. E-mail: pmende@princeton.edu are highly correlated with this valence component. Given
ß The Author (2012). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com
286 SCAN (2013) P. Mende-Siedlecki et al.

these behavioral data, one would expect to observe overlap- same psychological phenomenon, but that are not typically
ping regions in neuroimaging studies on attractiveness and associated with that phenomenon.
trustworthiness. Indeed, a meta-analysis of the social evaluation of faces
For the purposes of this meta-analysis, we focus on studies has been recently published (Bzdok et al., 2011), and in part,
on attractiveness and trustworthiness. Typically, such studies motivated the analyses herein. While we ultimately em-
present participants with facial stimuli that vary on the re- ployed slightly different selection criteria in choosing studies
spective dimensioneither systematically manipulated via to include, we also sought to perform several more targeted
computer modeling, or confirmed by independent behavior- analyses, as noted above. Perhaps more importantly, while
al ratingsand subsequently report brain activity that shows Bzdok and colleagues conducted an activation likelihood es-
a linear relationship with changes in facial appearance along timation (ALE) meta-analysis, we use a different statistical
that dimension. For example, some studies have observed procedure.
increased responses in the amygdala for untrustworthy Specifically, we use a Multi-level Kernel Density Analysis
faces (Winston et al., 2002), while other studies have (MKDA), which represents an advance in meta-analytic
observed increased responses in the nucleus accumbens methods for neuroimaging data, because it accounts for
(NAcc) and medial orbitofrontal cortex (mOFC) for attract- the fact that individual activation peaks are nested within
ive faces (Aharon et al., 2001; O’Doherty et al., 2003). More contrast maps (maps of particular comparisons within stu-
recent studies have sought to identify regions that show a dies), making these maps the unit of analysis, and not the
quadratic relationship between brain activity and changes in peaks (Wager et al., 2008). Further, MKDA models contrast
attractiveness or trustworthiness. Researchers have observed maps as a random effect, eliminating the possibility of one
non-linear responses in the amygdala for both attractive and contrast dominating the meta-analysis.
unattractive faces (Winston et al., 2007), as well as for both We conduct several analyses. First, we analyze activations
trustworthy and untrustworthy faces (Todorov et al., 2011). across all contrasts showing (i) stronger brain responses to
While there is convergence between the linear and negativeuntrustworthy and unattractivethan positive
non-linear approaches, there exists the possibility that trustworthy and attractivefaces; (ii) stronger responses to
these analyses are tapping distinct processes, wherein areas positive than negative faces; and (iii) stronger responses to
that show a linear pattern of activity are coding for face positive and negative faces than to neutral faces. Second,
valence, while areas that show quadratic patterns are within these contrasts, we also explore potential differences
coding something more like face intensity. between trustworthiness and attractiveness studies.
The first objective of this article is to systematically ex-
plore the pattern of observed brain activations across pub- METHODS
lished neuroimaging studies on face evaluation as a function Data collection
of face valence. The second objective is to examine possible We searched for neuroimaging studies of the social evaluation
dissociations between linear and non-linear responses. The of faces using the online databases PsycINFO and PubMed, as
third and final objective is to explore potential differences well as the scholarly article search engine Google Scholar. We
between trustworthiness and attractiveness studies. limited our search using combinations of keywords including
‘faces’, ‘social evaluation’, ‘social judgment’, ‘fMRI’, ‘trust-
worthiness’ and ‘attractiveness’. To be included in our
Multilevel kernel density analysis meta-analysis, studies had to involve fMRI or PET investiga-
Meta-analysis is a powerful statistical tool that allows re- tions of healthy adults,1 report activations in a standard co-
searchers to combine the data sets of a collection of similar ordinate systemeither Talairach or Montreal Neurological
studies to provide a more accurate, robust estimate of the Institute (MNI) coordinates, and explicitly state whether
effect-size of a given phenomena. This approach is wide- their analyses were performed with fixed or random effects.
spread within behavioral research, and in recent years, With respect to in-scanner tasks, we only included studies in
meta-analyses of neuroimaging studies have become more which subjects either made explicit judgments regarding the
common (Fox et al., 1998; Phan et al., 2002; Wager and trustworthiness or attractiveness of faces, or were presented
Smith, 2003; Wager et al., 2004; Laird et al., 2005; Nielsen with faces that varied on one of these two dimensions during
et al., 2005). Meta-analyses of neuroimaging data typically an implicit or a passive viewing task, based upon normative
compute how frequently studies examining a given psycho- ratings, computer modeling or some other form of categor-
logical phenomenon report activity in a specific brain area ization. In the case of some studies (Hampshire et al., 2011;
(Kober and Wager, 2010). This approach can be used to Pochon et al., 2008; Zaki et al., 2011), relevant contrasts were
confirm the prevailing thinking regarding what brain areas not originally reported, but were obtained through personal
are associated with a particular psychological phenomenon communication with the respective authors.
or experience. At the same time, meta-analysis can serve a 1
Pinkham et al. (2008a) and Baas et al. (2008) were neuroimaging studies comparing the social evaluation of
more exploratory purposeidentifying regions that are con- faces in patient populations to healthy controls. When composing our MKDA, we only included the coordinates
sistently activated across a large number of studies of the yielded from the analysis of the healthy controls’ data.
Social evaluation of faces SCAN (2013) 287

Table 1 Breakdown of Studies Included in the Meta-Analysis


Study Included N Task naturea Study type Valence ROI?c Stimulus category
contrasts
Implicit Explicit Collapsedb Negative Positive Non-Linear

Aharon, et al., 2001 1 6 X attractiveness X extreme


Aron, et al., 2005 1 17 X attractiveness X average
Baas, et al., 2008 4 21 X X X trustworthiness X X average
Blasi, et al., 2009 1 43 X trustworthiness X average
Bray, et al., 2007 2 25 X attractiveness X X extreme
Chatterjee, et al., 2009 4 13 X X attractiveness X X computer generated
Cloutier, et al., 2008 2 48 X attractiveness X X extreme
Engell, et al., 2007 1 15 X trustworthiness X average
Gordon, et al., 2009 2 6 X trustworthiness X X X average
Hampshire, et al., 2011 1 19 X attractiveness X extreme
Iaria, et al., 2008 1 10 X attractiveness X extreme
Kampe, et al., 2001 1 16 X attractiveness X average
Kim, et al., 2007 1 25 X attractiveness X computer generated
Liang, et al., 2010 3 17 X attractiveness X X X X extreme
O’Doherty, et al., 2003 2 25 X attractiveness X X extreme
Pinkham, et al., 2008 1 12 X trustworthiness X X average
Pochon, et al., 2008 1 17 X attractiveness X extreme
Said, et al., 2009 3 31 X trustworthiness X X X average
Said, et al., 2010 1 24 X trustworthiness X computer generated
Smith, et al., 2010 1 26 X attractiveness X average
Todorov, et al., 2008 2 14 X trustworthiness X X X computer generated
Todorov, et al., 2010 2 22 X trustworthiness X X computer generated
Todorov, et al., 2010 2 22 X trustworthiness X X computer generated
Tsukiura, et al., 2010a 3 22 X attractiveness X X X average
Turk, et al., 2004 1 18 X attractiveness X extreme
VanRijn, et al., 2011 3 18 X trustworthiness X X X average
Winston, et al., 2002 2 14 X trustworthiness X X average
Winston, et al., 2007 2 26 X attractiveness X X extreme
Zaki, et al., 2011 1 14 X attractiveness X extreme
a
‘Task nature’ categorizes only the contrasts included in our meta-analysis. In some cases, like Winston et al. (2002), both explicit and implicit paradigms were employed, but only
collapsed analyses were reported.
b
‘Collapsed’ analyses refer to analyses in which neural activity was aggregated across both explicit and implicit tasks.
c
In this column, we note if a given study reported coordinates arising from ROI-based analyses. In some cases, these studies only reported such ROI-based analyses (for instance,
Pinkham et al., 2008). As such, these studies have only been able to impact our supplementary analyses, which incorporate ROI-based analyses in addition to whole-brain
contrasts.

We excluded studies that did not report specific coordin- conducted by Bzdok and colleagues (2011), in terms of
ates arising from relevant contrasts, but instead referred to study selection.
various ROIs from a functional localizer being more or This search yielded 28 published papers comprising 292
less active during specific contrasts (Kranz and Ishai, neuroimaging studies on the social evaluation of faces.
2006). In some instances, multiple studies were found Seventeen of these studies were on attractiveness evaluations
which presented analyses of the same data sets (Todorov and 12 were on trustworthiness or related evaluations (i.e.
and Engell, 2008; Pinkham et al., 2008b). In these cases, ‘would you approach or avoid this person’). The latter were
we only included one study’s reported coordinates, and included because such approach/avoidance evaluations
this choice was made based upon which version of the are highly correlated with trustworthiness evaluations
study ultimately presented the more relevant analyses. (Todorov, 2008). This set of studies accounted for 52 separ-
Finally, we excluded some studies whose research questions ate contrasts (Table 1). For contrasts to be included in our
bordered on ours (for instance, aesthetic judgments of paint- database, they had to be representative of neural activity that
ings of faces, as in Kawabata and Zeki (2004) or neural re- varied parametrically with either facial attractiveness or
sponses to faces similar to the self varying in trustworthiness, trustworthiness, and furthermore, the direction and linearity
as in Verosky and Todorov (2010) as they ultimately did not
2
report contrasts that were appropriate for inclusion in our We consider a single study to represent an investigation of the neural responses to a given set of stimuli in
the context of one or potentially multiple psychological tasks within the same set of subjects. Thus, Todorov
analyses. These choices are not trivial, as they represent some et al. (2011) represents two separate studies, while Chatterjee et al. (2009)in which the same subjects took
of the differences between our meta-analysis and the one part in explicit and implicit tasks in-scanner on separate scanning daysrepresents one study.
288 SCAN (2013) P. Mende-Siedlecki et al.

of this relationship had to be clearly stated. We excluded 2003). These faces likely differ in terms of their typical-
coordinates derived from complex interaction-based ana- ityfaces in standardized photographs are more typical
lyses (for instance, stimuli type and gender interactions, as than the extreme faces seen in photographs of models and
seen in O’Doherty et al. (2003), as well as coordinates arising actresses. Given recent work suggesting that face typicality
from analyses that were not relevant to our research ques- can partially account for the amygdala’s response to the va-
tions (e.g. effects of face novelty in Kim et al. (2007). lence of face stimuli (Said et al., 2010), it is possible that
Further, overlapping contrasts are often reported in the art- different types of face stimuli (e.g. extremely attractive faces
icles surveyed. For instance, Aharon and colleagues (2001) that are less typical) could lead to different patterns of neural
report separate contrasts detailing neural activity associated responses. As such, while we did not exclude studies based
with facial attractiveness for male stimuli, female stimuli, on the sources of the face stimuli, we did keep track of the
and collapsed across both kinds of stimuli. In these cases, source of each study’s stimuli. This allowed for the possibil-
we only included the most general reported contrastfor ity of comparing the more typical faces (computer-generated
instance, for Aharon et al. (2001), we used the collapsed and standardized sets) against the more atypical faces
contrast. Studies that report separate results for explicit (photos of models and actors from print media).
and implicit paradigms presented a unique problem (see It is important to note that contrasts containing
Winston et al., 2002; Baas et al., 2008; Chatterjee et al., ROI-based analyses pose a problem for inclusion in
2009). On the one hand, both analyses are relevant to our meta-analyses. On the one hand, including coordinates
main research question, and favoring one paradigm over the from ROI-based analyses may bias the results by introducing
other in these three cases would bias our results in favor of researchers’ a priori predictions about which regions are
that task design. On the other hand, the contrasts are un- involved in trustworthiness and attractiveness evaluation.
deniably non-independent of each other. Ultimately, we On the other hand, such analyses represent theoretically
chose to run our analyses using both sets of coordinates motivated prior research. Further, because some ROIs like
for these three studies, which were entered into our database the amygdala and NAcc are relatively small and often diffi-
as separate contrasts. To confirm that this approach had no cult to image, excluding ROI-based analyses may miss im-
demonstrable impact on our results, we ran complimentary portant findings that are consistent across studies. Given
analyses that only included one contrast per study (i.e. only that, we chose to run each of our analyses twiceonce lim-
the explicit task contrast from the three studies in question). ited to whole-brain contrasts, and once with ROI-based con-
We observed no practical differences in either the size or trasts included. In the interest of space, we chose to report
localization of consistent activations. the whole-brain analyses in the main text, as well as to note
We tabulated the design particulars and parameters of whether or not adding ROI-based contrasts substantially af-
each study, as well as the reported activation points for all fected the results. (In all cases but one, adding ROI-based
relevant contrasts. Specifically, we coded each study in terms contrasts did not have a substantial effect on analyses. For
of which coordinate system activations were reported in, the contrast that produced divergent results, we chose to
number of participants, whether a fixed or random effects explicitly note in the text how the two approaches differed.)
analysis had been performed, whether activations repre- The specific results for the ROI-based analyses are reported
sented linear or non-linear effects, whether the task was in supplemental material. We note that while some studies
explicit or implicit in nature, and whether the reported reported ROI-based analyses side by side with whole-brain
activations were the result of a whole-brain or analyses (for instance, Van Rijn et al., 2011), there are a small
region-of-interest (ROI) analysis. This coding scheme number of studies that reported only ROI-based analyses
served two purposes. Primarily, this information was fed (for instance, Pinkham et al., 2008a).
into the MKDA toolbox and used to determine the proper
weighting scheme for the different studies. Secondarily, it
served as the basis for contrasting studies against each Data analysis
other on relevant variables. This coding scheme was initially Our MKDA of ‘negative’ contrasts comprised all contrasts in
entered by the first author, with subsequent confirmation which brain activity increases as facial stimuli decrease in
and complete agreement from the second and third authors. either trustworthiness or attractiveness. ‘Positive’ contrasts
Entered coordinates were checked and re-checked against comprised all contrasts in which brain activity increases as
their original sources numerous times throughout the facial stimuli increase in either trustworthiness or attractive-
course of setting up our database. ness. Non-linear, quadratic contrasts comprised all contrasts
The studies compiled in our database used a variety of face in which brain activity increases as facial stimuli increase or
stimuli. Some studies used computer-generated faces (for decrease in either trustworthiness or attractiveness relative to
instance, Chatterjee et al., 2009), others used standardized faces at the middle of the continuum. Not all studies
photograph sets of volunteer subjects (for instance, Engell included in our database reported both negative and positive
et al., 2007), and still others used photographs culled from contrasts. Therefore, neither of our primary MKDAs con-
magazines and newspapers (for instance, O’Doherty et al., tains contrasts from every study.
Social evaluation of faces SCAN (2013) 289

When performing these analyses, the peak coordinates image (colin27.img, the single-subject template in SPM5;
from all relevant contrast maps were first separately con- http://www.fil.ion.ucl.ac.uk/spm/software/spm5/), which
volved with a 10-mm spherical kernel, yielding comparison was co-registered to the MNI brain template.
indicator maps (CIMs). Previous meta-analytic work sug- When reporting areas of consistent activation in our
gests that this is an appropriate default kernel size (Wager tables, we provide information on whether each area with-
et al. 2003; Salimi-Khorshidi et al., 2009). These CIMs were stood height-based thresholding, extent-based thresholding,
subsequently weighted based upon the number of partici- or both. Some areas of activation were sizable enough to pass
pants and what type of analysis was performed in each extent-based thresholding but not height-based threshold-
study, following the same parameters used by Kober and ing. Conversely, other areas were highly consistent across
colleagues (2008). Specifically, each map was first weighted the database and passed height-based thresholding, but
by the square root of its study’s sample size and subsequently were not sufficiently large to pass extent-based thresholding.
multiplied by an adjustment factor accounting for the type XYZ-coordinates reported in our tables reflect the peak ac-
of analysis used in the respective study. Random effects stu- tivation foci which withstand height-based thresholding, or,
dies were multiplied by an adjustment factor of 1; fixed ef- if activations are less consistent, the center of mass of the
fects studies were multiplied by an adjustment factor of .75. cluster at the most stringent level of extent-based threshold-
In this fashion, studies received higher weighting if they had ing. Further, we report the number of voxels in each cluster
large sample sizes and performed random effects analyses. which withstood height-based thresholding, or if activations
Second, the weighted CIMs were averaged together, produ- are less consistent, the number of voxels at the most strin-
cing a density map. Each voxel of this density map attains a gent level of extent-based thresholding.
density statistic, P, which is the weighted proportion of con- We also performed several smaller, more targeted MKDAs
trasts included in the MKDA that yield activity within 10 mm exploring differences between trustworthiness and attractive-
of that voxel. To identify voxels whose P-statistic exceeds the ness studies and performed several additional exploratory
frequency expected by chance, a Monte Carlo simulation was analyses based on stimulus typicality. To perform such ana-
conducted. Over 5000 iterations of the Monte Carlo simula- lyses, a simple subtraction yields the relative difference in the
tion, the observed activation blobs (contiguous regions of ac- distribution of peaks between the respective contrasts, which
tivation within the CIMs, holding shape constant) from each is subsequently thresholded as explained above.
CIM were randomly shuffled within a gray-matter mask.
Following each iteration, we recorded both the maximum RESULTS
whole brain density statistic (P, across all studies) and the Results across negative contrasts
largest cluster of contiguous voxels. These values were used Eleven studies reported 13 negative contrastswhere brain
to create null-hypothesis distributions for the density statistic activity increased as attractiveness or trustworthiness decrea-
and the expected size of clusters, respectively. sedacross the whole brain. The MKDA results for these
Third, the weighted P was subsequently tested against the contrasts are summarized in Table 2 and Figure 1. We
resulting null-hypothesis P0 produced by the Monte Carlo observed highly consistent activation in right amygdala
simulation. A similar procedure was used to test for the (withstood height- and extent-thresholding, P < 0.001), as
significance of the size of the clusters, allowing us to identify well as activation in left amygdala that survived extent- but
a size threshold at which a certain number of voxels must be not height-thresholding (P < 0.001). Four studies reported
activated contiguously for a given cluster to be deemed sig- ROI-based coordinates for negative contrasts. When we
nificant. Hence, we used two types of thresholdsa density included these additional coordinates in our analysis as
height-based threshold and a cluster size threshold, the latter well, we continued to observe highly consistent activation
derived from a non-parametric cluster-based thresholding in right amygdala (withstood height- and extent-
procedure (Nichols and Hayasaka, 2003). For P, the resulting thresholding, P < 0.001), as well as activations which sur-
familywise error rate (FWER)-controlled threshold is the vived extent- but not height-thresholding in left amygdala
proportion of studies reporting activity within 10 mm of a (P < 0.001), right globus pallidus (P < 0.01) and a large
given voxel that exceeds the maximum P-statistic across 95% region of consistent activation encompassing right anterior
of the resulting Monte Carlo maps. These voxels appear on insula, right inferior frontal gyrus (IFG) and right ventrolat-
resulting maps colored in yellow and will be referred to in eral prefrontal cortex (vlPFC, P < 0.01, additional results
our results as exceeding the height-based threshold of the summarized in Supplementary Table S1).
MKDA. For the cluster size threshold, the resulting
FWER-controlled threshold is the clusters observed at Results across positive contrasts
P < .001 and P < 0.01 whose size exceeds the maximum clus- Twenty-one studies reported 23 positive contrastswhere
ter size across 95% of the Monte Carlo maps. These voxels brain activity increased as attractiveness or trustworthiness
appear on resulting maps in orange and pink, respectively, increasedacross the whole brain. The MKDA results for
and will be referred to as exceeding the extent-based thresh- these contrasts are summarized in Table 2 and Figure 2.
old. The thresholded maps were overlaid on a canonical MRI We observed highly consistent activation in left caudate
290 SCAN (2013) P. Mende-Siedlecki et al.

Table 2 Areas Consistently Activated During Negative and Positive Face Evaluations
Region Lat x y z Vol %Act

Increased activity for negative evaluations, collapsed across Untrustworthiness and Unattractiveness, whole-brain contrasts only
Basal telencephalon
Amygdala R 20 6 18 1080 0.34 y**
Amygdala L 18 6 18 1328 0.29 **

Increased activity for positive evaluations, collapsed across Trustworthiness and Attractiveness, whole-brain contrasts only
Basal telencephalon
Caudate/nucleus accumbens/medial orbitofrontal cortex L 10 10 4 1888 0.33 y**
Thalamus R 14 16 6 384 0.28 y**
Caudate/right amygdala/anterior insula/inferior frontal gyrus R 4 22 0 76656 0.22 **
Ventral striatum/thalamus/anterior insula/inferior frontal gyrus/ventrolateral prefrontal cortex R 14 2 2 34688 0.20 *

Frontal/insular cortex
Ventromedial prefrontal cortex – 0 42 6 344 0.30 y**
Pregenual cingulate cortex/dorsal anterior cingulate – 2 40 8 96 0.25 y**
Pregenual cingulate cortex – 0 36 2 16 0.25 y**

Note. Stereotactic coordinates representing the areas most consistently activated across full database. We report laterality (Right or Left), XYZ coordinates, number of voxels in
each cluster (Vol), and weighted percentage of CIMs which activated each cluster (%Act).
y, areas withstanding height-based thresholding.
**, areas withstanding extent-based thresholding (p < .001).
*, areas withstanding extent-based thresholding (p < .01).

(unattractive or untrustworthy) and positive-looking (at-


tractive or trustworthy) faces than to faces at the middle of
the continuum. Collapsed across both sets of stimuli, we
observed consistent non-linear activation across seven
whole-brain contrasts in the right amygdala extending into
right putamen (withstood height- and extent-thresholding,
P < 0.001, Table 3). Including two additional ROI-based
contrasts in the analysis yielded similar results
(Supplementary Table S2). We note that given the relatively
small number of contrasts documenting non-linear re-
sponses, this analysis is underpowered. Nevertheless, five of
the seven whole-brain contrasts reported activity in right
amygdala.
We also compared non-linear responses against linear re-
sponses, though these comparisons are, by virtue of the
Fig. 1 Consistently activated areas across negative evaluations, showing consistent smaller number of non-linear contrasts, unavoidably unba-
right amygdala activation. Yellow voxels withstood height-based thresholding, orange lanced. Contrasting negative linear contrasts (13 contrasts)
voxels withstood extent-based thresholding (P<.001).
against non-linear contrasts (seven contrasts), we observed a
ventral portion of the right amygdala that was more consist-
extending into NAcc and mOFC, right thalamus, vmPFC ently active in negative linear contrasts (withstood height-
and dACC/pgACC (withstood height- and extent- but not extent-thresholding, Supplementary Table S3), while
thresholding, P < 0.001), as well as portions of right amyg- a more dorsal portion of the right amygdala was more
dala right anterior insula, right IFG (P < 0.001), and bilateral consistently active in non-linear contrasts. Including
vlPFC that survived extent- but not height-thresholding (P < ROI-based contrasts in the analysis yielded similar results
0.01). Four studies reported ROI-based coordinates for (Supplementary Table S4). (As this contrast is unbalanced,
negative contrasts. Including these additional coordinates we have provided information regarding the frequency of
in our analysis yielded similar results (summarized in activation at the peak voxels of those areas that withstood
Supplementary Table S1). height-thresholding, Supplementary Table S5A)
Contrasting positive linear contrasts (23 contrasts)
against non-linear contrasts (seven contrasts), we observed
Non-linear responses a set of regions that were more consistently active in positive
Nine studies within our database conducted non-linear linear contrasts, including bilateral caudate, vmPFC/OFC,
analyses testing for stronger responses to both negative- dACC/pgACC (withstood height- and extent-thresholding,
Social evaluation of faces SCAN (2013) 291

Fig. 2 Consistently activated areas across positive evaluations, including pgACC, vmPFC (A), left caudate/NAcc extending into mOFC (A and B), and right amygdala (C).
Yellow voxels withstood height-based thresholding, orange voxels withstood extent-based thresholding (P < 0.001), and pink voxels withstood extent-based thresholding
(P < 0.01).

Table 3 Consistently Activated Areas Displaying Non-linear Response Negative linear responses in attractiveness and
Profiles trustworthiness studies
Region Lat x y z Vol %Act We contrasted negative linear responses in attractiveness (six
contrasts) and trustworthiness studies (seven contrasts),
Non-Linear responses, collapsed across Attractiveness and Trustworthiness studies observing one activation in the right amygdala that was
Basal telencephalon more consistently active for negative linear responses to
Amygdala R 20 2 10 1040 0.63 y
trustworthiness than attractiveness (withstood height- and
Note. Stereotactic coordinates representing the areas most consistently activated extent-thresholding, P < 0.001). We observed no regions
across full database. We report laterality (Right or Left), XYZ coordinates, number that were consistently more active for negative linear re-
of voxels in each cluster (Vol), and weighted percentage of CIMs which activated each sponses to attractiveness than trustworthiness. (Results are
cluster (%Act).
summarized in Supplementary Table S5.) Including ROI co-
y, areas withstanding height-based thresholding.
ordinates (from one unattractiveness study and three un-
trustworthiness studies) in the analysis yielded similar
P < 0.001), right thalamus (withstood height-thresholding,
results (noted in Supplementary Table S6).
P < 0.001), sgACC and bilateral vlPFC (P < 0.01,
Supplementary Table S3). Conversely, we observed a
region of right dorsal amygdala extending into right puta- Positive linear responses in attractiveness and
men (withstood height- but not extent-thresholding, results trustworthiness studies
summarized in Supplementary Table S3) that was more con- We contrasted positive linear responses in attractiveness (18
sistently active in non-linear contrasts. Including ROI coord- contrasts) and trustworthiness (5 contrasts). We observed
inates in the analysis yielded similar results (noted in activations in left caudate extending into NAcc, vmPFC/
Supplementary Table S4). (Information regarding the fre- OFC and pgACC extending dorsally into dACC (withstood
quency of activation at the peak voxels of those areas that height- and extent-thresholding, P < 0.01) that were more
withstood height-thresholding is provided in Supplementary consistent for positive linear responses to attractiveness
Table S5B.) than trustworthiness. We observed no regions that were
292 SCAN (2013) P. Mende-Siedlecki et al.

Fig. 3 Consistently activated areas in the contrast ‘Extreme’ Attractiveness > Trustworthiness, (A) NAcc extending into mOFC, (B) pgACC and vmPFC. (The Average
Attractiveness > Trustworthiness contrast produces no regions of consistent activation.) Yellow voxels withstood height-based thresholding and pink voxels withstood
extent-based thresholding (P < 0.01).

consistently more active for positive linear responses to Indeed, when contrasting extreme attractiveness (11 con-
trustworthiness than attractiveness. (Results are summarized trasts) against trustworthiness (8 contrasts), we observed
in Supplementary Table S5.) Including ROI coordinates consistent activation in left caudate and NAcc, extending
(from one attractiveness study and three trustworthiness into mOFC, pgACC, and vmPFC (withstood height- and
studies) in the analysis yielded similar results (noted in extent-thresholding, p < .01; see Figure 3, results summarized
Supplementary Table S6). (Information regarding the fre- in Supplemental Table 7). Further, we observed a consistent
quency of activation at the peak voxels of those areas that pattern of activation centered in pgACC and extending
withstood height-thresholding is provided in Supplementary broadly into both vmPFC and vlPFC that withstood
Table S5C.) extent-thresholding (p < .01) but not height-thresholding.
Contrasting average attractiveness against trustworthiness
Separating attractiveness studies by stimulus type produced no areas of consistent activation.
Similarly within the set of attractiveness studies, when
The differences between trustworthiness and attractiveness
contrasting studies that used extremely attractive faces (11
studies are interesting but also puzzling given that evalu-
contrasts) against studies that used more typical faces (7
ations on these two dimensions are highly correlated.
contrasts), we observed consistent activation in left caudate,
There were no obvious differences between these two sets
vmPFC/mOFC, and pgACC/dACC (withstood height- and
of studies (for instance, they were well-balanced be-
extent-thesholding, p < .01), while a larger activation
tween implicit and explicit tasks) except for the nature of
extending broadly through mOFC, vmPFC and vlPFC with-
the face stimuli used in the studies. Whereas eleven of the
stood extent-thresholding (p < .01), but not height-
attractiveness studies used atypical, extremely attractive
thresholding. The reverse contrast produced no areas of con-
faces (culled from magazines and print media, often of
sistent activation.
models), none of the trustworthiness studies used such
Further, differences due to face stimuli should be appar-
faces (typically, these were standardized sets of faces or
ent in studies that used implicit evaluation paradigms.
computer-generated faces).
Because no evaluative dimension is specified in such para-
If the differences between attractiveness and trustworthi-
digms, stimulus properties should drive the neural responses.
ness studies are partly due to differences in stimuli, then the
Contrasting implicit paradigm studies that used extremely
regions that differentiate these studies should also appear in
attractive faces with implicit paradigm studies that used
contrasts involving the extremeness of faces. We can test this
more typical faces produced consistent activation in right
proposition by splitting attractiveness studies into two
amygdala, left caudate extending into NAcc and right inferior
groupsthose that used extremely attractive stimuli and
frontal gyrus (withstood height- but not extent thresholding;
those that used average or computer-generated stimuli.
results are summarized in Supplemental Table S7).
Comparing extreme attractiveness studies to the set of trust-
worthiness studies should yield areas of consistent activation
in NAcc/caudate and mOFC, for example, while there should DISCUSSION
be fewer differences between average attractiveness and trust- Using multi-level kernel density analysis, a statistically rigor-
worthiness studies. ous method of meta-analysis that treats contrasts as the unit
Social evaluation of faces SCAN (2013) 293

of analysis instead of individual activation peaks, we per- The similarities between the neural correlates of negatively
formed a meta-analysis on 29 neuroimaging studies of the and positively evaluated faces and angry and happy faces,
social evaluation of faces. We split these studies by valence respectively, parallels perceptual similarities between these
into two MKDAs, one focusing on brain responses to nega- types of faces. In computer models of facial trustworthiness,
tive evaluations like unattractiveness and untrustworthiness, extreme untrustworthiness resembles anger and extreme
and the other focusing on brain responses to positive evalu- trustworthiness resembles happiness (Oosterhof and
ations like attractiveness and trustworthiness. Todorov, 2008, 2009; Todorov et al., 2008a,b). Further, be-
Our negative MKDA revealed the most consistent activa- havioral adaptation studies suggest common neural under-
tion in right amygdala. Less consistent areas of activation pinnings for evaluations of trustworthiness and anger/
were observed in left amygdala, right anterior insula, right happiness (Engell et al., 2010). These observations are con-
IFG, right vlPFC and right globus pallidus. These results are sistent with the emotion overgeneralization hypothesis
remarkably consistent with previous findings regarding the (Montepare and Dobish, 2003; Todorov et al., 2008a,b;
neural responses to angry faces (Morris et al., 1998; Whalen Zebrowitz and Montepare, 2008; Said et al., 2009a,b), ac-
et al., 2001; Monk et al., 2006; Dannlowski et al., 2007). cording to which evaluative judgments of faces are based
Amygdala responses to angry faces have been widely on configurations of facial features resembling emotional
observed and characterized (Morris et al., 1998; Whalen expressions. In the context of positive and negative evalu-
et al., 2001; Nomura et al., 2004; Taylor et al., 2006; ation, these configurations signal approach and avoidance
Dannlowski et al., 2007; Monk et al., 2008; Vrticka et al., behaviors, respectively (Todorov, 2008). Our meta-analysis
2008). Furthermore, a functional connectivity between the findings are also consistent with the hypothesis that novel
amygdala and vlPFC has been proposed and demonstrated faces are automatically evaluated with respect to their ap-
(Nomura et al., 2004; Taylor et al., 2006; Monk et al., 2006, proach/avoidance value.
2008), suggesting that in response to angry faces, the vlPFC
may serve to modulate amygdala reactivity, effectively reg- The role of the amygdala in face evaluation
ulating emotional responses. Right IFG (Dannlowski et al.,
The amygdala is critical for adaptive social behavior
2007), right insula (Dannlowski et al., 2007; Vrticka et al.,
(Adolphs, 2010; Sander et al., 2003) and, possibly, for
2008) and right globus pallidus (Jackson et al., 2008) have
normal face perception and evaluation (Todorov, 2011).
also all been implicated in the neural response to angry faces.
Large meta-analyses of PET and fMRI studies on emotional
Our positive MKDA revealed highly consistent activations
processing show that faces are one of the most potent stimuli
in left caudate extending into NAcc/mOFC, vmPFC, dACC/ for eliciting responses in the amygdala (Costafreda et al.,
pgACC, right thalamus as well as less consistent activations 2008; Sergerie et al., 2008). The role of the amygdala in
in right amygdala, insula, IFG and vlPFC. Once again, this face evaluation is also consistent with neurophysiology find-
pattern of activations bears a strong resemblance to that ings of face selective responses in the amygdala (Nakamura
associated with a different emotional expressionhappiness. et al., 1992; Rolls, 2000a,b; Gothard et al., 2007). The
Happy faces have been observed to elicit responses in parts amygdala receives input from the inferior temporal (IT)
of the striatum (Morris et al., 1996; Phillips et al., 1998; cortex and projects back not only to IT cortex but also to
Fu et al. 2007; Vrticka et al., 2008), mPFC (Phillips et al., extrastriate and striate visual areas (Amaral et al., 1992). The
1998; Kesler-West et al., 2001), ACC (Dolan et al., 1996; amygdala also has strong interconnections with rACC, OFC,
Phillips et al., 1998; Kesler-West et al., 2001; Vrticka et al., mPFC, basal ganglia and anterior insula. This anatomical
2008), thalamus (Dolan et al., 1996), IFG (Dolan et al., 1996) position of the amygdala allows for it to serve as an affective
and insula (Lee et al., 2002). Furthermore, a number of hub of information. The current findings, together with the
studies have observed amygdala responses to happy faces findings of a recent ALE-based meta-analysis of a smaller
(Breiter et al., 1996; Canli et al., 2002; Pessoa et al., 2002; and only partially overlapping set of 16 studies on face evalu-
Yang et al., 2002; Somerville et al., 2004). ation (Bzdok et al., 2011), further buttress the importance of
The consistent activation in the left caudate nucleus, ex- the amygdala in face perception and evaluation.
tending broadly into the nucleus accumbens, suggests that Importantly, the amygdala responded not only to nega-
positive evaluation of faces may depend, in part, on the re- tively evaluated faces but also to positively evaluated faces,
cruitment of structures implicated in reward-processing consistent with meta-analyses of its responses to the valence
(Knutson et al., 2001a,b; Haruno et al., 2004). However, of emotional expressions (Sergerie et al., 2008). Interestingly,
we note that consistent activation in this area was almost we observed different loci of activation within the amygdala
entirely driven by attractiveness contrasts, and, therefore, for linear and non-linear responses (Figure 4). Whereas a
may not be part of a general network for face evaluation. ventral portion responded more consistently to negative
Nonetheless, the highly consistent presence of these areas in faces only, a dorsal portion of the amygdala responded
our meta-analysis suggests that under certain task and more consistently to both negative and positive faces than
stimulus conditions, attractive faces modulate activity in to neutral faces. This dissociation of linear and non-linear
reward-related regions of the brain. responses in the human amygdala parallels the findings of a
294 SCAN (2013) P. Mende-Siedlecki et al.

Fig. 4 Linear and non-linear response patterns in right amygdala. Blue indicates voxels more consistently active across non-linear contrasts, red indicates voxels more
consistently active across negative evaluations, and green indicates voxels consistently active across positive evaluations. Blue and red clusters withstood height-based
thresholding, while the green cluster withstood extent-based thresholding (P < 0.001).

high-resolution fMRI study on non-human primates turn, can serve to modulate amygdala activity. Prefrontal-
(Hoffman et al., 2007). Hoffman and colleagues observed a amygdala connections have been explored in the vmPFC
linear response in ventral portions of the amygdala (com- (Quirk et al., 2003, Heinz et al., 2004), as well as
prising the basolateral amygdala)specifically, stronger the pgACC (Pezawas et al., 2005; Stein et al., 2007;
responses to threatening faces and progressively weaker re- Zink et al., 2010), both of which were observed as consist-
sponses to neutral and appeasing faces. However, in a more ently activated across our set of positive contrasts.
dorsal portion (comprising the central nucleus and the bed nu-
cleus of the stria terminalis), they observed a non-linear re- Stimulus effects on neuroimaging findings
sponsestronger responses to both threatening and appeasing We also performed several smaller MKDAs to compare be-
faces than to neutral faces. This ventral/dorsal distinction also tween study type, within negative and positive linear re-
parallels a distinction made by Whalen and his colleagues sponses. These more targeted MKDAs offered evidence
(Whalen et al., 2001; Kim et al., 2003, Somerville, et al., that our negative and positive analyses were driven by un-
2006; Davis, et al., 2010). They have argued that while the trustworthiness and attractiveness, respectively. These two
ventral portion of the amygdala is involved in processing va- sets of studies were associated with different loci of activa-
lence, the dorsal portion of the amygdala is recruited in deter- tions: the right amygdala was more consistently active as
mining the value of ambiguous information (e.g. expressions facial trustworthiness decreased, while the NAcc/caudate
of surprise) in a given context. These authors suggest further and vmPFC/pgACC were all more consistently active as
that given the dorsal amygdala’s response to surprised (Kim facial attractiveness increased. This distinction mirrors the
et al., 2003), fearful (Whalen et al., 1998, 2001) and happy faces results we observed in our primary analyses. In contrast, no
(Breiter et al., 1996; Whalen et al., 1998), it may be tracking the brain regions were consistently activated across contrasts
salience of these faces, more generally. This hypothesis is con- where facial attractiveness decreased or facial trustworthiness
sistent with the current findings. increased, respectively, even when including ROI coordin-
These findings open the door to future work along those ates in the analyses. We should note that these contrastses-
lines. One possibility is that there exist separate populations pecially the comparison between positive linear responses in
of neurons within the amygdala that code for stimulus va- attractiveness and trustworthiness studiesare certainly
lence and stimulus salience, respectively. Ultimately, the unbalanced, rendering the results more suggestive than
findings are in line with previous work proposing a shift confirmative.
away from conceptualizing the amygdala as simply a fear As noted in the introduction, given that attractiveness and
or threat module and instead toward an account of the trustworthiness judgments from faces are highly correlated,
amygdala as also tracking stimulus intensity (Anderson this pattern is puzzling. These differences between trust-
et al., 2003; Small et al., 2003) or motivational salience worthiness and attractiveness studies cannot be explained
(Sander et al., 2003; Cunningham et al., 2008; Adolphs, by researchers’ a priori focus on different regions because
2010; Todorov, 2011). These findings also serve as an excel- our results hold even for whole brain analyses that did not
lent reminder that one of the additional benefits of the include ROI coordinates from individual studies.
meta-analytic method is the possibility of generating new, The apparent differences in the neural bases of attractive-
testable hypotheses for future research. ness and trustworthiness are also puzzling in the context of
Faces that are tagged as affectively significant in the amyg- studies that used the same set of faces to examine responses
dala can be further processed in prefrontal regions, which, in to facial attractiveness and trustworthiness (Todorov and
Social evaluation of faces SCAN (2013) 295

Fig. 5 The relationship between perceptions of face typicality and face attractiveness for (A) a standardized set of faces (the Karolinska set) and (B) faces sampled to be
extremely attractive from websites of models. The judgments are shown in standardized units. Each point of the plots represents a face.

Engell, 2008). Specifically, Todorov and Engell re-analyzed (Figure 5B). In such studies, the amygdala may respond to
the data from Engell et al. (2007), using 14 different social both extremely attractive and extremely unattractive faces as
judgments of the same set of faces. Most of the brain re- observed in Winston et al. (2007).
sponses were accounted by a general valence dimension The typicality hypothesis predicts that faces that system-
rather than by specific dimensions such as attractiveness atically differ in their perceived typicality may lead to
and trustworthiness (both of these were highly correlated different neural responses. In fact, in the contrast of attract-
with this dimension). iveness studies using extreme faces and studies using more
What could be driving the differences in neuroimaging typical faces, focusing specifically on studies employing im-
studies on attractiveness and trustworthiness? One possibil- plicit paradigms, we observed consistent patterns of activa-
ity is that the type of faces used in these studies may lead to tion in right amygdala and NAcc/caudate. This suggests that
different responses. Specifically, a third variable that is cor- when task demands are controlled for, the driving force
related with both trustworthiness and attractiveness but behind NAcc and caudate activations observed in these
could vary across sets of faces may account for such differ- studies was the usage of extremely attractive, atypical faces.
ences. One candidate is face typicality. Recently, Said and This result also lends additional support to the suggestion
colleagues (2010) showed that coding face typicality is a that extreme, atypical faces will drive amygdala activity,
more parsimonious explanation of prior findings of the in- regardless of their trustworthiness. Further, the consistent
volvement of the amygdala in face evaluation than coding activations in vmPFC and pgACC that were observed
face valence. across attractiveness contrasts but not trustworthiness con-
Face typicality could vary across data sets and lead to trasts can also be accounted for by face typicality.
different results. For example, in many standardized data Contrasting extreme attractiveness and trustworthiness con-
sets of natural faces, typicality is positively correlated with tinued to produce consistent activation in these regions,
both attractiveness and trustworthiness judgments while contrasting more typical attractiveness against trust-
(Figure 5A). In studies using these stimuli, the amygdala worthiness did not.
shows stronger responses to more atypical faces that hap- It may be the case that in the context of face evaluation,
pened also to be more negative (Todorov and Engell, 2008). some of the regions implicated in reward processing are only
In studies using artificial stimuli created by a statistical activated upon the presence of real and extremely attractive
model, the most atypical faces are faces at the extremes of faces, or the goal to evaluate face attractiveness, or some
the dimension. In such studies, the amygdala responds to combination of stimulus features and task demands.
more atypical faces that happened to be more positive or Unfortunately, we do not have a sufficient number of studies
more negative (Said et al., 2010). The important distinction to test for more specific effects.
here is not between real and artificial faces. Judgments of
artificial faces that have not been manipulated to exaggerate Recommendations for studies using face stimuli
differences along social dimensions are linearly correlated Our findings suggest that the type of face stimuli selected for
with their perceived typicality. Finally, in attractiveness stu- a particular study matters a great deal. For example, using
dies that use extremely attractive faces (e.g. Aharon et al., more ‘extreme’ faces resulted in more consistently observed
2001), the most attractive faces may be the least typical activation in the NAcc. Given that stimuli are often selected
296 SCAN (2013) P. Mende-Siedlecki et al.

in an ad hoc fashion and rarely shared among research Blasi, G., Hariri, A.R., Alce, G., et al. (2009). Preferential amygdala reactivity
groups, this complicates comparisons across studies. to the negative assessment of neutral faces. Biological Psychiatry, 66,
847–53.
Moreover, it undermines the generalizability of results. Bray, S., O’Doherty, J. (2007). Neural coding of reward-prediction error
To overcome these problems, researchers need to use a signals during classical conditioning with attractive faces. Journal of
shared set of stimuli, not necessarily the same stimuli but Neurophysiology, 97, 3036–45.
stimuli sampled from a common pool. One approach is to Breiter, H.C., Etcoff, N.L., Whalen, P.J., et al. (1996). Response and habitu-
use parametrically manipulated faces generated by an expli- ation of the human amygdala during visual processing of facial expres-
sion. Neuron, 17, 875–87.
citly specified statistical model (e.g. Oosterhof and Todorov, Bzdok, D., Langner, R., Caspers, S., et al. (2011). ALE meta-analysis on
2008; Todorov and Oosterhof, 2011). This approach has the facial judgments of trustworthiness and attractiveness. Brain Structure
benefit of providing researchers with a full spectrum of and Function, 215, 209–23.
facesone that is not biased towards one portion of a Canli, T., Sivers, H., Whitfield, S.L., Gotlib, I.H., Gabrieli, J.D. (2002).
given dimension. Our laboratory has made a number of Amygdala response to happy faces as a function of extraversion.
Science, 296, 2191.
such databases available for academic research (http://web Chatterjee, A., Thomas, A., Smith, S.E., Aguirre, G.K. (2009). The neural
script.princeton.edu/tlab/databases/). However, artificial response to facial attractiveness. Neuropsychology, 23, 135–43.
faces may not be the best stimuli for many investigators. Cloutier, J., Heatherton, T.F., Whalen, P.J., Kelley, W.M. (2008). Are at-
In this case, it would be best to create a common bank of tractive people rewarding? Sex differences in the neural substrates of facial
stimuli that are shared with other research groups. These attractiveness. Journal of Cognitive Neuroscience, 20, 941–51.
Costafreda, S.G., Brammer, M.J., David, A.S., Fu, C.H.Y. (2008). Predictors
stimuli could be validated on a number of important vari- of amygdala activation during the processing of emotional stimuli: A
ables such as typicality, and these variables could be further meta-analysis of 385 PET and fMRI studies. Brain Research Reviews, 58,
used to facilitate comparisons across studies. 57–70.
Cunningham, W.A., Van Bavel, J.J., Johnsen, I.R. (2008). Affective flexibil-
ity: evaluative processing goals shape amygdala activity. Psychological
SUPPLEMENTARY DATA Science, 19, 152–60.
Supplementary data are available at SCAN online. Dannlowski, U., Ohrmann, P., Bauer, J., et al. (2007). Amygdala reactivity
predicts automatic negative evaluations for facial emotions. Psychiatry
Research: Neuroimgaging, 154, 13–20.
Davis, F.C., Johnstone, T., Mazzulla, E.C., Oler, J.A., Whalen, P.J. (2010).
Conflict of Interest
Regional response differences across the human amygdaloid complex
None declared. during social conditioning. Cerebral Cortex, 20, 612–21.
Dolan, R.J., Fletcher, P., Morris, J., Kapur, N., Deakin, J.F.W., Frith, C.D.
(1996). Neural activation during covert processing of positive emotional
REFERENCES facial expressions. NeuroImage, 4, 194–200.
Adolphs, R. (2010). What does the amygdala contribute to social cognition? Eberhardt, J.L., Davies, P.G., Purdie-Vaughns, V.J., Johnson, S.L. (2006).
Annals of the New York Academy of Sciences, 1191, 42–61. Looking deathworthy: Perceived stereotypicality of Black defend-
Adolphs, R., Tranel, D., Damasio, A.R. (1998). The human amygdala in ants predicts capital-sentencing outcomes. Psychological Science, 17,
social judgment. Nature, 393, 470–4. 383–6.
Aharon, I., Etcoff, N., Ariely, D., Chabris, C.F., O’Connor, E., Breiter, H.C. Engell, A.D., Haxby, J.V., Todorov, A. (2007). Implicit trustworthiness de-
(2001). Beautiful faces have variable reward value: fMRI and behavioral cisions: automatic coding of face properties in human amygdala. Journal
evidence. Neuron, 32, 537–51. of Cognitive Neuroscience, 19, 1508–19.
Amaral, D.G., Price, J.L., Pitkänen, A., Carmichael, S.T. (1992). Anatomical Engell, A.D., Todorov, A., Haxby, J.V. (2010). Common neural mechanisms
organization of the primate amygdaloid complex. In: Aggleton, J.P., for the evaluation of facial trustworthiness and emotional expressions as
editor. The Amygdala: Neurobiological Aspects of Emotion, Memory, and revealed by behavioral adaptation. Perception, 39, 931–41.
Mental Dysfunction. New York: Wiley-Liss, pp. 1–66. Fox, P.T., Parsons, L.M., Lancaster, J.L. (1998). Beyond the single study:
Anderson, A.K., Christoff, K., Stappen, I., et al. (2003). Dissociated neural function/location meta-analysis in cognitive neuroimaging. Current
representations of intensity and valence in human olfaction. Nature Opinions in Neurobiology, 8, 178–87.
Neuroscience, 6, 196–202. Fu, C.H.Y., Williams, S.C.R., Brammer, M.J., et al. (2007). Neural
Aron, A., Fisher, H., Mashek, D.J., Strong, G., Li, H., Brown, L.L. (2005). responses to happy facial expressions in major depression follow-
Reward, motivation, and emotion systems associated with early-stage ing antidepressant treatment. American Journal of Psychiatry, 164,
intense romantic love. Journal of Neurophysiology, 94, 327–37. 599–607.
Asch, S.E. (1946). Forming impressions of personality. Journal of Abnormal Gordon, D.S., Platek, S.M. (2009). Trustworthy? The brain knows: Implicit
and Social Psychology, 41, 258–90. neural responses to faces that vary in Dark Triad Personality character-
Baas, D., Aleman, A., Vink, M., Ramsey, N.F., de Haan, E.H.F., Kahn, R.S. istics and trustworthiness. Journal of Social, Evolutionary, and Cultural
(2008). Evidence of altered cortical and amygdala activation during social Psychology, 3, 182–200.
decision-making in schizophrenia. NeuroImage, 40, 719–27. Gothard, K.M., Battaglia, F.P., Erickson, C.A., Spitler, K.M., Amaral, D.G.
Bar, M., Neta, M., Linz, H. (2006). Very first impressions. Emotion, 6, (2007). Neural responses to facial expression and face identity in the
269–78. monkey amygdala. Journal of Neurophysiology, 97, 1671–83.
Ballew, C.C., Todorov, A. (2007). Predicting political elections from rapid Hamermesh, D., Biddle, J. (1994). Beauty and the labor market. The
and unreflective face judgments. Proceedings of the National Academy of American Economic Review, 84, 1174–94.
Sciences of USA, 104, 17948–53. Hampshire, A., Chaudhry, A.M., Owen, A.M., Roberts, A.C. (2011).
Blair, I.V., Judd, C.M., Chapleau, K.M. (2004). The influence of Dissociable roles for lateral orbitofrontal cortex and lateral prefrontal
Afrocentric facial features in criminal sentencing. Psychological Science, cortex during preference driven reversal learning. Neuroimage, [Epub
15, 674–9. 29 October, 2011, doi: 10.1016/j.neuroimage.2011.10.072].
Social evaluation of faces SCAN (2013) 297

Haruno, M., Kuroda, T., Doya, K., et al. (2004). A neural correlate of Montepare, J.M., Dobish, H. (2003). The contribution of emotion percep-
reward-based behavioral learning in caudate nucleus: a functional mag- tions and their overgeneralizations to trait impressions. Journal of
netic resonance imaging study of a stochastic decision task. Journal of Nonverbal Behavior, 27, 236–54.
Neuroscience, 24, 1660–5. Morris, J.S., Frith, C.D., Perrett, D.I., et al. (1996). A differential neural
Heinz, A., Braus, D.F., Smolka, M.N., et al. (2004). Amygdala-prefrontal response in the human amygdala to fearful and happy expressions.
coupling depends on a genetic variation of the serotonin transporter. Nature, 383, 812–5.
Nature Neuroscience, 8, 20–1. Morris, J.S., Ohman, A., Dolan, R.J. (1998). Conscious and unconscious
Hoffman, K.L., Gothard, K.M., Schmid, M.C., Logothetis, N.K. (2007). emotional learning in the human amygdala. Nature, 393, 467–70.
Facial-expression and gaze-selective responses in the monkey amygdala. Nakamura, K., Kawashima, R., Nagumo, S., et al. (1998). Neuro-
Current Biology, 17, 766–72. anatomical correlates of the assessment of facial attractiveness.
Iaria, G., Fox, C.J., Waite, C.T., Aharon, I., Barton, J.J.S. (2008). The con- Neuroreport, 9, 753–7.
tribution of the fusiform gyrus and superior temporal sulcus in proces- Nakamura, K., Mikami, A., Kubota, K. (1992). Activity of single neurons in
sing facial attractiveness: Neuropsychological and neuroimaging evidence. the monkey amygdala during performance of a visual discrimination task.
Journal of Neuroscience, 155, 409–22. Journal of Neurophysiology, 67, 1447–63.
Jackson, M.C., Wolf, C., Johnston, S.J., Raymond, J.E., Linden, D.E.J. Nichols, T., Hayasaka, S. (2003). Controlling the familywise error rate in
(2008). Neural correlates of enhanced visual short-term memory for functional neuroimaging: a comparative review. Statistical Methods in
angry faces: an fMRI study. PLoS One, 3, e3536. Medical Research, 12, 419–46.
Kampe, K.K., Frith, C.D., Dolan, R.J., Frith, U. (2001). Reward value of Nielsen, F.A., Copenhagen, D., Lyngby, D. (2005). Mass meta-analysis in
attractiveness and gaze. Nature, 413, 589. Talairach space. Advances in Neural Information Processing Systems, 17,
Kawabata, H., Zeki, S. (2004). Neural correlates of beauty. Journal of 985–92.
Neurophysiology, 91, 1699–05. Nomura, M., Ohira, H., Haneda, K., et al. (2004). Functional association of
Kesler-West, M.L., Andersen, A.H., Smith, C.D., Avison, M.J., Davis, C.E., the amygdala and ventral prefrontal cortex during cognitive evaluation of
Kryscio, R.J., Blonder, L.X. (2001). Neural substrates of facial emotion facial expressions primed by masked angry faces: an event-related fMRI
processing using fMRI. Cognitive Brain Research, 11, 213–26. study. NeuroImage, 21, 352–63.
Kim, H., Somerville, L.H., McLean, A.A., Johnstone, T., Shin, L.M., Pessoa, L., McKenna, M., Gutierrez, E., Ungerleider, L.G. (2002). Neural
Whalen, P.J. (2003). Functional MRI response of the human dorsal amyg- processing of emotional faces requires attention. Proceedings of the
dala/substantia innominata region to facial expressions of emotion. National Academy of Sciences of USA, 99, 11458–63.
Annals of the New York Academy of Sciences, 985, 533–5. Pezawas, L., Meyer-Lindenberg, A., Drabant, E.M., et al. (2005).
Kim, H., Adolphs, R., O Doherty, J.P., Shimojo, S. (2007). Temporal isola- 5-HTTLPR polymorphism impacts human cingulate-amygdala inter-
tion of neural processes underlying face preference decisions. Proceedings actions: a genetic susceptibility mechanism for depression. Nature
of the National Academy of Sciences of USA, 104, 18253–8. Neuroscience, 8, 828–34.
Kober, H., Barrett, L.F., Joseph, J., Bliss-Moreau, E., Lindquist, K., Phan, K.L., Wager, T.D., Taylor, S.F., Liberzon, I. (2002). Functional neuro-
Wager, T.D. (2008). Functional grouping and cortical-subcortical inter- anatomy of emotion: a meta-analysis of emotion activation studies in
actions in emotion: a meta-analysis of neuroimaging studies. NeuroImage, PET and fMRI. NeuroImage, 16, 331–48.
42, 998–1031. Phillips, M.L., Bullmore, E.T., Howard, R., et al. (1998). Investigation of
Kober, H., Wager, T.D. (2010). Meta-analyses of neuroimaging data. Wiley facial recognition memory and happy and sad facial expression percep-
Interdisciplinary Reviews, 1, 293–300. tion: an fMRI study. Psychiatry Research: Neuroimaging Section, 83,
Knutson, B., Adams, C.M., Fong, G.W., Hommer, D. (2001a). Anticipation 127–38.
of increasing monetary reward selectively recruits nucleus accumbens. Pinkham, A.E., Hopfinger, J.B., Pelphrey, K.A., Piven, J., Penn, D.L.
Journal of Neuroscience, 21, 1–5. (2008a). Neural bases for impaired social cognition in schizophre-
Knuston, B., Fong, G.W., Adams, C.M., Varner, J.L., Hommer, D. (2001b). nia and autism spectrum disorders. Schizophrenia Research, 99,
Dissociation of reward anticipation and outcome with event-related 164–75.
fMRI. NeuroReport, 12, 3683–7. Pinkham, A.E., Hopfinger, J.B., Ruparel, K., Penn, D.L. (2008b). An in-
Kranz, F., Ishai, A. (2006). Face perception is modulated by sexual prefer- vestigation of the relationship between activation of a social cogni-
ence. Current Biology, 16, 63–8. tive neural network and social functioning. Schizophrenia Bulletin, 34,
Laird, A.R., Fox, P.M., Price, C.J., et al. (2005). ALE meta-analysis: control- 688–97.
ling the false discovery rate and performing statistical contrasts. Human Pochon, J.-B., Riis, J., Sanfey, A.G., Nystrom, L.E., Cohen, J.D. (2008).
Brain Mapping, 25, 155–64. Function imaging of decision conflict. Journal of Neuroscience, 28,
Lee, T.M.C., Liu, H., Hoosain, R., et al. (2002). Gender differences in 2468–3473.
neural correlates of recognition of happy and sad faces in humans O’Doherty, J., Winston, J., Critchley, H., Perrett, D., Burt, D.M., Dolan, R.J.
assessed by functional magnetic resonance imaging. Neuroscience (2003). Beauty in a smile: the role of medial orbitofrontal cortex in facial
Letters, 1, 13–16. attractiveness. Neuropsychologia, 41, 147–55.
Liang, X., Zebrowitz, L.A., Zhang, Y. (2010). Neural activation in the Olivola, C.Y., Todorov, A. (2010a). Elected in 100 milliseconds:
‘reward circuit’ shows a nonlinear response to facial attractiveness. appearance-based trait inferences and voting. Journal of Nonverbal
Social Neuroscience, 5, 320–34. Behavior, 34, 83–110.
Mazur, A., Mazur, J., Keating, C. (1984). Military rank attainment of a West Olivola, C.Y., Todorov, A. (2010b). Fooled by first impressions?
Point class: effects of cadets’ physical features. American Journal of Re-examining the diagnostic value of appearance-based inferences.
Sociology, 90, 125–50. Journal of Experimental Social Psychology, 46, 315–24.
Monk, C.S., Nelson, E.E., McClure, E.B., et al. (2006). Ventrolateral pre- Olson, I.R., Marshuetz, C. (2005). Facial attractiveness is appraised in a
frontal cortex activation and attentional bias in response to angry faces in glance. Emotion, 5, 498–502.
adolescents with generalized anxiety disorder. American Journal of Oosterhof, N.N., Todorov, A. (2008). The functional basis of face evalu-
Psychiatry, 163, 1091–7. ation. Proceedings of the National Academy of Sciences of USA, 105,
Monk, C.S., Telzer, E.H., Mogg, K., et al. (2008). Amygdala and ventrolat- 11087–92.
eral prefrontal cortex activation to masked angry faces in children and Oosterhof, N.N., Todorov, A. (2009). Shared perceptual basis of emotional
adolescents with generalized anxiety disorder. Archives of General expressions and trustworthiness impressions from faces. Emotion, 9,
Psychiatry, 65, 568–76. 128–33.
298 SCAN (2013) P. Mende-Siedlecki et al.

Quirk, G.J., Likhtik, E., Pelletier, J.G., Paré, D. (2003). Stimulation of medial Todorov, A., Engell, A. (2008). The role of the amygdala in implicit evalu-
prefrontal cortex decreases the responsiveness of central amygdala output ation of emotionally neutral faces. Social, Cognitive, and Affective
neurons. Journal of Neuroscience, 23, 8800–7. Neuroscience, 3, 303–12.
Rolls, E.T. (2000a). The orbitofrontal cortex and reward. Cereberal Cortex, Todorov, A., Mandisodza, A.N., Goren, A., Hall, C.C. (2005). Inferences
10, 284–94. of competence from faces predict election outcomes. Science, 308,
Rolls, E.T. (2000b). Neurophysiology and function of the primate amyg- 1623–6.
dala, and neural basis of emotion. In: Aggleton, J.P., editor. Todorov, A., Oosterhof, N.N. (2011). Modeling social perception of faces.
The Amygdala: A Functional Analysis. USA: Oxford University Press, IEEE Signal Processing Magazine, 28, 117–22.
pp. 447–78. Todorov, A., Pakrashi, M., Oosterhof, N.N. (2009). Evaluating faces on
Rule, N.O., Ambady, N. (2008). Brief exposures: male sexual orientation is trustworthiness after minimal time exposure. Social Cognition, 27,
accurately perceived at 50 ms. Journal of Experimental Social Psychology, 813–33.
44, 1100–5. Todorov, A., Said, C.P., Engell, A.D., Oosterhof, N.N. (2008b).
Rule, N.O., Ambady, N., Adams, R.B.Jr (2009). Personality in perspective: Understanding evaluation of faces on social dimensions. Trends in
judgmental consistency across orientations of the face. Perception, 38, Cognitive Sciences, 12, 455–60.
1688–99. Todorov, A., Said, C.P., Oosterhof, N.N., Engell, A.D. (2011). Task-
Said, C.P., Baron, S.G., Todorov, A. (2009a). Nonlinear amygdala invariant brain responses to the social value of faces. Journal of
response to face trustworthiness: contributions of high and low Cognitive Neuroscience. [Epub ahead of print; doi:10.1162/
spatial frequency information. Journal of Cognitive Neuroscience, 21, jocn.2011.21616].
519–28. Todorov, A., Said, C.P., Verosky, S.C. (2011). Personality impressions from
Said, C.P., Dotsch, R., Todorov, A. (2010). The amygdala and FFA track facial appearance. In: Calder, A., Haxby, J.V., Johnson, M., Rhodes, G.,
both social and non-social face dimensions. Neuropsychologia, 48, editors. Handbook of Face Perception. USA: Oxford University Press, pp.
3596–605. 631–52.
Said, C.P., Haxby, J.V., Todorov, A. (2011). Brain systems for the assess- Tsukiura, T., Cabeza, R. (2010). Shared brain activity for aesthetic
ment of the affective value of faces. Philosophical Transactions of the Royal and moral judgments: implications for the Beauty-is-Good stereotype.
Society, B, 336, 1660–70. Social Cognitive and Affective Neuroscience. [Published online March 15,
Said, C.P., Sebe, N., Todorov, A. (2009b). Structural resemblance to emo- 2010; doi: 10.1093/scan/nsq025].
tional expressions predicts evaluation of emotionally neutral faces. Turk, D.J., Banfield, J.F., Walling, B.R., Heatherton, T.F., Grafton, S.T.,
Emotion, 9, 260–4. Handy, T.C., et al. (2004). From facial cue to dinner for two: the
Sander, D., Grafman, J., Zalla, T. (2003). The human amygdala: an evolved neural substrates of personal choice. NeuroImage, 22, 1281–90.
system for relevance detection. Reviews in the Neurosciences, 14(4), Van Rijn, S., Swaab, H., Baas, D., de Haan, E., Kahn, R.S., Aleman, A.
303–16. (2011). Neural systems for social cognition in Klinefelter
Salimi-Khorshidi, G., Smith, S.M., Keltner, J.R., Wager, T.D., Nichols, T.E. syndrome (47,XXY): evidence from fMRI. Social Cognitive and
(2009). Meta-analysis of neuroimaging data: a comparison of Affective Neuroscience. [Published online July 6, 2011; doi: 10.1093/
image-based and coordinate-based pooling of studies. NeuroImage, 45, scan/nsr041].
810–23. Verosky, S.C., Todorov, A. (2010). Differential neural responses to faces
Sergerie, K., Chochol, C., Armony, J.L. (2008). The role of the amygdala physically similar to the self as a function of their valence. NeuroImage,
in emotional processing: a quantitative meta-analysis of functional 49, 1690–8.
neuroimaging studies. Neuroscience and Biobehavioral Reviews, 32, Vrticka, P., Andersson, F., Grandjean, D., Sander, D., Vuilleumier, P.
811–30. (2008). Individual attachment style modulates human amygdala and stri-
Small, D.M., Gregory, M.D., Mak, Y.E., Gitelman, D., Mesulam, M.M., atum activation during social appraisal. PLoS ONE, 3, e2868.
Parrish, T. (2003). Dissociation of neural representation of intensity Wager, T.D., Barrett, L.F., Bliss-Moreau, E., et al. (2008). The neuroimaging
and affective valuation in human gestation. Neuron, 39, 701–11. of emotion. In: Lewis, M., Haviland-Jones, J.M., Barrett, L.F., editors.
Smith, D.V., Hayden, B.Y., Truong, T., Song, A.W., Platt, M.L., Handbook of Emotion 3rd edn. New York: Guilford, pp. 249–71.
Huettel, S.A. (2010). Distinct value signals in anterior and posterior Wager, T.D., Smith, E.E. (2003). Neuroimaging studies of working mem-
ventromedial prefrontal cortex. Journal of Neuroscience, 30, 2490–95. ory: a meta-analysis. Cognitive Affective Behavioural Neuroscience, 3,
Somerville, L.H., Kim, H., Johnstone, T., Alexander, A.L., Whalen, P.J. 255–74.
(2004). Human amygdala responses during presentation of happy and Wager, T.D., Reading, S., Jonides, J. (2004). Neuroimaging studies of shift-
neutral faces: correlations with state anxiety. Biological Psychiatry, 55, ing attention: a meta-analysis. NeuroImage, 22, 1679–93.
897–903. Whalen, P.J., Rauch, S.L., Etcoff, N.L., McInerney, S.C., Lee, M.B.,
Somerville, L.H., Wig, G.S., Whalen, P.J., Kelley, W.M. (2006). Dissociable Jenike, M.A. (1998). Masked presentations of emotional facial expressions
medial temporal lobe contributions to social memory. Journal of modulate amygdala activity without explicit knowledge. Journal of
Cognitive Neuroscience, 18, 1253–65. Neuroscience, 18, 411–8.
Stein, J.L., Wiedholz, L.M., Bassett, D.S., et al. (2007). A validated network Whalen, P.J., Shin, L.M., McInerny, S.C., Fischer, H., Wright, C.I.,
of effective amygdala connectivity. NeuroImage, 36, 736–45. Rauch, S.L. (2001). A function MRI study of human amygdala responses
Taylor, S.E., Eisenberger, N.I., Saxbe, D., Lehman, B.J., Lieberman, M.D. to facial expressions of fear versus anger. Emotion, 1, 70–83.
(2006). Neural responses to emotional stimuli are associated with child- Willis, J., Todorov, A. (2006). First impressions: making up your mind after
hood family stress. Biological Psychiatry, 60, 296–301. 100 ms exposure to a face. Psychological Science, 17, 592–8.
Todorov, A. (2008). Evaluating faces on trustworthiness: an extension of Winston, J.S., O’Doherty, J., Kilner, J.M., Perrett, D.I., Dolan, R.J. (2007).
systems for recognition of emotions signaling approach/avoidance behav- Brain systems for assessing facial attractiveness. Neuropsychologia, 45,
iors. Annals of the New York Academy of Sciences, 1124, 208–24. 195–206.
Todorov, A. (2011). The role of the amygdala in face perception and evalu- Winston, J.A., Strange, B., O’Doherty, J., Dolan, R.J. (2002). Automatic and
ation. Motivation and Emotion. [Published online August 2, 2011; intentional brain responses during evaluation of trustworthiness of face.
doi:10.1007/s11031-011-9238-5]. Nature Neuroscience, 5, 277–83.
Todorov, A., Baron, S., Oosterhof, N.N. (2008a). Evaluating face trust- Yang, T.T., Menon, C., Eliez, S., et al. (2002). Amygdalar activation asso-
worthiness: a model based approach. Social, Cognitive, and Affective ciated with positive and negative facial expressions. Neuroreport, 13,
Neuroscience, 3, 119–27. 1737–41.
Social evaluation of faces SCAN (2013) 299

Zaki, J., Schirmer, J., Mitchell, J.P. (2011). Social influence modulates the Zebrowitz, L.A., Montepare, J.M. (2008). Social psychological face percep-
neural computation of value. Psychological Science, 22, 894–900. tion: why appearance matters. Social and Personality Psychology Compass,
Zebrowitz, L.A. (1999). Reading faces: window to the soul?. Boulder, CO: 2, 1497–1517.
Westview Press. Zink, C.F., Stein, J.L., Kempf, L., Hakimi, S., Meyer-Lindenberg, A. (2010).
Zebrowitz, L.A., McDonald, S.M. (1991). The impact of litigants’ babyface- Vasopressin modulates medial prefrontal cortex-amygdala circuitry
ness and attractiveness on adjudications in small claims courts. Law and during emotion processing in humans. Journal of Neuroscience, 30,
Human Behavior, 15, 603–23. 7017–22.

You might also like