You are on page 1of 13

Brain Research Protocols 15 (2005) 142 – 154

www.elsevier.com/locate/brainresprot

Protocol

Regression analysis utilizing subjective evaluation of emotional


experience in PET studies on emotions
Sargo Aalto a,b,*, Esa Wallius c,1, Petri Näätänen d, Jaana Hiltunen e, Liisa Metsähonkala b,f,
Hannu Sipilä b, Hasse Karlsson b,g
a
Department of Psychology, Åbo Akademi University, FIN-20500 Turku, Finland
b
Turku PET Centre, University of Turku, FIN-20520 Turku, Finland
c
Institute of Signal Processing, DMI, Tampere University of Technology, Tampere, Finland
d
Department of Psychology, University of Helsinki, Finland
e
Section of Clinical Neurosciences, Finnish Institute of Occupational Health, Helsinki, Finland
f
Department of Child Neurology, Helsinki University Hospital, Helsinki, Finland
g
Department of Psychiatry, University of Helsinki, 00014 Helsinki, Finland

Accepted 27 June 2005


Available online 29 August 2005

Abstract

A methodological study on subject-specific regression analysis (SSRA) exploring the correlation between the neural response and the
subjective evaluation of emotional experience in eleven healthy females is presented. The target emotions, i.e., amusement and sadness, were
induced using validated film clips, regional cerebral blood flow (rCBF) was measured using positron emission tomography (PET), and the
subjective intensity of the emotional experience during the PET scanning was measured using a category ratio (CR-10) scale. Reliability
analysis of the rating data indicated that the subjects rated the intensity of their emotional experience fairly consistently on the CR-10 scale
(Cronbach alphas 0.70 – 0.97). A two-phase random-effects analysis was performed to ensure the generalizability and inter-study
comparability of the SSRA results. Random-effects SSRAs using Statistical non-Parametric Mapping 99 (SnPM99) showed that rCBF
correlated with the self-rated intensity of the emotional experience mainly in the brain regions that were identified in the random-effects
subtraction analyses using the same imaging data. Our results give preliminary evidence of a linear association between the neural responses
related to amusement and sadness and the self-evaluated intensity of the emotional experience in several regions involved in the emotional
response. SSRA utilizing subjective evaluation of emotional experience turned out a feasible and promising method of analysis. It allows
versatile exploration of the neurobiology of emotions and the neural correlates of actual and individual emotional experience. Thus, SSRA
might be able to catch the idiosyncratic aspects of the emotional response better than traditional subtraction analysis.
D 2005 Elsevier B.V. All rights reserved.

Theme: Neural basis of behavior


Topic: Motivation and emotion

Keywords: Subject specific regression analysis; Regression analysis; Correlation analysis; Subjective rating; Emotion; Sadness; Amusement; Statistical
parametric mapping; Positron emission tomography

1. Type of research

The statistical analyses of imaging studies on emotions


have almost exclusively utilized the subtraction method (see
* Corresponding author. Department of Psychology, Åbo Akademi
University, 20500 Turku, Finland. Fax: +358 2 231 8191.
[30]), where two conditions, typically ‘‘activation’’ and
E-mail address: sargo.aalto@utu.fi (S. Aalto). reference (‘‘neutral’’) states, are subtracted from each other,
1
Has contributed more than is typical for 2nd writer. which is a bipolar and fairly simplistic approach. This
1385-299X/$ - see front matter D 2005 Elsevier B.V. All rights reserved.
doi:10.1016/j.brainresprot.2005.06.003
S. Aalto et al. / Brain Research Protocols 15 (2005) 142 – 154 143

approach is based on external validation of emotion with eleven subjects used in our earlier study presenting the
induction and presumes reliable coupling between the results of fixed-effects subtraction analysis [2]. The present
stimulus and the response, i.e., that almost similar emotional study is mainly methodological, and the discussion focuses
states can be induced in the study sample as in the validation on the usability, benefits, and restrictions of SSRA in studies
sample. However, even in controlled laboratory conditions, on emotions.
emotional experience varies considerably between subjects
(see, e.g., [43]). Therefore, in parallel with the ‘‘traditional’’
subtraction approach, there is a need for methods of analysis 2. Time required
that could capture more flexibly the inherent individuality of
emotional responses. Training of subjects to use the CR-10 scale: 30 min per
The theoretical works by Friston et al. [10 – 12] have subject.
served as a basis for subject-specific regression analysis Manipulation check: 60 min.
(SSRA) in a voxel-based statistical analysis of imaging data. Evaluation of rating data: 60 min.
With this method, it is possible to examine the association Magnetic resonance imaging of the brain: 35 min per
between regional cerebral blood flow (rCBF) reflecting subject.
neuronal activity and external variables, e.g. subjective PET data acquisition: 150 min per subject.
ratings. SSRA with subjective self-evaluation of the emo- PET data preprocessing: 10 min per subject.
tional experience has several potential advantages compared Voxel-based statistical analyses: 120 min.
to subtraction analysis in studies on emotion. Firstly, the Total time required to run the protocol with 11 subjects:
method does not need a reference (neutral) condition or a approximately 45 h.
validation procedure of dichotomous emotion induction,
which are required for the subtraction method. Secondly,
this approach allows individual responses to the material 3. Materials
used for emotion induction because it is based on individual
ratings of emotional experience, and the statistical model is 3.1. Subjects
fitted individually for each subject. Thirdly, by using a
versatile rating questionnaire, it is possible to explore the Eleven right-handed healthy female volunteers (mean
different emotions or aspects of emotions induced by the age 33.4; range 18 to 44 years) participated in the study
stimuli using the same (multiscan) imaging data. Thus, approved by the Ethics Committee of Turku University/
SSRA might be able to catch more fully the idiosyncratic Turku University Central Hospital. The volunteers gave
aspects of the emotional response, as it allows and draws on written informed consent. (For a detailed description of the
the natural variation of emotional experience. On the other study sample, see [2]).
hand, despite the individualistic approach and the subject-
specific statistical model, the results of a multi-subject study 3.2. Stimulus material
can be generalized at the population level, using random-
effects analysis (RFX). Despite its possible methodological The stimulus material consisted of 12 film clips, each
benefits, SSRA utilizing self-evaluation of subjective emo- lasting for an average of 2:30 min, with four films in each
tional experience has been utilized only in a few recent category, to induce amusement, sadness and a ‘‘neutral’’
fMRI studies [31,32,46]. However, to the best of our state. Four of the emotional film clips (When Harry met
knowledge, it has been neither applied nor methodologically Sally (amusement), two clips from Kramer vs. Kramer
evaluated in positron emission tomography (PET) studies on (sadness), and The Champ (sadness)) were chosen from
emotions. previously validated film sets [16,33]. All the additional
The aim of the study is methodological evaluation of films were validated for the purposes of the present study
SSRA utilizing subjective evaluation of emotional experi- with a sample of 51 university students. From this set, three
ence in imaging studies on emotion. We present a PET study episodes of the film Bean-The Ultimate Disaster Movie
utilizing SSRA and subjective evaluation of emotional (amusement) and one episode from Kramer vs. Kramer
experience. Two target emotions, amusement and sadness, (sadness) were chosen. The four neutral films were
were induced with validated film stimuli. The rCBF values professional video material containing views of social
were measured using PET, and the subjective intensity of scenes, talking people, and scenes of nature with movement
the emotional experience was rated on a category ratio scale and sound. The neutral films with minimal emotional
[5] after each PET scan. The correlation between rCBF and content were chosen in such a way that the basic sensory
the subjective rating data was analyzed using subject- properties (sound, movement, color) were similar to those of
specific regression analysis with RFX to achieve results the emotional films. To eliminate potential order effects, the
generalizable at the population level. For comparison, sequence of films was pseudo-random, but similar for all
subject-specific subtraction analysis with RFX was per- subjects. The present set of films has been previously used
formed as well. In the present study, we utilize the PET data by Aalto et al. [2].
144 S. Aalto et al. / Brain Research Protocols 15 (2005) 142 – 154

4. Detailed procedure the rating data were computed with SPSS for Windows,
Release 11.0.1.
4.1. Measurement of the intensity of emotional experience
4.3. Evaluation of rating data
After each PET scan, the subjects rated their subjective
emotional experience during the film using a questionnaire, The inter-subject consistency of the ratings, as measured
which covered the thematic (appraisal), action readiness, with Cronbach alphas of the amusement and sadness ratings
and feeling aspects of sadness, amusement, and a few for the target films, varied from high (a = 0.84, amusement
covariate emotions (interest, joy, disgust, fear, anger). The ratings) to very high (a = 0.97, sadness ratings). The
items for amusement were: ‘‘Humorous or funny things corresponding alphas for both the target and the neutral
happened’’ (core-relational theme), ‘‘I wanted to smile or films (with very low emotional intensity) varied from 0.70
laugh’’ (action readiness), and ‘‘I felt amused’’ (feeling). (amusement, excluding one neutral film of inconsistent
The items for sadness were: ‘‘Something important was amusement ratings) to 0.79 (sadness). Thus, considering the
lost’’ (core-relational theme), ‘‘I wanted to comfort’’ inter-personal context, the subjects rated their emotional
(action readiness), and ‘‘I felt sad’’ (feeling). The intensity experience in a considerably stable manner throughout the
ratings of the feeling items of sadness and amusement experiment, which supports the reliability of the ratings.
were used in this study. The intensities of the experienced Considering the intra-personal context, the scatter plots
emotions were measured with a verbally anchored 12-step of the CR-10 ratings of the intensity of the emotional
(0, 0.5, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10) category ratio (CR-10) experience show that the variety in the intra-subject ratings
scale [5], which allows linear quantification of perceptual was large and the profiles differed considerably between
intensities [7,39]. To obtain maximal accuracy and subjects (Fig. 1, left panels). The films seem to provide the
reliability of the intensity ratings, the subjects were trained necessary intra-subject variation for subject-specific regres-
and tested with a special blackness test to use the CR-10 sion estimates, although some individuals rated the films in
scale [6]. The subjects’ experiential responses to linearly a more dichotomous manner. The scatter plots of the CR-10
increasing blackness were within the 95% confidence ratings (Fig. 1, left panels) also show that some of the films
interval compared to the normal values [6]. The subjects did not have the expected effect on some individuals (see,
were instructed to rate their average emotional experience e.g., subject 5, who experienced one of the neutral films as
during the film. Ratings based on one’s subjective highly amusing).
experience instead of normative expectations were encour-
aged. The questions were projected on the film screen 4.4. PET data acquisition
after each PET scan and the subjects answered them
verbally. The PET data covering the whole brain were gathered in
the 3 D mode using a whole-body PET scanner (GE
4.2. Manipulation check Advance, Milwaukee, WI, USA), which provided 35
cantomeatal slices of 4.25 mm thickness and with 2.34 
(1) To check the effectiveness of the films in inducing the 2.34 mm in-plane voxel size. The performance characteristic
target emotions of the present study, two repeated-measures tests made on this scanner ensure that the transaxial spatial
analyses of variance (rmANOVA) were conducted on the resolution is 6 mm in the radial and 5 mm in the tangential
amusement and sadness ratings separately across the twelve direction, and the axial resolution is 6.5 mm [24]. In each of
films. Simple contrasts with two parameters were used. The the 12 scans, the film was initiated approximately 20 s
first parameter compared the ratings of amusement or before the injection of an intravenous 300 MBq [15O]-water
sadness between the corresponding target emotion films bolus (10 ml) into the left antecubital vein. The data were
and neutral films. The second parameter compared the integrated into a single 90-s frame. (For the details of PET
amusement or sadness ratings between the two target scanning, see [2]).
emotion films. The ratings of both target emotions were
significantly the highest in the corresponding target emotion 4.5. Preprocessing of imaging data
films in comparison with the neutral or the other target film,
the lowest F(1, 10) = 57.2, P < 0.001. The preprocessing and statistical analyses were per-
(2) To ensure that amusement and sadness were the formed using the Statistical Parametric Mapping [10]
most conspicuous components of the induced emotional software version 99 (SPM99), Statistical non-Parametric
states, paired t tests were conducted to compare the mean Mapping 99 (SnPM99; [27]) and Matlab 5.3 for Windows
ratings of the target emotions to all the other covariate (Math Works, Natick, MA, USA). Realignment and spatial
emotions. Among all the feeling ratings, the sadness ratings normalization were made using the standard procedure of
of the sadness films and the amusement ratings of the SPM99 (see [2]) and, finally, the images were smoothed
amusement films reached significantly the highest level, the with an isotropic Gaussian filter of 14 mm FWHM (full
lowest T = 3.4, P < 0.01. Statistical analyses concerning width at half maximum).
S. Aalto et al. / Brain Research Protocols 15 (2005) 142 – 154 145

Fig. 1. Scatter plots (left panels) and mean scores (right panels) of subjective intensity ratings of amusement (upper panels) and sadness (lower panels) based on
a category ratio scale (CR-10). In the scatter plots of subjective intensity ratings, the eleven subjects are shown on the horizontal axis and the intensity ratings of
the four emotion-inducing and the four neutral films on the vertical axis. The observations of emotion-inducing films are depicted as circles and the
observations of the neutral films as quadrangles. In the mean scores of the subjective intensity ratings, the CR-10 ratings of the target emotions during the
corresponding target emotion films are denoted by S and the ratings during the neutral films by N. The error bars represent standard error of mean (SEM).

4.6. Voxel-based statistical analyses served as the first, within-subject phase of RFX. As the
second, between-subjects phase of RFX, the null hypotheses
Statistical testing was done using two types of procedure: of no significant positive or negative correlation effects in
an exploratory analysis covered the entire brain without any the contrast images were statistically tested with one-tailed
a priori hypothesis about the location of effects, while a one-sample t tests using SnPM99. A corrected P value of
hypothesis-driven (confirmatory) VOI-based (volume of 0.05 at a cluster level was applied, which had been obtained
interest) analysis enabled higher sensitivity. by a corrected height threshold P value of 0.05 at the voxel
level combined with a critical suprathreshold size of 16
4.6.1. Exploratory regression analysis voxels. SnPM’s cluster level inference differs relevantly
At the first phase of RFX analysis, SSRAs testing the from that of SPM. In SnPM, such results are presented that
correlation between rCBF and the subjective ratings (CR- (i) are significant at the cluster level or (ii) exceed the
10) utilized eight scans per subject, out of which four scans critical threshold of the voxel-level inference. In the
corresponded to the four films inducing specific emotions analysis, variance smoothing of 12 mm and 2048 permu-
(amusement or sadness) and the other four to the ‘‘neutral’’ tations were used. Variance smoothing pools variance
films. Separate SSRAs for both emotions were conducted estimates over neighboring voxels, giving additional
with a model including subject-by-covariate interaction. degrees of freedom and decreasing noise. It also makes
Subject-specific AnCova global normalization was used, the statistic image, now called pseudo-t image, no longer t-
and the mean voxel values were subject-specifically scaled distributed. With more variance smoothing, the pseudo-t
to 50 ml/dl per minute. The model had 33 parameters, thresholds for the analysis become lower, increasing the
leaving 55 df for the estimation. The parameters in SSRAs sensitivity (statistical power) of the analysis. The corre-
consisted of three parts: a subject part, a block part, and a sponding pseudo-t height thresholds were 4.55 in amuse-
nuisance part. The subject part consisted of a block of ment and 4.29 in sadness.
subjective ratings for each subject, yielding 11 parameters.
The block part contained 11 parameters from the number of 4.6.2. Exploratory subtraction analysis
subjects, and the nuisance part included 11 subject-specific The comparative method, subject-specific subtraction
parameters for global normalization of CBF. analysis, was applied separately for both emotions using a
After the SSRA model specification, subject-specific condition-by-subject interaction model. Otherwise, the
contrasts were made and written to contrast images, which model settings in the first phase of RFX were the same
146 S. Aalto et al. / Brain Research Protocols 15 (2005) 142 – 154

as in SSRA. The model specifications resulted in a design 4.6.4. Localization and calculation of correlation
with 44 parameters leaving 55 df for the estimation. In coefficients
subtraction analyses, the subject part of the parameters For localization, the coordinates of the local maxima of
comprised a block of specific emotion and neutral scans the clusters resulting from statistical analysis were converted
for each subject, yielding 22 parameters. The block part into Talairach coordinates [41] using the mni2tal conversion
(11 parameters) and the nuisance part (11 parameters) software by Brett (http://www.mrc-cbu.cam.ac.uk/Imaging/
were the same as in the SSRAs. The second phase of mnispace.html) and localized using the Talairach Deamon
RFX testing the null hypotheses of no significant software [20]. The correlation coefficient for the peak voxel
activation and deactivation effects was conducted as of each cluster was computed with Matlab after adjustment
described earlier in the context of SSRA. The resulting for the effects of interest contrast.
pseudo-t height thresholds were 4.92 in amusement and
4.87 in sadness.
5. Results
4.6.3. VOI-based analysis
The hypothesis-driven VOI analysis performed with Fig. 3 presents the results of random-effects regression
SPM was directed onto the amygdala, medial frontal and subtraction analyses for amusement (amusement vs.
cortex (MFC), and subcallocal cingulate (SCC), which are neutral) and sadness (sadness vs. neutral) with three
frequently shown to be involved in sadness, amusement, orthogonal projections of a glass brain. The corresponding
or visually induced emotional state (for meta-analysis, see anatomic regions are given in Table 1 for amusement and in
[30]). The VOIs were drawn with the Imadeus software Table 2 for sadness.
(version 1.5, Forima Inc., Turku, Finland) on a ‘‘template’’ In amusement, the most extensive and intensive (highest
image averaged from spatially normalized T1-weighted pseudo-t statistics) cluster with a positive correlation
magnetic resonance images. The circular VOI with a 10 occurred in the right occipitotemporal area (BA19,
mm radius was placed bilaterally onto the four consec- BA22, BA39; Talairach coordinates of the peak voxel
utive slices in the amygdala. The VOI for SCC was [44, 76, 6]) (Fig. 3, upper left panel). Clusters showing
placed onto the eight consecutive planes inferior to the positive correlations were also seen in the occipitotemporal
anterior genu of corpus callosum, corresponding mainly to (BA18; [36, 82, 4] and BA22; [59, 33, 7]) and
the undermost part of the Brodmann areas 32. The VOI fusiform (BA37; [42, 51, 13]) areas and in the
for MFC was placed onto the nine consecutive planes superior temporal gyrus on the left (BA38; [26, 24,
including the medial aspects of the Brodmann areas 9 and 33]), in the right middle temporal lobe (BA21; [53, 10,
10, extending from the anterior boundary of the anterior 29]), and in the cerebellum on the left [10, 71, 15].
cingulate to the frontopolar tip. The search volume Clusters with negative correlations were seen in right
covering bilaterally the amygdala, MFC, and SCC was medial frontal gyrus (BA10; [8, 38, 9]) and in the AC
3300 voxels, which equals 26.4 cm3. Fig. 2 shows the bilaterally (BA24), in the right inferior frontal gyrus
location and shape of the VOIs. The binary VOI image (BA46; [48, 39, 13], BA47; [14, 19, 18]), in the left
was multiplied by the contrast images to obtain images superior and middle frontal gyri (BA8; [22, 24, 45],
including only a region corresponding to VOI. A BA10; [22, 52, 3]; BA11, BA46; [42, 28, 17]), in the
corrected P value of 0.05 was used in the regression right supraorbital area (BA11; [4, 41, 31]), bilaterally in
and subtraction VOI analyses. the inferior and middle temporal lobes (BA20; right [65,

Fig. 2. Visualization of anatomical localization and shapes of VOIs onto a MRI template image.
S. Aalto et al. / Brain Research Protocols 15 (2005) 142 – 154 147

Table 1
Anatomical brain regions showing statistically significant effects in random-effects regression and subtraction analyses in amusement
Amusement
Random effects regression analysis Random effects subtraction analysis
Positive correlation of rCBF and amusement ratings Amusing > Neutral film blocks
Brain region Talairach Local Cluster pseudo-t R Brain region Talairach Local Cluster pseudo-t
coordinates maxima size value coordinates maxima size value
of the peak (BA) of the peak (BA)
voxel voxel
Right occipitotemporal [44, 76, 6] BA 19, 3501 9.23 0.65 Right occipitotemporal [48, 74, 3] BA19, 4193 12.90
area 22, 39 area and gyrus BA22
fusiformis BA36
Right middle temporal [53, 10, 29] BA 21 118 5.37 0.67 Right middle temporal [53, 6, 27] BA21 109 5.60
gyrus gyrus
[65, 12, 6] BA 21 27 4.92 0.61
Left occipitotemporal [36, 82, 4] BA 18 1022 7.77 0.63 Left occipitotemporal [38, 80, 1] BA19, 3398 11.53
area area and gyrus BA22
fusiformis BA37
[59, 33, 7] BA 22 464 6.01 0.54
Left fusiform gyrus [42, 51, 13] BA 37 277 6.59 0.70
Left superior temporal [26, 24, 33] BA 38 34 6.45 0.54 Left superior temporal [46, 16, 31] BA38 76 5.44
gyrus gyrus
Left cerebellum [10, 71, 15] 331 5.92 0.54 Left cerebellum [12, 69, 12] 269 6.82

Negative correlation of rCBF and amusement Neutral > amusing film blocks
Right medial frontal [8, 38, 9] BA10 825 6.40 0.56 Right medial frontal [24, 40, 17] BA11 3111 7.83
gyrus gyrus, left medial and
middle frontal gyrus
and anterior cingulate
Anterior cingulate BA24 BA32
Right orbital gyrus [4, 41, 31] BA11 22 5.26 0.54
Left superior and [22, 52, 3] BA10, 417 5.59 0.53
middle frontal gyrus BA11
Left middle frontal [42, 28, 17] BA46 125 5.29 0.64
gyrus
Right inferior frontal [48, 39, 13] BA46 236 5.87 0.65 Right inferior [48, 37, 11] BA46 379 7.81
gyrus frontal gyrus
Right inferior frontal [14, 19, 18] BA47 30 4.90 0.53
gyrus
Right middle frontal [32, 20, 47] BA8 27 5.16
gyrus
Left superior frontal [22, 24, 45] BA8 77 5.45 0.63 Left middle frontal [22, 22, 45] BA8 80 5.64
gyrus gyrus
Right inferior parietal [57, 39, 44] BA40 138 5.46 0.58 Right inferior parietal [57, 37, 44] BA40 208 6.35
lobule lobule
Right inferior [65, 24, 19] BA20 108 5.20 0.56 Right inferior temporal [67, 30, 17] BA20 494 7.25
temporal gyrus gyrus
Left inferior parietal [38, 64, 42] BA39 23 4.81 0.60 Left inferior parietal [36, 64, 42] BA39 400 7.02
lobule lobule
Left middle temporal [61, 45, 11] BA20 35 4.85 0.61 Posterior cingulate and [4, 28, 33] BA31 295 6.04
gyrus paracentral lobule BA5,
bilaterally BA6
Brain regions showing statistically significant effects in random-effects regression (left tables) and subtraction analyses (right tables) in amusement. The upper
left table represents the areas showing a positive correlation, the lower left table contains negative correlations, while the upper right table shows activations
and the lower right table deactivations, respectively. A corrected P value of 0.05 at the cluster level (corrected height threshold P value of 0.05; critical
suprathreshold size of 16 voxels) was considered statistically significant in SnPM analyses. The results are localized according to the coordinates of the peak
voxel of the cluster and its local maxima. Anatomical brain regions, Brodmann areas (BA, for all local maxima of the cluster), cluster sizes in 2  2  2 mm
voxels, pseudo-t statistic values, and for regression analyses, correlation coefficients (denoted by R) for the peak voxels of the clusters are given.

24, 19], left [61, 45, 11]), and bilaterally in the The results of subtraction analyses (Fig. 3, upper right
parietal lobules (right BA40; [57, 39, 44]; left BA39; panels) differed slightly from those of regression analyses
[38, 64, 42]). in amusement. A small cluster in the right middle temporal
148 S. Aalto et al. / Brain Research Protocols 15 (2005) 142 – 154

Table 2
Anatomical brain regions showing statistically significant effects in random-effects regression and subtraction analyses in sadness
Sadness
Random effects regression analysis Random effects subtraction analysis
Positive correlation of rCBF and sadness rating Sad > Neutral film blocks
Brain region Talairach Local Cluster pseudo-t R Brain area Talairach Local Cluster pseudo-t
coordinates maxima size value coordinate maxima size value
of the peak (BA) of the peak (BA)
voxel voxel
Right middle occipital [44, 76, 10] BA 18 214 4.81 0.70 Right occipital [44, 80, 9] BA18 1992 8.84
gyrus area and cerebellum
Right fusiform gyrus [40, 51, 14] BA 36, 37 62 4.60 0.58
Right superior temporal [34, 26, 33] BA 38 30 4.96 0.60 Right fusiform [44, 46, 18] BA37 55 5.43
gyrus gyrus
Right cerebellum [32, 81, 25] 41 4.72 0.53 Right middle [65, 14, 3] BA21 715 8.72
temporal gyrus
[55, 7, 21] BA21 380 6.68
[46, 0, 42] BA38 65 5.70
Left inferior occipital [38, 82, 4] BA 19 387 5.40 0.69 Left superior and [61, 16, 1] BA22, 3664 11.24
gyrus middle temporal BA38
area
Left temporal lobe [61, 16, 1] BA 22 824 6.99 0.73 Left inferior [40, 82, 6] BA18 841 8.74
occipital gyrus
[26, 24, 33] BA 21, 38 465 6.71 0.57
[40, 8, 42] BA 20 20 4.59 0.55
Left precentral gyrus [44, 10, 43] BA 4 114 5.14 0.61 Left precentral gyrus [48, 8, 41] BA4 92 5.55
Left superior frontal [6, 54, 29] BA9 59 5.68
gyrus
Right superior frontal [6, 9, 57] BA6 18 5.15
gyrus

Negative correlation of rCBF and sadness rating Neutral > sad film blocks
Right middle frontal [26, 36, 17] BA11 432 7.61 0.90 Right inferior frontal [26, 34, 18] BA11 316 7.34
gyrus gyrus
Right inferior frontal [40, 45, 0] BA46 189 4.88 0.88 Right inferior frontal [48, 39, 7] BA46 225 5.98
gyrus gyrus
Right inferior parietal [53, 35, 44] BA40 336 5.49 0.91 Right inferior [61, 37, 42] BA40 325 6.99
lobule parietal lobule
Right inferior temporal [65, 32, 20] BA20 816 8.70 0.81 Right inferior and [63, 30, 22] BA20 797 8.93
gyrus middle temporal
gyrus
Left superior frontal [26, 59, 6] BA10 78 5.00 0.87 Left middle frontal [24, 38, 19] BA11 171 6.89
gyrus gyrus
Left inferior frontal BA11 50 4.95 [30, 59, 6] BA10 144 6.27
gyrus
Left middle frontal [26, 38, 19] BA11 50 4.95 0.88
gyrus
Left middle and inferior [61, 45, 13] BA20 266 5.89 0.83 Left middle and [61, 45, 13] BA20 348 7.27
temporal gyrus inferior temporal
gyrus
Left inferior parietal [40, 60, 45] BA40 128 4.69 0.89 Left parietal lobule [48, 50, 39] BA40, 527 6.22
lobule BA7
Right middle frontal [47, 27, 32] BA9 18 4.60 0.90 Anterior cingulate [2, 28, 33] BA23 382 6.24
gyrus
Left inferior frontal [44, 37, 6] BA46 138 5.64
gyrus
Right precuneus [18, 68, 44] BA7 112 5.80
Brain regions showing statistically significant effects in random-effects regression (left tables) and subtraction analyses (right tables) in sadness. The upper left
table depicts the areas showing a positive correlation, the lower left table includes negative correlations, and the upper right table shows activations and lower
right table deactivations, respectively. A corrected P value of 0.05 at the cluster level (corrected height threshold P value of 0.05; critical suprathreshold size of
16 voxels) was considered statistically significant in SnPM analyses. The results are localized according to the coordinates of the peak voxel of the cluster and
its local maxima. Anatomical brain regions, Brodmann areas (BA, for all local maxima of the cluster), cluster sizes in 2  2  2 mm voxels, pseudo-t statistic
values, and for regression analyses, correlation coefficients (denoted by R) for the peak voxels of the clusters are given.
S. Aalto et al. / Brain Research Protocols 15 (2005) 142 – 154 149

Fig. 3. SnPM results of random-effects regression analyses (left panels) and random-effects subtraction analyses (right panels) of amusement (upper two rows)
and sadness (lower two rows) projected on a glass brain. The upper row in both emotions depicts positive correlations (left panel) and activation (right panel)
and the lower row negative correlations (left panel) and deactivation (right panel), respectively. The statistically significant effects of using a corrected P value
of 0.05 at the cluster level are shown (corrected height threshold P value of 0.05; critical suprathreshold size of 16 voxels). The images are presented in
accordance with the neurological convention (Right is right).

gyrus (BA21; [65, 12, 6]) showed only a positive 81, 25] on the right. In sadness, clusters with negative
correlation and no activation (amusement > neutral) in the correlations were found bilaterally in the inferior and
subtraction analysis. One cluster in the left middle middle temporal gyri (BA20; right [65, 32, 20], left
temporal gyrus (BA20; [61, 45, 11]) showed a [61, 45, 13]), in the right inferior (BA46; [40, 45,
negative correlation in the regression analysis, but did 0]) and middle frontal gyri (BA9; [47, 27, 32], BA11;
not show deactivation (amusement < neutral) in the [26, 38, 19]), in the left superior and middle frontal
subtraction analysis. The posterior cingulate gyrus gyri (BA10; [26, 59, 6], BA11; [26, 38, 19]), and
(BA31; [4, 28, 33]) and the paracentral areas (BA 5, bilaterally in the parietal lobe (BA40; right [53 ,35, 44],
BA6) showed only deactivation and no negative correla- left [40, 60, 45]).
tion. The left frontal (BA 11; [24, 40, 17]) and right In sadness, too, there were some differences between the
temporal areas (BA 20; [67, 30, 17]) with deactivation results of subtraction (Fig. 3, lower right panels) and the
were more extensive than the corresponding areas with regression analyses. The activated (sadness > neutral)
negative correlations. clusters in the cerebellum and in the right temporal lobe
In sadness, the cluster with the most extensive and (BA18; [44, 80, 9], BA37; [44, 46, 18]) were larger
intensive positive correlation was situated in the left than the clusters with positive correlations in the corre-
temporal lobe (BA22; [61, 16, 1]) (Fig. 3, lower left sponding brain areas. A small cluster in the superior frontal
panel). Several other clusters showing positive correla- gyrus (BA 9; [6, 54, 29]) on the left and another in the
tions were also situated in the left occipitotemporal area superior frontal gyrus (BA 6; [6, 9, 57]) on the right also
(BA21; [26, 24, 33], BA38, BA20; [40, 8, 42]), showed only activation and no positive correlation. A small
BA19; [38, 82, 4]). Positive correlations were cluster in the right middle frontal gyrus (BA9; [47, 27, 32])
further seen in clusters in the superior temporal gyrus showed only a negative correlation and no deactivation
(BA38; [34, 26, 33]), the middle occipital gyrus (BA18; (sadness < neutral). Clusters in the left inferior frontal gyrus
[44, 76, 10]), and the fusiform gyrus (BA36; [40, (BA46; [44, 37, 6]), in the anterior cingulate gyrus (BA
51, 14], BA37) on the right. Clusters showing positive 23; [2, 28, 33]), and in the right precuneus (BA7; [18,
correlations were also found in the precentral gyrus (BA4; 68, 44]) showed only deactivation and no negative
[44, 10, 43]) on the left and in the cerebellum [32, correlation.
150 S. Aalto et al. / Brain Research Protocols 15 (2005) 142 – 154

VOI-based analysis directed onto the amygdala, the findings of subtraction analyses were the deactivation of the
medial frontal cortex (MFC), and the subcallocal cingulate posterior cingulate without a negative correlation in amuse-
(SCC) did not yield correlation or activation in either of the ment and the inactivation of the ventral part of AC (BA23)
emotions. bilaterally without a negative correlation in sadness.
Although activation of the AC would better agree with its
suggested role in emotional awareness [21], deactivation of
6. Discussion the AC related to emotions has also been reported [26,28].
In general, the lack of correlation might indicate a nonlinear
Imaging studies of the neurobiological basis of emotions neural response or non-additive interaction [11]. On the
have so far almost exclusively applied the subtraction method other hand, there were also regions that were only found in
(see [30] for a review), which reveals only dichotomous the regression analyses. In amusement, a cluster in the right
activation or deactivation and does not allow a more versatile middle temporal gyrus showed only a positive correlation
evaluation of the neurobiology of emotional experience. and no activation, and one cluster in the left middle temporal
Subject-specific regression analysis (SSRA) utilizing sub- gyrus showed a negative correlation but no deactivation. In
jective evaluation of emotional experience might open up sadness, a cluster in the right middle frontal gyrus showed
new possibilities in studies of emotions. Although analysis of only a negative correlation and no deactivation. As far as we
covariance has been utilized earlier in PET studies on know, precisely, these areas have no previously identified
emotions [23], SSRA utilizing self-ratings has not been function in the neurobiology of emotion. It is not easy to
previously applied to PET studies exploring the correlation give a convincing interpretation of the deactivations or the
between rCBF and subjective emotional experience. In the corresponding negative correlations found in the frontal
present study, we utilized SSRA to explore the association lobe. They might relate to functional interaction between
between rCBF and post-film subjective evaluation of the cognition and emotion (e.g., [15]). However, at least a
intensity of emotional experience. The generalizability of the partial explanation might be that distinct emotional stimuli
results and inter-study comparability were ensured using probably provoke less cognition in comparison to clearly
random-effects analysis (RFX). For comparison, subject- non-emotional stimuli with otherwise equal content (for
specific subtraction analysis with RFX was also performed. further discussion, see [2]).
We found that the areas revealed by regression analyses To enhance the sensitivity of the analysis, we conducted
were mainly the same as those found using subtraction VOI-based analyses focused onto the amygdala, the sub-
analyses (see Fig. 3). In general, the comparison of the callosal cingulate (SCC), and the medial frontal cortex
results of SSRAs to the results of the previous studies on (MFC), which did not reveal any findings related to sadness
emotions is not straightforward, as the earlier studies have or amusement. Although visual emotional stimuli generally
not utilized a subject-specific statistical model to explore the activate the amygdala [30], our results are in line with some
correlation between self-evaluation of emotional experience previous studies showing that film-induced emotional states
and rCBF. Furthermore, as far as we know, the previous PET do not activate the amygdala [22,28]. In addition, our results
studies on emotions utilizing subtraction analysis have not of a female sample are well in line with the findings reported
utilized RFX which limits the generalizability and compar- by Schneider et al. [37], who used ROI analysis to
isons between studies. Despite the considerable methodo- demonstrate that females, unlike males, fail to show
logical differences between the present and previous studies, amygdala activation or any association between amygdala
the overlapping brain areas seen in both regression and activity and mood change. VOI analysis did not reveal
subtraction analyses have been detected in several earlier activation or correlation in SCC, either, which is considered
studies on emotions using film stimuli. Activation of the to be involved in sadness [30]. However, even this agrees
occipital cortex is a common finding when using visual with the previous studies showing that film-induced sadness
stimuli for emotions [30]. Activation in the temporal [22,28] does not activate SCC [4,22,44]. Finally, VOI analysis did not
and occipital areas bilaterally [28,44] has been seen during yield a positive correlation or activation in the MFC, although
amusement in studies using film stimuli. Deactivation in the MFC activation was seen in almost 40% of emotion studies
left frontal and right parietal areas and in the anterior and using visual induction [30]. However, some studies have also
middle cingulate has also been reported previously to be shown deactivation of the MFC [14,26]. Although the lack of
associated with film-induced amusement/happiness [28]. As findings in the amygdala, SCC, and MFC is not surprising in
regards sadness, even other studies using film induction have view of the results of the above-mentioned eight studies, one
revealed increased activation in the cerebellum and bilat- should also note that almost all earlier studies have been
erally in the temporal area [4,22]. As the common and performed without random-effects analysis, which weakens
distinct neural substrates of amusement and sadness were the generalizability of their results. Apart from this methodo-
examined and discussed in our earlier study [2], their logical factor, the differences in the stimuli and the imaging
discussion is not included in the present study. protocols might also partially explain why the recent meta-
In some areas, however, the findings of regression and analysis of emotion studies showed no specific brain area to
subtraction analyses differed. The most prominent exclusive be activated consistently in the different studies [30].
S. Aalto et al. / Brain Research Protocols 15 (2005) 142 – 154 151

There were only a few regional differences between the smoothing, to increase the statistical power (sensitivity) of
results of the regression and subtraction analyses, which the analysis. Although additional hypothesis-driven VOI
might be partially due to the properties of our data. Despite analysis enhanced the sensitivity of the analyses, the
the considerable variation in the subjective ratings (see Fig. relatively small study sample (11 subjects) may have
1, left panels), the intensities of the emotions were fairly precluded us from detecting correlations in some regions
polarized at the group level due to the ‘‘neutral’’ films (see that might play a role in the neurobiology of emotional
Fig. 1, right panels), which increased the convergence of the experience. One should note that the fairly small sample size
results. On the other hand, the very low intensity of also weakens the generalizability of the results. Finally,
emotional involvement during the neutral films may have although we have conducted mainly a comparison between
decreased the accuracy of the ratings. This was demon- the statistical properties of the results, one should note that
strated by the lower reliabilities of the emotional ratings statistical significance, per se, does not guarantee biological
over the neutral films, possibly influencing the results of relevance of the results.
SSRA. There is also evidence to suggest that the activation SSRA utilizing subjective evaluation of emotional
of the emotional system must reach a certain level to cause experience has some methodological properties that open
congruence between the different response systems (e.g., up interesting possibilities for studies on emotion. It enables
facial expression and experience) [42,35], which might also emotions to be studied basically from an individual
apply to the relationship between brain activity and self- subjective point of view, contrary to subtraction analysis,
evaluation (ratings). Thus, emotional stimuli that induce a which is based on validation and dichotomous selection of
response of at least moderate intensity and also cover the the stimuli beforehand. Validation may not be appropriate
entire range of intensity of a certain emotion would be most when stimuli are used in an actual imaging situation or for a
suitable for performing SSRA (see [1]). However, SSRA dissimilar group of study subjects, e.g., psychiatric patients.
also seems feasible for the present fairly polarized data in SSRA is based on individual ratings made in the actual
spite of the above-mentioned factors that detract from the experimental conditions and acknowledges that subjects can
accuracy of ratings. experience a given stimulus in considerably different ways,
The rating of emotional experience may be considerably which enhances its psychological validity. Another advant-
inaccurate, especially when the object of a single rating is age of regression analysis is that no particular reference
the average intensity of the emotional experience over the condition of the kind needed in subtraction analysis is
whole scanning session (at least 1 min in PET). An average required. This makes regression analysis more specific
retrospective rating used in the present study does not reflect because the lack of sensory or cognitive equivalence
the primary emotional experience in the best possible way between neutral and emotional conditions easily hampers
because there is no guarantee that the rated state remains the specificity of subtraction analysis (see, e.g., [34]). A
stable over this period. In addition, several factors, such as special advantage of the regression method is the possibility
the demand characteristics, stereotypes and temporal fea- to study the different nuances of an emotional experience.
tures of the response, may hamper the validity of An emotional experience is typically a multidimensional
retrospective subjective ratings and should be taken into construct containing elements from the emotion-eliciting
consideration when planning the experimental design (see, appraisal processes and the following action tendencies and
e.g., [8] and [45]). However, the moderately high alphas of feelings [9,38]. With an appropriate rating questionnaire and
the ratings through the films give some support for the separate regression analyses, it would be possible to locate
notion that there is true variation behind the retrospective brain areas associated with the different dimensions of
ratings of this study. The usability of subjective ratings emotional experience. This novel approach also seems to be
made after the scanning session was also demonstrated in a applicable when utilizing an objective variable, e.g., in
recent fMRI study [31]. There is also empirical support for research on the association between rCBF and the EEG
the accuracy of retrospective rating of emotional state, as the entropy index of the depth of anesthesia [25].
facial expressions induced by 1- to 2-min films and the Subject-specific regression analysis utilizing subjective
retrospective ratings made after a lag of at least 30 s evaluation of emotional experience turned out a promising
considerably overlap ([35], see also [36]). As fMRI studies method of analysis in imaging studies of emotions. Our
allow operation at short time intervals, they might offer results give support to the idea that, in several regions, the
good opportunities to catch the immediate and momentary neural responses related to amusement and sadness associate
aspects of emotional experience (see [31,32]). linearly with the self-evaluated intensity of emotional
All first-phase SPM analyses are fixed-effects analyses experience. The most significant benefit of SSRA using
that ignore the between-subject component of variance and subjective ratings is the possibility to explore the neuro-
thus produce results that cannot be generalized beyond the biological correlates of actual and individual emotional
study sample [18]. Hence, when generalizable results and experience. Using a random-effects analysis, the results of a
reliable inter-study comparisons are wanted, RFX is the multi-subject study can be generalized at the population
only appropriate method of analysis. Due to the low degrees level, enabling reliable comparisons between the results of
of freedom, RFX was performed using SnPM with variance different studies. The regression approach seems more
152 S. Aalto et al. / Brain Research Protocols 15 (2005) 142 – 154

suitable than the traditional subtraction methodology in the regression coefficients for the nuisance variables, and ( is
studies focusing on subjective and experiential aspects of the residual matrix. It is assumed that the residuals are
emotions and might reveal completely new aspects in independent and normally distributed with zero mean and
studies on emotion-related phenomena. variance r2j [N(0, r2j )]. In the regression model, it is possible
to test statistically the distinct contribution of the covariate of
interest (e.g. subjective rating) in G c to the variance of the
7. Quick procedure response (rCBF) while simultaneously controlling for the
effect of the nuisance covariates in H c. However, one should
7.1 Measurement of emotional experience; be careful in choosing the covariates, since the use of
7.2 Manipulation check; correlated covariates may confound the results (see [3]).
7.3 Evaluation of rating data;
7.4 PET data acquisition; A.2. Application to multi-subject repeated-measures data
7.5 Preprocessing of image data;
7.6 Voxel-based statistical analyses; SSRA is based on the subject-specific regression model
(i) Exploratory regression analysis; (SSRM), where a parametric regressor is fitted at a single-
(ii) Exploratory subtraction analysis; subject level for each subject of the study. It differs
(iii) VOI-based analysis; fundamentally from the group-level regression model
(iv) Localization and calculation of correlation known as ‘‘simple regression’’ in Statistical Parametric
coefficients. Mapping (SPM) or, more generally, as ‘‘correlation analy-
sis’’. The group-level model is inappropriate in multi-subject
repeated-measures designs with multiple pairs of observa-
8. Essential literature references tions (scans and corresponding ratings) per subject because
it leads to a within-subject covariance structure, which
[5 –7,10,16,18,27,30,33,43] violates the fundamental independence assumptions under-
lying the analyses. SSRM models the within-subject
covariance structure by decomposing the observations into
Acknowledgments blocks for each subject, and the model therefore includes
only within-subject variation, so that the independence of
The study has been funded by Signe and Ane Gyllenberg residuals can be maintained. SSRM also allows subject-by-
Foundation. E.W. was funded by the Academy of Finland covariate interactions, i.e., individual variation in the slopes
and Tampere Graduate School of Information Science and of the regression lines, which may be considerable,
Engineering (TISE). The authors thank the following especially in the context of study on emotions.
persons for their valuable comments: Dr. Jyrki Möttönen,
Institute of Signal Processing, Tampere University of A.3. Types of inference and generalizability of results
Technology, Finland, and Virpi Ahola, M.Sc., Department
of Statistics, University of Turku, Finland. All first-level SPM analyses are fixed-effects analyses
(FFX), but subject-specific models enable random-effects
analysis (RFX) [18] as a second-level analysis. The type of
Appendix A. Theory of subject-specific regression and statistical inference and the generalizability of the results
random effects analysis differ essentially between FFX and RFX (see [12,13] for a
review). In FFX, the error variance is estimated on a scan-
A.1. General linear model to-scan basis, whereas in RFX, it consists of both scan-to-
scan error variance and a between-subject component of
The subject-specific regression model was presented by variance. FFX tests statistically the subjects’ mean effect,
Friston et al. [10] in the framework of a general linear model which, however, might be due to a large effect in some
with the following matrix equation: subjects, but no effect in the others. Whenever there is a lot
of between-subject variation in the effects, which is typical
Y ¼ Gc b c þ Hl cl þ Hc cc þ e; ð1Þ
in emotional responses, the within-subject variance in FFX
where Y is the response matrix consisting of the voxels j = is inappropriate for between-subject (group-level) inference
1,. . .,J as columns and the observations (e.g. scans) i = 1,. . .,I [18]. Thus, FFX is principally a case study [18] allowing
as rows. The columns of G c contain the covariates of interest only inference for the subjects studied.
(e.g. subject-by-covariate interaction), H l is a matrix con- RFX or, to be exact, mixed-effects analysis enables
taining the effects of no interest (e.g. subject or block effects), population level inference. This is achieved by testing
H c contains the nuisance variables (e.g. global activity), statistically the significance of the mean effect in the within-
matrix b c includes the regression coefficients of interest, subject parameter estimates (h:s) for the sum of scan-to-scan
matrix c l contains the effects of no interest, matrix c c includes error variance and a between-subject component of var-
S. Aalto et al. / Brain Research Protocols 15 (2005) 142 – 154 153

iance. RFX is the only method that yields generalizable Dolan, The trouble with cognitive subtraction, NeuroImage 4 (1996)
results and reliable inter-study comparisons. However, this 97 – 104.
[12] K.J. Friston, A.P. Holmes, C.J. Price, C. Büchel, K.J. Worsley,
is accomplished at the cost of degrees of freedom (df), Multisubject fMRI studies and conjunction analyses, NeuroImage 10
which collapse from N (scans)-rank(X) to N (subjects)-1, (1999) 385 – 396.
where N (scans) is the number of scans, N (subjects) is the [13] K.J. Friston, A.P. Holmes, K.J. Worsley, How many subjects constitute
number of subjects, and rank (X) is the rank, i.e., the a study?, NeuroImage 10 (1999) 1 – 5.
[14] J. Geday, A. Gjedde, A.-S. Boldsen, R. Kupers, Emotional valence
number of linearly independent columns of the design
modulates activity in the posterior fusiform gyrus and inferior medial
matrix X, which consists of G c, H l, and H l in (1). prefrontal cortex in social perception, NeuroImage 18 (2003) 675 – 684.
A two-phase RFX can be made using SPM as well as the [15] J.R. Gray, T.S. Braver, Integration of emotion and cognitive control: a
first-level analysis. However, the study sample should be neurocomputational hypothesis of dynamic goal regulation, Emotional
fairly large to yield a reliable estimate of the between- Cognition: From Brain to Behaviour, John Benjamins Publishing
subject variance needed in RFX [13]. Moreover, with low df Company, Amsterdam, Netherlands, 2002, pp. 289 – 316.
[16] J.J. Gross, R.W. Levenson, Emotion elicitation using films, Cogn.
or low smoothness, the multiple-comparison correction in Emot. 9 (1995) 87 – 108.
SPM based on the theory of random fields [47] has been [17] A.P. Holmes, Statistical issues in functional brain imaging. Doctor of
found too rigorous for voxel-level inference [17,40], Philosophy thesis, University of Glasgow, Glasgow, 1994.
resulting in insensitivity of analysis. Thus, in studies using [18] A.P. Holmes, K.J. Friston, Generalisability, random effects and
typical samples (n < 15), the recently developed Statistical population inference, NeuroImage 7 (1998) S754.
[19] A.P. Holmes, R.C. Blair, J.D.G. Watson, I. Ford, Non-parametric
non-Parametric Mapping 99 software (SnPM99) [27] is a analysis of statistic images from functional mapping experiments,
promising tool for RFX. In SnPM, the multiple comparison J. Cereb. Blood Flow Metab. 16 (1996) 7 – 22.
correction is based on permutations, which enables analyses [20] J.L. Lancaster, M.G. Woldorff, L.M. Parsons, M. Liotti, C.S. Freitas,
with small samples [19,27]. Moreover, it is possible to use L. Rainey, P.V. Kochunov, D. Nickerson, S.A. Mikiten, P.T. Fox,
non-parametric pseudo-t statistics [27,29] with local Automated Talairach atlas labels for functional brain mapping, Hum.
Brain Mapp. 10 (2000) 120 – 131.
smoothing of noisy variance images. This increases the [21] R. Lane, Neural correlates of conscious emotional experience, in: N.
statistical power of the analysis, making SnPM even more Lane (Ed.), Cognitive Neuroscience of Emotion, Oxford Univ. Press,
appropriate for RFXs with a modest number of subjects. New York, 2000, pp. 345 – 370.
[22] R.D. Lane, E.M. Reiman, G.L. Ahern, G.E. Schwartz, R.J. Davidson,
Neuroanatomical correlates of happiness, sadness, and disgust, Am. J.
Psychiatry 154 (1997) 926 – 933.
References [23] R.D. Lane, E.M. Reiman, B. Axelrod, L.S. Yung, A. Holmes, G.E.
Schwartz, Neural correlates of levels of emotional awareness:
[1] S. Aalto, P. Näätänen, L. Metsähonkala, E. Wallius, J. Hiltunen, H. evidence of an interaction between emotion and attention in the
Karlsson, H. Sipilä, Neuroanatomical correlates of film induced anterior cingulate cortex, J. Cogn. Neurosci. 10 (4) (1998) 525 – 535.
disgust: a PET activation study, NeuroImage 13 (2001) S376. [24] T.K. Lewellen, S.G. Kohlmyer, R.S. Miyaoka, M.S. Kaplan, C.W.
[2] S. Aalto, P. Näätänen, E. Wallius, L. Metsähonkala, H. Stenman, P.M. Sterans, S.F. Schubert, Investigation of the performance of the general
Niemi, H. Karlsson, Neuroanatomical substrata of amusement and Electric ADVANCE positron emission tomograph in 3 D mode, IEEE
sadness: PET activation study using film stimuli, NeuroReport 13 Trans. Nucl. Sci. 43:2 (1996) 1999 – 2206.
(2002) 67 – 73. [25] A. Maksimow, K.K. Kaisti, S. Aalto, M. Mäenpää, S. Jääskeläinen, S.
[3] A. Andrade, A.-L. Paradis, S. Rouquette, J.-B. Poline, Ambiguous Hinkka, S. Martens, M. Särkelä, H. Viertiö-Oja, H. Scheinin, EEG
results in functional neuroimaging data analysis due to covariate Spectral Entropy Correlates with Regional Cerebral Blood Flow
correlation, NeuroImage 10 (1999) 483 – 486. During Sevoflurane and Propofol Anesthesia. In press, Anaesthesia.
[4] M. Beauregard, J.-M. Leroux, S. Bergman, Y. Arzoumanian, G. [26] H.S. Mayberg, M. Liotti, S.K. Brannan, S. Mcginnis, R.K. Mahurin,
Beaudoin, P. Bourgouin, E. Stip, The functional neuroanatomy of P.A. Jerabek, J. Arturo Silva, J.L. Tekell, C.C. Martin, J.L. Lancaster,
major depression: an fMRI study using an emotional activation P.T. Fox, Reciprocal limbic-cortical function and negative mood-
paradigm, NeuroReport 9 (1998) 3253 – 3258. converging PET findings in depression and normal sadness, Am. J.
[5] G. Borg, A category scale with ratio properties for intermodal and Psychiatry 156 (1999) 675 – 682.
interindividual comparisons, in: H.G. Geissler, P. Petzold (Eds.), [27] T.E. Nichols, A.P. Holmes, Nonparametric permutation tests for
Psychophysical Judgment and the Process of Perception, Deutscher functional neuroimaging: a primer with examples, Hum. Brain Mapp.
Verlag der Wissenschaften, Berlin, 1982, pp. 25 – 34. 15 (2001) 1 – 25.
[6] G. Borg, E. Borg, A general psychophysical scale of blackness and its [28] S. Paradiso, R.G. Robinson, N.C. Andreasen, J.E. Downhill, R.J.
possibilities as a test of rating behavior. Reports from the Department Davidson, P.T. Kirchner, G.L. Watkins, L.L. Boles Ponto, R.D.
of Psychology, No. 737 Stockholm University, Stockholm, 1991. Hichwa, Emotional activation of limbic circuitry in elderly normal
[7] G. Borg, H. Diamant, L. Ström, Y. Zotterman, The relation between subjects in a PET Study, Am. J. Psychiatry 154 (1997) 384 – 389.
neural and perceptual intensity: a comparative study on the neural [29] K.M. Petersson, T.E. Nichols, J.-B. Poline, A.P. Holmes, Statistical
and psychophysical response to taste stimuli, J. Physiol. 192 (1967) limitations in functional neuroimaging II. Signal detection and statistical
13 – 20. inference, Philos. Trans. R. Soc. London, B 354 (1999) 1261 – 1281.
[8] G. Braucht, Nicholas, Analysis and reduction of components of [30] K.L. Phan, T. Wager, S.F. Taylor, I. Liberzon, Functional neuro-
systematic error in ratings, Multivariate Behav. Res. 7 (1972) 203 – 222. anatomy of emotion: a meta-analysis of emotion activation studies,
[9] N.H. Frijda, The Emotions, Cambridge Univ. Press, Cambridge, 1986. NeuroImage 16 (2002) 331 – 348.
[10] K.J. Friston, A.P. Holmes, K.J. Worsley, J.-B. Poline, C.D. Frith, [31] K.L. Phan, S.F. Taylor, R.C. Welsh, L.R. Decker, D.C. Noll, T.E.
R.S.J. Frackowiak, Statistical parametric maps in functional imaging: Nichols, J.C. Britton, I. Liberzon, Activation of the medial prefrontal
a general linear approach, Hum. Brain Mapp. 2 (1995) 189 – 210. cortex and extended amygdala by individual ratings of emotional
[11] K.J. Friston, C.J. Price, P. Fletcher, C. Moore, R.S.J. Frackowiak, R.J. arousal: a fMRI study, Biol. Psychiatry 53 (2003) 211 – 215.
154 S. Aalto et al. / Brain Research Protocols 15 (2005) 142 – 154

[32] K.L. Phan, S.F. Taylor, R.C. Welsh, S.-H. Ho, J. Britton, I. Liberzon, Smoothness and degrees of freedom restrictions when using SPM99,
Neural correlates of individual ratings of emotional salience: a trial- NeuroImage 13 (2001) S259.
related fMRI study, NeuroImage 21 (2004) 768 – 780. [41] J. Talairach, P. Tournoux, Co-Planar Stereotaxic Atlas of the Human
[33] P. Philippot, Inducing and assessing differentiated emotion-feeling Brain: Three-Dimensional Proportional System, Georg Thieme,
states in the laboratory, Cogn. Emot. 7 (1993) 171 – 193. Stuttgart, 1988.
[34] E.M. Reiman, R.D. Lane, G.L. Ahern, G.E. Schwartz, R.J. Davidson, [42] L.G. Tassinary, J.T. Cacioppo, Unobservable facial actions and
K.J. Friston, L.S. Yun, K. Chen, Neuroanatomical correlates of emotion, Psychol. Sci. 3 (1992) 28 – 33.
externally and internally generated human emotion, Am. J. Psychiatry [43] R. Westermann, K. Spies, G. Stahl, F.W. Hesse, Relative effectiveness
154 (1997) 918 – 925. and validity of mood induction procedures: a meta-analysis, Eur. J.
[35] E.L. Rosenberg, P. Ekman, Coherence between expressive and Soc. Psychol. 26 (1996) 557 – 580.
experiential systems in emotion, Cogn. Emot. 8 (1994) 201 – 229. [44] B.E. Wexler, I. Prohovnik, R.K. Fulbright, P. Skudlarski, M.
[36] W. Ruch, Will the real relationship between facial expression and Anderson, C.M. Lacadie, J.C. Gore, Brain activation by happy and
affective experience please stand up: the case of exhilaration, Cogn. sad emotional stimulation, NeuroImage 9 (1999) S369.
Emot. 9 (1995) 33 – 58. [45] R.J. Wherry, C.J. Bartlett, The control of bias in ratings: a theory of
[37] F. Schneider, U. Habel, C. Kessler, J.B. Salloum, S. Posse, Gender rating, Pers. Psychol. 35 (1982) 521 – 551.
differences in regional cerebral activity during sadness, Hum. Brain [46] J.S. Winston, B.A. Strange, J. O’Doherty, R.J. Dolan, Automatic and
Mapp. 9 (2000) 226 – 238. intentional brain responses during evaluation of trust-worthiness of
[38] C.A Smith, R.S. Lazarus, Appraisal components, core relational faces, Nat. Neurosci. 5 (2002) 277 – 283.
themes, and the emotions, Cogn. Emot. 7 (1993) 233 – 269. [47] K.J. Worsley, S. Marrett, P. Neelin, A.C. Vandal, K.J. Friston, A.C.
[39] S.S. Stevens, On the psychophysical law, Psychol. Rev. 64 (1957) Evans, A unified statistical approach for determining significant
153 – 187. signals in images of cerebral activation, Hum. Brain Mapp. 4 (1996)
[40] J. Stoeckel, J.-B. Poline, G. Malandain, N. Ayache, J. Darcourt, 58 – 73.

You might also like