You are on page 1of 7

Psychological Assessment Copyright 2007 by the American Psychological Association

2007, Vol. 19, No. 4, 430 – 436 1040-3590/07/$12.00 DOI: 10.1037/1040-3590.19.4.430

A Comparison of MMPI–2 Measures of Psychopathic


Deviance in a Forensic Setting

Martin Sellbom and Yossef S. Ben-Porath Kathleen P. Stafford


Kent State University Psycho-Diagnostic Clinic and Kent State University

We examined the convergent and discriminant validity of the Minnesota Multiphasic Personality
Inventory—2 (MMPI–2) measures of psychopathy, including the Clinical Scale 4, Restructured Clinical
Scale 4 (RC4), Content Scale Antisocial Practices (ASP), and Personality Psychopathology Five Scale
Disconstraint (DISC). Comparisons of the empirical correlates of these scales were conducted with 2
samples of participants evaluated at a criminal court clinic. The 2 samples included 59 men and 19
women and 913 men and 327 women, respectively. Two types of criteria (clinician ratings and archival
record review) were utilized in the analyses. Relative to Clinical Scale 4, RC4 had significantly greater
convergent validity in predicting psychopathy as measured by the Psychopathy Checklist—Screening
Version (S. D. Hart, D. N. Cox, & R. D. Hare, 1995) and behavioral criteria associated with this
construct. RC4 also showed substantially improved discriminant validity when compared with its Clinical
Scale counterpart. Among all the MMPI–2 scales studied, RC4 was the best measure of the social
deviance traits of psychopathy.

Keywords: psychopathy, Minnesota Multiphasic Personality Inventory—2 (MMPI–2), Restructured


Clinical (RC) scales, forensic assessment

The Minnesota Multiphasic Personality Inventory—2 “syndromal fidelity”; that is, the multidimensional makeup of the
(MMPI–2) Restructured Clinical (RC) Scales (Tellegen et al., Clinical Scales is consistent with multifaceted diagnostic syn-
2003) were developed to address problems in the original clinical dromes. This assertion has been contradicted, however, by empir-
scales, including higher than expected intercorrelations, inclusion ical findings showing that the RC Scales outperform the Clinical
of questionable subtle items, and the lack of theoretical grounding. Scales in predicting psychiatric diagnoses (e.g., Sellbom, Graham,
This goal was accomplished by removing (to the extent necessary & Schenk, 2006; Simms et al., 2005; Tellegen et al., 2006).
and possible) items measuring a common emotional distress con- Caldwell (2006) has similarly argued that the Clinical Scales are
struct labeled demoralization and identifying and developing new better suited than the RC Scales for assessing complex mental
scales measuring the major distinctive core constructs assessed by disorders. He singled out the construct of psychopathy, which has
the Clinical Scales. Complete details on the development of the RC not been previously examined empirically in this context. Caldwell
Scales as well as extensive validation data were provided by (2006) proffered the MMPI–2 Scale 4 (Psychopathic Deviate) as
Tellegen et al. (2003). Subsequent research with the RC scales has an “instructive case” (p. 194) and argued that the syndrome of
demonstrated substantially improved psychometric characteristics psychopathy is better captured by this scale than is the correspond-
relative to their original counterparts (e.g., Forbey & Ben-Porath, ing RC4 (Antisocial Behavior) scale because “Scale 4 (Pd) reflects
2007; Sellbom, Ben-Porath, & Graham, 2006; Sellbom, Ben- a complex syndrome with multiple, contributory elements” (p.
Porath, McNulty, Arbisi, & Graham, 2006; Simms, Casillas, Clark, 196). The present study was designed to put this assertion to an
Watson, & Doebbeling, 2005; Tellegen et al., 2003, 2006). empirical test in the context of a broader examination of the utility
Despite these positive empirical findings, the RC Scales have of MMPI–2 measures designed to assess features and correlates of
come under some criticism. Nichols (2006) asserted that the Clin- psychopathy.
ical Scales are better suited for the prediction of psychiatric diag-
noses than are the RC Scales because of the original scales’
Assessment of Psychopathy
Psychopathy is a constellation of maladaptive personality char-
Martin Sellbom and Yossef S. Ben-Porath, Department of Psychology, acteristics such as superficial charm, pathological lying, callous-
Kent State University; Kathleen P. Stafford, Psycho-Diagnostic Clinic, ness, grandiosity, and a lack of empathy and remorse (Cleckley,
Akron, Ohio, and Department of Psychology, Kent State University. 1941; Hare, 1991, 2003). Factor analyses of various measures of
This research was supported by a grant from the University of Minne- this construct have generally yielded a two-factor solution (Ben-
sota Press, the publisher of the MMPI–2. Yossef Ben-Porath also serves as
ning et al., 2003; Harpur, Hakstian, & Hare, 1988; but see Cooke
a consultant to the publisher. We thank Scott Lilienfeld for his insightful
comments on an earlier version of this article. We are also grateful to
& Michie, 2001; and Hare, 2003, for alternative models). These
Dustin Wygant and Stephen James for their assistance with data collection. factors focus on the Affective–Interpersonal (i.e., callous–
Correspondence concerning this article should be addressed to Martin unemotional, fearlessness, grandiosity, etc.) and Social Deviance
Sellbom, Department of Psychology, Kent Hall 144, Kent State University, (i.e., disinhibition, antisociality, excitement seeking, nonconfor-
Kent, OH 44242-0001. E-mail: msellbom@kent.edu mity, irresponsibility, etc.) dimensions.

430
MMPI–2 AND PSYCHOPATHIC DEVIANCE 431

Assessment of psychopathy evolved primarily through the de- Affective–Interpersonal facet and the Social Deviance facet being
velopment of clinical rating scales using incarcerated individuals respectively negatively and positively correlated with negative
(e.g., Psychopathy Checklist—Revised [PCL–R]; Hare, 1991, affect and emotional distress (cf. Hicks & Patrick, 2006; Patrick,
2003). Although views regarding self-report assessment of psy- 1994; Sellbom et al., 2005; Verona, Patrick, & Joiner, 2001). Scale
chopathy have generally been mixed (see Lilienfeld & Fowler, 4⬘s failure to tap the Affective–Interpersonal component of psy-
2006), recent research with measures such as the Psychopathic chopathy likely explains its positive correlation with emotional
Personality Inventory (Lilienfeld & Andrews, 1996), Levenson distress and depression.
Self-Report Psychopathy Scale (Levenson, Kiehl, & Fitzpatrick, Three major MMPI–2 scale development efforts in the past 20
1995), and the MMPI–2 (Butcher et al., 2001) has yielded prom- years (i.e., the Content Scales, Personality Psychopathology Five
ising results (see Lilienfeld & Fowler, 2006, for a review). Scales, and RC Scales) have yielded newer measures designed to
address some of the limitations of Scale 4. The Content Scale
MMPI–2 Measures of Psychopathy Antisocial Practices (ASP) was developed primarily through a
rational and statistical strategy to assess a face valid content
Caldwell (2006) suggested that Clinical Scale 4 measures the domain associated with antisocial personality. It has been found to
same “psychopathic constellation” as the PCL–R (Hare, 1991, be superior to Scale 4 in the prediction of psychopathic personality
2003) and cited the literature on various factor models (e.g., Cooke traits in several different college student samples (Lilienfeld, 1996;
& Michie, 2001; Hare, 2003) as support for the complexity of the Sellbom et al., 2005).
psychopathy construct. He also argued, The Personality Psychopathology Five (PSY-5) Scale Discon-
straint (DISC) was constructed to assess a stable personality trait
If the scale 4 (Pd) T-score is moderately to highly elevated (a bit over
associated primarily with antisocial personality disorder and psy-
T-70), all of the components originally identified by McKinley and
Hathaway (1944) as well as with the PCL–R and PCL–SV typically chopathy (Harkness, McNulty, & Ben-Porath, 1995). Sellbom et
are clinically apparent, if not severely so. (Caldwell, 2006, p. 195) al. (2005) found that DISC was superior to Scale 4 in predicting
global psychopathic personality traits, and in particular, those
Caldwell’s (2006) assertion is inconsistent with the existing associated with the Affective–Interpersonal psychopathy facet.
research on Scale 4. As early as 50 years ago, Lykken (1957) Most recently, RC4 was developed by removing the general
questioned the utility of this scale as an indicator of psychopathy, distress factor from Scale 4 and identifying and building on a
as it did not differentiate offenders who were rated as psychopaths distinctive dimension of this scale associated with antisocial be-
(based on Cleckley’s, 1941, criteria) from nonpsychopathic of- havior. Sellbom et al. (2005) found that RC4 outperforms Scale 4
fenders. Hawk and Peterson (1974) examined associations be- in measuring psychopathy and that this RC scale is the best
tween Scale 4 and Kohlberg’s (1981) moral development scheme predictor of social deviance relative to other MMPI–2 scales.
in groups of adolescent delinquents, college students, and therapy However, Sellbom et al. (2005) used a college student sample with
clients. Their results showed that these associations were very a relatively low base rate of psychopathy. The present investiga-
weak, indicating that Scale 4 is a measure of general social tion compares these scales in a forensic sample by using non-self-
deviance rather than psychopathic traits specifically. Moreover, report criterion measures.
Hare and Cox (1978) and Hare (1985) found only modest associ- Caldwell’s (2006) hypothesis that Scale 4 is a better measure of
ations between Scale 4 and clinician ratings (e.g., Psychopathy the construct than RC4 is predicated on the assumption that psy-
Checklist [PCL]) of psychopathy. chopathy is a syndromal, and hence categorical, variable. Although
The correlation between Scale 4 and psychopathy appears re- consistent with current clinical practice (cf. First, 2005), this
stricted to traits and characteristics associated with the Social perspective has been challenged by conceptual and empirical de-
Deviance facet rather than the Affective–Interpersonal facet. Har- velopments in psychopathology research in general, and in the area
pur et al. (1989) found that Scale 4 correlated .05 and .11 with PCL of psychopathy in particular. Two recent taxometric studies using
Factor 1 (Affective–Interpersonal) in two inmate samples, com- both self-report and PCL–R ratings concluded that psychopathy is
pared with .28 and .31 with Factor 2 (Social Deviance). Sellbom, a dimensional construct rather than a taxon (Edens, Marcus, Lil-
Ben-Porath, Lilienfield, Patrick, and Graham (2005) found that ienfeld, & Poythress, 2006; Marcus, John, & Edens, 2004). In
Scale 4 correlated –.17 with Psychopathic Personality Inventory contrast, Harris, Rice, and Quinsey (1994), Skilling, Quinsey, and
Factor 1 (Affective–Interpersonal) and .50 with Psychopathic Per- Craig (2001), and Vasey, Kotov, Frick, and Loney (2005) have
sonality Inventory Factor 2 (Social Deviance). Thus, “core” psy- presented evidence of a taxon associated with serious antisocial
chopathic traits (e.g., shallow affect, lack of empathy and remorse, behavior or conduct problems but not for psychopathy as a broader
deceitfulness, fearlessness) represented in Factor 1 are minimally construct.
correlated with this MMPI–2 scale. In the present study, we compared the convergent and discrimi-
The absence of correlations with core features of psychopathy nant validity of four MMPI–2 measures of psychopathy. For
indicates that Scale 4 has limited validity as a measure of this reasons just reviewed, we examine psychopathy from both a di-
construct. Strong positive correlations between this Clinical Scale mensional and categorical perspective. Because several previous
and general distress and depression (e.g., Tellegen et al., 2003) studies have indicated that RC4, ASP, and DISC outperform Scale
raise further questions about its construct validity. This unexpected 4 in assessment of psychopathy (e.g., Lilienfeld, 1996; Sellbom et
but consistent finding can be understood in the context of research al., 2005), we hypothesized that these scales would be stronger
showing that psychopathy as a whole is uncorrelated with mea- predictors of psychopathy and antisociality than would Scale 4.
sures of emotional distress and negative affect (Hicks & Patrick, We further hypothesized that RC4, ASP, and DISC would be less
2006; Schmitt & Newman, 1999), which is likely due to the strongly associated with indices of emotional distress when com-
432 SELLBOM, BEN-PORATH, AND STAFFORD

pared with Scale 4, indicating their improved discriminant validity. Sample 1, there were no significant differences on demographic
On the basis of the findings of Sellbom et al. (2005), we hypoth- variables between included and excluded participants: for age,
esized that RC4 would be the strongest measure of the Social t(311) ⫽ 0.686, p ⬎ .05, effect size r ⫽ .02; for sex, ␹2(1, N ⫽
Deviance facet and its common correlates among the four 1,312) ⫽ 0.203, p ⬎ .05, effect size r ⫽ .01; and for ethnicity,
MMPI–2 psychopathy measures and that DISC would provide the ␹2(2, N ⫽ 1,312) ⫽ 5.72, p ⬎ .05, effect size r ⫽ .04.
best prediction of affective–interpersonal traits.
Measures—All Samples
Method
Minnesota Multiphasic Personality Inventory—2 (MMPI–2).
Two separate archival forensic samples drawn from the same The MMPI–2 (Butcher et al., 2001) was administered in all sam-
population and offering complementary types of criteria were used ples. The internal consistencies for the scales used in this study
in the present study. The Institutional Review Board at Kent State were .63 and .76 (Scale 4), .74 and .82 (RC4), .82 and .82 (ASP),
University approved this study. Table 1 lists the basic demograph- and .77 and .70 (DISC) in Samples 1 and 2, respectively.
ics of both samples.
Measures—Forensic Sample 1
Participants
PCL–SV. The PCL–SV (Hart et al., 1995) is a 12-item version
Forensic Sample 1. This sample consisted of 85 individuals
of the longer 20-item PCL–R. It correlated approximately .80 with
who were undergoing pre-trial forensic psychological evaluations
the longer version in the normative samples (Hart et al., 1995) and
at a court clinic in Northeastern Ohio1 and who had been rated on
consists of two rationally derived, 6-item parts. Part 1 corresponds
the Psychopathy Checklist—Screening Version (PCL–SV; Hart,
to Factor 1 of the PCL–R (Affective–Interpersonal), and Part 2
Cox, & Hare, 1995). Because deliberate response distortion is
corresponds to Factor 2 on the PCL–R (Social Deviance). Each
commonplace in these settings, participants were excluded on the
item is scored 0 (absent), 1 ( possibly present or present to a minor
basis of both inconsistent responding and extreme scores on
degree), or 2 (definitely present). Internal consistency values
MMPI–2 measures of over- and under-reporting. Therefore, the
across 11 samples published in the manual indicate acceptable
following exclusionary criteria for the MMPI–2 were employed:
reliability.
Cannot Say ⱖ 30, VRIN or TRIN T ⱖ 80, F raw score ⱖ 29, FP
Raters consisted of two licensed doctoral-level psychologists
T ⱖ 100, and L T ⱖ 80 (Petroskey, Ben-Porath, & Stafford, 2003).
and four advanced doctoral students in clinical psychology.2 All
This procedure excluded 7 (22%) participants. The participants
raters were extensively trained. The doctoral-level psychologists
were evaluated for either drug intervention in lieu of conviction
had received training through PCL workshops and had trained the
(82%), risk assessment issues (15%), or competency to stand
doctoral students. The doctoral students continued training until
trial/criminal responsibility (3%). To test whether the excluded
they achieved an average of 90% inter-rater agreement on each
participants differed meaningfully from the included participants
PCL–SV item. All raters used the scoring guide in the PCL–SV
on the demographic variables in this sample, we conducted t tests
manual for all cases. Due to practical limitations in this setting,
for continuous variables (i.e., age) and chi-square tests for cate-
which included the PCL–SV being administered as part of a
gorical variables (i.e., sex and ethnicity). These tests were nonsig-
psychological evaluation with no availability for videotaping or
nificant: for age, t(84) ⫽ 0.435, p ⬎ .05, effect size r ⫽ .05; for
otherwise observing the participant, we were unable to calculate
sex, ␹2(1, N ⫽ 85) ⫽ 0.169, p ⬎ .05, effect size r ⫽ .04; and for
inter-rater reliability through the remainder of the study. We did
ethnicity, ␹2(2, N ⫽ 85) ⫽ 1.80, p ⬎ .05, effect size r ⫽ .05.
calculate internal consistencies for the PCL–SV Total and Factor
Forensic Sample 2. Another 1,592 individuals who had been
scores to at least partly address legitimate concerns regarding
evaluated at the same forensic center as Forensic Sample 1 were
measurement error. Cronbach’s alphas were .86 (PCL–SV Total),
used in the present investigation. The same MMPI–2 exclusionary
.77 (Part 1), and .77 (Part 2).
criteria were applied, which excluded 352 (22%) participants. The
referral questions for these participants were competency to stand
trial/criminal responsibility (50%), drug intervention in lieu of Measures—Forensic Sample 2
conviction (28%), or risk assessment issues (14%). Consistent with Record Review Form. The Record Review Form was devel-
oped by Ben-Porath and Stafford (see Petroskey et al., 2003) to
extract data from forensic clients’ records, including demographic
Table 1 and historical data (including social history, educational history,
Basic Sample Demographics relationship history, adult relationships, parenting history, employ-
Variable Forensic Sample 1 Forensic Sample 2
1
Men (n) 59 913 Although this setting primarily receives referrals for pre-trial evalua-
Women (n) 19 327 tions, some individuals are evaluated post-conviction for risk assessment
Age range 18–74 18–82 and recommendations to assist in their management. This center also
Age, M (SD) 32.12 (12.21) 33.67 (11.03) performs risk assessments of individuals committed after being found not
Ethnicity (%) guilty by reason of insanity. These post-conviction or post-insanity acquit-
Caucasian 72 78 tal evaluations are included in the risk assessment category.
African American 26 21 2
Martin Sellbom was one of the advanced doctoral student raters, and
Other or Unknown 2 1
Kathleen P. Stafford was one of the doctoral-level psychologists.
MMPI–2 AND PSYCHOPATHIC DEVIANCE 433

ment history, abuse history, psychiatric history, medical history, ineffective measure would yield an AUC of .50 (chance level). In
legal history, and substance use history) as well as mental status at the present study, the AUCs for classifying psychopathy were the
the time of evaluation. Variables that were deemed conceptually following: for Scale 4, .70 ( p ⫽ .06; 95% confidence interval [CI]
relevant to psychopathy on the basis of the research literature and ⫽ .54, .86); for RC4, .72 ( p ⬍ .05; 95% CI ⫽ .54, .89); for ASP,
that appeared with enough frequency (⬎ 3%) were included in the .62 ( p ⫽ .27; 95% CI ⫽ .44, .80); and for DISC, .74 ( p ⬍ .05;
present study. These variables were clustered in four categories: 95% CI ⫽ .60, .87). These results indicate generally poor classi-
juvenile delinquency history, adult criminal history, substance fication for all scales with only RC4 and DISC reaching significant
abuse history, and depressed mood variables. The last category AUC values.
was chosen for discriminant validity analyses. The internal con- In the analyses where psychopathy was treated as a dimensional
sistencies for these variables were .84, .64, .77, and .51, respec- variable, the results generally conformed to our expectations that
tively. Because the number of items within each “scale” was quite RC4 would be more strongly correlated with psychopathy-relevant
small (ranging from three to seven), we also calculated average criteria than would Scale 4, with mixed results for ASP and DISC.
inter-item correlations. These ranged from .16 to .40. Clark and In the first forensic sample, RC4 was significantly more strongly
Watson (1995) suggested that acceptable average inter-item cor- correlated with PCL–SV scores than was Scale 4 (rs ⫽ .50 and .29,
relations should be in the .15 to .25 range, indicating adequate respectively). Importantly, in direct contradiction to Caldwell’s
internal reliability for the present scales. A randomly chosen 10% hypothesis about the two scales, RC4 was also significantly cor-
of the records were reviewed independently by two research as- related with PCL–SV Part 1 score, whereas Scale 4 was not (rs ⫽
sistants to assess inter-rater reliability. We calculated intra-class .29 vs. .06), demonstrating that RC4 is associated with some of the
correlations for the model of agreement, which ranged from .58 “core” psychopathy traits and does not exclusively predict social
(juvenile delinquency history) to .84 (substance abuse history). deviance. DISC and ASP were also more highly correlated with
PCL–SV scores than was Clinical Scale 4, but only DISC was
Procedures significantly more highly correlated with PCL–SV Part 1 than was
Scale 4.
Forensic Sample 1. Participants were administered the The three newer, unidimensional MMPI–2 scales were compa-
MMPI–2 and rated on the PCL–SV as part of their psychological rably correlated with PCL–SV Total score, with the correlation for
evaluations. As part of an ongoing research protocol at this clinic, RC4 having the highest magnitude. Although DISC had the high-
PCL–SV ratings were based on interview and on legal, educa- est correlation with PCL–SV Part 1, it was not significantly higher
tional, and treatment records, and ratings were completed prior to than those for RC4 and ASP. As hypothesized, RC4 had signifi-
accessing the MMPI–2 results. cantly and meaningfully higher correlations with PCL–SV Part 2
Forensic Sample 2. The MMPI–2 was administered as part of than did ASP and DISC.
the psychological evaluation at the court clinic. Research assistants In the second forensic sample (see Table 2; lower panel), RC4
reviewed the client charts and coded the variables on the Record was also more strongly correlated than Scale 4 with various forms
Review Form. The research assistants had been extensively trained of criminal history, including juvenile delinquency and adult arrest
prior to coding and were blind to the MMPI–2 results. history. ASP and DISC also had significantly higher correlations
with these variables relative to Scale 4, but the effect sizes for
Results these differential associations were not meaningful. Substance
abuse, a consistently strong correlate of psychopathy (e.g., Smith
We calculated zero-order correlations between the MMPI–2 & Newman, 1990), was more strongly correlated with RC4 than
scales and external criteria. These are reported in Table 2 for the Scale 4, ASP, and DISC, which did not differ from each other. In
two samples. We used Steiger’s (1980) t test for dependent cor- the analyses designed to compare the scales’ discriminant validity,
relations to test whether the correlations between the MMPI–2 Scale 4 had a significantly and meaningfully higher correlation
scales and criteria were significantly different from each other and with Depressed Mood Variables relative to RC4, ASP, and DISC.
calculated an effect size (point bi-serial r values) for each com-
parison. Table 2 also shows the effect sizes for each of these
Discussion
comparisons.3 An r ⬎ .10 is indicative of a small but meaningful
effect (Cohen, 1988). We examined the ability of four MMPI–2 scales to assess
We first examined the point bi-serial correlations for Scale 4, psychopathy and related criteria. When psychopathy was treated as
RC4, ASP, and DISC with PCL–SV scores as a categorical vari-
able. For this purpose, we divided participants into two groups: a
3
psychopathy group including participants scoring equal to or An examination of Table 2 indicates that sometimes absolute correla-
greater than 18 on the PCL–SV and a nonpsychopathy group tional magnitude difference between one comparison might be higher than
including participants scoring 12 or lower on the PCL–SV (Hart et that for a second comparison, but the second comparison has a higher effect
al., 1995). Fifteen participants who scored between 13 and 17 were size. This is not a miscalculation. Steiger’s (1980) formula takes the
correlation between the two scales (e.g., Scale 4 and RC4) into account
left out of the categorical analyses. Table 2 shows these correla-
when comparing their relative correlations with external criteria. For in-
tions. None of the four MMPI–2 scales was better able to predict stance, the correlation for Scale 4, RC4, and DISC with PCL–SV Part 1
the dichotomized psychopathy classification relative to the others. were .09, .29, and .36, respectively. However, the effect size for the
We followed up with receiver-operating characteristics analyses comparison of Scale 4 and RC4 with this PCL–SV factor is higher than that
and examined the area under the curve (AUC) for each scale. A for the Scale 4 and DISC comparison (–.28 vs. –.26). This is the effect of
perfect measure would yield an AUC of 1.0, whereas a completely Scale 4 and RC4 being more highly correlated than are Scale 4 and DISC.
434 SELLBOM, BEN-PORATH, AND STAFFORD

Table 2
Correlations for MMPI–2 Scales with Psychopathy-Relevant External Criteria and Effect Size Comparisons for Correlational Pairs

Correlational analyses Effect size comparisons (r)

Scale 4 vs. Scale 4 vs. Scale 4 vs. RC4 vs. RC4 vs. ASP vs.
Measure n Scale 4 RC4 ASP DISC RC4 ASP DISC ASP DISC DISC

Forensic Sample 1
PCL–SV Categorical scorea 63 .22 .28 .16 .27 ⫺.08 .06 ⫺.05 .14 .01 ⫺.17
PCL–SV Total score 78 .29 .50 .39 .45 ⫺.31** ⫺.11 ⫺.16 .15 .07 ⫺.10
PCL–SV Part 1 78 .09 .29 .29 .36 ⫺.28** ⫺.21 ⫺.26* .00 ⫺.09 ⫺.11
PCL–SV Part 2 78 .45 .62 .41 .46 ⫺.28** .06 ⫺.01 .30** .25* ⫺.09

Forensic Sample 2
Juvenile Delinquency History 1,240 .14 .27 .22 .23 ⫺.17*** ⫺.09** ⫺.07** .06* .06* .01
Adult Criminal History 1,240 .14 .23 .15 .14 ⫺.12*** ⫺.01 .00 .08** .10*** .01
Substance Abuse History 1,240 .27 .50 .24 .31 ⫺.32*** .03 ⫺.04 .33*** .26*** ⫺.09**
Depressed Mood Variables 1,240 .21 .06 ⫺.02 ⫺.10 .19*** .22*** .27*** .10** .19*** .10**

Note. Absolute rs of .29 and .37 in Forensic Sample 1 are statistically significant at alphas of .01 and .001, respectively. Absolute r of .13 is statistically
significant at an alpha of .001 in Forensic Sample 2. All effect sizes are in r values. Steiger’s (1980) t test for dependent correlations was used as significance
test for each correlational pair. MMPI–2 ⫽ Minnesota Multiphasic Personality Inventory—2; Scale 4 ⫽ Clinical Scale 4; RC4 ⫽ Restructured Clinical Scale
4; ASP ⫽ Antisocial Practices; DISC ⫽ Disconstraint; PCL–SV ⫽ Psychopathy Checklist—Screening Version.
*
p ⬍ .05. ** p ⬍ .01. *** p ⬍ .001.
a
PCL–SV dummy coded, 1 ⫽ nonpsychopath (i.e., PCL–SV ⱕ 12; Hart et al., 1995) and 2 ⫽ psychopath (PCL–SV ⱖ 18; Hart et al., 1995). Fifteen
participants scored between 13 and 17 and were left out of this analysis.

a categorical variable, the four scales were comparable in their This approach resulted in the identification of some items that
correlations with this construct. Thus, Caldwell’s hypothesis that were unique to psychopathy and others that more generally differ-
Scale 4 would predict a classification of psychopathy better than entiated between individuals hospitalized for treatment and non-
would RC4 (or any other unidimensional MMPI–2 scale) was not patients. As a result, nonspecific demoralization variance was
supported. The AUC analyses indicated that none of the four introduced, which significantly attenuated the correlation of Scale
MMPI–2 scales was particularly effective in classifying psychop- 4 with psychopathy-relevant criteria.
athy. The present results indicate that the MMPI–2 can capture a
When psychopathy was treated as a dimensional construct, RC4 considerable amount of variance associated with psychopathy.
had substantially greater validity as a predictor of the total psy- RC4 correlated .50 with the PCL–SV Total score; this is a sub-
chopathy score as well as both factor scores relative to Scale 4. In stantial correlation when considered in light of existing literature
fact, this Clinical Scale, which Caldwell hypothesized would be a on the use of self-report measures to predict clinical rating scales
superior measure of PCL Factor 1, was uncorrelated with this of psychopathy (e.g., Hare, 1985; Harpur et al., 1989). Elevated
factor, whereas the correlation for RC4 was significant and also scores on RC4 indicate the potential presence of psychopathic
substantially greater than the one for Scale 4. Both ASP and DISC traits. However, because of the focus on social deviance in the
also had higher correlations with the PCL–SV relative to Scale 4, RC4 items, scores on other RC scales more directly related to the
indicating that this Clinical Scale was not superior to any of the affective–interpersonal deviance aspects of psychopathy should be
unidimensional MMPI–2 psychopathy/antisociality measures in consulted as well. Sellbom et al. (2005) found that an elevation on
predicting individual differences in psychopathy. Scale 4 also had RC4 along with RC9 and DISC, and a below average score on
weak discriminant validity relative to RC4, ASP, and DISC. It was RC7, indicate the likely presence of behavioral proclivities and
more strongly correlated with depressed mood than were the other personality traits associated with psychopathy. RC9 assesses a
MMPI–2 scales, where, as discussed earlier, the literature has grandiose, socially potent, and sensation-seeking style (Sellbom &
indicated that overall psychopathy measures are generally uncor- Ben-Porath, 2005), DISC captures low harm avoidance (Harkness
related to moderately negatively correlated with depressed affect. et al., 1995), whereas RC7 measures negative affectivity and
Relative to ASP and DISC, RC4 was a substantially better fearfulness (Tellegen et al., 2003, 2006). These characteristics in
predictor of social deviance, including juvenile delinquency, adult conjunction cover many of the core characteristics of psychopathy.
criminal behavior, and substance abuse. RC4, on the other hand, One of the strengths of the present study is that the MMPI–2
did not outperform either of these scales in the prediction of scales were examined in a forensic sample. This setting allowed
affective–interpersonal traits. Although the PSY-5 Scale DISC had for an examination in the context where psychopathy assessment is
the highest correlation with such traits, the difference relative to most relevant and where psychopathy occurs with a higher base
RC4 and ASP was not statistically significant. rate than that of other settings (e.g., college students, Sellbom et
One of the major reasons for Scale 4’s failure to capture the core al., 2005). No previously published study has examined the rela-
aspects of psychopathy can be traced back to its development tive utility of these four scales in predicting clinician-rated psy-
through empirical keying by contrasting the MMPI–2 responses of chopathy and various forms of antisocial behaviors.
delinquents and criminals who were hospitalized for treatment There are also limitations to this study that must be acknowl-
with those of normal individuals (Hathaway & McKinley, 1940). edged. First, we did not have access to inter-rater reliability data
MMPI–2 AND PSYCHOPATHIC DEVIANCE 435

for the PCL–SV. However, the obtained pattern of validity coef- Harkness, A. L., McNulty, J. L., & Ben-Porath, Y. S. (1995). The Person-
ficients indicates strong convergence between PCL–SV scores and ality Psychopathology Five (PSY-5): Constructs and MMPI–2 scales.
MMPI–2 scales, suggesting that unreliability of the criterion mea- Psychological Assessment, 7, 104 –114.
sure is not likely problematic in the present investigation. In any Harpur, T. J., Hakstian, A. R., & Hare, R. D. (1988). Factor structure of the
event, it would not differentially favor any of the MMPI–2 scales Psychopathy Checklist. Journal of Consulting and Clinical Psychology,
56, 741–747.
in the comparative analyses. Second, the sample size for the first
Harpur, T. J., Hare, R. D., & Hakstian, A. R. (1989). Two-factor concep-
forensic sample was somewhat small, particularly when the am- tualization of psychopathy: Construct validity and assessment implica-
biguous psychopathy scores were removed. Therefore, replication tions. Psychological Assessment, 1, 6 –17.
of these findings is warranted. Harris, G. T., Rice, M. E., & Quinsey, V. L. (1994). Psychopathy as a
In conclusion, in analyses where it was treated as a categorical taxon: Evidence that psychopaths are a discrete class. Journal of Con-
variable, Clinical Scale 4 did not outperform RC4 or the other sulting and Clinical Psychology, 62, 387–397.
dimensionally based MMPI–2 measures of psychopathy. This Hart, S. D., Cox, D. N., & Hare, R. D. (1995). Manual for the Psychopathy
finding is consistent with previous research (Sellbom, Graham, & Checklist—Screening Version (PCL–SV). Toronto, Ontario, Canada:
Schenk, 2006; Simms et al., 2005; Tellegen et al., 2006) in refuting Multi-Health Systems.
assertions by Caldwell (2006) and Nichols (2006) that the Clinical Hathaway, S. R., & McKinley, J. C. (1940). A multiphasic personality
Scales are better suited for assessing syndromal, diagnostic con- schedule (Minnesota): I. Construction of the schedule. Journal of Psy-
chology, 10, 249 –254.
structs than are their restructured counterparts. Our findings also
Hawk, S. S., & Peterson, R. A. (1974). Do MMPI psychopathic deviancy
add to a growing body of literature showing that RC4, ASP, and
scores reflect psychopathic deviancy or just deviancy? Journal of Per-
DISC consistently outperform Scale 4 in predicting psychopathy sonality Assessment, 38, 362–368.
and related criteria when assessed from a dimensional perspective. Hicks, B. M., & Patrick, C. J. (2006). Psychopathy and negative emotion-
ality: Analyses of suppressor effects reveal distinct relations with emo-
tional distress, fearfulness, and anger– hostility. Journal of Abnormal
References Psychology, 115, 276 –287.
Kohlberg, L. (1981). The meaning and measurement of moral develop-
Benning, S. D., Patrick, C. J., Hicks, B. M., Blonigen, D. M., & Krueger,
ment. Worcester, MA: Clark University Press.
R. F. (2003). Factor structure of the Psychopathic Personality Inventory:
Levenson, M. R., Kiehl, K. A., & Fitzpatrick, C. M. (1995). Assessing
Validity and implications for clinical assessment. Psychological Assess-
psychopathic attributes in a noninstitutionalized population. Journal of
ment, 15, 340 –350.
Personality and Social Psychology, 68, 151–158.
Butcher, J. N., Graham, J. R., Ben-Porath, Y. S., Tellegen, A., Dahlstrom,
Lilienfeld, S. O. (1996). The MMPI–2 Antisocial Practices Content Scale:
W. G., & Kaemmer, B. (2001). Minnesota Multiphasic Personality
Construct validity and comparison with the psychopathic deviate scale.
Inventory—2: Manual for Administration and Scoring (2nd ed.). Min-
Psychological Assessment, 8, 281–293.
neapolis: University of Minnesota Press.
Lilienfeld, S. O., & Andrews, B. P. (1996). Development and preliminary
Caldwell, A. B. (2006). Maximal measurement or meaningful measure-
ment: The interpretive challenges of the MMPI–2 Restructured Clinical validation of a self report measure of psychopathic personality traits in
(RC) Scales. Journal of Personality Assessment, 87, 193–201. noncriminal populations. Journal of Personality Assessment, 66, 488 –
Clark, L. A., & Watson, D. (1995). Constructing validity: Basic issues in 524.
objective scale development. Psychological Assessment, 7, 309 –319. Lilienfeld, S. O., & Fowler, K. A. (2006). The self-report assessment of
Cleckley, H. (1941). The mask of sanity. St. Louis, MO: C. V. Mosby. psychopathy: Problems, pitfalls, and promises. In C. J. Patrick (Ed.),
Cohen, J. (1988). Statistical power analysis for the behavioral sciences Handbook of psychopathy (pp. 107–132). New York: Guilford Press.
(2nd ed.). New York: Academic Press. Lykken, D. T. (1957). A study of anxiety in the sociopathic personality.
Cooke, D. J., & Michie, C. (2001). Refining the construct of psychopathy: Journal of Abnormal and Social Psychology, 55, 6 –10.
Towards a hierarchical model. Psychological Assessment, 13, 171–188. Marcus, D. K., John, S. L., & Edens, J. F. (2004). A taxometric analysis of
Edens, J. F., Marcus, D. K., Lilienfeld, S. O., & Poythress, N. G. (2006). psychopathic personality. Journal of Abnormal Psychology, 113, 626 –
Psychopathic, not psychopath: Taxometric evidence for the dimensional 635.
structure of psychopathy. Journal of Abnormal Psychology, 115, 131– McKinley, J., & Hathaway, S. R. (1944). The MMPI: Hysteria, hypomania,
144. and psychopathic deviate. Journal of Applied Psychology, 28, 153–174.
First, M. B. (2005). Clinical utility: A prerequisite for the adoption of a Nichols, D. S. (2006). The trials of separating bath water from baby: A
dimensional approach in DSM. Journal of Abnormal Psychology, 114, review and critique of the MMPI–2 Restructured Clinical Scales. Jour-
560 –564. nal of Personality Assessment, 87, 121–138.
Forbey, J. D., & Ben-Porath, Y. S. (2007). A comparison of the MMPI–2 Patrick, C. J. (1994). Emotion and psychopathy: Startling new insights.
Restructured Clinical (RC) and Clinical Scales in a substance abuse Psychophysiology, 31, 319 –330.
treatment sample. Psychological Services, 4, 46 –58. Petroskey, L. J., Ben-Porath, Y. S., & Stafford, K. P. (2003). Correlates of
Hare, R. D. (1985). Comparison of the procedures for the assessment of the Minnesota Multiphasic Personality Inventory—2 (MMPI–2) Person-
psychopathy. Journal of Clinical and Consulting Psychology, 53, 111– ality Psychopathology Five (PSY-5) scales in a forensic assessment
119. setting. Assessment, 10, 393–399.
Hare, R. D. (1991). The Hare Psychopathy Checklist—Revised. Toronto, Schmitt, W. A., & Newman, J. P. (1999). Are all psychopathic individuals
Ontario, Canada: Multi-Health Systems. low anxious. Journal of Abnormal Psychology, 108, 353–358.
Hare, R. D. (2003). The Hare Psychopathy Checklist—Revised (2nd ed.). Sellbom, M., & Ben-Porath, Y. S. (2005). Mapping the MMPI–2 Restruc-
Toronto, Ontario, Canada: Multi-Health Systems. tured Clinical (RC) Scales onto normal personality traits: Evidence for
Hare, R. D., & Cox, D. N. (1978). Clinical and empirical conceptions of construct validity. Journal of Personality Assessment, 85, 169 –178.
psychopathy, and the selection of subjects for research. In R. D. Hare & Sellbom, M., Ben-Porath, Y. S., & Graham, J. R. (2006). Correlates of the
D. Schalling (Eds.), Psychopathic behaviour: Approaches to research MMPI–2 Restructured Clinical (RC) Scales in a college counseling
(pp. 1–21). Chichester, England: Wiley. setting. Journal of Personality Assessment, 86, 89 –99.
436 SELLBOM, BEN-PORATH, AND STAFFORD

Sellbom, M., Ben-Porath, Y. S., Lilienfeld, S. O., Patrick, C. J., & Graham, Tellegen, A., Ben-Porath, Y. S., McNulty, J. L., Arbisi, P. A., Graham,
J. R. (2005). Assessing psychopathic personality traits with the J. R., & Kaemmer, B. (2003). MMPI–2 Restructured Clinical (RC)
MMPI–2. Journal of Personality Assessment, 85, 334 –343. scales: Development, validation, and interpretation. Minneapolis: Uni-
Sellbom, M., Ben-Porath, Y. S., McNulty, J. L., Arbisi, P. A., & Graham, versity of Minnesota Press.
J. R. (2006). Elevation differences between MMPI–2 Clinical and Re- Tellegen, A., Ben-Porath, Y. S., Sellbom, M., Arbisi, P. A., McNulty,
structured Clinical (RC) Scales: Origins and interpretative implications. J. L., & Graham, J. R. (2006). Further evidence on the validity of the
Assessment, 13, 430 – 441. MMPI–2 Restructured Clinical (RC) Scales: Addressing questions
Sellbom, M., Graham, J. R., & Schenk, P. W. (2006). Incremental validity raised by Rogers et al. and Nichols. Journal of Personality Assess-
of the MMPI–2 Restructured Clinical (RC) Scales in a private practice ment, 87, 148 –171.
sample. Journal of Personality Assessment, 86, 196 –205.
Vasey, M. W., Kotov, R., Frick, P. J., & Loney, B. R. (2005). The latent
Simms, L. J., Casillas, A., Clark, L. A., Watson, D., & Doebbeling, B. N.
structure of psychopathy in youth: A taxometric investigation. Journal of
(2005). Psychometric evaluation of the Restructured Clinical Scales of
Abnormal Child Psychology, 33, 411– 429.
the MMPI–2. Psychological Assessment, 17, 345–358.
Verona, E., Patrick, C. J., & Joiner, T. E. (2001). Psychopathy, antisocial
Skilling, T. A., Quinsey, V. L., & Craig, W. M. (2001). Evidence of a taxon
underlying serious antisocial behavior in boys. Criminal Justice and personality, and suicide risk. Journal of Abnormal Psychology, 110,
Behavior, 28, 450 – 470. 462– 470.
Smith, S. S., & Newman, J. P. (1990). Alcohol and drug abuse-dependence
disorders in psychopathic and nonpsychopathic criminal offenders. Jour-
nal of Abnormal Psychology, 99, 430 – 439. Received November 9, 2006
Steiger, J. H. (1980). Tests for comparing elements of a correlation matrix. Revision received August 2, 2007
Psychological Bulletin, 87, 245–251. Accepted August 8, 2007 䡲

You might also like