You are on page 1of 13

Journal of Research in Personality 44 (2010) 453–465

Contents lists available at ScienceDirect

Journal of Research in Personality


journal homepage: www.elsevier.com/locate/jrp

Narcissism assessment in social–personality research: Does the association


between narcissism and psychological health result from a confound with
self-esteem?
Seth A. Rosenthal *, Jill M. Hooley
Harvard University, Department of Psychology, 33 Kirkland Street, Cambridge, MA 02138, United States

a r t i c l e i n f o a b s t r a c t

Article history: Influential social and personality psychology research indicates that narcissism is related to psychological
Available online 15 May 2010 health. Such inferences are open to question, however, because they nearly all rely on the same self-
report instrument—the Narcissistic Personality Inventory (NPI; Raskin & Hall, 1979, 1981)—to operation-
Keywords: alize and measure narcissism. This is problematic because numerous NPI items do not appear to corre-
Narcissism spond to common definitions or manifestations of narcissism, and may instead be indicative of self-
Self-esteem esteem. Two studies demonstrate that the NPI’s confound with self-esteem accounts for the purported
Psychological health
relationship between narcissism and psychological health. This suggests that inferences about narcissism
Narcissistic personality inventory (NPI)
Narcissistic personality disorder
and psychological health may need to be reinterpreted. Results also highlight the need for measures that
Pathological narcissism correspond more directly to core components of narcissism.
Normal narcissism Ó 2010 Elsevier Inc. All rights reserved.

1. Introduction normative social–personality perspectives on this question, and


clinical perspectives, which generally emphasize narcissists’ low
Imagine hearing about two people who are both described as or fragile self-esteem (e.g., APA, 2000; Kernberg, 1975; Kohut,
assertive and confident. Both also prefer leadership roles and enjoy 1971, 1977), has made it increasingly difficult to reconcile social–
receiving compliments. However, beyond these apparent similari- personality and clinical narcissism research (Cain, Pincus, & Ansell,
ties, the two are quite different from each other. The first is consis- 2008; Miller & Campbell, 2008; Pincus & Lukowitsky, 2010; Pincus
tently full of bravado to overcompensate for core insecurities, et al., 2009). Moreover, and most germane to this article, disagree-
insatiably in need of other people’s admiration (e.g., Morf & Rho- ment over whether self-esteem and other normative traits should
dewalt, 2001), and unreasonably pushy, overbearing, and demand- be considered narcissistic has created confusion about whether
ing. You probably would not be surprised to hear this person psychological health is truly a potential characteristic of people
referred to as a narcissist (e.g., American Psychiatric Association, who are narcissistic.
2000). In contrast, the second person is ‘‘happier than most, less so- Although it is clear that many social–personality psychologists
cially anxious, . . . less depressed, . . . [and] higher [in] self-esteem” include high self-esteem in their conceptions of narcissism
(see W. K. Campbell, 2001, p. 214). Is it possible that this norma- whereas clinical psychologists generally do not (Fossati et al.,
tively happy and healthy person is a narcissist as well? According 2005; Miller & Campbell, 2008; Pincus & Lukowitsky, 2010; Pincus
to some perspectives in social and personality psychology research et al., 2009), it is unlikely that this reflects fundamental theoretical
(e.g., W. K. Campbell, 2001; Miller & Campbell, 2008), the answer differences between the two camps. Instead, we posit that the
may be ‘‘yes.” In fact, the psychologically healthy characteristics inclusion of high self-esteem and other normative characteristics
enumerated above are a partial description of a narcissist from in social–personality definitions of narcissism results primarily
one social–personality point of view. from the way narcissism is traditionally operationalized. The self-
The narcissist with these healthy traits lies at the center of a report scale that is used to measure narcissism in nearly all so-
crucial question about the limits of the theoretical and operational cial–personality research (Cain et al., 2008; Mullins & Kopelman,
definitions of narcissism. To what extent should high self-esteem, 1988; Pincus et al., 2009) is the Narcissistic Personality Inventory
and normative traits related to it such as assertiveness and confi- (NPI; Raskin & Hall, 1979, 1981). The NPI contains items that ap-
dence, play a role in defining narcissism? The divergence between pear to be confounded with self-esteem, a characteristic that they
may measure at least as effectively as they measure narcissism. As
* Corresponding author. a result, the NPI’s correlates include not only the negative psycho-
E-mail address: seth@merrimanriver.com (S.A. Rosenthal). logical states and outcomes that might be shared with typical

0092-6566/$ - see front matter Ó 2010 Elsevier Inc. All rights reserved.
doi:10.1016/j.jrp.2010.05.008
454 S.A. Rosenthal, J.M. Hooley / Journal of Research in Personality 44 (2010) 453–465

clinical definitions of narcissism (e.g., aggression, Bushman & sense of self-importance, preoccupation with fantasies of unlim-
Baumeister, 1998; reduced romantic commitment, W. K. Campbell ited success, exhibitionism, indifference or rage, and disturbances
& Foster, 2002; pathological gambling, Lakey, Rose, Campbell, & in interpersonal relationships such as entitlement, exploitative-
Goodie, 2008), but also the positive psychological states that are ness, splitting, and lack of empathy. The NPI was based on the
more likely to be associated with high self-esteem, such as those assumption that ‘‘abnormality is continuous with normality, [and
noted in the description of the happy, healthy narcissist in example thus] behaviors descriptive of the Narcissistic Personality Disorder
two. are . . . extreme forms [of these narcissistic traits] which are
Self-esteem is the normative characteristic with which the NPI manifested to a lesser extent in normal individuals” (Raskin & Hall,
appears to share its most robust empirical relationship (see Brown 1981, p. 159).
& Zeigler-Hill, 2004; Cain et al., 2008; Raskin, Novacek, & Hogan, In other words, the scale’s authors intended for the NPI to mea-
1991a, 1991b; Rhodewalt & Morf, 1995). One reason to closely sure less extreme levels of characteristics associated with narcis-
examine the NPI’s positive link with self-esteem, and the possibil- sism as described in the DSM-III (see Pincus & Lukowitsky, 2010;
ity that this link is largely a byproduct of confounded items Pincus et al., 2009). They did not intend to expand the definition
contained within the NPI itself, is that there is accumulating of the construct based on normative clinical or social–personality
evidence that the connection between the NPI and psychological theories. By referring to historic theories that included high self-es-
health is contingent on the NPI’s relationship with self-esteem. This teem in their definition of narcissism to justify NPI-based findings
is the case, for example, in research by Rose (2002), who reported about psychological health, critics (e.g., W. K. Campbell, 2001; Mill-
that narcissism was related to multiple measures of happiness, and er & Campbell, 2008) implicitly suggest that the authors of the NPI
by Sedikides, Rudich, Gregg, Kumashiro, and Rusbult (2004), who got the measurement aspects of narcissism right, but got the the-
reported that narcissism was related to numerous indicators of ory on which they based their measure wrong. In contrast, we sug-
psychological health, such as lower depression, sadness, anxiety, gest that just the opposite may be the case; the NPI’s authors
and neuroticism, as well as higher levels of personal and couple appear to have created a scale that is not entirely consistent with
well-being. In both sets of studies, the relationship between the the theory on which it was based. In fact, the NPD section of the
NPI and each of its healthy psychological correlates was fully med- DSM-III states that narcissistic self-esteem is ‘‘often fragile”
iated by self-esteem (see also Brown, Budzek, & Tamborski, 2009). (p. 316), rather than that narcissists have high self-esteem.
This led Sedikides and colleagues to conclude that self-esteem is Using the DSM-III criteria as a theoretical ‘‘conceptual template”
the ‘‘key component of narcissism” (p. 401) through which narcis- (Raskin & Terry, 1988, p. 892), it is easy to understand how items
sism predicts positive psychological outcomes (see also Sinha & ranging from severe manifestations of narcissistic characteristics
Krueger, 1998). In contrast, self-esteem does not appear to mediate (e.g., ‘‘I insist on getting the respect that is due me;” ‘‘I know that
the association between the NPI and the kinds of negative out- I am good because everybody keeps telling me so”) to more mod-
comes more traditionally associated with narcissism. For example, erate manifestations (e.g., ‘‘I am apt to show off if I get a chance;” ‘‘I
controlling for self-esteem did not negate the relationship between am more capable than other people”) were included in the NPI.
the NPI and reduced romantic commitment (W. K. Campbell & Unfortunately, other NPI items, such as ‘‘I am assertive” and ‘‘I
Foster, 2002), pathological gambling (Lakey et al., 2008), or the see myself as a good leader” appear to fall outside of the NPI’s
greedy exploitation of natural resources (W. K. Campbell, Bush, authors’ own DSM-III-based definition of narcissism. These more
Brunell, & Shelton, 2005). Taken together, it appears that a link normative characteristics do not appear to lie on a clear continuum
between the NPI and psychological health (but not negative with those enumerated in the DSM-III. Rather, they most likely
psychological outcomes) depends on a theory of narcissism that measure subjectively different constructs from the diagnostic cri-
considers high self-esteem to be an inherent narcissistic trait teria rather than less severe versions of the same constructs (see
(e.g., Baumeister, Campbell, Krueger, & Vohs, 2003). Pincus & Lukowitsky, 2010; Pincus et al., 2009).
To justify the inclusion of self-esteem and other normative A practical problem this causes is that the NPI’s most normative
characteristics within a social–personality theory of narcissism, items are not specific to narcissism—a narcissist might be described
some have called for revisiting historic clinical theories that pro- by them (if only superficially), as in the first example presented ear-
vide the grounds doing so (see W. K. Campbell, 2001; Miller & lier. But the content of these items also might not be indicative of
Campbell, 2008). However, such an approach may be problematic narcissism. In other words, the items do not necessarily differenti-
for several reasons. First, it employs post hoc theoretical explana- ate well between narcissists and non-narcissists. Even if narcissists
tions for findings that might be more parsimoniously explained often exhibit these characteristics (see Lynam & Widiger, 2001;
through an empirical critique of some of the NPI’s items. Further, Miller, Gaughan, Pryor, Kamen, & Campbell, 2009; Samuel & Widi-
the clinical theories that did include high self-esteem in their def- ger, 2004), knowing that someone possesses these attributes does
inition of narcissism were either too nebulous and overinclusive not necessarily help one discern how narcissistic that individual
(e.g., Freud, 1931/1950) or too multifaceted (e.g., Kohut, 1971, is, or even whether that individual is narcissistic at all. Further, such
1977) to be operationalized properly using any single measure items may provide more information about whether a person has
(see Clark & Watson, 1995; Raskin & Terry, 1988). high self-esteem than about whether that person is narcissistic.
Perhaps most problematically, these historical clinical theories And although such normative attributes are not measured by a
are not aligned with the theoretical foundation that was used to majority of the NPI’s items, the internal consistency strategy origi-
develop the NPI. The NPI was not developed to correspond with nally used to develop the NPI resulted in statistical overrepresenta-
a normative definition of narcissism. Instead, the scale’s authors in- tion of its most normative items in aggregated scores (Emmons,
tended to provide a continuous, non-clinical measure (for use in 1984; Kansi, 2003; Raskin & Terry, 1988). As a result, aggregated
normal populations) of the characteristics described by a specific NPI scores are poorly proportioned (see Haynes, Richard, & Kubany,
clinical definition of narcissism, the diagnostic criteria for narcis- 1995), causing them to follow the scale’s most normative items in
sistic personality disorder (NPD) in the then-current edition of correlating with variables indicative of psychological health.
Diagnostic and Statistical Manual of Mental Disorders (DSM-III, In sum, the conclusion that narcissism is associated with
APA, 1980; see Raskin & Terry, 1988). Accordingly, the NPI’s healthy psychological states and outcomes may depend largely
authors developed items that they believed ‘‘sampled the domain on the effects of a number of items in the NPI that appear to be
of the narcissistic personality” (Raskin & Hall, 1979, p. 590) identi- more closely related to self-esteem than to narcissism. To investi-
fied by the DSM-III criteria. These criteria included a grandiose gate this possibility, in Study 1 we examined whether the NPI’s
S.A. Rosenthal, J.M. Hooley / Journal of Research in Personality 44 (2010) 453–465 455

overlap with self-esteem is attributable to a theoretically sound Clinical Interview for DSM-IV Personality Disorders (SCID-II; First
empirical relationship between the two constructs, or whether, et al., 1997). Participants completed the 17 PQ items that corre-
as we hypothesize, it is the result of the inclusion of specific items spond to the nine DSM-IV diagnostic criteria for NPD. Examples in-
in the NPI that are confounded with self-esteem. In Study 2, we ex- clude ‘‘Do people often fail to appreciate your very special talents
plored whether these same NPI items account for the types of rela- or accomplishments?” and ‘‘Do you often expect other people to
tionships between narcissism and psychological health that have do what you ask without question because of who you are?” Re-
been reported in the social–personality literature. sponses were coded according to the number of NPD criteria en-
dorsed (i.e., scores ranged from 0 to 9). For criteria with more
2. Study 1 than one associated PQ item, a ‘‘yes” answer to any associated item
was coded as endorsement of the criterion.
2.1. Overview The PQ was designed to be a screening instrument for the SCID-
II diagnostic interview (First, Spitzer, Gibbon, & Williams, 1995).
In Study 1, we used three independent methods—expert ratings, However, agreement between the two assessments is such that
item response theory (IRT) data, and traditional NPI factors derived the PQ can serve as a reasonable alternative to the interview (Ekse-
using exploratory factor analysis (EFA)—to delineate which NPI lius, Lindstrom, von Knorring, Bodlund, & Kullgren, 1994). The PQ
items did a good job measuring narcissism, and which items func- has been used previously as a stand-alone research instrument
tioned relatively poorly at measuring the construct. We then com- (e.g., Dowson & Berrios, 1991; Morse, Robins, & Gittes-Fox, 2002).
bined the items that most clearly measured narcissism into NPI-N
subscales, whereas the items that appeared to measure some other 2.2.3.3. Rosenberg Self-Esteem Scale. The Rosenberg Self-Esteem
characteristic(s) better than they measured narcissism were com- Scale (RSE; Rosenberg, 1965) is a widely used measure that as-
bined and labeled the NPI-X subscales. We then investigated the sesses participants’ feelings of self-worth. It contains ten items
subscales’ relationships to a benchmark measure of DSM-based such as ‘‘On the whole, I am satisfied with myself” rated on a 1
narcissism to determine whether the subscales measured narcis- (strongly disagree) to 4 (strongly agree) scale. The RSE has been rec-
sism in a manner consistent with the intentions of the NPI’s ommended for use in research that aims to separate the effects of
authors. We also used a benchmark measure of self-esteem to narcissism from those of self-esteem (Brown & Zeigler-Hill, 2004).
investigate whether the NPI-X subscales measured self-esteem
more effectively than they measured DSM-based narcissism. 2.3. Approaches to assessing the narcissistic content of NPI items

2.3.1. Expert ratings


2.2. Method
Ratings of the narcissistic content of NPI items were made by 19
clinicians who were also empirical narcissism researchers. Poten-
2.2.1. Participants
tial participants met two criteria: they were (a) Ph.D. or M.D. level
The sample consisted of 232 students between the ages of 17
clinicians and (b) authors of empirical peer-reviewed narcissism
and 24–129 men and 103 women. The mean age of participants
research articles. Using the PsycINFO database, we identified 32
was 19.5 years (SD = 1.2). This sample is typical of the population
individuals who met both criteria. We contacted each potential
with which NPI-based research is often conducted. Participants
participant by email and sent a follow up request if there was no
were compensated with research credit or small payments. They
response to the first message. Nineteen participants (16 men and
were recruited through a psychology department study pool and
three women) completed the study. Of these, 15 held Ph.Ds., three
also via posters.
held M.Ds., and one held both degrees.
Experts assessed the content validity of each of the 54 items
2.2.2. Procedure from the original version of the NPI (Raskin & Hall, 1979, 1981)
Participants provided informed consent and demographic infor- by rating (a) whether it was ‘‘indicative of the construct of narcis-
mation. They then completed the narcissism and self-esteem ques- sism” and (b) whether it suggested ‘‘a clinical or diagnostic level
tionnaires as part of a larger study. To reduce priming effects, the of narcissism.” This second step was intended, in part, to remind
narcissism and self-esteem questionnaires were each separated participants that items did not have to meet a clinical threshold
by several other questionnaires that did not measure either con- in order to be considered indicative of the construct. Expert raters
struct. At the end of the study, participants were debriefed and in- were not directed to make their ratings based on any particular
formed about the purpose of the research. theoretical or typological orientation. Instead, they were intended
to consider narcissism ‘‘from their own diverse experiences” (see
2.2.3. Materials Lynam & Widiger, 2001, p. 409).
2.2.3.1. Narcissistic Personality Inventory. The NPI is a forced-choice Expert ratings and subscale information for the 37 items in-
measure of narcissism as a dimensional a personality trait. It in- cluded in the Emmons (1987) version of the NPI are presented in
cludes items ranging in severity from ‘‘I am assertive” to ‘‘I insist Table 1. Of the 37, the mean number of items each rater regarded
on upon getting the respect that is due me.” Participants completed as indicative of the construct of narcissism (i.e., hits) was 20.55
the 37-item, 4-factor version of the scale (Emmons, 1987). (SD = 5.67). From the perspective of the scale, of the 703 total item
ratings made, 390 (55.5%) were hits (SD = 0.16). From the perspec-
2.2.3.2. Personality Questionnaire for the Structured Clinical Interview tive of items, the mean number of hits per item (out of a possible
for DSM-IV Axis II Personality Disorders. Participants completed the 19) was 10.54 (SD = 4.16). Overall, 25 of the 37 items were en-
NPD section of the Personality Questionnaire for the Structured dorsed as indicative of the construct of narcissism by more than
Clinical Interview for DSM-IV Axis II Personality Disorders (PQ; half of the experts. The two items that research has shown to have
First, Gibbon, Spitzer, Williams, & Benjamin, 1997). This allowed the strongest statistical relationship with aggregated NPI scores
us to test the convergent validity of NPI items against a benchmark (i.e., they have the greatest statistical influence on overall NPI
measure directly related to the construct on which the NPI is pur- scores; Raskin & Terry, 1988), ‘‘I would prefer to be a leader” and
portedly based. The PQ is a 119-item yes/no questionnaire. Its ‘‘I like to have authority over people” received only two and ten
items correspond to the DSM-IV diagnostic criteria for personality hits respectively. In contrast, the item that has been shown to have
disorders, and are directly linked to the content of the Structured the weakest relationship with the aggregated NPI (i.e., it has the
456 S.A. Rosenthal, J.M. Hooley / Journal of Research in Personality 44 (2010) 453–465

Table 1
Expert, IRT, and EFA subscale ratings for 37-item NPI, Study 1.

Item Expert hits Expert subscale IRT subscale EFA subscale


20. I insist upon getting the respect that is due me 17 N N N
35. I will never be satisfied until I get all that I deserve 16 N N N
14. I think I am a special person 16 N X N
54. I am an extraordinary person 16 N X N
48. I am going to be a great person 16 N X N
32. Everybody likes to hear my stories 15 N N N
4. Superiority is something you are born with 14 N – N
49. I can make anybody believe anything I want them to 14 N N N
7. I know that I am good because everybody keeps telling me so 14 N N N
18. People can learn a great deal from me 14 N – N
40. I am envious of other people’s good fortunes 13 N – N
46. People always seem to recognize my authority 13 N N X
29. I always know what I am doing 13 N X N
19. I find it easy to manipulate people 12 N N N
53. I am more capable than other people 11 N N N
26. I like to look at my body 11 N N N
28. I am apt to show off if I get a chance 11 N N N
33. I usually dominate any conversation 11 N – N
42. I like to look at myself in the mirror 11 N X N
38. I have a strong desire for power 10 N N N
52. I get upset when people don’t notice how I look when I go out in public 10 N N N
10. I can usually talk my way out of anything 10 N N N
22. I can read people like a book 10 N N N
2. I have a natural talent for influencing people 10 N X X
17. I like having authority over other people 10 N X X
36. I like to be complimented 9 X X N
12. I like to be the center of attention 9 X X X
44. I really like to be the center of attention 9 X X X
50. I am a born leader 9 X N N
21. I like to display my body 9 X N N
27. I have good taste when it comes to beauty 7 X – N
6. I would be willing to describe myself as a strong personality 6 X – X
15. I see myself as a good leader 6 X X X
34. I expect a great deal from other people 5 X N N
47. I would prefer to be a leader 2 X X X
16. I am assertive 1 X X X
5. I would do almost anything on a dare 0 X N N
Mean (SD) 10.54 (4.16)

Note. For expert ratings, N = 19. Expert hits = number of experts who endorsed the item as indicative of narcissism. IRT = item response theory. EFA = exploratory factor
analysis. Item numbers are from the original 54-item NPI. For the Expert subscales, N = more than 50% of raters endorsed item as indicative of narcissism, X = fewer than 50%
of raters endorsed item as indicative of narcissism. For the IRT subscales, N = not identified as a poor item by IRT data, X = identified as a poor item by IRT data, – = IRT data not
available. For the EFA subscales, N = item from the Exploitativeness/Entitlement (E/E), Superiority/Arrogance (S/A), or Self-Absorption/Self-Sufficiency (S/S) subscale, X = item
from the Leadership/Authority (L/A) subscale.

least statistical influence on overall NPI scores; Raskin & Terry, item NPI shares 31 items in common with the Emmons (1987)
1988), ‘‘I insist upon getting the respect that is due me,” received 37-item version employed in the current research. O’Shea and Gus-
the greatest number of hits (17) from the expert raters. tafson’s (1999) results indicated that a number of the scale’s items
Overall agreement among the 19 raters was good. The two-way measured traits toward the lowest severity levels of the NPI’s spec-
mixed, absolute agreement, average measures intraclass correla- trum. As indicated by b parameter scores near or below zero, these
tion, which assumes that these specific experts’ ratings will be items were likely to be endorsed in the ‘‘narcissistic” direction by
used in the aggregate, was .77. The alpha for raters’ internal consis- individuals who had near average, or even below average levels
tency (with raters treated as variables and NPI items treated as of the general construct measured by the NPI. The data identified
cases) was .79. No single rater had a significantly detrimental effect 13 items with low b parameter scores. The authors also identified
on the alpha coefficient. a 14th item with a high c parameter score, which indicated that it
Using a liberal 50% endorsement threshold for each item as a was excessively likely to be endorsed by individuals who were ex-
cut-off (see Lawshe, 1975), we classified the 25 NPI items rated tremely low in the trait measured by the scale. Thirteen of the 14
as narcissistic by 10 or more expert raters as Expert-N items, and identified items are also contained in the Emmons (1987) 37-item
the 12 items rated as narcissistic by nine or fewer raters as Ex- NPI. Accordingly, we classified those 13 items as IRT-X items. The
pert-X items. other eighteen items shared by both scales (i.e., those with higher
b parameter scores) were classified as IRT-N items. We dropped the
remaining six items for which there were no ratings.
2.3.2. Item response theory
In the context of the NPI, an IRT analysis can determine whether
each NPI item is likely to be endorsed mainly by individuals who 2.3.3. Traditional subscales
are higher in the general trait measured by the scale, or is just as Emmons (1984, 1987) derived four NPI subscales using EFA:
likely to be endorsed by individuals with low levels of the trait. Exploitativeness/Entitlement (E/E), Superiority/Arrogance (S/A),
O’Shea and Gustafson (1999) conducted a three-parameter model Self-Absorption/Self-Sufficiency (S/S), and Leadership/Authority
IRT analysis on the 40-item version of the NPI (Raskin & Terry, (L/A). E/E was the most clinically-relevant subscale; it may mea-
1988) with data from 1260 undergraduate participants. The 40- sure the core, maladaptive aspects of narcissism (Dickenson &
S.A. Rosenthal, J.M. Hooley / Journal of Research in Personality 44 (2010) 453–465 457

Table 2 Table 3
Correlations, descriptive statistics, and reliabilities, Study 1. Regression summaries for NPI-N and NPI-X subscales predicting benchmark narcis-
sism and self-esteem measures, Study 1.
NPI PQ RSE M SD Alpha
Benchmark measures
NPI 14.33 5.83 .80
PQ .34 4.21 2.02 .62 Narcissism (PQ) Self-esteem (RSE)
RSE .36 .21 3.20 0.53 .88
Beta B SEB Beta B SEB
Expert-N .92 .45 .21 8.77 3.85 .69
Expert-X .83 .08 .47 5.56 2.78 .72 Expert-N .58* 0.30 .04 .06 0.01 .01
IRT-N .87 .42 .14 5.09 2.90 .62 Expert-X .23* 0.17 .05 .51* 0.10 .01
IRT-X .86 .11 .55 7.43 3.18 .76
IRT-N .52* 0.36 .05 .22* 0.04 .01
EFA-N .90 .47 .19 9.00 4.09 .70
IRT-X .17* 0.11 .04 .67* 0.11 .01
EFA-X .77 .01 .47 5.32 2.78 .82
EFA-N .57* 0.28 .03 .01 0.00 .01
Note. N = 232. NPI = Narcissistic Personality Inventory. PQ = narcissistic personality EFA-X .23* 0.17 .05 .47* 0.09 .01
disorder section from the Personality Questionnaire for the Structured Clinical
Interview for DSM-IV Axis II Personality Disorders. RSE = Rosenberg Self-Esteem Note. N = 232. NPI = Narcissistic Personality Inventory. PQ = narcissistic personality
Scale. Expert = expert item content ratings. IRT = item response theory. disorder section from the Personality Questionnaire for the Structured Clinical
EFA = exploratory factor analysis. Expert-, IRT-, and EFA-N subscales = subscales Interview for DSM-IV Axis II Personality Disorders. RSE = Rosenberg Self-Esteem
comprised of more clearly narcissistic NPI items. Expert-, IRT-, and EFA-X sub- Scale. Expert = expert item content ratings. IRT = item response theory.
scales = subscales comprised of less clearly narcissistic NPI items. All correlations EFA = exploratory factor analysis. Expert-, IRT-, and EFA-N subscales = subscales
r P .13, p < .05; r P .17, p < .01; r P .22, p < .001. comprised of more clearly narcissistic NPI items. Expert-, IRT-, and EFA-X sub-
scales = subscales comprised of less clearly narcissistic NPI items.
*
p < .001.
Pincus, 2003; P. J. Watson, Grisham, Trotter, & Biderman, 1984). In
contrast, L/A was considered the most adaptive and least clinically-
relevant. The other two subscales, S/A and S/S, fell between E/E and measure of self-esteem as it was to a benchmark measure of nar-
L/A, but are often considered to be adaptive subscales that are clo- cissism. This is also notable as the two benchmark measures were
sely related to L/A (Emmons, 1984, 1987; P. J. Watson & Biderman, negatively correlated with each other in the same data set
1993; P. J. Watson, Little, Sawrie, & Biderman, 1992; P. J. Watson & (r = .21, p < .01).
Morris, 1990).
However, there is also evidence that L/A stands apart from 3.2. Subscales
the two other adaptive subscales, S/A and S/S, as well as from
E/E. L/A exhibits a unique lack of convergence with various other We used three independent methods for dividing the NPI into
measures of narcissism (Shulman & Ferguson, 1988). It is also more two sets of items that were better, or more poorly, aligned with
strongly related to normative characteristics such as assertiveness the construct of narcissism: clinical research experts’ content
(P. J. Watson, McKinney, Hawkins, & Morris, 1988) and extraver- validity ratings, IRT results reflecting internal validity, and tradi-
sion (Emmons, 1984) than are any of the other subscales. Further, tional EFA-derived subscales developed to investigate construct
the L/A subscale is lacking in construct validity on its face (Em- validity. As indicated in Table 1, the three methods produced par-
mons, 1987; Mullins & Kopelman, 1988), because leadership and tially overlapping results. For the 31 items rated by all three meth-
related characteristics do not appear among the DSM-III (or subse- ods, there was three-way agreement on 18 (13 agreed as NPI-N
quent) NPD criteria, but have long been measured as desirable items, five agreed as NPI-X items), and disagreement on the 13
non-narcissistic traits (e.g., Gough, 1969). Thus, the L/A subscale remaining items. Four of the six items for which there were only
essentially ‘‘adds a new dimension” to narcissism (Mullins & Kop- two ratings were agreed as NPI-N items, one as an NPI-X item,
elman, 1988, p. 620), which is generally considered poor practice in and there was disagreement on one.
defining the limits of a construct in order to measure it precisely Although there was notable variation in the composition of the
(Clark & Watson, 1995; Haynes et al., 1995). subscales produced by the three methods for dividing the NPI, the
Because of the potential problems specific to the L/A subscale, pattern of the correlations between the subscales and the bench-
we investigated the consequences of separating L/A from the rest mark scales was nearly identical (see Table 2). In each case, the
of the NPI by labeling the nine L/A items the EFA-X subscale, and NPI-N subscale was significantly correlated with the benchmark
the 28 items from the other three subscales the EFA-N subscale. measure of narcissism (PQ) whereas the NPI-X subscale was uncor-
Thus, the EFA-N subscale retained the items from the adaptive related with the PQ. In contrast, all subscales were significantly
S/A and S/S subscales as well as from the maladaptive E/E subscale. correlated with the self-esteem benchmark measure (RSE). How-
ever, in each pair of subscales, the NPI-X subscale’s correlation with
3. Results the RSE was significantly stronger than was the corresponding NPI-
N subscale’s correlation (ZExpert = 4.40; ZIRT = 7.06; ZEFA = 4.26, all
3.1. Aggregated NPI ps < .001).1 This indicates that the NPI-X subscales share a stronger
relationship with self-esteem than do the NPI-N subscales. More
Descriptive statistics, reliabilities, and correlations for the scales importantly, each NPI-X subscale was also more strongly correlated
and subscales used in Study 1 are reported in Table 2. The aggre- with the RSE than with the PQ (ZExpert = 4.10; ZIRT = 4.82; ZEFA = 4.77,
gated NPI was significantly correlated with both the PQ and the all ps < .001). This indicates that each NPI-X subscale was more
RSE. Further, there was no statistical difference between the mag- strongly related to the benchmark measure of self-esteem than to
nitudes of the two correlation coefficients (rs = .34 and .36 respec- the benchmark measure of narcissism.
tively; Z = 0.22, p = .83; see Meng, Rosenthal, & Rubin, 1992, for the We also investigated whether the NPI-X subscales contributed
method used to compare correlated correlation coefficients variance independent of the NPI-N subscales to predicting the
throughout this article). The same coefficients, corrected for disat- benchmark narcissism measure by simultaneously entering the
tenuation due to less than perfect internal consistency (Spearman, corresponding paired subscales in regressions predicting the PQ.
1904), were also statistically equivalent (disattenuated rs = .48 and
.43 respectively, Z = 0.60, p = .55). In other words, when used as an 1
The correlation between the Expert-N and Expert-X subscales = .53; between the
aggregated scale, the NPI was as closely related to a benchmark IRT-N and IRT-X subscales = .54; and between the EFA-N and EFA-X subscales = .42.
458 S.A. Rosenthal, J.M. Hooley / Journal of Research in Personality 44 (2010) 453–465

The left half of Table 3 illustrates that in each case, the NPI-N sub- taneous regressions reported in Table 3 indicate that the relation-
scale predicted PQ scores. In contrast, each NPI-X subscale was ships between the NPI-N subscales and self-esteem are negated by
negatively related to the PQ. Although this occurred in the context controlling for the NPI-X subscales, suggesting that this relation-
of statistical suppressor effects, whereby estimates of the specific ship is tenuous and in need of further investigation.
direction and strength of the relationships are unreliable, the sup-
pression did not affect the key conclusion that the NPI-X subscales 4.1. Limitations
were not positively related to the PQ.2
In contrast, as illustrated in the right half of Table 3, when en- It is important to note that each of the three methods used to
tered simultaneously in a regression, each of the NPI-X subscales divide the NPI into more and less narcissistic items poses problems
predicted the benchmark self-esteem measure whereas the corre- on its own. An expert ratings approach is generally favored for test
sponding NPI-N subscales did not contribute any additional vari- items that measure observable outcomes, such as job or school
ance to predicting self-esteem (except in the case of the IRT- performance, rather than abstractions such as personality traits
derived subscales, where IRT-N was negatively related to the (Lawshe, 1985). Further, a 50% cut point for dividing the scale is
RSE). This provides further evidence that the items comprising arbitrary, although it is widely used and based on the principle that
the NPI-X subscales are robustly related to self-esteem. items with more than 50% endorsement by a group of experts have
Finally, it is also noteworthy that the potential problems with at least ‘‘some degree of content validity” (Lawshe, 1975, p. 567).
the L/A subscale identified by the traditional subscale approach Our design for assessing expert ratings also did not account for par-
may have been recognized implicitly in the experts’ ratings. Only ticipants’ familiarity with or biases about the NPI, either of which
three of L/A’s nine items were rated as indicative of narcissism could have affected their ratings. We also did not ask experts to
by more than half of the experts. The mean number of hits per item choose whether each NPI item measures ‘‘narcissism or self-
for the 9-item L/A subscale was 7.33 (SD = 3.94), and the mean hit esteem,” which would have been more in keeping with the hypoth-
percentage per item was 38.6% (SD = 0.20). In contrast, the hits per eses of this research. Future research using expert ratings could
item for the 11-item S/A subscale was 11.00 (SD = 4.17), hit per- benefit by including items from multiple narcissism and self-es-
centage = 57.9% (SD = 0.21); for the 9-item S/S subscale, hits per teem measures, and providing a format in which experts choose
item = 12.11 (SD = 3.48), hit percentage = 63.7% (SD = 0.26); and whether each item measures narcissism or self-esteem.
for the 8-item Exploitativeness/Entitlement subscale (E/E), hits IRT analyses assume that the measure being analyzed is unidi-
per item = 11.75 (SD = 3.77), hit percentage = 61.8% (SD = 0.24). mensional. However, the NPI has been shown in numerous studies
Overall, the average item from the L/A subscale was endorsed as to be multidimensional (Corry, Merritt, Mrug, & Pamp, 2008;
narcissistic significantly less frequently than was the average item Emmons, 1984, 1987; Kubarych, Deary, & Austin, 2004; Raskin &
from the three other subscales, paired-samples t(18) = 4.07, Terry, 1988). The IRT’s authors (O’Shea & Gustafson, 1999) agree
p < .001. that the NPI is not fully described by a single factor. On the other
hand, they note that Monte Carlo simulations indicate that IRT
models should produce accurate descriptions of a multidimen-
4. Discussion
sional scale if the scale’s first factor accounts for 20% or more of
the overall variance (Reckase, 1979; see also Drasgow & Parsons,
Results from Study 1 support the hypothesis that portions of the
1983). Accordingly, O’Shea and Gustafson (1999) conducted an
NPI do not do a good job of measuring narcissism. Further, these
EFA with their data. Their analysis produced a first factor that ac-
items appear to be confounded with self-esteem. These conclu-
counted for 43% of the variance in the NPI. This suggests that an
sions are borne out almost identically whether the NPI is divided
IRT model of their data should produce relatively accurate results.
into subscales using judgments of expert clinical researchers, IRT
Also, treating the NPI as if it were undimensional introduces eco-
analyses (O’Shea & Gustafson, 1999), or subscales based on EFAs
logical validity to the research (if only unintentionally). Research
conducted by a personality psychologist (Emmons, 1987).
using the NPI most often relies on a unidimensional aggregated
The conclusions derive from two key findings. First, using each
score (Miller & Campbell, 2008). Further, the NPI was originally
method to divide the NPI, the resulting NPI-X subscale is unrelated
developed using an internal consistency strategy better suited for
to the benchmark narcissism measure (i.e., the PQ). This suggests
selecting scale items to measure a unidimensional than a multidi-
that major portions of the NPI do not meet the scale’s authors’ sta-
mensional construct (Raskin & Terry, 1988). Nevertheless, because
ted goal of measuring narcissism that is linked to the DSM diagnos-
of dimensionality concerns, the IRT results should be treated with
tic criteria for NPD (Raskin & Hall, 1979). Second, these less
caution.
narcissistic NPI subscales have a significantly stronger relationship
As noted earlier, Emmons’s (1987) traditional NPI subscales
with the benchmark self-esteem measure (i.e., the RSE) than with
have typically been divided into three adaptive subscales (L/A,
the benchmark narcissism measure, suggesting that they measure
S/S, and S/A), with E/E set aside as the lone maladaptive subscale
self-esteem better than they measure narcissism.
(Emmons, 1984, 1987; P. J. Watson et al., 1992). We take a different
The results of Study 1 also provide some potentially good news
approach by combining E/E, S/S, and S/A into a single measure of
for the validity of inferences based on some of the NPI’s items. In all
narcissism and setting aside L/A as a less appropriate means for
cases, the NPI-N subscales were strongly related to the benchmark
measuring narcissism. We believe that setting L/A, rather than
narcissism scale. This indicates that many NPI items do meet the
E/E, aside is more theoretically consistent with the intentions of
goal of measuring narcissism that overlaps with the DSM descrip-
the NPI’s authors (Raskin & Hall, 1979, 1981). By removing L/A un-
tion of the trait (see Miller et al., 2009). The NPI-N subscales also
der the assumption that it is comprised of poorly-conceived items
shared positive zero-order relationships with the benchmark self-
(i.e., that it does not measure narcissism properly), we retain the
esteem scale, suggesting that the NPI’s more narcissistic items
remainder of the NPI as a continuous measure of narcissism. In
may also be positively related to self-esteem. However, the simul-
contrast, the common practice of separating E/E from the rest of
the NPI while maintaining that both represent valid measures of
2
The statistical suppressor effects do not appear to be the result of multicolinearity narcissism suggests that the NPI is actually made up of two
between the NPI-N and NPI-X subscales. Allison (1999) provided the conservative
estimate that a variance inflation factor (VIF) of 2.50 or higher indicates a
separate continuous measures of narcissism (E/E being a clinical-
multicolinearity problem. In contrast, the VIF in each of the current regression level narcissism measure that is discontinuous from the other
models was lower than 1.40. three normal narcissism subscales; e.g., Dickenson & Pincus, 2003;
S.A. Rosenthal, J.M. Hooley / Journal of Research in Personality 44 (2010) 453–465 459

P. J. Watson et al., 1984, 1992). We believe that an approach to the psychological health and distress questionnaires as part of a larger
NPI that retains the continuity from more to less severe narcissism, study. Participants were then debriefed and informed about the
while removing the items that may not be closely associated with study’s purpose.
narcissism at all, is preferable. However, this method for dividing
the NPI has not been tested empirically elsewhere, and should be 5.2.3. Materials
considered with that in mind. Participants completed the 37-item NPI and the RSE as well as
It is also important to note that the DSM diagnostic criteria for self-reports of the following psychological health variables (PHVs):
NPD have changed since the development of the NPI. This could ac-
count for some of our results (i.e., for the lack of a relationship be- 5.2.3.1. Optimism. The Life Orientation Test (Scheier & Carver,
tween some NPI items and the PQ). However, we believe this is an 1985) measures dispositional optimism. It consists of eight items
unlikely explanation for a number of reasons. First, the crucial such as ‘‘I always look on the bright side of things” rated on a 1
characteristics of grandiosity, entitlement, exploitativeness, need (strongly disagree) to 5 (strongly agree) scale.
for admiration, lack of empathy, etc., were retained from the
DSM-III, on which the NPI is based, through the DSM-IV, on which 5.2.3.2. Happiness. The Oxford Happiness Questionnaire (Hills & Ar-
the PQ is based. Second, the changes in criteria from the inception gyle, 2002) measures dispositional happiness. It consists of 29
of the DSM-III to the DSM-IV should theoretically increase, rather items such as ‘‘I am very happy” rated on a 1 (strongly disagree)
than decrease, the relationship between the NPI and the PQ. This to 6 (strongly agree) scale.
is because the DSM criteria that were removed emphasized vulner-
able narcissistic traits (e.g., inferiority, shame, emptiness, splitting;
5.2.3.3. Positive and negative affect. The Positive and Negative Affect
Cain et al., 2008; Gunderson, Ronningstam, & Smith, 1995). As a re-
Schedule measures positive affect (i.e., ‘‘the extent to which a per-
sult, the remaining DSM criteria focus nearly exclusively on gran-
son feels enthusiastic, active, and alert;” D. Watson, Clark, & Telle-
diose narcissistic themes (Cain et al., 2008; Miller & Campbell,
gen, 1988, p. 1063) and negative affect (i.e., ‘‘subjective distress
2008; Miller, Hoffman, Campbell, & Pilkonis, 2008; Pincus & Luko-
and unpleasurable engagement;” p. 1063). Each subscale consists
witsky, 2010; Pincus et al., 2009), suggesting that there should be
of ten items which are rated on a 1 (very slightly or not at all) to
an increased level of overlap with the NPI. Accordingly, the
5 (extremely) scale. When used to measure dispositional affect,
changes in the diagnostic criteria for NPD made from the DSM-III
the Positive Affect and Negative Affect subscales are generally
to the DSM-IV are unlikely to be the cause of a lack of correlation
uncorrelated (Schmukle, Egloff, & Burns, 2002).
between the NPI-X subscales and the PQ.
Overall, and even with these caveats, the results of Study 1 ap-
5.2.3.4. Aggression. The Aggression Questionnaire (Buss & Perry,
pear to support the central hypotheses: (1) that parts of the NPI do
1992) measures dispositional hostility, anger, physical aggression,
poor job of measuring narcissism and (2) that those poor parts of
and verbal aggression. It consists of 29 items such as ‘‘sometimes I
the NPI are confounded with and bias the aggregated scale toward
fly off the handle for no good reason” rated on a 1 (extremely
measuring self-esteem.
uncharacteristic of me) to 5 (extremely characteristic of me) scale.

5. Study 2 5.2.3.5. Anxiety sensitivity. The Anxiety Sensitivity Index (Reiss, Pet-
erson, Gursky, & McNally, 1986) measures the belief that anxiety
5.1. Overview experiences have negative implications and consequences (i.e., it
measures individuals’ fear of anxiety rather than their level of anx-
In Study 2, we investigated the degree to which the overlap be- iety; Taylor, Koch, McNally, & Crockett, 1992). The scale contains
tween the NPI-X subscales and self-esteem was responsible for the 16 items (e.g., ‘‘It scares me when I am nervous”) which are rated
relationship between the NPI and self-reports of indicators of psy- on 1 (very little) to 5 (very much) scale. Anxiety sensitivity is asso-
chological health and distress, including optimism, happiness, po- ciated with behavioral manifestations of anxiety (Maller & Reiss,
sitive affect, aggression, anxiety sensitivity, and negative affect. We 1987) and the presence of anxiety disorders, particularly panic dis-
predicted that any relationship between the NPI and psychological order (McNally, 2002; Olatunji & Wolitzky-Taylor, 2009). It also
health would be fully accounted for by the NPI-X subscales and by shares a robust positive relationship with neuroticism (Norton,
the NPI’s overlap with self-esteem. In contrast, the literature re- Cox, Hewitt, & McLeod, 1997; Zvolensky et al., 2003).
viewed earlier suggests that any connections between the NPI
and psychological distress should be driven directly by the NPI-N
6. Results
subscales and should be minimally affected by controlling for
self-esteem.
Descriptive statistics for the scales and subscales from Study 2
are reported in Table 4. The first column of Table 5 reports the cor-
5.2. Method relations between the NPI and the self-report PHVs. The aggregated
NPI was positively related to each of the positive PHVs: optimism,
5.2.1. Participants happiness, and positive affect. The aggregated NPI was also posi-
A new sample of 141 students between the ages of 18 and tively related to aggression, but had a marginal negative relation-
23–40 men and 101 women—was recruited through a psychology ship with the other two negative PHVs: negative affect and
department study pool and also via recruitment posters. The mean anxiety sensitivity. These are consistent with the relationships be-
age of participants was 19.6 years (SD = 1.1). This sample is typical tween narcissism and psychological health and distress typically
of the population with which NPI-based research is often con- reported in the types of social–personality studies reviewed earlier.
ducted. Participants were compensated with research credit or The second column reports the correlations between the RSE
small payments. and the PHVs. The RSE was positively related to the each of the po-
sitive PHVs and negatively related to each of the negative PHVs.
5.2.2. Procedure The aggregated NPI and RSE shared the same directional relation-
Participants provided informed consent and demographic infor- ship with each of the PHVs except for aggression, with which the
mation, and completed narcissism, self-esteem, and self-report NPI was positively related whereas the RSE was negatively related.
460 S.A. Rosenthal, J.M. Hooley / Journal of Research in Personality 44 (2010) 453–465

Table 4 with the PHVs, the NPI-N subscales’ relationships with the PHVs
Descriptive statistics, Study 2. were generally inconsistent with those relationships. Accordingly,
M SD Alpha it appears that the NPI items that were identified in Study 1 as
NPI 13.54 6.19 .83 poorer indicators of the narcissism construct were largely respon-
Expert-N 7.58 3.72 .72 sible for the aggregated NPI’s relationship with the PHVs. In con-
Expert-X 5.34 2.86 .74 trast, the NPI items that were deemed better indicators of
IRT-N 4.75 2.98 .66 narcissism in Study 1 appear to have little effect on the aggregated
IRT-X 7.13 3.31 .78
EFA-N 8.44 4.33 .75
NPI’s relationship with the PHVs.
EFA-X 5.10 2.82 .83 The right-most column reports partial correlations, which re-
Self-esteem 3.19 0.54 .89 moved the variance associated with the RSE, between the aggre-
Optimism 3.66 0.67 .84 gated NPI and the PHVs. Removing self-esteem’s variance from
Happiness 4.27 0.69 .93
the aggregated NPI negated most of the significant relationships
Positive affect 3.62 0.63 .86
Aggression 2.07 0.49 .89 between the NPI and the PHVs, leaving a only a significant relation-
Anxiety sensitivity 2.22 0.57 .85 ship with aggression and a marginal relationship with positive af-
Negative affect 2.06 0.68 .88 fect, and reversing (i.e., making positive) a marginal relationship
Note. N = 141. NPI = Narcissistic Personality Inventory. Expert = expert item content
with negative affect. Overall, the pattern of partial correlations be-
ratings. IRT = item response theory. EFA = exploratory factor analysis. Expert-, IRT-, tween the aggregated NPI and the PHVs was similar to the pattern
and EFA-N subscales = subscales comprised of more clearly narcissistic NPI items. of zero-order correlations between the NPI-N subscales and the
Expert-, IRT-, and EFA-X subscales = subscales comprised of less clearly narcissistic same PHVs. In contrast, this pattern was strikingly dissimilar from
NPI items.
the pattern of zero-order correlations of the aggregated NPI with
the PHVs.

In each directionally-consistent case, the correlation between the


RSE and the PHV was significantly stronger than the correlation be-
tween the aggregated NPI and the same PHV at the p < .01 signifi- 7. Discussion
cance level or greater.
Columns three through five report the correlations between the Investigating the connection of narcissism to psychological
NPI-X subscales derived in Study 1 and the PHVs. In each case ex- health using an aggregated NPI score paints a fairly straightfor-
cept for aggression, the NPI-X subscales shared the same direc- ward picture. High NPI-rated narcissists appear to be more psycho-
tional relationship with the PHV as did both the aggregated NPI logically healthy than non-narcissists (e.g., W. K. Campbell, 2001).
and the RSE. Each of the NPI-X subscales was uncorrelated with They are optimistic and happy, and are at least marginally lower in
aggression—these relationships essentially ‘‘split the difference” negative affect and fearful reactions to anxiety. In fact, they are
between the positive relationship of the aggregated NPI with healthy in ways very much like people with high self-esteem
aggression and the negative relationship of the RSE with aggres- (although less strongly so), except that they report being aggres-
sion. In every other case, the correlation between the RSE and sive whereas their high self-esteem counterparts report the
the PHV was stronger than the correlation between the NPI-X sub- opposite.
scale and the same PHV at the p < .05 level or greater, except for However, a closer examination of why there is a positive rela-
the RSE’s and NPI-X subscales’ correlations with positive affect, tionship between the aggregated NPI and self-reported psycholog-
which were each statistically equivalent. ical health reveals a starkly different picture. It is apparent that the
Columns six through eight report the correlations between the relationship between the NPI and psychological health is nearly
NPI-N subscales and the PHVs. The NPI-N subscales were signifi- entirely dependent on a small number of NPI items—the same
cantly related to aggression and significantly or marginally related items that were deemed by multiple methods in Study 1 to be poor
to positive affect. None of the other relationships between the NPI- indicators of the narcissism construct. Study 2 further indicates
N subscales and the PHVs were significant or marginal. In each that the NPI’s relationship with psychological health is largely a re-
case, the NPI-X subscale was more strongly correlated than its cor- sult of its overlap with self-esteem. Removing self-esteem from the
responding NPI-N subscale with each PHV in the direction that aggregated NPI greatly reduced the scale’s relevance to the PHVs.
suggests a relationship between narcissism and psychological This indicates that self-esteem plays a crucial role in guiding the
health at the p < .01 level or greater, except in the case of aggres- NPI’s associations with self-reported psychological health.
sion, with which the NPI-N subscales were more strongly corre- In contrast, as predicted, the NPI’s association with one less nor-
lated than the NPI-X subscales in the ‘‘unhealthy” direction. In mative trait—aggression—was largely driven by the NPI items that
other words, whereas the NPI-X subscales, the aggregated NPI, were deemed the better indicators of narcissism in Study 1. This
and the RSE generally shared directionally consistent relationships relationship was actually strengthened by removing the effects of

Table 5
Correlations and partial correlations of NPI, self-esteem, and NPI-X and NPI-N subscales with psychological health and distress variables, Study 2.

NPI Self-esteem NPI-X subscales NPI-N subscales Partial correlations


Expert IRT EFA Expert IRT EFA NPI-pr
Optimism .30 .70 .47 .51 .51 .12 .07 .09 .01
Happiness .29 .73 .49 .47 .51 .09 .10 .07 .05
Positive affect .35 .57 .48 .49 .54 .20 .19 .15 .14
Aggression .25 .36 .08 .03 .06 .33 .36 .32 .48
Anxiety sensitivity .14 .43 .28 .27 .27 .02 .02 .03 .05
Negative affect .15 .57 .31 .30 .31 .00 .04 .01 .14

Note. N = 141. NPI = Narcissistic Personality Inventory. Expert = expert item content ratings. IRT = item response theory. EFA = exploratory factor analysis. Expert-, IRT-, and
EFA-X subscales = subscales comprised of less clearly narcissistic NPI items. Expert-, IRT-, and EFA-N subscales = subscales comprised of more clearly narcissistic NPI items.
Partial correlations (pr) remove the variance associated with self-esteem. All correlations r P 14, p < .10; r P .17, p < .05; r P .22, p < .01; r P .28, p < .001.
S.A. Rosenthal, J.M. Hooley / Journal of Research in Personality 44 (2010) 453–465 461

self-esteem (see Paulhus, Robins, Trzesniewski, & Tracy, 2004; Tra- For instance, Freud (1931/1950) noted that narcissists can exhi-
cy, Cheng, Robins, & Trzesniewski, 2009). bit healthy unflappable strength and confidence, and suggested
Overall, the results of Study 2 indicate that either eliminating a that any type of psychological investment in the self, whether
small number of questionable items from the NPI, or controlling for pathological or not, fits under the umbrella of narcissism (see Pul-
the NPI’s overlap with self-esteem, could potentially lead to over- ver, 1970). Freud’s clinical theory may align best with current so-
hauling current findings in some social–personality literature cial–personality theories that consider pathological and normal
about the connection of narcissism to psychological health. The narcissism to be correlated constructs that are related through ba-
ensuing results would likely indicate that such relationships are sic core traits (e.g., Miller & Campbell, 2008; Miller et al., 2009). Be-
tenuous at best, and should be reconsidered. yond those core traits, however, these types of narcissism have
‘‘substantially different nomological networks” (Miller & Campbell,
2008, p. 470), particularly in their relationship with psychological
8. General discussion
health. Kohut (1966) also differentiated normal from pathological
narcissism, indicating that the two have independent developmen-
Much of the NPI-based research linking narcissism to psycho-
tal trajectories, where normal narcissism can develop into mature
logical health may need to be reinterpreted. It appears that estab-
psychological structures and processes. His view may align best
lishing a robust connection between narcissism and psychological
with current theories that consider pathological and normal nar-
health necessitates the following: (1) using only the NPI (including
cissism to be largely independent constructs, which may share
its most normative items) to measure narcissism, (2) accepting
some descriptive traits, but are otherwise unrelated (e.g., Cain
that the NPI items that are most normative actually measure nar-
et al., 2008; Pincus & Lukowitsky, 2010; Pincus et al., 2009).
cissism, and (3) accepting that the full mediation of the NPI’s con-
Consistent with theories of normal narcissism, the NPI’s opera-
nection to psychological health by self-esteem reflects an inherent
tional definition of narcissism has been described as ‘‘simply recog-
overlap of narcissism with high self-esteem rather than a
nizing one’s own contribution to positive outcomes without overly
confound.
exaggerating one’s accomplishments” (Emmons, 1987, p. 16).
Making each of these three choices is problematic. (1) Using
However, as noted by Raskin and Terry (1988), such a broad con-
only the NPI to measure narcissism is unwise both because relying
ception of narcissism runs the risk of rendering the term a vague
on a single method of measuring any construct is generally consid-
and somewhat meaningless way of describing ‘‘all human efforts”
ered problematic (D. T. Campbell & Fiske, 1959), and because, as
(see Ellis, 1927; Hoffman, 2008). It also makes it difficult, if not
our results indicate, aggregating scale items that may measure
impossible, to differentiate narcissism from definitions of self-es-
more than one construct can lead to making overinclusive infer-
teem (Pulver, 1970; Westen, 1990), such as ‘‘the individual . . . is
ences (Clark & Watson, 1995). (2) Accepting that the most norma-
aware of his virtues . . . [and has] confident anticipation of success”
tive NPI items measure narcissism is problematic because our
(Rosenberg, 1965, p. 31).
results (as well as much of the accumulated literature) suggest that
Moreover, the NPI was not developed to measure historical nor-
these items may bear little resemblance in their content or rela-
mative conceptualizations of narcissism. Therefore, such theories
tionships with third variables to the DSM-III description of narcis-
are not particularly germane to a discussion of NPI-based research.
sism on which the NPI was purportedly based. Finally, (3)
Instead, the NPI was intended to measure less extreme levels of
accepting that the NPI’s overlap with self-esteem reflects a valid,
narcissism ‘‘as defined by” a specific clinical typology, the DSM-
robust relationship is problematic because many theoretical (e.g.,
III criteria for NPD (Raskin & Hall, 1979, p. 590). Thus, it should
Westen, 1990) and empirical (e.g., Brown & Bosson, 2001; Paulhus,
not be necessary or desirable to segregate NPI-based research from
1998, 2001; Paulhus et al., 2004; Tracy et al., 2009) accounts of
clinical narcissism research, as has been suggested elsewhere (Cain
narcissism, most empirical work using narcissism measures other
et al., 2008; Pincus & Lukowitsky, 2010; Pincus et al., 2009). Our re-
than the NPI (e.g., Soyer, Rovenpor, Kopelman, Mullins, & Watson,
sults indicate that taking a critical approach to the NPI—by recog-
2001), and our regression results, suggest that it does not.
nizing that it contains poorly-conceived items that appear to be
If as a response to these problems, social–personality narcissism
confounded with self-esteem—may make it easier to understand
researchers modified their practice of relying on aggregated NPI
how NPI-based research and clinical narcissism research might
scores, omitted questionable NPI items, and/or partialed out self-
yet form a ‘‘cohesive knowledge base” that converges on a unitary
esteem as a confound when using the NPI, what we think we know
narcissism construct (see Pincus & Lukowitsky, 2010, p. 422).
about the positive side of narcissism could be radically different.
However, it is also possible that a DSM-based definition of nar-
Rather than appearing to be a sign of psychological health, narcis-
cissism was too narrow a guide for developing the NPI and/or is too
sism from a social–personality perspective might align more clo-
limited as a benchmark measure against which to test the NPI.
sely with clinical perspectives on the trait.
There is more than a century’s worth of theory describing narcis-
sism in ways that reach well beyond the short list of diagnostic cri-
8.1. Multiple definitions of narcissism? teria included in the versions of the DSM published during the last
30 years (see Morrison, 1986; Ronningstam, 1998; Ronningstam &
Our results suggest that the NPI is most accurately described as Gunderson, 1988). However, essential criteria contained in the
measuring both less extreme levels of characteristics associated DSM, such as arrogance, grandiosity, entitlement, exploitativeness,
with clinical narcissism and self-esteem (and confounding the and lack of empathy, are also at the core of the vast majority of
two into a single score) rather than as measuring a unitary con- other typologies of narcissism. And in the case of all but the most
struct of normal narcissism (see Miller & Campbell, 2008; Pincus normative theories, narcissists’ self-esteem is thought to be either
& Lukowitsky, 2010; Pincus et al., 2009). However, it is true that, low, or at best, disordered (Westen, 1990), rather than high. Be-
in contrast with most current clinical conceptions of narcissism, cause of this, although using the DSM as a research template
in narcissism’s early theoretical incarnations, psychoanalysts such may omit some important aspects of narcissism, conclusions
as Freud (1931/1950) and Rank (1911, cited in Pulver, 1970) also reached in narcissism research using the NPI, or any other mea-
used the term ‘‘narcissism” to describe an eclectic variety of nor- sure, should still stand up to scrutiny through the lens of the DSM’s
mative positive feelings and beliefs about the self analogous to criteria.
high self-esteem (see W. K. Campbell, 2001; Miller & Campbell, But where does a focus on less extreme levels of characteristics
2008). associated with clinical narcissism leave the types of healthy,
462 S.A. Rosenthal, J.M. Hooley / Journal of Research in Personality 44 (2010) 453–465

normal narcissism recognized by Freud (1931/1950) and Kohut scales from the 40-item NPI developed by Raskin & Terry, 1988).
(1966), and referenced by social–personality psychologists (e.g., From our perspective, these data may point to a counterintuitive
W. K. Campbell, 2001; Miller & Campbell, 2008)? Do some or all result—core characteristics of narcissism may be just as prevalent
of the NPI’s seemingly poorer items measure this other construct? in the east as in the west. Because of confusion about what the
Without a clear definition of normal narcissism, or strong evidence NPI measures, we suggest caution in making broad assertions
that it exists independent of other constructs, this question is dif- regarding NPI-based findings, including in the two debates refer-
ficult to answer. However, if research on normal narcissism can be enced here.
more accurately described as investigations of self-esteem (e.g.,
Rosenberg, 1965), assertiveness (e.g., Rathus, 1973), or leadership 8.3. Limitations
motivations (e.g., Avolio & Locke, 2002; Gough, 1969), etc., it might
be preferable to identify and measure those constructs accordingly, Although we focus on the NPI’s overlap with self-esteem, self-
leaving the narcissism moniker behind. esteem is not the only trait with which the NPI is confounded. Re-
Miller et al. (2009), take an opposing view. They suggest that a search indicates that the NPI may also fail to discriminate between
DSM-based benchmark is inherently limited. Instead, they recom- narcissism and other normative traits including dominance (Brown
mend that the normative characteristics measured by the NPI, such & Zeigler-Hill, 2004) and extraversion (Emmons, 1984), and that L/A
as assertiveness and extraversion, should be incorporated more in particular may be confounded with assertiveness (P. J. Watson,
broadly into the operational definition of narcissism. Further, they McKinney, et al., 1988). However, our findings suggest that
point out that such characteristics are already considered by clini- when the universe is constrained to two self-regard constructs—
cians to be important aspects of narcissism (e.g., Lynam & Widiger, narcissism and self-esteem—the problematic NPI items that we
2001; Samuel & Widiger, 2004). However, as noted earlier, such have identified are more closely aligned theoretically and empiri-
characteristics exhibit low specificity—they most likely do not dif- cally with self-esteem than with narcissism.
ferentiate well between narcissists and non-narcissists. And thus, We also recognize that critiquing the empirical overlap of nar-
although narcissism may be associated with the presence of these cissism and self-esteem may oversimplify the relationship be-
characteristics, they may be just as prevalent in non-narcissists. tween the two constructs. Most clinical theory suggests that
Because of this, they are not good candidates for inclusion in a nar- narcissism and self-esteem are not independent. Instead, there is
cissism scale that aims for discriminant validity in its predictions. thought to be a complex, dynamic relationship between them, with
The effects of measuring narcissism based on the NPI’s overin- narcissism functioning as a regulatory system that compensates
clusive definition of the trait were borne out in the descriptive data for temporary and chronic deficits in self-esteem (e.g., Akhtar &
of Miller et al. (2009), which indicated that their normal under- Thomson, 1982; Kernberg, 1975; Kohut, 1971, 1977; Stolorow,
graduate sample had significantly higher NPI scores than did their 1975; Westen, 1990). This perspective has gained support in the
clinical outpatient sample (t(95) = 2.59, p < .01). In contrast, as research literature as well (e.g., Morf & Rhodewalt, 2001; Raskin
would be expected, their clinical sample had significantly higher et al., 1991b; Robins, Tracy, & Shaver, 2001; Tracy & Robins,
narcissism scores on clinical (i.e., SCID-II) interviews (First et al., 2003; Tracy et al., 2009). We do not take issue with this view. How-
1997) than did their undergraduate sample (t(95) = 2.89, p < .01). ever, we contend that in order to understand the relationship be-
The fact that patients who are higher in clinically-defined narcis- tween two constructs, especially closely related ones, it is critical
sism can have lower NPI scores than do normal undergraduates to measure them in ways that clearly delineate both their core as-
further underscores the likelihood that some of the characteristics pects and their boundaries (Clark & Watson, 1995; see also Tracy
measured by the NPI do not help determine whether an individual et al., 2009). Therefore, this article emphasizes the importance of
is actually narcissistic. recognizing the differences between narcissism and self-esteem.
It is also important to note that others may take a more nuanced
8.2. Broader implications? approach to defining high self-esteem, particularly as it relates to
narcissism. Some researchers have described the high self-esteem
Reevaluating the NPI—assessing whether the scale’s least nar- that is linked robustly with the NPI as qualitatively different from
cissistic items measure self-esteem better than they measure nar- non-narcissists’ high self-esteem (Tracy et al., 2009). For instance,
cissism—may shed new, albeit speculative, light on a number of narcissists may be described as having accompanying low implicit
current debates about narcissism and health at a societal level. self-esteem (Bosson, Brown, Zeigler-Hill, & Swann, 2003; Jordan,
For example, there is a dispute about whether a steady increase Spencer, Zanna, Hoshino-Brown, & Correll, 2003; Sakellaropoulo
in aggregated NPI scores over the past few decades signals a prob- & Baldwin, 2007; Zeigler-Hill, 2006), unstable high self-esteem
lematic rise in egotism and self-centeredness among college stu- (Kernis, 2001, 2003), self-esteem that is highly contingent on posi-
dents (see Twenge, Konrath, Foster, Campbell, & Bushman, 2008a, tive social feedback (Morf & Rhodewalt, 2001), or egocentric gran-
2008b), or whether NPI subscale data indicate a less worrisome in- diosity that only mimics high self-esteem (Westen, 1990). At other
crease in only the least pathological aspects of normal narcissism times, the relationship between narcissism and self-esteem is de-
(see Trzesniewski, Donnellan, & Robins, 2008). However, if reas- scribed as we have described it here—as a flaw in the NPI with
sessed from the standpoint of the current research, increasing self-esteem confounding the results of NPI-based research (Brown
scores on certain NPI subscales may not reflect an increase in nar- & Bosson, 2001; Paulhus, 1998, 2001; Paulhus et al., 2004). How-
cissism at all. They may instead be the result principally of in- ever, most NPI-based research ignores the overlap and potential
creases in self-esteem and other similar characteristics. If this confound of narcissism and self-esteem, or treats it as a meaningful
were the case, the research may reflect a positive, rather than neg- mediating relationship. Other influential work even balks at mak-
ative societal change. ing a clear distinction between the two constructs (e.g., Baumeister
Similarly, Foster, Campbell, and Twenge (2003) appeared to et al., 2003). This work, in particular, has entered mainstream
support Lasch’s (1979) assertion that western societies are more thought as the basis for confusing news media reports (e.g., Goode,
narcissistic than eastern societies by finding that scores on the 2002; Sullivan, 2002).
aggregated NPI and some NPI subscales were higher in the west Finally, we recognize that the conclusions reached in this article
than in the east. However, they also reported that there were no were based on self-report measures and correlational data. The use
cultural differences in scores on the most clearly narcissistic NPI of the self-report measure of narcissism (the NPI) was inevitable,
subscales (in this case, the Entitlement and Exploitativeness sub- given that it is central to the questions being addressed by this
S.A. Rosenthal, J.M. Hooley / Journal of Research in Personality 44 (2010) 453–465 463

research. However, future research of this type would benefit in Another alternative, the Pathological Narcissism Inventory (PNI;
particular from the use of both short- and long-term behavioral Pincus et al., 2009), was developed to measure multiple facets of
measures of psychological health and distress. pathological narcissism as they range from subclinical to clinical
levels. As a measure that encompasses subclinical levels of patho-
logical narcissistic traits, the PNI actually appears to accomplish
8.4. Where do we go from here? what the authors of the NPI originally intended. The PNI measures
both grandiose (i.e., entitlement rage, exploitativeness, grandiose
Given the problems with the NPI, how might we obtain a more fantasy, and self-sacrificing self-enhancement) and vulnerable
interpretable narcissism measure? There may be a number of ways (i.e., contingent self-esteem, hiding the self, and devaluing) aspects
to retain the NPI by changing how it is used or overhauling it. How- of pathological narcissism. Its grandiose subscales (which are the
ever, although dividing the NPI based on expert ratings, IRT analy- subscales most relevant to a discussion of the NPI) overlap posi-
ses, and/or factor analyzed subscales helped provide a clear tively with the NPI. But unlike the NPI, they are related to psycho-
illustration of the scale’s problems in the current research, it may logical distress (e.g., shame, identity diffusion, interpersonal
not be the best strategy for its future use. The trouble with this ap- distress, suicidality) rather than health. They also generally have
proach is that the resulting NPI-N subscales generally had unac- negligible or negative correlations with self-esteem. It will be
ceptably low internal consistency (see also del Rosario & White, important to directly compare the PNI’s Entitlement Rage and
2005; Emmons, 1987; Kansi, 2003; Raskin & Terry, 1988). For in- Grandiose Fantasy subscales to the Psychological Entitlement Scale
stance, the alphas for the NPI-N subscales in Studies 1 and 2 range and the Narcissistic Grandiosity Scale respectively to determine
from .62 to .75. Given the number of items in each NPI-N subscale whether their differing content may provide important incremen-
(18–28), such low reliabilities suggest that these subscales may not tal information in defining the full spectrum of core aspects of nar-
measure coherent constructs.3 Updated factor analyses of the NPI cissism. Using these three new narcissism scales together may
have improved the subscales’ psychometrics (Corry et al., 2008; Ku- provide a complementary and comprehensive assessment of the
barych et al., 2004). However, these new subscales are not likely to range of narcissistic characteristics and problems in normal sam-
correct the broader problems created by the inclusion of poor items ples and could begin to make the NPI obsolete. It may also help
in the scale. clarify whether there are any specific narcissistic antecedents of
Better options include controlling for self-esteem (as suggested psychological health.
by Brown & Bosson, 2001; Paulhus, 1998, 2001; Paulhus et al.,
2004) or using a revised version of the NPI. The results of Study 9. Conclusion
2 indicate that controlling for self-esteem yields results that align
with those produced by the NPI-N subscales. However, it would Ultimately, the goal of any scale is ‘‘to measure one thing (i.e.,
clearly be preferable to use a narcissism scale that works properly the target construct)—and only this thing—as precisely as possible”
on its own without requiring statistical manipulation. Alterna- (Clark & Watson, 1995, p. 315). To the extent that there is no defin-
tively, Ames, Rose, and Anderson (2006) developed a 16-item ver- itive answer to the question of what constitutes narcissism and
sion of the NPI. They eliminated items that most likely overlapped what does not (Millon, 1998; Westen, 1990), this goal may be dif-
with more normative constructs such as assertiveness and self-effi- ficult to achieve. Most psychologists would agree that narcissists
cacy. The results of their procedure are reflected in our expert rater are entitled, exploitative, grandiose, self-absorbed, and so forth.
data; their 16 items garnered a higher average hit rate (M = 12.56, Unfortunately, some inferences made in social–personality re-
SD = 3.27) than did the full 37-item NPI (M = 10.54, SD = 4.16). search are driven by the NPI’s relationship with characteristics that
Their scale does, however, share an as-yet unexplored overlap with are at best tangential to these domains, such as self-esteem, asser-
self-esteem. tiveness, and leadership motivations. This is evidenced by the fact
Brown et al. (2009), however, may have provided the best guid- that the item ‘‘I am assertive” was considered narcissistic by only
ance. Their research did not rely on the NPI or any scale that aggre- one expert rater in Study 1.
gates multiple facets of narcissism into a single score (see Carver, Our concern is that the NPI, and the construct it was developed
1989). Instead, they used separate narrowly and precisely defined to measure (i.e., narcissism), have developed a tail-wags-the-dog
scales specific to two core aspects of narcissism: entitlement and relationship in the social–personality literature. The NPI is cur-
grandiosity (Morey, 1988). By doing this, they ensured that the rently the most frequent means for measuring narcissism in psy-
constructs they measured corresponded to a priori theories of chology research, and an aggregated score is the ‘‘most common
narcissism’s facets. Using the Psychological Entitlement Scale usage” of the NPI (Miller & Campbell, 2008, p. 456). Because of this,
(W. K. Campbell, Bonacci, Shelton, Exline, & Bushman, 2004) and it often appears that narcissism is no longer understood as a latent
the Narcissistic Grandiosity Scale (Rosenthal, Hooley, & Steshenko, personality trait estimated by scores on the NPI. Instead, narcis-
in preparation), Brown and colleagues found that whereas sism has become increasingly redefined as ‘‘that which the aggre-
narcissistic entitlement was generally negatively associated with gated NPI measures.” Extensive use of the NPI has led to a situation
self-reported psychological health, narcissistic grandiosity was pos- in which social–personality and clinical narcissism research are
itively associated with psychological health—a relationship that increasingly difficult to integrate. It also has created the potential
was only partially mediated by self-esteem. Further, the authors for reaching questionable conclusions about narcissism, particu-
demonstrated that it was not possible to replicate this important larly about its relationship to psychological health.
distinction using the NPI.

3 Acknowledgments
In contrast, L/A (i.e., the EFA-X subscale) is essentially as internally consistent as is
the full aggregated NPI (see Tables 2 and 4). This in itself is noteworthy and indicative
of the NPI’s problems. If methodically removing more than three-fourths of a scale’s The authors are grateful to Matt Montoya, Diane Purvin, Jenni-
items (i.e., the EFA-N items) did not decrease the internal consistency of the fer Green, and Elsa Ronningstam for their instructive comments.
remaining items, it strongly challenges the notion that most of the removed items We also thank Yulia Steshenko, Eleftheria Kyriakopoulos, Andrea
belong in the scale at all; they may actually detract from the aggregated NPI’s ability
Hsu Roe, and Lindsey Yourman for their help collecting and prepar-
to measure a coherent, unitary construct. Unfortunately, to the extent that the NPI
does measure a unitary construct, the data suggest that the construct is more closely ing data, and 19 anonymous clinical researchers for their time
related to the NPI-X than the NPI-N items. and expertise. The research and manuscript preparation were
464 S.A. Rosenthal, J.M. Hooley / Journal of Research in Personality 44 (2010) 453–465

supported by the Allport, Ditmars, and Biddle Memorial Research First, M. B., Gibbon, M., Spitzer, R. L., Williams, J. B. W., & Benjamin, L. S. (1997).
User’s guide for the Structured Clinical Interview for DSM-IV Axis II Personality
Funds from the Harvard University Department of Psychology,
Disorders (SCID-II). Washington, DC: American Psychiatric Press.
and by a research fellowship from the Center for Public Leadership First, M. B., Spitzer, R. L., Gibbon, M., & Williams, J. B. W. (1995). The Structured
at the Harvard Kennedy School. Clinical Interview for DSM-III-R Personality Disorders (SCID-II). I. Description.
Journal of Personality Disorders, 9, 83–91.
Fossati, A., Beauchaine, T. P., Grazioli, F., Carretta, I., Cortinovis, F., & Maffei, C.
(2005). A latent structure analysis of Diagnostic and Statistical Manual of Mental
Disorders, Fourth Edition, Narcissistic Personality Disorder criteria.
References Comprehensive Psychiatry, 46, 361–367.
Foster, J. D., Campbell, W. K., & Twenge, J. M. (2003). Individual differences in
narcissism: Inflated self-views across the lifespan and around the world. Journal
Akhtar, S., & Thomson, J. A. Jr., (1982). Overview: Narcissistic personality disorder.
of Research in Personality, 37, 469–486.
American Journal of Psychiatry, 139, 12–20.
Freud, S. (1931). Libidinal types. Collected papers (Vol. 5). London: Hogarth Press.
Allison, P. D. (1999). Multiple regression: A primer. Thousand Oaks, CA: Pine Forge
Goode, E. (2002). Deflating self-esteem’s role in society’s ills. The New York Times,
Press.
152, F1. October 1.
Ames, D. R., Rose, P., & Anderson, C. P. (2006). The NPI-16 as a short measure of
Gough, H. G. (1969). A leadership index on the California Psychological Inventory.
narcissism. Journal of Research in Personality, 40, 440–450.
Journal of Counseling Psychology, 16, 283–289.
American Psychiatric Association (1980). Diagnostic and statistical manual of mental
Gunderson, J. G., Ronningstam, E., & Smith, L. E. (1995). Narcissistic personality
disorders (3rd ed.). Washington, DC: Author.
disorder. In W. J. Livesley (Ed.), The DSM-IV personality disorders (pp. 201–212).
American Psychiatric Association (2000). Diagnostic and statistical manual of mental
New York: Guilford Press.
disorders (4th ed.). Washington, DC: Author. text revision.
Haynes, S. N., Richard, D. C. S., & Kubany, E. S. (1995). Content validity in
Avolio, B. J., & Locke, E. E. (2002). Contrasting different philosophies of leader
psychological assessment: A functional approach to concepts and methods.
motivation: Altruism versus egoism. The Leadership Quarterly, 13, 169–191.
Psychological Assessment, 7, 238–247.
Baumeister, R. F., Campbell, J. D., Krueger, J. I., & Vohs, K. D. (2003). Does high self-
Hills, P., & Argyle, M. (2002). The Oxford happiness questionnaire: A compact scale
esteem cause better performance, interpersonal success, happiness, or healthier
for the measurement of psychological well-being. Personality and Individual
lifestyles? Psychological Science in the Public Interest, 4, 1–44.
Differences, 33, 1073–1082.
Bosson, J. K., Brown, R. P., Zeigler-Hill, V., & Swann, W. B. Jr., (2003). Self-
Hoffman, J. (2008). Here’s looking at me, kid. The New York Times, 158, ST1. July 20.
enhancement tendencies among people with high explicit self-esteem: The
Jordan, C. H., Spencer, S. J., Zanna, M. P., Hoshino-Brown, E., & Correll, J. (2003).
moderating role of implicit self-esteem. Self and Identity, 2, 167–187.
Secure and defensive high self-esteem. Journal of Personality and Social
Brown, R. P., & Bosson, J. K. (2001). Narcissus meets Sisyphus: Self-love, self-
Psychology, 85, 969–978.
loathing, and the never-ending pursuit of self-worth. Psychological Inquiry, 12,
Kansi, J. (2003). The Narcissistic Personality Inventory: Applicability in a Swedish
210–213.
population sample. Scandinavian Journal of Psychology, 44, 441–448.
Brown, R. P., Budzek, K., & Tamborski, M. (2009). On the meaning and measure of
Kernberg, O. F. (1975). Borderline conditions and pathological narcissism. New York:
narcissism. Personality and Social Psychology Bulletin, 35, 951–964.
Jason Aronson, Inc.
Brown, R. P., & Zeigler-Hill, V. (2004). Narcissism and the non-equivalence of self-
Kernis, M. H. (2001). Following the trail from narcissism to fragile self-esteem.
esteem measures: A matter of dominance? Journal of Research in Personality, 38,
Psychological Inquiry, 12, 223–225.
585–592.
Kernis, M. H. (2003). Optimal self-esteem and authenticity: Separating fantasy from
Bushman, B. J., & Baumeister, R. F. (1998). Threatened egotism, narcissism, self-
reality. Psychological Inquiry, 14, 83–89.
esteem, and direct and displaced aggression: Does self-love or self-hate lead to
Kohut, H. (1966). Forms and transformations of narcissism. Journal of the American
violence? Journal of Personality and Social Psychology, 75, 219–229.
Psychoanalytic Association, 14, 243–272.
Buss, A. H., & Perry, M. (1992). The Aggression Questionnaire. Journal of Personality
Kohut, H. (1971). The analysis of the self. New York: International Universities Press.
and Social Psychology, 63, 452–459.
Kohut, H. (1977). The restoration of the self. New York: International Universities
Cain, N. M., Pincus, A. L., & Ansell, E. B. (2008). Narcissism at the crossroads:
Press.
Phenotypic description of pathological narcissism across clinical theory, social/
Kubarych, T. S., Deary, I. J., & Austin, E. J. (2004). The Narcissistic Personality
personality psychology, and psychiatric diagnosis. Clinical Psychology Review,
Inventory: Factor structure in a non-clinical sample. Personality and Individual
28, 638–656.
Differences, 36, 857–872.
Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by
Lakey, C. E., Rose, P., Campbell, W. K., & Goodie, A. S. (2008). Probing the link
the multitrait–multimethod matrix. Psychological Bulletin, 56, 81–105.
between narcissism and gambling: The mediating role of judgment and
Campbell, W. K. (2001). Is narcissism really so bad? Psychological Inquiry, 12,
decision-making. Journal of Behavioral Decision Making, 21, 113–137.
214–216.
Lasch, C. (1979). The culture of narcissism: American life in an age of diminishing
Campbell, W. K., Bonacci, A. M., Shelton, J., Exline, J. J., & Bushman, B. J. (2004).
expectations. NY: Norton.
Psychological entitlement: Interpersonal consequences and validation of a self-
Lawshe, C. H. (1975). A quantitative approach to content validity. Personnel
report measure. Journal of Personality Assessment, 83, 29–45.
Psychology, 28, 563–575.
Campbell, W. K., Bush, C. P., Brunell, A. B., & Shelton, J. (2005). Understanding the
Lawshe, C. H. (1985). Inferences from personnel tests and their validity. Journal of
social costs of narcissism: The case of the tragedy of the commons. Personality
Applied Psychology, 70, 237–238.
and Social Psychology Bulletin, 31, 1358–1368.
Lynam, D. R., & Widiger, T. A. (2001). Using the five-factor model to represent the
Campbell, W. K., & Foster, C. A. (2002). Narcissism and commitment in romantic
DSM-IV personality disorders: An expert consensus approach. Journal of
relationships: An investment model analysis. Personality and Social Psychology
Abnormal Psychology, 110, 401–412.
Bulletin, 28, 484–495.
Maller, R. G., & Reiss, S. (1987). A behavioral validation of the Anxiety Sensitivity
Carver, C. S. (1989). How should multifaceted personality constructs be tested?
Index. Journal of Anxiety Disorders, 1, 265–272.
Issues illustrated by self-monitoring, attributional style, and hardiness. Journal
McNally, R. J. (2002). Anxiety sensitivity and panic disorder. Biological Psychiatry, 52,
of Personality and Social Psychology, 56, 577–585.
938–946.
Clark, L. A., & Watson, D. (1995). Constructing validity: Basic issues in objective
Meng, X.-L., Rosenthal, R., & Rubin, D. B. (1992). Comparing correlated correlation
scale development. Psychological Assessment, 7, 309–319.
coefficients. Psychological Bulletin, 111, 172–175.
Corry, N., Merritt, R. D., Mrug, S., & Pamp, B. (2008). The factor structure of the
Miller, J. D., & Campbell, W. K. (2008). Comparing clinical and social–personality
Narcissistic Personality Inventory. Journal of Personality Assessment, 90,
conceptualizations of narcissism. Journal of Personality, 76, 449–476.
593–600.
Miller, J. D., Gaughan, E. T., Pryor, L. R., Kamen, C., & Campbell, W. K. (2009). Is using
del Rosario, P. M., & White, R. M. (2005). The Narcissistic Personality Inventory:
the narcissistic personality inventory relevant for understanding narcissistic
Test–retest stability and internal consistency. Personality and Individual
personality disorder? Journal of Research in Personality, 43, 482–488.
Differences, 39, 1075–1081.
Miller, J. D., Hoffman, B. J., Campbell, W. K., & Pilkonis, P. A. (2008). An examination
Dickenson, K. A., & Pincus, A. L. (2003). Interpersonal analysis of grandiose and
of the factor structure of Diagnostic and Statistical Manual of Mental Disorders,
vulnerable narcissism. Journal of Personality Disorders, 17, 188–207.
Fourth Edition, narcissistic personality disorder criteria: 1 or 2 factors?
Dowson, J. H., & Berrios, G. E. (1991). Factor structure of DSM-III-R personality
Comprehensive Psychiatry, 49, 141–145.
disorders shown by self-report questionnaire: Implications for classifying and
Millon, T. (1998). DSM narcissistic personality disorder: Historical reflections and
assessing personality disorders. Acta Psychiatrica Scandinavica, 84, 555–560.
future directions. In E. F. Ronningstam (Ed.), Disorders of narcissism
Drasgow, F. D., & Parsons, C. K. (1983). Application of unidimensional item response
(pp. 75–101). Washington, DC: American Psychiatric Press.
theory models to multidimensional data. Applied Psychological Measurement, 7,
Morey, L. C. (1988). A psychometric analysis of the DSM-III-R personality disorder
189–199.
criteria. Journal of Personality Disorders, 2, 109–124.
Ekselius, L., Lindstrom, E., von Knorring, L., Bodlund, O., & Kullgren, G. (1994). SCID II
Morrison, A. P. (Ed.). (1986). Essential papers on narcissism. New York University
interviews and the SCID screen questionnaire as diagnostic tools for personality
Press: New York.
disorders in DSM-III-R. Acta Psychiatrica Scandinavica, 90, 120–123.
Morf, C. C., & Rhodewalt, F. (2001). Unraveling the paradoxes of narcissism: A
Ellis, H. (1927). The conception of narcissism. Psychoanalytic Review, 14, 129–153.
dynamic self-regulatory processing model. Psychological Inquiry, 12, 177–196.
Emmons, R. A. (1984). Factor analysis and construct validity of the Narcissistic
Morse, J. Q., Robins, C. J., & Gittes-Fox, M. (2002). Sociotropy, autonomy, and
Personality Inventory. Journal of Personality Assessment, 48, 291–300.
personality disorder criteria in psychiatric patients. Journal of Personality
Emmons, R. A. (1987). Narcissism: Theory and measurement. Journal of Personality
Disorders, 16, 549–560.
and Social Psychology, 52, 11–17.
S.A. Rosenthal, J.M. Hooley / Journal of Research in Personality 44 (2010) 453–465 465

Mullins, L. S., & Kopelman, R. E. (1988). Toward an assessment of the construct Samuel, D. B., & Widiger, T. A. (2004). Clinicians’ personality descriptions of
validity of four measures of narcissism. Journal of Personality Assessment, 52, prototypic personality disorders. Journal of Personality Disorders, 18, 286–308.
610–625. Scheier, M., & Carver, C. S. (1985). Optimism, coping, and health: Assessment and
Norton, G. R., Cox, B. J., Hewitt, P. L., & McLeod, L. (1997). Personality factors implications of generalized outcome expectancies. Health Psychology, 4,
associated with generalized and non-generalized social anxiety. Personality and 219–247.
Individual Differences, 22, 655–660. Schmukle, S. C., Egloff, B., & Burns, L. R. (2002). The relationship between positive
Olatunji, B. O., & Wolitzky-Taylor, K. B. (2009). Anxiety sensitivity and the anxiety and negative affect in the Positive and Negative Affect Schedule. Journal of
disorders: A meta-analytic review and synthesis. Psychological Bulletin, 135, Research in Personality, 36, 463–475.
974–999. Sedikides, C., Rudich, E. A., Gregg, A. P., Kumashiro, M., & Rusbult, C. (2004). Are
O’Shea, P. G., & Gustafson, S. B. (1999). Confirmatory item response theory: An analysis normal narcissists psychologically healthy?: Self-esteem matters. Journal of
of the Narcissistic Personality Inventory. Poster presented at the 11th annual Personality and Social Psychology, 87, 400–416.
conference of the American Psychological Society, Denver, CO. June. Shulman, D. G., & Ferguson, G. R. (1988). Two methods of assessing narcissism:
Paulhus, D. L. (1998). Interpersonal and intrapsychic adaptiveness of trait self- Comparison of the Narcissism–Projective (N–P) and the Narcissistic Personality
enhancement: A mixed blessing? Journal of Personality and Social Psychology, 74, Inventory (NPI). Journal of Clinical Psychology, 44, 857–866.
1197–1208. Sinha, R. R., & Krueger, J. (1998). Idiographic self-evaluation and bias. Journal of
Paulhus, D. L. (2001). Normal narcissism: Two minimalist accounts. Psychological Research in Personality, 32, 131–155.
Inquiry, 12, 228–230. Soyer, R. B., Rovenpor, J. L., Kopelman, R. E., Mullins, L. S., & Watson, P. J. (2001).
Paulhus, D. L., Robins, R. W., Trzesniewski, K. H., & Tracy, J. L. (2004). Two replicable Further assessment of the construct validity of four measures of narcissism:
suppressor situations in personality research. Multivariate Behavioral Research, Replication and extension. The Journal of Psychology, 135, 245–258.
39, 303–328. Spearman, C. (1904). The proof and measurement of association between two
Pincus, A. L., Ansell, E. B., Pimentel, C. A., Cain, N. M., Wright, A. G. C., & Levy, K. N. things. American Journal of Psychology, 15, 72–101.
(2009). Initial construction and validation of the Pathological Narcissism Stolorow, R. D. (1975). Toward a functional definition of narcissism. International
Inventory. Psychological Assessment, 21, 365–379. Journal of Psycho-analysis, 56, 179–185.
Pincus, A. L., & Lukowitsky, M. R. (2010). Pathological narcissism and narcissistic Sullivan, A. (2002). Lacking in self-esteem? Good for You! Time, 160, 102. October 14.
personality disorder. Annual Review of Clinical Psychology, 6, 421–446. Taylor, S., Koch, W. J., McNally, R. J., & Crockett, D. J. (1992). Conceptualizations of
Pulver, S. E. (1970). Narcissism: The term and concept. Journal of the American anxiety sensitivity. Psychological Assessment, 4, 245–250.
Psychoanalytic Association, 18, 319–342. Tracy, J. L., Cheng, J. T., Robins, R. W., & Trzesniewski, K. H. (2009). Authentic and
Raskin, R., & Hall, C. S. (1979). A Narcissistic Personality Inventory. Psychological hubristic pride: The affective core of self-esteem and narcissism. Self and
Reports, 45, 590. Identity, 8, 196–213.
Raskin, R., & Hall, C. S. (1981). The Narcissistic Personality Inventory: Alternate form Tracy, J. L., & Robins, R. W. (2003). ‘‘Death of a (narcissistic) salesman:” An
reliability and further evidence of construct validity. Journal of Personality integrative model of fragile self-esteem. Psychological Inquiry, 14, 57–62.
Assessment, 45, 159–162. Trzesniewski, R. H., Donnellan, M. B., & Robins, R. W. (2008). Is ‘‘Generation Me’’
Raskin, R., Novacek, J., & Hogan, R. (1991a). Narcissism, self-esteem, and defensive really more narcissistic than previous generations? Journal of Personality, 76,
self-enhancement. Journal of Personality, 59, 19–38. 903–917.
Raskin, R., Novacek, J., & Hogan, R. (1991b). Narcissistic self-esteem management. Twenge, J. M., Konrath, S., Foster, J. D., Campbell, W. K., & Bushman, B. J. (2008a).
Journal of Personality and Social Psychology, 60, 911–918. Egos inflating over time: A cross-temporal meta-analysis of the Narcissistic
Raskin, R., & Terry, H. (1988). A principal-components analysis of the Narcissistic Personality Inventory. Journal of Personality, 76, 875–901.
Personality Inventory and further evidence of its construct validity. Journal of Twenge, J. M., Konrath, S., Foster, J. D., Campbell, W. K., & Bushman, B. J. (2008b).
Personality and Social Psychology, 54, 890–902. Further evidence of an increase in narcissism among college students. Journal of
Rathus, S. A. (1973). A 30-item schedule for assessing assertive behavior. Behavior Personality, 76, 919–927.
Therapy, 4, 398–406. Watson, D., Clark, L., & Tellegen, A. (1988). Development and validation of brief
Reckase, M. D. (1979). Unifactor latent trait models applied to multifactor tests: measures of positive and negative affects: The PANAS Scales. Journal of
Results and implications. Journal of Educational Statistics, 4, 207–230. Personality and Social Psychology, 54, 1063–1070.
Reiss, S., Peterson, R. A., Gursky, D. M., & McNally, R. J. (1986). Anxiety sensitivity, Watson, P. J., & Biderman, M. D. (1993). Narcissistic Personality Inventory factors,
anxiety frequency, and the prediction of fearfulness. Behaviour Research and splitting, and self-consciousness. Journal of Personality Assessment, 61, 41–57.
Therapy, 24, 1–8. Watson, P. J., Grisham, S. O., Trotter, M. V., & Biderman, M. D. (1984). Narcissism and
Rhodewalt, F., & Morf, C. C. (1995). Self and interpersonal correlates of the empathy: Validity evidence for the Narcissistic Personality Inventory. Journal of
Narcissistic Personality Inventory: A review and new findings. Journal of Personality Assessment, 48, 301–305.
Research in Personality, 29, 1–23. Watson, P. J., Little, T., Sawrie, S. M., & Biderman, M. D. (1992). Measures of the
Robins, R. W., Tracy, J. L., & Shaver, P. R. (2001). Shamed into self-love: Dynamics, narcissistic personality: Complexity of relationships with self-esteem and
roots, and functions of narcissism. Psychological Inquiry, 12, 230–236. empathy. Journal of Personality Disorders, 6, 434–449.
Ronningstam, E. F. (1998). Disorders of narcissism: Diagnostic, clinical, and empirical Watson, P. J., McKinney, J., Hawkins, C., & Morris, R. J. (1988). Assertiveness and
implications. Washington, DC: American Psychiatric Press. narcissism. Psychotherapy, 25, 125–131.
Ronningstam, E. F., & Gunderson, J. G. (1988). Narcissistic traits in psychiatric Watson, P. J., & Morris, R. J. (1990). Irrational beliefs and the problem of narcissism.
patients. Comprehensive Psychiatry, 29, 545–549. Personality and Individual Differences, 11, 1137–1140.
Rose, P. (2002). The happy and unhappy faces of narcissism. Personality and Westen, D. (1990). The relations among narcissism, egocentrism, self-concept, and
Individual Differences, 33, 379–391. self-esteem: Experimental, clinical, and theoretical considerations.
Rosenberg, M. (1965). Society and the adolescent self-image. Princeton: Princeton Psychoanalysis and Contemporary Thought, 13, 183–239.
University Press. Zeigler-Hill, V. (2006). Discrepancies between implicit and explicit self-esteem:
Rosenthal, S. A., Hooley, J. M., & Steshenko, Y. (in preparation). Distinguishing Implications for narcissism and self-esteem instability. Journal of Personality, 74,
grandiosity from self-esteem: Development of the Narcissistic Grandiosity Scale. 119–143.
Sakellaropoulo, M., & Baldwin, M. W. (2007). The hidden sides of self-esteem: Two Zvolensky, M. J., Arrindell, W. A., Taylor, S., Bouvard, M., Cox, B. J., Stewart, S. H., et al.
dimensions of implicit self-esteem and their relation to narcissistic reactions. (2003). Anxiety sensitivity in six countries. Behaviour Research and Therapy, 41,
Journal of Experimental Social Psychology, 43, 995–1001. 841–859.

You might also like