Professional Documents
Culture Documents
Michael C. Ashton
This document is copyrighted by the American Psychological Association or one of its allied publishers.
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
Brock University
The authors compared the Big 5 factors of personality with the facets or traits of personality that
constitute those factors on their ability to predict 40 behavior criteria. Both the broad factors and the
narrow facets predicted substantial numbers of criteria, but the latter did noticeably better in that regard,
even when the number of facet predictors was limited to the number of factor predictors. Moreover, the
criterion variance accounted for by the personality facets often included large portions not predicted by
the personality factors. The narrow facets, therefore, were able to substantially increase the maximum
prediction achieved by the broad factors. The results of this study are interpreted as supporting a more
detailed approach to personality assessment, one that goes beyond the measurement of the Big 5 factors
alone.
Past studies of personality structure have contributed to a voluminous archive of evidence pointing to the conclusion that most of
the personality-based consistencies in behavior can be adequately
explained in terms of the so-called five-factor model. That model
posits that there are exactly five personality dimensions, often
referred to as the Big Five, that play important roles in our
understanding of much of human behavior variation. The Big Five
factors of personality are often labeled Extraversion, Agreeableness, Conscientiousness, Neuroticism, and Openness to Experience. They are presumed to represent the topmost level of a
personality hierarchy in which narrower traits and even narrower
behaviors represent the lower levels (e.g., see McCrae & John,
1992; Paunonen, 1998). The Big Five are thought by some to be
universal across cultures (McCrae, Costa, del Pilar, Rolland, &
Parker, 1998).
The Big Five personality factors continue to enjoy an unprecedented level of interest in personality research and practice. It is
unfortunate, however, that we see an increasing reliance on measures of these five superordinate personality variables to the exclusion of any other variables. Is it possible that some of those
other variables are partly independent of the Big Five and, consequently, might add something to the prediction and understanding
of behavior not achieved by the five factors alone? The purpose of
this empirical study is to answer this question.
525
This document is copyrighted by the American Psychological Association or one of its allied publishers.
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
& Gorsuch, 1988). In this study we used a more theoreticaldeductive approach and had expert judges choose a subset of five
facet scales as predictors for a criterion. In that way we were able
to compare the Big Five broad factors of personality, purportedly
encompassing most of the important personality-based variation in
behavior, with five narrower traits of personality, undoubtedly
accounting for much less behavior variation.
The second notable difference between this study and that of
Paunonen (1998) is in the Big Five factor and facet measures used.
In the previous study, the Big Five factors were measured by the
NEO Five Factor Inventory (NEO-FFI; Costa & McCrae, 1992).
This is a 60-item questionnaire that assesses each factor with
only 12 items. For this study, in contrast, we used the much longer
Revised NEO Personality Inventory (NEO-PI-R; Costa & McCrae,
1992) to measure the Big Five. That questionnaire has 240 items
that assess each factor with 48 items. Moreover, the NEO-PI-R
contains 30 Big Five facet scales, which can be used in the present
factor-versus-facet comparison of predictive accuracy.
The third major difference between the present study and
Paunonen's (1998) study is in the number of criteria predicted.
Whereas Paunonen used a dozen or so criteria, we use more than
three times as many in this study. Criteria were chosen for both
studies so that they (a) can be argued to be of some social
significance (e.g., blood donations, ability to play musical instruments) and (b) are reasonable candidates for behaviors that have
personality determinants. With regard to this latter point, we
wanted to avoid criterion variables that are simply variants of the
personality predictor variables used (e.g., using peer ratings of
conscientiousness as a criterion for self-reports on a Conscientiousness factor scale or self-ratings on the adjective ambitious as
a criterion for self-reports on an Achievement Striving facet scale).
Method
Personality Measures
In this study we administered Big Five factor measures and Big
Five facet measures to respondents along with measures of many
different criterion variables. We then compared the factor measures and the facet measures in terms of their differential abilities
in predicting the criterion variables. Although this is the same
basic procedure as that used by Paunonen (1998), three important
differences should be noted. First, as mentioned earlier, Paunonen
(1998) used many more facet measures of personality than he used
factor measures, increasing the chances of finding large correlations for the former variables by chance alone (see also Mershon
526
naire consists of 30 lower level facet measures, each of which has been
incorporated into the 240-item inventory because it is strongly associated
with one of the Big Five personality factors.
This document is copyrighted by the American Psychological Association or one of its allied publishers.
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
Criterion Measures
The behavior criteria used in this study, numbering 40 in all, were
measured by a variety of methods. First of all, participants completed the
Behavior Report Form, a short self-report measure first used by Paunonen
(1998) and expanded for this study to include more items. The students also
completed paper-and-pencil tasks designed to assess general knowledge,
quantitative ability, altruism, and monetary risk-taking. Other criterion
measures relied less on participants' self-reports. Experimenters rated each
person on attributes such as questionnaire neatness and physical attractiveness. Each participant was rated by his or her roommate on attributes likely
to be distorted by impression management tendencies in self-report such as
honesty and intelligence. University records were used to obtain gradepoint averages and course enrollment information. Tardiness to the study's
sessions and slowness in completing the experimental tasks were recorded
objectively. The 40 criterion measures are described in more detail in the
following sections and are summarized in Table 1.
Behavior Report Form. Self-rated and peer-rated criterion measures
were obtained using the Behavior Report Form, the pages of which are
reproduced in the Appendix. This form is similar to that used by Paunonen
(1998) but contains several additional items. However, not all of the
Behavior Report Form items were evaluated in the analyses that follow,
and responses to some items were transformed. For example, none of the
participants of this study was a member of a fraternity or sorority (see Item
12), so interest in joining a fraternity was used as a criterion instead of
actual fraternity membership. Because of a concern with impression management and a possible lack of impartiality in rating 5 of the items, we
evaluated roommate or experimenter ratings instead of self-ratings for the
Behavior Report Form measures of attractiveness (Item 1), intelligence
(Item 2), popularity (Item 3), femininity (Item 4), and honesty (Item 6).
(Following Paunonen's, 1998, p. 541, reasoning, we thought self-reports to
be the more accurate indices of behavior on the other Behavior Report
Form items, which mostly involve objective statements of fact.) The first
four ratings of driving behavior (Item 13) were combined into one variable
representing the mean number of all traffic violations per year of driving
experience. The number of prescription medications taken regularly (Item
18) was totaled over the five individual ratings. The ratings of prescription
lens usage (Item 19) were reduced into one score reflecting a preference for
contact lenses (1), glasses (-1), or either (0). Each participant's selfreported weight (in kilograms) and height (in meters) were used to compute
an index of obesity (by dividing weight by height squared). And finally,
some self-ratings were superseded by more objective measures (e.g., university registrar's records of grade-point average replaced Item 7).
Twenty-four criterion variables were derived from the Behavior Report
Form for analysis in this study. These variables, with numbers representing
their locations in Table 1, include the following: (1) roommate rating of
intelligence, (2) roommate rating of popularity, (3) roommate rating of
femininity, (4) roommate rating of honesty, (5) self-rating of religiosity, (6)
number of dates per month, (7) number of different people dated over a
year, (8) 5-point rating of smoking behavior, (9) 5-point rating of alcohol
consumption, (10) 9-point rating of interest in fraternity or sorority membership, (11) mean number of traffic violations per year, (12) maximum
speed driving a car, (13) money spent on lottery tickets per month, (14)
number of parties attended per month, (15) long-term dieting behavior,
(16) total number of prescription medications taken regularly, (17) preference for contacts over glasses as prescription lenses, (18) engaged or not
engaged in part-time employment, (19) ability to play musical instruments,
(20) participation in organized sports, (21) engagement in regular exercise,
(22) gives occasional blood donations, (23) obesity as defined by weight/
height2, and (24) participant sex or gender. (Sex was also used in this study
as a covariate in analyses of the other criteria.)
Other tests. Participants in this study completed paper-and-pencil measures of four attributes that were included in our criterion battery. Two of
these measures comprised scales taken from the Multidimensional Aptitude Battery (MAB; Jackson, 1990). The MAB is a timed test of several
distinct cognitive abilities. We extracted the Information and Arithmetic
subscales from that inventory and used those as indices of (25) general
knowledge and (26) numerical ability, respectively. The two other measures were developed specifically for this study as tests of (27) altruism and
(28) low risk taking. In the first case, participants completed a five-item
money allocation task in which each person had to decide, in five hypothetical scenarios, whether to share a certain amount of money with another
person at the expense of keeping a smaller amount of money for him- or
herself. In the second instance, participants completed an eight-item money
wagering task of low risk taking in which each person had to decide, in
eight hypothetical scenarios, on the amount of money he or she was willing
to gamble for a given monetary prize at a given probability of success.
Experimenter ratings. While the students in this study were completing their paper-and-pencil tasks, three experimenters independently observed them and made ratings of their (29) physical attractiveness and (30)
personal neatness. After the students completed the study, three experimenters (two women and one man) also rated their PRF computer-scanned
answer sheets for (31) neatness of the item responses. (The experimenters
were not able to discern the participants' personality scale scores from the
answer sheets.) All three experimenter ratings were then averaged for each
participant and each variable.
University records. Rather than relying on students' self-reports of
grade-point average as a criterion variable (Behavior Report Form Item 7),
we retrieved that information from the university registrar's office. We
used each student's academic record to obtain his or her (32) grade-point
average for the previous year and information about course preferences.
With regard to the latter measures, we counted the number of courses taken
in the previous year within five areas of study: (33) business, (34) social
sciences, (35) humanities, (36) mathematics, and (37) science. We also
obtained Department of Psychology records for those students who had
taken the introductory psychology course. One of the requirements of that
lst-year course is participation in 5 hr of experimental research over the
duration of the year. Several students, however, failed to complete all 5 hr,
and this count was used as (38) an absenteeism from experiments criterion
variable in this study.
Other records. Participants in this study had to sign in as they arrived
for each of the two testing sessions and sign out as they left. Their recorded
arrival order and departure order, averaged over the two testing sessions
and adjusted for group size, were used as indicators of (39) tardiness to
appointments and (40) slowness in completing experimental tasks,
respectively.
Missing data. We had almost complete data on all of our participants
measured on all 40 criterion variables. There were, however, the following
five exceptions. Eleven of the 141 participants in this study did not have a
driver's license, so the sample sizes for the (11) traffic violations and (12)
driving fast criteria were N = 130. For the (17) preference for contact
lenses criterion, data were available only for those students who had
corrected vision, 56 students in all. For the (28) unwillingness to gamble
criterion, an oversight meant that the measure was administered to only 104
of the 141 participants. Also, for the criterion of (38) absenteeism from
experiments, only 80 students in our sample had taken the introductory
psychology course on which that criterion measure was based. A few of the
analyses reported below, therefore, were based on sample sizes notably
smaller than N = 1 4 1 .
527
Table 1
The 40 Criterion Variables
Description
This document is copyrighted by the American Psychological Association or one of its allied publishers.
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
Label
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.
13.
14.
15.
16.
17.
18.
19.
20.
21.
22.
23.
24.
25.
Peer-rated intelligence
Peer-rated popularity
Peer-rated femininity
Peer-rated honesty
Religiosity rating
Dating frequency
Dating variety
Tobacco consumption
Alcohol consumption
Fraternity interest
Traffic violations
Driving fast
Buys lottery tickets
Parties attended
Dieting behavior
Medication usage
Preference for contacts
Part-time work
Plays musical instruments
Participation in sports
Routinely exercises
Blood donations
Obesity index
Participant sex
General knowledge
32.
33.
34.
35.
36.
37.
38.
Grade-point average
Business courses
Social science courses
Humanities courses
Math courses
Science courses
Absenteeism from experiments
The PRF and JPI scales total 36 in number. However, the JPI Breadth
of Interest and Social Participation scales were omitted from our expert
judges' rating forms and from the analyses that follow because of their
substantial overlap with the PRF scales of Understanding and Affiliation,
respectively.
528
Table 2
PRF-JPI Factor Scales and 34 Constituent Trait Scales
Factor scale
Neuroticism
Extraversion
Openness to Experience
Agreeableness
Conscientiousness
Trait scale
Succorance, Autonomy," Conformity, Interpersonal Affect, Social
Recognition, Harmavoidance, Anxiety, Risk Takinga
Affiliation, Self-Esteem, Exhibition, Dominance, Energy Level
Complexity, Understanding, Sentience, Nurturance, Innovation, Tolerance,
Change
Abasement, Aggression," Defendence," Responsibility, Social Adroitness"
Organization, Order, Impulsivity," Cognitive Structure, Desirability,
Achievement, Play,8 Endurance, Value Orthodoxy
This document is copyrighted by the American Psychological Association or one of its allied publishers.
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
into four groups of five. The raters in each group were then given one of
the four sets of (600 or 680) ratings to complete. Their task was to consider
each trait-criterion pair and make a judgment about the expected strength
of association between the variables using the 5-point rating scale already
described.
Results
Overview of Analyses
In this study we treated the 34 PRF-JPI personality trait measures as one set of lower level predictors (see Footnote 1) and
the 30 NEO-PI-R facet scales as another independent set. We also
had two independent sets of Big Five factor predictors. For the
first, we simply scored the 30 NEO-PI-R facet scales on the Big
Five domain scales, according to the standard scoring procedure
for that inventory. For the PRF-JPI scales, the procedure was not
so straightforward, because those scales are not generally scored in
terms of the Big Five personality factors. The scales do, however,
have a relatively clear representation in the Big Five factor space.
This is evident in separate as well as joint factor analyses of the
PRF and JPI (Ashton, Jackson, Helmes, & Paunonen, 1998; Jackson, Paunonen, Fraboni, & Goffin, 1996; Paunonen & Jackson,
1996), even in cross-cultural data (Paunonen, Jackson, Trzebinski,
& Forsterling, 1992; Paunonen et al., 1996).
Our participants' scores on the 34 PRF-JPI trait scales were
subjected to a principal-components analysis in this study, in
which we extracted five factors and rotated them to a varimax
criterion. Those factors resembled typical Big Five personality
factors, albeit with some slight rotational variations (cf. Ashton et
al., 1998). The specific allegiances of the 34 lower level PRF-JPI
trait scales to the five higher level varimax factors are shown in
Table 2. In that table, each PRF-JPI scale is listed next to the
factor on which it had its highest loading in the present varimax
solution. For comparison purposes, the NEO-PI-R factors and
facets are shown in Table 3.
We decided to compute factor scores for the five PRF-JPI
varimax dimensions and use those as our second set of higher level
personality factor indicators. The factor scores for our participants
correlated quite highly, in general, with their corresponding NEOPI-R domain scores: Conscientiousness = .79, Extraversion = .71,
Agreeableness = .68, Openness to Experience = .60, and Neuroticism = .40. The lower correlation for Neuroticism probably
reflects the greater role of social dependency in the PRF-JPI
variant of that factor (i.e., reflecting conformity, succorance, social
recognition, and low autonomy). In any case, the fact that the
corresponding factor measures are by no means perfectly correlated means that there is ample opportunity in this study for the
PRF-JPI and NEO-PI-R measures to act independently in the
prediction of our criterion variables.
In the results described below, we first present the reliability of
our expert raters' judgments of predictor-criterion association. We
then present the reliabilities of our participants' personality inventory scores. The reliabilities of the criterion measures were not
determined because, on the whole, they comprised single-item
measures of behavior. Exceptions were the three experimenters'
ratings of participants' (29) physical attractiveness, (30) personal
neatness, and (31) questionnaire neatness, which yielded interrater
reliabilities of .61, .62, and .93, respectively. Although it might be
expected that single-item measures are very unreliable because of
their short length, many of our criteria reflect self-reports of
frequencies, such as amount of money spent on lotteries per
month, that are probably quite reliable.
529
Table 3
NEO-PI-R Domain Scales and 30 Constituent Facet Scales
Facet scale
Domain scale
Neuroticism
Extraversion
Openness to Experience
Agreeableness
Conscientiousness
This document is copyrighted by the American Psychological Association or one of its allied publishers.
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
Note.
Because of the large number of predictors (34 PRF-JPI + 30 NEOPI-R facet scales + 1 0 factor scales) and criteria (the 40 variables listed in
Table 1) in this study, neither the predictor-criterion correlations, the
predictor-predictor correlations, nor the criterion-criterion correlations are
presented. (Those data can be obtained by writing to Sampo V. Paunonen.)
Instead, for each criterion we present only those results pertinent to a
comparison of the predictive validity of the Big Five personality factors
with the predictive validity of the five personality facets picked by our
judges as the best lower level predictor subset.
530
This document is copyrighted by the American Psychological Association or one of its allied publishers.
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
Table 4
Validity in Predicting 20 Criteria: All Five PRF-JP1
Factor Scales
Criterion
*i
Ro
Tobacco consumption
Willingness to share money
Participant sex*
Parties attended
Driving fast
Alcohol consumption
Business courses
Peer-rated intelligence
Routinely exercises
Grade-point average
Peer-rated popularity
Peer-rated honesty
Math courses
Social science courses
General knowledge
Questionnaire neatness
Religiosity rating
Part-time work
Humanities courses
Fraternity interest
.46
.48
.37
.37
.49
.33
.33
.30
.28
.27
.26
.26
.24
.35
.37
.25
.24
.22
.24
.17
.00
.18
.00
.00
.34
.00
.11
.00
.00
.00
.00
.00
.00
.25
.29
.11
.11
.06
.14
.00
2i 3***
20.1***
13.6***
13.4***
12.5***
10.8***
9.6**
9.2**
7.8**
7.4**
6.9**
6.6*
5.9*
6.0*
5.3*
4.8*
4.5*
4.3
3.7
2.9
Note. The Big Five factor scales were used as the five predictors for each
criterion. Rt = multiple correlation of sex and the predictors with criterion;
Ro = multiple correlation of sex alone with criterion; % = percentage of
increase in criterion variance accounted for by R1 over Ro. Criteria are
ordered by the significance of the R, - Ro increase; the top 20 criteria are
shown. PRF = Personality Research Form; JPI = Jackson Personality
Inventory.
" Sex was not included in the predictor battery for this criterion.
*p<.05.
**p<.0l.
***/?<.001.
531
This document is copyrighted by the American Psychological Association or one of its allied publishers.
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
Table 5
Validity in Predicting 20 Criteria: Judges' Five PRF-JPI Trait Scales
Criterion
PRF-JPI predictors
.50
.45
.39
.39
.34
.33
.31
.41
.30
.29
.31
.33
.32
.27
.26
.25
.28
.23
.30
.33
.18
.00
.00
.00
.00
.06
.00
.29
.00
.00
.11
.04
.14
.00
.00
.00
.11
.00
.00
.25
21.6***
20.3***
15.0***
14.9***
11.6***
10.5***
97**
8.9**
8.8**
8.4**
8.4**
10.8**
7.9**
7.1**
6.7**
6.2*
6.5*
5.4*
10.0*
4.5*
Note. Rl = multiple correlation of sex and the predictors with criterion; Ro = multiple correlation of sex alone
with criterion; % - percentage of increase in criterion variance accounted for by i?, over Ro. Criteria are ordered
by the significance of the /?, - Ro increase; the top 20 criteria are shown. PRF = Personality Research
Form; JPI = Jackson Personality Inventory; IAf = Interpersonal Affect; Nu = Nurturance; Res = Responsibility; Adr = Social Adroitness; Ag = Aggression; Su = Succorance; Ha = Harmavoidance; Ab = Abasement;
Anx = Anxiety; CS = Cognitive Structure; Dy = Desirability; Enr = Energy Level; Com = Complexity; Un =
Understanding; Ac = Achievement; En = Endurance; Inn = Innovation; SR = Social Recognition; Org = Organization; Af = Interpersonal Affect; Ex = Exhibition; PI = Play; Do = Dominance; Se = Sentience; Est =
Self-Esteem; Or = Order; Im = Impulsivity; Rsk = Risk Taking; Ch = Change; De = Defendence; Tol =
Tolerance.
a
Negative predictor-criterion relation. b Sex not included in the predictor battery for this criterion.
*p<.05.
**p<.0\.
532
Table 6
Validity in Predicting 20 Criteria: All Five NEO-PI-R
Domain Scales
This document is copyrighted by the American Psychological Association or one of its allied publishers.
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
Criterion
Parties attended
Willingness to share money
Humanities courses
Participant sex"
Tobacco consumption
Grade-point average
Science courses
Dieting behavior
Alcohol consumption
Questionnaire neatness
General knowledge
Fraternity interest
Business courses
Routinely exercises
Participation in sports
Peer-rated popularity
Obesity index
Buys lottery tickets
Peer-rated intelligence
Peer-rated femininity
.43
.42
.40
.39
.34
.33
.29
.29
.25
.28
.37
.23
.26
.21
.22
.18
.26
.17
.17
.72
*o
.00
.18
.14
.00
.00
.00
.00
.13
.00
.11
.29
.00
.11
.00
.06
.00
.18
.00
.00
.71
18.4***
14.1***
142***
15.2***
11.7***
11.1***
8.3**
6.7*
6.4*
6.3*
5.5*
5.5*
5.8*
4.6*
4.5*
3.3
3.3
2.8
2.8
1.6
Note. The Big Five Factor scales were used as the five predictors for each
criterion. R1 = multiple correlation of sex and the predictors with criterion;
Ro = multiple correlation of sex alone with criterion; % = percentage of
increase in criterion variance accounted for by Rl over Ro. Criteria are
ordered by the significance of the Rl - Ro increase; the top 20 criteria are
shown. NEO-PI-R = Revised NEO Personality Inventory.
a
Sex was not included in the predictor battery for this criterion.
*p<.05.
**/><.01. ***p<.001.
important advances in behavior explanation. For example, consider again the orderliness and ambition facets of the Big Five
Conscientiousness factor. It is possible that, in a work setting for
instance, Conscientiousness predicts assembly-line productivity by
some amount. If that were all the information available to the
researcher, he or she would have to conclude that all facets of
Conscientiousness contribute equally to that prediction. However,
a more detailed assessment of personality at the level of those
narrow traits might indicate otherwise: for example, that it is
orderliness and not ambition that is most responsible for individual
differences in productivity on the assembly line. Such information,
unavailable with factor level assessments, could be used to design
appropriate personnel programs. More important, it can be very
useful information for the development of a general theory of work
behavior.
from a large pool of traits against which the Big Five personality
factors were compared, in this study we relied on the subjective
decisions of human judges for that selection task. This resulted in
one notable difference between the results of the two studies.
Compared with the results of the present study, Paunonen
(1998) found somewhat larger prediction discrepancies favoring
trait-level assessments over factor-level assessments, even though
he took care to equate his empirical procedures for capitalization
on chance. To illustrate, the former study reported the trait scales
as being able to increase the predictive accuracy of the factor
scales by an amount in the neighborhood of 14-15% more criterion variance accounted for, whereas the comparable amount in
this study was about 8%. This difference could be due to at least
two possibilities: (a) The human judges in this study were not quite
as able to identify the strongest personality-behavior links as were
the quantitative, data-based procedures used by Paunonen, or (b)
empirical procedures such as those used by Paunonen require even
greater statistical corrections to guard against capitalization on
chance. Either way, the data of both studies still strongly support
the use of facet-level personality measures over factor-level measures for behavior prediction.
The present data also corroborate findings reported by Ashton
and his colleagues. For example, Ashton et al. (1995) compared
the validity of the Big Five Extraversion and Conscientiousness
factors with the validity of narrow traits that define those factors,
in the prediction of fun-seeking behaviors such as party going,
sports participation, and alcohol consumption. They reported that,
consistent with their predictions, the facets of Extraversion and
Conscientiousness that are thought to be conceptually related to
fun-seeking behavior (i.e., traits involving sociability and impulse
control) were better predictors of fun-seeking behavior than were
the broad factors to which they belong. In a similar study, Ashton
(1998) compared the validities of broad and narrow personality
variables in predicting workplace delinquency behaviors such as
theft, absenteeism, and safety violations. Consistent with his predictions, Ashton found that the theoretically relevant narrow traits
of responsibility and risk taking were better predictors of workplace delinquency than were even the best predicting Big Five
factors, which were Agreeableness and Conscientiousness.
Other data have been reported supporting our contention that
narrow personality traits can outpredict broader personality factors, even when both are part of the Big Five domain. Paunonen
and Ashton (2001) compared two Big Five factors with two of
their constituent traits in the prediction of academic performance
in an introductory personality course. Their analyses were based
on two facet traits that were rated by a panel of judges to be most
relevant to academic performance (i.e., need for achievement and
need for understanding) with the factors that comprise those scales
(Conscientiousness and Openness to Experience, respectively).
The results of the Paunonen and Ashton study clearly show, once
again, that the narrow traits had the predictive advantage over the
broad factors, this time with respect to a criterion of undergraduate
course grades in a very large sample (N 717).
533
This document is copyrighted by the American Psychological Association or one of its allied publishers.
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
Table 7
Validity in Predicting 20 Criteria: Judges' Five NEO-PI-R Facet Scales
Criterion
NEO-PI-R predictors
Ro
.48
.46
.39
.35
.33
.33
.34
.30
.30
.29
.30
.38
.25
.31
.33
.22
.73
.24
.20
.19
.18
.11
.00
.00
.06
.13
.14
.00
.00
.00
.13
.29
.00
.18
.25
.00
.71
.11
.00
.00
19.9***
20.0***
15.3***
12.3***
10.7***
9.5**
9.5**
9.1**
9.1**
8.3**
7.4**
6.2*
6.1*
6.3*
4.4*
4.7*
2.4*
4.3
4.1
3.8
Note. /?, = multiple correlation of sex and the predictors with criterion; Ro = multiple correlation of sex alone
with criterion; % = percentage of increase in criterion variance accounted for by R, over Ro. Criteria are ordered
by the significance of the Rt - Ro increase; the top 20 criteria are shown. NEO-PI-R = Revised NEO Personality
Inventory; Str = Straightforwardness; Alt = Altruism; Mod = Modesty; Ten = Tender-Mindedness; Tru =
Trust; Val = Values; Imp = Impulsiveness; Ach = Achievement Striving; Dis = Self-Discipline; Ide = Ideas;
Com = Competence; Dut = Dutifulness; Anx = Anxiety; Vul = Vulnerability; Hos = Angry Hostility; Gre =
Gregariousness; Acy = Activity; SCs = Self-Consciousness; War = Warmth; Cpl = Compliance; Del =
Deliberation; Exc = Excitement Seeking; Aes = Aesthetics; Fan = Fantasy; Fee = Feelings; Emo = Positive
Emotions; Dep = Depression; Act = Actions; Ass = Assertiveness; Ord = Order.
a
b
Negative predictor-criterion relation.
Sex was not included in the predictor battery for this criterion.
*p < .05. **p<.0l.
***/><.001.
We believe that one reason for the success of our narrow traits
in adding incrementally to criterion prediction is the fact that those
few traits were rationally selected by expert judges as being
criterion predictive. Other narrow traits might not have done so
well. In fact, we ran some follow-up hierarchical regressions
evaluating the incremental validity of trait scales over factor
scales, but using trait scales that were not expected to predict
specific criteria. For each criterion, we first used the Big Five
factors as predictors and then added five lower level traits, but
traits that were randomly selected from those rated by the expert
judges as being unrelated to the criterion. In only 5 of the 40
evaluations did the PRF-JPI trait scales increase criterion prediction relative to Big Five factor predictors (cf. Table 8). Only 4 of
the 40 evaluations were significant for the similarity chosen NEOPI-R facet scales (cf. Table 9).
Our point in this section is that although the specific variance of
lower level trait scales is almost guaranteed to add to the predictive
accuracy of Big Five factor scales, the amount gained could be
trivial. A judicious selection of trait variables will maximize the
probability of finding increments in prediction that are both substantial and meaningful. We further believe that a theoretically
guided selection of such predictors will result in a predictor subset
that has better generality than those predictors selected by purely
empirical means. The regression weights for predictors chosen by
the former method will almost certainly be more stable than will
the weights for the latter type of predictor (which are more likely
534
This document is copyrighted by the American Psychological Association or one of its allied publishers.
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
Table 8
Incremental Validity in Predicting 20 Criteria: Judges' Five PRF-JPI Trait Scales
Criterion
PRF-JPI predictors
Science courses
Willingness to share money
Participant sexb
Participation in sports
Unwillingness to gamble
Alcohol consumption
Routinely exercises
Fraternity interest
Religiosity rating
Business courses
Tobacco consumption
Peer-rated intelligence
General knowledge
Absenteeism from experiments
Math courses
Dating frequency
Social science courses
Medication usage
Part-time work
Peer-rated popularity
Com Un Ac En Inn
IAf Nu Res Adr" Aga
Su IAf Ha Ab Aga
Af Ex PI Enr Ac
Rska Ha Ima Aca Cha
PI Dya Anx Orga Aca
Enr En SR Org Ac
Af PI SR Con Est
Nu Ha Su IAf Tola
Ac Do En Af Au
Anx Resa CSa Dya Enra
Com Un Inn Ac Do
Un Com En Org Ac
CSa Orga Ena Im Resa
Com Ac En Aba Ch
Af PI Est Su Ch
Com Un Af Tol Nu
Anx Enra Su Aua CS
En Au Enr Res Ac
Af PI Est Aga Dea
.45
.52
.49
.39
.38
.38
.33
.34
.29
.34
.40
.27
.42
.22
.18
.15
.31
.24
.20
.22
.29
.42
.39
.22
.17
.25
.21
.23
.18
.26
.34
.17
.37
.00
.00
.00
.26
.19
.15
.18
12.2**
9.5**
8.6**
10.1**
11.9**
8.4**
6.1*
6.1*
5.3*
4.4*
4.2*
4.4
3.8
6.7
4.4
3.4
3.0
2.2
1.6
1.6
Note. Rx = multiple correlation of (sex + the NEO-PI-R domain scales + these predictors) with criterion; Ro =
multiple correlation of (sex + the NEO-PI-R domain scales) with criterion; % = percentage of increase in
criterion variance accounted for by /?, over Ro. Criteria are ordered by the significance of the fl, - Ro increase;
the top 20 criteria are shown. PRF = Personality Research Form; JPI = Jackson Personality Inventory;
NEO-PI-R = Revised NEO Personality Inventory; Com = Complexity; Un = Understanding; Ac = Achievement; En = Endurance; Inn = Innovation; IAf = Interpersonal Affect; Nu = Nurturance; Res = Responsibility;
Adr = Social Adroitness; Ag = Aggression; Su = Succorance; Ha = Harmavoidance; Ab = Abasement; Af =
Affiliation; Ex = Exhibition; PI = Play; Enr = Energy Level; Rsk = Risk Taking; Im = Impulsivity; Ch =
Change; Dy = Desirability; Anx = Anxiety; Org = Organization; SR = Social Recognition; Con =
Conformity; Est = Self-Esteem; Tol = Tolerance; Do = Dominance; Au = Autonomy; CS = Cognitive
Structure.
a
Negative predictor-criterion relation.
b
Sex was not included in the predictor battery for this criterion.
* p < .05. **p<.01.
***/?<.001.
535
This document is copyrighted by the American Psychological Association or one of its allied publishers.
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
Table 9
Incremental Validity in Predicting 20 Criteria: Judges' Five NEO-PI-R Facet Scales
Criterion
NEO-PI-R predictors
Religiosity rating
Numerical ability
Willingness to share money
Participation in sports
Grade-point average
General knowledge
Fraternity interest
Dating variety
Dieting behavior
Humanities courses
Routinely exercises
Parties attended
Obesity index
Blood donations
Math courses
Medication usage
Peer-rated femininity
Peer-rated popularity
Science courses
Tobacco consumption
*o
.49
.34
.56
.30
.39
.44
.31
.24
.30
.33
.34
.41
.31
.23
.30
.23
.72
.31
.18
.47
.24
.08
.48
.07
.27
.37
.17
.00
.17
.24
.28
.37
.25
.13
.24
.16
.71
.26
.10
.46
17.9***
10.7***
7.9**
8.6**
7.7**
6.3*
6.6*
5.8*
6.1*
5.1*
4.1
3.4
3.5
3.4
2.9
2.6
1.3
2.5
2.1
1.2
Note. /?, = multiple correlation of (sex + the PRF-JPI factor scales + these predictors) with criterion; Ro =
multiple correlation of (sex + the PRF-JPI factor scales) with criterion; % = percentage of increase in criterion
variance accounted for by Rt over Ro. Criteria are ordered by the significance of the Rt Ro increase; the top 20
criteria are shown. NEO-PI-R = Revised NEO Personality Inventory; Val = Values; Tru = Trust; Ten =
Tender-Mindedness; Imp = Impulsiveness; Alt = Altruism; Com = Competence; Del = Deliberation; Exc =
Excitement Seeking; Ide = Ideas; Str = Straightforwardness; Mod = Modesty; Gre = Gregariousness; Acy =
Activity; SCs = Self-Consciousness; War = Warmth; Cpl = Compliance; Ach = Achievement Striving; Dis =
Self-Discipline; Dut = Dutifulness; Act = Actions; Aes = Aesthetics; Emo = Positive Emotions; Dep =
Depression; Fan = Fantasy; Fee = Feelings; Vul = Vulnerability; Ord = Order; Ass = Assertiveness; Hos =
Hostility; PRF = Personality Research Form; JPI = Jackson Personality Inventory.
" Negative predictor-criterion relation.
* p < . 0 5 . **p<.Ql.
***/><.001.
latter phenomenon, where broad Big Five personality factors predicted relatively narrow job performance criteria better than they
predicted broader job performance criteria (cf. Fishbein & Ajzen,
1974).
What about the issue of dimensionality and the present study?
As has been argued elsewhere (Paunonen, 1998), criteria of the
type used here arguably represent multidimensional and multidetermined variables. One may consider smoking and drinking behavior, grade-point average and general knowledge, interest in
joining a fraternity and dieting behavior, or number of humanities
courses taken and peer ratings of intelligence. It seems improbable
to us that any personality-based determinants of such behaviors are
simple and one-dimensional. It is more likely that their determination involves the complex interplay of many personality (and
nonpersonality) variables.
One could argue in the present context that, if anything, the
broad Big Five personality factors in our study should have had a
predictive advantage over the narrow traits. This conclusion follows logically if (a) our criteria are indeed as multidimensional as
they appear to be and (b) predictor-criterion dimensionality match
does in fact facilitate prediction. Instead, the opposite was true in
many instances, where the narrow personality variables did better
at predicting our criteria than did broader personality variables (cf.
Table 4 with Table 5 and Table 6 with Table 7; see also Ashton et
al., 1995; Paunonen, 1998; Paunonen & Ashton, 2001). We there-
This document is copyrighted by the American Psychological Association or one of its allied publishers.
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
536
A Final Word
Are there assessment situations in which the exclusive use of
Big Five factor measures over an equivalent number of facet
measures is to be recommended for the prediction of human
behavior? Of course there are. Lest anyone think we are promoting
the wholesale abandonment of the Big Five in this article, we
hasten to emphasize that measures of those factors do have their
applications. And those applications go beyond formal empirical
evaluations of interesting theoretical questions, as represented in
this comparison study. At the same time, we believe that such
applications are relatively scant.
An occasion in which it would be desirable, in our view, to use
personality factor measures rather than personality facet measures
for behavior prediction is when pragmatic considerations limit the
amount of time available for the assessment and one of the following two conditions applies: Either (a) one has no good basis for
identifying the few best lower level predictors of the criterion or
(b) many criteria are to be predicted and they represent a diverse
array of variables with many different personality determinants. In
the former case, the Big Five measures would probably do better
Conclusions
The Big Five factors of personality account for a substantial
amount of the variation in human behavior. Measures of those
factors, therefore, can be useful tools for predicting and understanding behavior. But there is also reliable personality-based
variation in behavior that is not accounted for by the Big Five. That
additional variation is evident in the specific variance residing
within the facet or trait scales that make up the personality factors.
Such variation also is evident in the nonrandom variance characterizing trait scales that have little or no communality with the Big
Five personality factors. The results of this and other studies amply
support our conclusion that those sources of non-Big Five personality variance can and should be used for the purposes of reducing
error in behavior prediction and increasing accuracy in behavior
explanation.
References
Ashton, M. C. (1998). Personality and job performance: The importance of
narrow traits. Journal of Organizational Behavior, 19, 289-303.
Ashton, M. C , Jackson, D. N., Helmes, E., & Paunonen, S. V. (1998). Joint
factor analysis of the Personality Research Form and the Jackson Personality Inventory: Comparisons with the Big Five. Journal of Research
in Personality, 32, 243-250.
Ashton, M. C , Jackson, D. N., Paunonen, S. V., Helmes, E., & Rothstein,
M. G. (1995). The criterion validity of broad factor scales versus specific
trait scales. Journal of Research in Personality, 29, 432-442.
Ashton, M. C , Lee, K., & Son, C. (2000). Honesty as the sixth factor of
personality: Correlations with Machiavellianism, primary psychopathy,
and social adroitness. European Journal of Personality, 14, 359-368.
Costa, P. T. Jr., & McCrae, R. R. (1992). Revised NEO Personality
Inventory (NEO-P1-R) and NEO Five-Factor Inventory (NEO-FF1) professional manual. Odessa, FL: Psychological Assessment Resources.
Fishbein, M , & Ajzen, I. (1974). Attitudes towards objects as predictors of
single and multiple behavioral criteria. Psychological Review, 81, 5 9 74.
Goldberg, L. R. (1999). A broad-bandwidth, public-domain, personality
inventory measuring the lower-level facets of several five-factor models.
In I. Mervielde, I. Deary, F. De Fruyt, & F. Ostendorf (Eds.), Personality
psychology in Europe (Vol. 7, pp. 7-28). Tilburg, the Netherlands:
Tilburg University Press.
Jackson, D. N. (1976). Jackson Personality Inventory manual. Port Huron,
MI: Research Psychologists Press.
Jackson, D. N. (1984). Personality Research Form manual. Port Huron,
MI: Research Psychologists Press.
Jackson, D. N. (1990). Multidimensional Aptitude Battery manual. Port
Huron, MI: Sigma Assessment Systems.
Jackson, D. N., Paunonen, S. V., Fraboni, M., & Goffin, R. G. (1996). A
five-factor versus a six-factor model of personality structure. Personality
and Individual Differences, 20, 33-45.
Jang, K. L., McCrae, R. R., Angleitner, A., Riemann, R., & Livesley, W. J.
This document is copyrighted by the American Psychological Association or one of its allied publishers.
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
537
(Appendix follows)
538
Appendix
Behavior Report Form
INSTRUCTIONS
Please describe yourself by answering all of the questions in this booklet.
Be as accurate as possible in describing you, and try not to omit any item.
First, please indicate the following about you.
Your Name:
This document is copyrighted by the American Psychological Association or one of its allied publishers.
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
or(2)_
(in.) or_
(lbs.) or
(1)
.(cm.)
_ (kg.)
_ Right
or(2).
Left
Please answer the following six questions by circling a number on each of the corresponding 9-point rating scales.
1. How would you rate your level of physical attractiveness compared to the average student? Circle a number on the following scale:
UNATTRACTIVE
AVERAGE
ATTRACTIVE
1
2
3
4
5
6
7
8
Extremely
Very
Moderately
Somewhat
Somewhat
Moderately
Very
Extremely
2. How would you rate your level of general intelligence compared to the average student? Circle a number on the following scale:
UNINTELLIGENT
AVERAGE
INTELLIGENT
9
8
2
6
1
Extremely
Moderately
Moderately
Somewhat
Very
Somewhat
Very
Extremely
3. In relation to people you know, how would you describe your popularity among your peers?
UNPOPULAR
AVERAGE
1
2
3
4
5
6
Extremely
Very
Moderately
Somewhat
Somewhat
4. In relation to other people of your sex, how masculine/feminine are you?
MASCULINE
AVERAGE FOR MY SEX
1
2
3
4
5
6
Extremely
Very
Moderately
Somewhat
Somewhat
Moderately
POPULAR
8
Very
9
Extremely
Moderately
FEMININE
8
Very
9
Extremely
5. Would you consider yourself a religious person who, for example, might be interested in attending (or already does attend) formal religious
services?
NONRELIGIOUS
AVERAGE
RELIGIOUS
1 2 3
4
5
6
7
8
9
Extremely
Very
Moderately
Somewhat
Somewhat
Moderately
Very
Extremely
6. How would you describe your honesty compared to that of your friends?
DISHONEST
AVERAGE
1 2 3
4
5
Extremely
Very
Moderately
Somewhat
7. Indicate your overall average grade for last year.
6
Somewhat
Moderately
HONEST
7
8
Very
9
Extremely
% (percent)
8. Estimate the average number of dates per month that you have had over the past year with someone of the opposite sex.
How many different people did you date over the course of the past year?
(per month)
539
9. Do you consider yourself a nonsmoker, infrequent smoker, light smoker, moderate smoker, or heavy smoker! Circle a number below.
1
NonSmoker
3
Light
Smoker
Infrequent
Smoker
4
Moderate
Smoker
5
Heavy
Smoker
(per day)
10. Do you consider yourself a nondrinker, infrequent drinker, light drinker, moderate drinker, or heavy drinker of alcohol? Circle a number below.
1
NonDrinker
3
Light
Drinker
Infrequent
Drinker
4
Moderate
Drinker
5
Heavy
Drinker
This document is copyrighted by the American Psychological Association or one of its allied publishers.
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
9
Extremely
13. How long have you had a driver's license? Put 0 if never.
(years)
If you have a driver's license:
How many speeding tickets have you had in the past?
How many parking tickets!
How many other traffic violations?
What is the fastest you have driven?
(m.p.h.) or
(k.p.h.)
14. Indicate your graduating average grade from high school.
% (percent)
15. On average, how much money do you spend monthly buying lottery tickets?
($ per month)
16. Estimate the average number of parties per month that you attend.
(per month)
17. Have you ever been on a long-term diet (i.e., one month or more)? Check one.
(1)
no (2)
yes
18. Do you regularly take any prescription medications for the following ailments? Check each item.
asthma:
allergies:
diabetes:
depression:
other:
(1)
(1)
(1)
(1)
(1)
no (2)
no (2)
no (2)
no (2)
no (2)
ves
ves
ves
ves
yes
19. How would you describe your uncorrected eyesight! Check one.
(1)
normal vision
(2)
nearsighted
(3)
farsighted
(4)
nearsighted in one eye, farsighted in the other
Do you wear vision-correcting prescription lenses! Check both items.
glasses:
(1)
no (2)
yes
contacts:
(1)
no (2)
yes
20. Do you currently hold a part-time job! Check one.
(1)
no (2)
yes
If yes, how many hours do you work in the average week?
21. Do you:
(1)
(1)
(1)
(1)
(2)
(2)
(2)
(2)
yes
yes
yes
yes