Professional Documents
Culture Documents
net/publication/234823080
CITATIONS READS
11 2,485
5 authors, including:
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Jordan B Peterson on 04 June 2014.
Personality
Table 4
The revised NEO Personality Inventory (NEO-PI-R; Costa & McCrae, 1992)
Zero Order Correlations between Executive Function Factor and Subtests
was also administered at age 16, to a reduced set of 126 individuals. The
NEO-PI-R consists of 5 general factors (Extraversion, Neuroticism,
Agreeableness, Conscientiousness, and Openness to Experience). Each subscale EFF NSP NR SOP
is composed of 48 items, coded on a five-point scale. Each general factor may NSP -.81
be further subdivided into 6 facets of 8 items each. For the current analysis, the NR .65 -.38
NEO-PI-R was utilized as five subscale scores. Alpha reliability of these SOP -.58 .37 -.17
subscale scores averages ~ .90 (Costa & McCrae, 1992). SPS .56 -.34 .22 -.20
Notes: EFF = Executive Function Factor, NSP = Non-Spatial Conditioned Association (number of trials,
Table 1 higher is worse), NR = Number Randomization (number of trials, easy version, higher is better), SOP
Zero Order Correlations between Verbal Learning Factor and Subtests = Self-Ordered Pointing, total number of errors, higher is worse), SPS = Strategic Problem Solving
(number of successful tests, higher is better). All p's < .05.
VLF SF LF PA
SF .78
LF .78 .54 Results
PA .62 .45 .36 Correlational Analysis: IQ, Neuropsychological Test Factor Scores and
DS .66 .41 .45 .36 Failure-Weighted Grades
Notes: VLF = Verbal Learning Factor, SF = Semantic Fluency, LF = Letter Fluency, PA The zero-order correlations for the cognitive variables (IQ and
= Paired Associates, DS = Digit Span. All p's < .0001. neuropsychological test factor scores) and failure-weighted grades are presented
in Table 5. The zero-order correlations between personality and failure-weighted
grades were non-significant.
Individual Differences Research, 2003, 1(3) 165 166 Individual Differences Research, 2003, 1(3)
Correlational Analysis: IQ, Individual Neuropsychological Tests, and Regression Analyses: IQ, Neuropsychological Test Factor Scores, Personality
Failure-Weighted Grades and Failure-Weighted Grades
Table 6 contains zero-order correlations for the cognitive tests (IQ and Two stepwise linear regressions were first conducted, to assess the separate
individual neuropsychological test scores) and failure-weighted grades. relationships between IQ and grades and neuropsychological function and
grades. Entry F was set at .05, and removal at .10, for the stepping procedure.
Table 5 1. IQ and Grades: IQ and grades were strongly related, R²= .34, r= .58,
Zero Order Correlations between Cognitive Variables (IQ and F(2,145)= 37.37, p < .0001, with significant contributions from averaged
Neuropsychological Factor Scores) and Failure-Weighted Grades Vocabulary (β = .49, t= 6.97, p< .0001) and averaged Block Design (β = .19, t=
2.68, p< .008).
VLF ISLF TFF Vocab BD FW Grade 2. Neuropsychological Function and Grades: The neuropsychological test
EFF .28 .15 .19 .37 .31 .43 factor scores and grades were strongly related as well, R²= .46, r= .68,
VLF -.00 .12 .51 .33 .60 F(3,144)= 40.94, p< .0001, with significant contributions from the Verbal
ISLF .02 .05 .10 .09 Learning (β = .51, t= 7.91, p< .0001), Executive Function (β = .26, t= 4.01, p<
TFF .17 .14 .28 .0001), and Tactile Laterality (β = .17, t= 2.68, p< .008) factor scores.
Vocab .31 .55 Incidental Spatial Learning stepped out (β in= .05, t= .85, p< .40). The
BD .35 relationship between regression-derived neuropsychological performance
z-scores is presented graphically in Figure 1. It is of some interest to note that
Notes: Exec F= Executive Function factor score, Verb L= Verbal Learning factor score, this relationship appears quadratic, as indicated, rather than linear. This may
TcLT= Tactile Laterality factor score, M Voc= Averaged Vocabulary score, M BD= be valid, or may be a consequence of an apparent floor effect with regards to
Averaged Block Design score, FW Grade= Failure Weighted Grades. All p's < .05,
grades. In any case, analysis of the quadratic relationship revealed R² = .49, r
except ns, underlined.
= .7, p < .0001.
Table 6
Significant Zero Order Correlations between Individual
Figure 1
Relationship between Regression-Derived Neuropsychological
Neuropsychological Scores and Failure-Weighted Grades
Performance Z-Scores and Failure-Weighted Grades
FW Grade
Non Spatial Conditional Association -.36
Number Randomization .13 5
Self-Ordered Pointing (Concrete) -.25
Self-Ordered Pointing (Abstract) -.39
4
Strategic Problem Solving .46
Semantic Fluency .47
Letter Fluency .51 3
Paired Associate .40
Digit Span .50
Dichaptic Lateralization Right .35 2
Weighted
(number of trials, higher is worse), Number Randomization (number of trials, easy 1
Grades
Failure
version, higher is better), Self-Ordered Pointing (Concrete and Abstract) (number of
errors, higher is worse), Strategic Problem Solving (number of successful tests, higher 0
is better), Paired Associate (number correct, higher is better), Digit Span (number
correct, higher is better), Dichaptic Lateralization Right (number correct, higher is -3 -2 -1 0 1 2 3
better). Dichaptic Lateralization Left did not correlate significantly with FW Grade. All
Regression-Derived Neuropsychological Z-Scores
p's < .01.
Note: Linear R² = .46, Quadratic R² = .49, p< .0001, uncorrected for reliability.
Individual Differences Research, 2003, 1(3) 167 168 Individual Differences Research, 2003, 1(3)
The capacity of neuropsychological test performance to provide an & Mount, 1996), would be positively related to academic achievement, and
incremental improvement to the relationship between IQ and failure-weighted would account for variance over and above that of IQ and neuropsychological
grades was assessed next, using hierarchical regression analysis. Averaged performance.
Vocabulary and Averaged Block Design were entered into block 1, while the Neuropsychological test performance (particularly executive function and
four neuropsychological variables were allowed to step in block 2. The overall verbal learning) indeed appeared powerfully associated with grades - at least as
model was highly significant (R²= .51, r= .71, F(5,142)= 29.15, p < .0001), with potently as IQ, and perhaps more so. It is reasonable to draw attention to the
significant block 1 contributions from averaged Vocabulary (β = .24, t= 3.37, magnitude of this relationship: a correlation approaching .70, the magnitude
p< .001), but not averaged Block Design (β = .03, t= .99, p< .32). Verbal obtained in this study, is extremely high. Correlations of .50 or higher are
Learning (β = .38, t= 5.42, p< .0001, incremental r= .089), Executive Function characteristic of only 11% of psychological assessment studies, and 3% of social
(β = .19, t= 2.89, p< .005, incremental r= .026), and Tactile Laterality (β = .14, psychologystudies, on average (Hemphill, 2003). Frequently, assessments of the
t= 2.38, p< .019, incremental r= .014) stepped in significantly in block 2, relationship between general mental ability and various important life outcomes
adding a total incremental r= .13, with Incidental Spatial Learning stepping out, approach or exceed .50. Hunter & Schmidt (1998) reported a large
once again (β in= .04, t= .73, p< .47). A simple stepwise regression with both meta-analytically derived estimate of .51 for the relationship between general
IQ and all four neuropsychological factor scores produced R²= .50, r= .71, mental ability and job performance, for example. However, this estimate is
F(4,143)= 36.19, p< .0001, with Verbal Learning (β = .39, t= 5.71, p< .0001), corrected for restriction of range and reliability - correction that substantively
Averaged Vocabulary (β = .25, t= 3.51, p< .0006), Executive Function (β = .20, increases its magnitude. Assuming, in the present case, that the
t= 3.11, p< .002), Tactile Laterality (β = .15, t= 2.45, p< .02) stepping in and neuropsychological tasks are about as reliable as the grade estimates (.82) - an
averaged Block Design (β in= .06, t= .99, p< .32) and Incidental Spatial assumption that seems reasonable, given that the correlation between the factor
Learning stepping out (β in= .05, t= .80, p< .32). scores and the subcomponent task scores are about the same magnitude as the
The capacity of personality test scores to provide an incremental averaged grade score and grades for any given year - the true correlation could
improvement to the relationship between IQ/neuropsychological performance be as high as .68/.82 = .83. This is an effect size very rarely found in
and failure-weighted grades was then assessed, once again using hierarchical psychology.
regression analysis. The two IQ and four neuropsychological variables were Furthermore, neuropsychological test scores, particularly executive function
entered in block 1, and the five personality variables allowed to step in, in block and verbal learning, appeared to add validity incremental (r = 0.13) to that of
2. The overall model was highly significant R²= .54, r= .74, F(7,118)= 19.88, IQ, alone - no easy task, given that the relationship between IQ and academic
p < .0001, with significant block 1 contributions from Verbal Learning (β = .40, performance is already so powerful. It might be objected that the IQ assessment
t= 5.01, p< .0001), averaged Vocabulary (β = .25, t= 3.20, p< .002), Executive was limited to Vocabulary and Block Design, and that this limitation suppressed
Function (β = .17, t= 2.43, p< .016), and Tactile Laterality (β = .15, t= 2.31, p< the potential power of the IQ measures. However, IQ estimates derived from
.023), but not averaged Block Design (β = .05, t= .76, p< .44), or Incidental Block Design/Vocabulary subtests typically correlate at .91 with full-scale IQ
Spatial Learning (β = .10, t= .76, p< .44). Agreeableness stepped in scores (Sattler, 1988; Table C-10, p. 820). Furthermore, grade and IQ estimates
significantly in block 2 (β = .21, t= 3.36, p< .02), while Extraversion, were taken concurrently in the present study, while the neuropsychological
Neuroticism, Conscientiousness and Openness stepped out (all β in < .06, t < assessment occurred at the end of the period of time for which academic data
.86, p > .12). Very similar results were obtained when the analysis was repeated, were available. Finally, the IQ assessments occurred multiple times, increasing
using only the significant IQ and neuropsychological predictors from the their reliability, while the neuropsychological assessment only occurred once.
previous analysis (Vocabulary, Verbal Learning, Executive Function, and We have also produced recent evidence that neuropsychological test
Tactile Laterality).¹ performance (restricted, in this case, to tests of Executive Function and Verbal
Learning) also strongly predicts supervisor and self ratings of job performance,
Discussion among managers, administrators and line-workers of a medium sized
We hypothesized that academic achievement would be as strongly associated manufacturing company (Peterson, Higgins, Lee & Pihl, 2001; Higgins,
with neuropsychological test performance as it was with IQ, particularly in the Peterson, Lee & Pihl, submitted a) and are strongly positive associated with
case of tests of executive function and verbal learning. We also hypothesized grades at Harvard University (Peterson, Higgins, Lee & Pihl, 2001; Higgins,
that neuropsychological test scores would account for variance in academic Peterson, Lee & Pihl, submitted c) and the University of Toronto (Higgins,
achievement, over and above that of IQ. Finally, we hypothesized that Big-Five Peterson, Lee & Pihl, submitted b). Perhaps tests derived from the
personality variables, particularly agreeableness (Wentzel, 1993), as well as neuropsychological literature might be usefully applied to the twin problems of
conscientiousness and reversed neuroticism (Hunter & Schmidt, 1996; Barrick predicting and understanding academic and industrial performance, and help
Individual Differences Research, 2003, 1(3) 169 170 Individual Differences Research, 2003, 1(3)
us master the so far elusive task of adding incremental validity to IQ. .0001, with Aggression Category (beta = -.21, t= -3.41, p< .0008), Verbal Learning
Personality testing did not fare so well, at least on its own. One potential (beta= .41, t= 5.81, p< .0001), Averaged Vocabulary (beta= .25, t= 3.51, p< .0006),
reason for this is the lag between grade assessment and personality testing in the Executive Function (beta= .22, t= 3.18, p< .002) and Tactile Laterality (beta= .16, t=
present study. However, traits are supposed to remain constant over time periods 2.74, p< .02) stepping in, and averaged Block Design (beta in= .04, t= .75, p< .46) and
Incidental Spatial Learning stepping out (beta in= .05, t= .74, p< .46). The beta weights
of at least three to seven years, at least in theory (Costa & McCrae, 1992) (with
for executive function were slightly suppressed in the course of these new analyses, but
r's ranging from .51 to .82). Some evidence did emerge, supporting Wentzel's this was because aggression category and executive function were significantly related,
(1993) presuppositions: once variance in IQ and neuropsychological test as reported in Séguin et al. 1995.
performance had been accounted for, with regards to failure-weighted grades,
Agreeableness appeared positively related. Perhaps this is because children with
better interpersonal skills are looked upon favorably by teachers, and given the
benefit of the doubt; perhaps this is because agreeable children actually learn
References
Barrick, M.R. & Mount, M.K. (1991). The Big Five personality dimensions and job
more. performance: a meta-analysis. Personnel Psychology, 44, 1-26.
The present study suffered from a number of methodological limitations, Barrick, M.R. & Mount, M.K. (1993). Autonomy as a moderator of the relationships
despite what it revealed. First, the relationship between neuropsychological between the Big Five personality dimensions and job performance. Journal of Applied
performance and grades was assessed retrospectively, eradicating any possibility Psychology, 78, 111-118.
of drawing a clear causal relationship. Second, assessment of IQ, while Barrick, M.R. & Mount, M.K. (1996). Effects of impression management and
reasonably complete, could have benefitted from inclusion of a highly g-loaded self-deception on the predictive validity of personality constructs. Journal of Applied
test like the Raven's Progressive Matrices (Raven, 1998), as well as additional Psychology, 81, 261-272.
measures of crystallized intelligence. In recent work at the University of Becker, J. T., Butters, N., Rivoira, P. & Miliotis, P. (1986). Asking the right questions:
Toronto, we have done precisely this in the context of a concurrent study, and Problem solving in male alcoholics with Korsakoff's syndrome. Alcoholism: Clinical
the incremental validity of neuropsychological performance over IQ remained and Experimental Research, 10, 641-646.
Brody, N. (1997). Intelligence, schooling and society. American Psychologist, 52,
extant (Higgins et al., submitted b). A prospective longitudinal study would
1046-105.
constitute the best possible design, with neuropsychological performance Costa, P. T., Jr., & McCrae, R. R. (1992). Revised NEO personality inventory and NEO
assessed prior to academic and other performance measures. We are currently five-factor inventory professional manual. Odessa, FL: Psychological Assessment
undertaking such a study in the industrial domain. Resources.
Damasio, A.R (1994). Descartes' error. New York: Putnam.
Acknowledgment Fleming, G.W.T.H. (1942). Some preliminary remarks on prefrontal leucotomy. Journal
The National Science and Engineering Research Council of Canada, the Canadian of Mental Science, 88, 282-284.
Institutes of Health Research, and the Fonds pour la Formation des Chercheurs et l'Aide Frith, C. D., Friston, K. J., Liddle, P. F. & Frackowiak, R. S. J. (1991). A PET study of
à la Recherche (FCAR) provided scholarships that made this collaborative work word finding. Neuropsychologia, 29, 1137-1148.
possible. The Social Sciences and Humanities Research Council of Canada, FCAR, and Gardner, H. (1993). Multiple intelligences. New York: Basic Books.
the Conseil Québécois en Recherche Sociale funded the project and Research Unit on Goldberg, L.R. (1992). The development of markers for the big-five factor structure.
Child Psychosocial Maladjustment based at Université de Montréal. Psychological Assessment, 4, 26-42.
Goldman-Rakic, P.S. (1996). Regional and cellular fractionation of working memory.
Notes Proceedings of the National Academy of Science, 93, 13473-1348.
¹The original selection criteria for the boys (Séguin et al., 1995) involved their Grassi, J.R. (1950). Abstract behavior following prefrontal lobotomy. Psychiatric
categorization according to low, moderate and high multi-year averaged levels of Quarterly, 24, 74-88.
teacher-rated aggression. The focus of the current paper was the relationship between Hemphill, J.F. (2003). Interpreting the magnitudes of correlation coefficients. American
IQ, neuropsychological function, personality and grades. However, the authors were Psychologist, 58, 78-8.
concerned that selection for aggression may have affected the generalizability of the Higgins, D.M., Peterson, J.B., and Pihl, R.O. (submitted a) Computerized
present results. All analysis were therefore re-run, exactly as presented, except that all neuropsychological and big-5 personality task scores and concurrent corporate
blocks were shifted up one (so block 1 became block 2, etc.) and aggression category was managerial/administrative and line-worker performance.
entered into block 1. The results were essentially unchanged as a consequence of this Higgins, D.M., Peterson, J.B., Lee, A. and Pihl, R.O. (submitted b). Prefrontal cognitive
procedure, although aggression category always entered into the equations significantly. ability, the g factor, and personality in predicting academic performance among
So, for example, the final simple stepwise regression with aggression category, IQ and university undergraduates.
all four neuropsychological factor scores produced R²= .54, r= .74, F(5,142)= 33.44, p< Higgins, D.M., Peterson, J.B., Lee, A. and Pihl, R.O. (submitted c). Prefrontal cognitive
Individual Differences Research, 2003, 1(3) 171 172 Individual Differences Research, 2003, 1(3)
ability and conscientiousness predict academic performance in high-achieving retrieval failures. Neuropsychology, 7, 82-88.
university undergraduates. Raven, J. C. (1998). Raven's Progressive Matrices. San Antonio, Texas: The
Higgins, D.M., Peterson, J.B., Pihl, R.O. & Lee, A.G. (2001). Computerized Psychological Corporation.
neuropsychological and big-5 personality performance and academic achievement Rothstein, M.G., Paunonen, S.V., Rush, J.C. & King, G.A. (1994). Personality and
at Harvard. Paper presented at the American Psychological Society, Toronto, Ontario. cognitive predictors of performance in graduate business school. Journal of
Hunter, J.E. & Schmidt, F. (1996). Intelligence and job performance: Economic and Educational Psychology, 86, 516-53.
social implications. Psychology, Public Policy and Law, 2, 447-472. Salgado, J.F. (1997). The five factor model of personality and job performance in the
Kandel, E. & Freed, D. (1989). Frontal-lobe dysfunction and antisocial behavior: A European Community. Journal of Applied Psychology, 82, 30-43.
review. Journal of Clinical Psychology, 45, 404-413. Sattler, J.M. (1988). Assessment of children. San Diego: Author
King, L.A., McKee, W. & Broyles, S.J. (1996). Creativity and the five-factor model. Séguin, J.R., Pihl, R.O., Harden, P.W., Tremblay, R.E. & Boulerice, B. (1995).
Journal of Research in Personality, 30, 189-203. Cognitive and neuropsychological characteristics of physically aggressive boys.
Lezak, M. D. (1985). Neuropsychological assessment. In J. A. M. Frederiks (Ed.), Journal of Abnormal Psychology, 104, 614-624.
Handbook of clinical neurology: Vol. 1. Clinical neuropsychology (pp. 515-530). Smith, M. L. & Milner, B. (1981). The role of right hippocampus in the recall of spatial
New York: Elsevier. location. Neuropsychologia, 19, 781-793.
Lezak, M. D. (1983). Neuropsychological assessment (2nd ed.). New York: Oxford Smith, M. L. & Milner, B. (1989). Right hippocampal impairment in the recall of spatial
University Press. location: Encoding deficit or rapid forgetting? Neuropsychologia, 27, 71-81.
Luria, A.R., Homskaya, E.D. & Blinkov, S.M. (1967). Impaired selectivity of mental Smith, M., and Milner, B. (1981). The role of right hippocampus in the recall of spatial
processes in association with a lesion of the frontal lobe. Neuropsychologia, 5, location. Neuropsychologia, 19, 781-793.
105-117. Sternberg, R.J., Wagner, R.K., Williams, W.M. & Horvath, J.A. (1995). Testing
McCrae, R.R. & John, O. P. (1992). An introduction to the five-factor model and its common sense. American Psychologist, 50, 630-641.
applications. Journal of Personality, 60, 175-215. Stuss, D. T. & Benson, D. F. (1986). The frontal lobes. New York: Raven.
McHenry, J.J., Hough, L.M., Toquam, J.L., Hanson, M.A. & Ashworth, S. (1990). Tremblay, R.E., Pihl, R.O., Vitaro, F., Dobkin, P.L. (1994). Predicting early onset of
Project A validity results: The relationship between predictor and criterion domains. male antisocial behavior from preschool behavior. Archives of General Psychiatry,
Personnel Psychology, 43, 335-354. 51, 732-739.
Milner, B. & Petrides, M. (1984). Behavioural effects of frontal-lobe lesions in man. Wechsler, D. (1974). Manual for the Wechsler Intelligence Scale for Children - Revised.
Trends in Neurosciences, 7, 403-407. San Antonio, TX: Psychological Corporation.
Milner, B., Petrides, M. & Smith, L. (1985). Frontal lobes and the temporal organization Wechsler, D. (1987). Wechsler Memory Scale - Revised. New York: Psychological
of memory. Human Neurobiology, 4, 137-142. Corporation.
Moffitt,T. E. & Silva,P. A. (1988). Neuropsychological deficit and self-reported Wentzel, K.R. (1993). Does being good make the grade? Social behavior and academic
delinquency in an unselected birth cohort. Journal of the American Academy of Child competence in middle school. Journal of Educational Psychology, 85, 357-364.
and Adolescent Psychiatry, 27, 233-24. Wiegersma, S., van der Scheer, E., and Human, R. (1990). Subjective ordering,
Neuman, G.A. & Wright, J. (1999). Team effectiveness: Beyond skills and cognitive short-term memory, and the frontal lobes. Neuropsychologia, 28, 95-98.
ability. Journal of Applied Psychology, 84, 376-389. Witelson, S. F. (1976). Sex and the single hemisphere: Specialization of the right
Parks, R. W., Loewenstein, D. A., Dodrill, K. L., Barker,W. W., Yoshii, F., Chang, J. hemisphere for spatial processing. Science, 193, 425-427.
Y., Emran, A., Apicella, A., Sheramata, W. A. & Duara, R. (1988). Cerebral Witelson, S.F. (1974). Hemispheric specialization for linguistic and nonlinguistic tactual
metabolic effects of a verbal fluency test: A PET scan study. Journal of Clinical and perception using a dichotomous stimulation technique. Cortex, 10, 3-17.
Experimental Neuropsychology, 10, 565-575.
Peterson, J.B., Higgins, D.M., Lee, A.G. & Pihl, R.O. (2001). Computerized
neuropsychological and big-5 personality task scores and concurrent corporate Received 01/21/2003; Revision Received 05/12/2003; Accepted 05/12/2003
managerial/administrative performance. Paper presented at the American
Psychological Society, Toronto, Ontario.
Petrides, M. (1990). Nonspatial conditional learning impaired in patients with unilateral
frontal but not unilateral temporal lobe excisions. Neuropsychologia, 28, 137-149.
Petrides, M., Alivisatos, B., Meyer, E., & Evans, A. C. (1993). Functional activation of
the human frontal cortex during the performance of verbal working memory tasks.
Proceedings of the National Academy of Sciences of the United States of America, 90,
878-882.
Randolph, C., Braun, A. R., Goldberg, T. E. & Chase, T. N. (1993). Semantic fluency
in Alzheimer's, Parkinson's, and Huntington's disease: Dissociation of storage and