Professional Documents
Culture Documents
plicant takjng the test reads or listens to the same set of instructions. is allowed
ne same amount of time in which to respond, and is situated in a similar
cal environment. physi-
Any change in testing procedure
produce system
change in
in theindividual
may a
test
perlormance. For example, if the air conditioning testing room
Dreaks down
as well as
during a summer day, the people taking. the test
may not pertorm
people who took the test under more comfortable
conditions. lf an
Human Resources
100 Part Two The Development of
instructions
fails to read the complete
to.
or careless tester the test under thu
inexperienced are not taking
then those applicants
ofjob applicants,
conditions as other applicants
same
by its devel.
into a test
procedures can be designed
Appropriate testing is the responsibility
of the perS
standardized conditions d
but maintaining administrators in prona
Therefore, the training of test
ministering the rendered useless by an untrain Po
test.
Test Norms
a frame of reference o r point ot
To interpret the results of a psychological test,
the performance of one person can De
comparison múst be established so that ot tne
others. This is accomplished by means
compared with the performance of similar in nature
of people
test norms, the distribution of scores of a large group
Test n o m s The distribution standard
of this group, called the
of test scores of a large group o the job applicants being tested. The scores
of peopie similar in nature to
the job applicants being tested.
ization sample, serve as the point of comparison in determining.the relau
Standardization sample Standing of the applicants on the ability being tested.
The group ol subjects used
a high school graduate applies for a job that requires
mechani
Lo establish test norms. Thec skillsSuppose
ánd achieves a score of 82 on a test of mechanical ability. This score, ao
scores of ihe standardization thal
sample serve as the poini of tells us nothing about the level of the applicant's skill, but if we compare
comparison for determining the test
the relative standing of the score of 82 with the iest norms-the distribution of scores on the
persons being iesied. can ascribe some meaning
large group of high school graduates-then we
Validity
Validity is the most important requirement for a psychological test or any other valldity The determination
cdon device; that is, the test or selection device must be shown to measure owhether apychological
test or other selection device
i n t e n d e d to measure. I-0 psychologists consider several difierent kinds measures what it is iniended
of validity. to measure.
torm the job. Wih á word-processing job, for example, test questions about
word-procesing computer software are job-related, whereas questions about
isical abilities may not be. In the classroom, if your professor a:1nounces that
will be tested on the lirst three chapters of this book, then questions about
information from other chapters would not be considered content valid.
Construct validity is an attempt to determine the psychological character Construet validity A lype of
cics measured by a test. How do we know that a new test developed to measure validity that attempts to deter.
aelligence or motivation or emotional stability really does so? One way to mea- mine the psychological char
actenstics measured by a test.
sure construct alidity statistically is to correlate scores on the new test with
cores on established tests that are known to measure these variables. If the cor-
relation is high, then we can nave some confidence that the new test is measur-
it claims.to measure.
ing the trait
because these topics are directly related to the job they expect to perform,navigation
but requirements of a job.
they might balk at being asked if they loved their parents or slept with a light on
in their room. Such questions might be related to emotional
stability, but they do
not appear to be related to flying tn airplane. If a test lacks face
cants may not take it seriously, ar.d this may lower their test
validity, appli-
College students from the United States and from Franceperformance.
(a total of 259 sub-
jects) were asked rate the effectiveness and íairness of several selection
to
dures, to assess the students' degree of favorability toward the proce-
measures. The
selection procedures included personality, ability,
tests, as well as interviews, résumés, biographical data,honesty, and work-sample.
tacts, and handwriting analysis (a selection
references, personal con-
technique popular in
countries). The single strongest correlate of favorable ratings of these European
was the face validity techniques
ofí the measures (Steiner & Gilliland, 1996).
The best psychological tests include in their manuals the results of validation
studies. Without this information, the human
can have little confidence that resources or personnel manager
the tests in the
program are actually measuring the qualities andcompany's employee
abilities being soughtselection
in new
employees. Test validation is expensive, but proper validation
more than pay for themselves. procedures will
Validity Generalization
Until the late 1970s, 1-0
psychologists
ficity," which recommended
followed doctrine of "situational
a
speci
job and validating a test inevery situation-that is, every
every organization-for which it was
Were assumed to be differentially valid. A test chosen as a selection device. Tests
tory technicians in one company was not automaticallyappropriate for selecting labora-
ecting technicians in another considered valid for se-
Conidence for company. Therefore, no test could be used with
8iven
employee selection without first determining its validity in'the
instance, no matter how
valid the test had proven for other,
The idea of
situatiónal specificity or differential similar jobs.
validity generalization. On the basis of validity has been replaced by Validity generalization The
studies, 1-0 meta-analyses of previous validation
psychologists have concluded that tests valid in one situation may
idea that tests valid In one sit
uation may also be valid in
another situation.
Human Resources
104 Part Two The Development of
alca be valid in another situation. In other words, once establshed, the validity
(Schmidt et al., 1993).
of a test can be generalized
and Organlzational Psychology (SIOP) SuDno
The Society for Industrial
has also been endorsed by the National Academy.
validity generalization., It
Sciences and is included
in the Standards for Educational and Psychological Te
is widely accepted not only for tests hue
ing of the APA. Validity generalization
also for biographical data, assessment centers, interviews, integrity tests, and
and government agencies apply
other selection devices. Many large corporations
selection programs.
the concept of validity generalization in their
for psychological
Validity generalization has important practical implications
as an employee selection technique.
Organizations have realized that if
testing for every job at every
tests no longer require expensive validation proceduresby including tests, while
selection programs
level, then they can improve their
saving time and money.
people at the same time. number of computerized testing at a time. Because this
administered to one person
Individual tests Psycho Individual tests are
used less trequently by em.
tests, they are
Ogal tesis designed to makes them more costly than group for selecting senior management
be adminisiered to one are reserved
Usually they
person at a time. ploying organizations. for vocational guidance and coun.
popular
tests are more
personnel. Individual
work with patients.
seling and for diagnostic
Computerized Adaptive Tests
. adaptive tests provide
Computerized adaptive Designed for large-scale group testing, computerized
takes the test,at a computer
which the applicant
tests A means of administer
in
an individual testing situation in referred to as tailored testing because the
ing psychological tests
terminal. This approach is sometimes
which an applicant's response
it.
to an item delermines the test is tailored, or adapted, to the person taking
level of difficulty of succeed- test in paper-and-pencil for.
ing inems. If you were given a standard cognitive ability
mat, you would have to answer questionsdesigned to sample the full range of
Because individual tests are costly and time-consuming to administer. they are
used mostly for vocational counseling and for selecting management personnel.
109
Chapter 4 Psychological Testing
allowed as much time as they need to complete the test. A power test often
Con
tains more difficult items than does a speed test. Large-scale testing pror
often include speed tests because all test forms can be collected at the same ti
For some tasks, working speed is an important component of successfulne.
performance. A test for a computer keyboarding job wonid contain rela
easy questions. Given enough time, most people would be able to respond cor atively
rectly. The important predictive. factor for keyboarding or word processing is the
quality of the work that can be performed in a given period: in this case, dats
entry accuracy and speed. A power test would not be able to evaluate this ski
properly.
Auction in 1937, the Wonderlic has been administered to more than 125 million
people. A study of applicants to a computer applications training cen-
college-age
er found no significant differences between mean scores of persons who took
the computerized version and scores of those who took the print version (Dem-
bowski & Callans, 2000).
with their
Coding requires lebeling figures
minutes)
corresponding numbers (2
00+|D|o
112 Part Two The Development of Human Resoure
technical, clerical sales, Crat.
Beta-lI can be scored for professional, managerial, rats,
and service occupations.
The Wechsler Adult Intellígence
Scale-Revised (WAIS-R) is a lengthu .
Interests
tnterest tests include items about daily activities from among which applicants Interest tests Psychological
lect their preferences. The rationale is that if a person exhibits the same pattern tests to assess a person's inter
Csts and prelerences. These
of interests and preferences as people who are successful in a given occupation. tests are used primarily lor ca
then the chances are high that the' person taking the test will find satisfaction in eer counscling
that occupation.
It is important to remember, however, that just because a person shows a.
high degree of interest in a particular job, it is no guarantee that he or she has
the ability to be successlul in that job. What interest test scores show is that the
person's interests are compatible with the interests of successful people in that
career. If a test showsthat a person has no interest in a field, then the chances of
succeeding in it are limited.
Cross-cultural research on nearly 50.000 people showed no significant dif
ferences in vocational interests. African Americans, Mexican Americans, Asian
Americans, Native Americans, and Caucasians expressed highly similar patterns
of likes and dislikes for various types of work (Day & Rounds. 1998)
Two frequently used inierest tests are the Strong Interest Inventory and the
Kuder Occupational Interest Survey.
The Strong is a 317-item. computer-scored group test that covers occupa
tions, school subjects. leisure activities, types of people. and work prelerences.
Items are rated as "like" "dislike," or "indilferent." Scales for more than 100 vo-
cational, technical, and professional occupations are grouped around six themes
on which test-takers are ranked from low interest to high interest. These themes
are: artistic, conventional. social. realistic, investigative, and enterprising. In ad-
dition, many of the test's occupational scales are gender-differentiated: that is,
they have separate male and lemale norms. Research on the Strong has shown
that people's interests tend to remain stable over time.
The Kuder items are arrnged in 100 groups of three alternative activities.
Within each forced-choice trio. applicants select the most preferred and least pre-
ferred activities. The test can be scored for more than 100 occupations. Typical.
groups of items are as follows:
Aptitudes
Aptitude tests Psychological For many jobs, aptitude tests are administered to applicants to measure specific
tests to measure specific abili-
skills. Sometimes these tests must be specially designed for a particular job, but
ties, such as mechanical or
clerical skills. there are also tests available that measure general clerical and mechanical apti.
tudes.
The Minnesota Clerical Test is a l15-minute individual or group test in two
parts: number comparison (matching 200 pairs of numbers) and name comparison
see Figure 4-2). Applicants are instructed to work as fast as possible without mak.
ing errors. The test measures the perceptual speed and accuracy required to per.
form various clerical duties. It is useful for any job tha: requires attention to detail
in industries such as utility companies, financial institutions, and manufacturing,
The Revised Minnesota Paper Form Board Test measures those aspects of
mechanical ability that require the capacity to visualize and manipulate objects
in space, necessary skills for occupations with mechanical or artistic orientation,
such as industrial designer or electrician. Applicants are presented with 64 two-
dimensional diagrams of geometric shapes cut into two or more pieces and are
given 20 minutes to picture how the figures would look as whole geometric
shapes (see Figure 4-3). Research shows that the test successfully predicts perfor-
mance in production jobs, electrical maintenance work, engineering shopwork,
industrial tasks.
power sewing machine operation, and various other
The Bennett Mechanical Comprehension Test uses 68 pictures with ques
tions about the application of physical laws or principles of mechanical operation
instructions are provided for applicants with
(see Figure 4-4). Tape-recorded
limited reading skills. The Bennett is designed for individual or group administra-
tion. t takes 30 minutes to complete. The test is used for jobs in aviation, con-
struction, chemical plants, oil refineries, utilities,. glass manufacturing. steel.
paper and plywood manufacturing, and mining.
The Computer Competence Tests include five individual or group subiests
level of knowledge of
containing multiplé-choice items to assess an applicant's in the workplace. A
basic terminology and.ability to operate computets
computer
FIGURE 4-2. Sample items from Minne WHen the two numbers or names in a pair
sota Clerical Test. (Reproduced by per- are exactly the same, make a check mark
There ate two parte in the upper len-handcomer. Now look at the fve figures labeled
A.C. D,E. You are to decide wnkeh igure shows how these parts cen fit together.
K
FIGURE 4-3. Sample item from
Revised Minnesota Paper Form Board
Test. (Reproduced by permission.
Copyright 1941, renewed 1969, 1970
by The Psychological Corporation, San
Antonio, TX. All rights reserved.)
Motor Skills
Many jobs in industry and the military require abilities involving muscle coordi
nation, finger dexterity, and eye-hand coordination.
B
116 Part Two The Development of Human Resources
The Purdue Pegboard is a performance test that simulates assembly.t
ces.
coordination ne
and eye-hand
dexterity rehabilitation.
fingertip
work, and vocational
measures
conditions and
factory rapidly as possib.
lor assembly tasks,
general
of holes in a pegboard as to 30 seco
ible,
Sary in a series Each task is
limited
is to place 50 pegs both.
s i m u l t a n e o u s use of
task then the other,
then
the both
with one hand, task involving
rst also includes a
1-minute
nis problem is not unique to the MMPI; it applies to any psychological test used
by a large number of employers.
The California Psychological Inventory, developed in 1957 and revised in
87, consists of 462 items
r e s on 17
calling for "irue" or "false" responses. It provides
personality dimensions and has been shown to be useful for predicting
18
Part Two The Development of Human Resources
entists,
Success in teaching and in health care occupations (physicians, dentists.
nurses). The test has scales to identify leadership and management potential,e
and
Cre
ative potential, and social maturity.
The Big Five Petsonality Factors. Predictive validities for self-report personal.
ty tests are generally in the low to moderate range. However, research usina
Selt-report inventories to assess the so-called Big Five personality factors ha
factors:
shown higher validities. These are the basic personality
. 1. Extraversion,
2. Agreeableness
3. Conscientiousness (or the will to achieve)
4. Neuroicism
5. Openness to experience
that theirlevel extraversion was thé best single predictor of whether they re-
of in Europe of
ceived a job offer(Caldwell & Burger, 1998). A study conducted
extraversion and conscien-
401 college graduates found that their test scores on
and those who had
tiousness distinguished between those who had found jobs
The people who had scored high in
not, when surveyed a year after graduation.
extraversion and conscientiousness were the ones most likely to be employed
their job performance (Barrick, Mount, & Surauss, 1993). A study of 130 resort
hotel employees found that conscientiousness correlated significantly with self
direction-that is, the performance of desirable on-the-job behaviors undertaken
at the worker's own initiative (Stewart, Carson, & Cardy, 1996). A meta-analysis
of 36 studies of workers conducted in several countries in Europe showed con-
cdentiousness to be a valid predictor of job performance in professional, police,
sc
managerial, sa les, and skilled labor jobs (Salgado, 1997).
Other studies have found that conscientiousness is a highly valid predictor
of successful performance for U.S. employees working for multinational corpora-
tions in other countries, whether they are newly hired or long-term employees
(Caligiuri, 2000; Stewart, 1999). În research showing a negative correlation, low
Scores on conscientiousness were found to be a valid predictor of dysfunctional
behaviors such as alcoholism, substance abuse, and reckless driving. People scor-
ing high in conscientiousness were much less likely to exhibit these behaviors
than were people scoring low (Sarchione, Cuttler, Muchinsky. & Nelson-Gray,
1998). In view of these and many other similar studies, it is clear that conscien-
tiousness is a desirable characteristic for employees to show and for employers to
seek in job applicants.
Studies of managers who make hiring decisions confirm that conscientious-
ness (along with general mental ability) is the most important attribute related to
suitability for hiring (Dunn, Mount, Barrick, & Ones, 1995). Other research
found that ratings of conscientiousness and extraversion made by supervisors,
co-workers, and customers of 105 salespeople were valid predictors of job perfor
mance (Mount, Barrick, & Strauss, 1994). Thus, whether coñscientiousness and
extraversion are assessed by self-report inventory or by ratings given by otheTs
both correlate positively with high job performance.
Inventories have been developed to measure other specific personality char-
acteristics, such as introversion. self-esteem, sociability, emotional maturity, and
proactivity. Proactivity refers to a tendency to take action to try to influence or
change one's environment. The Proactive Personality Scale consists of 17 items
to which respondents indicate the extent of their agreement or disagreement. A
sample item is: "Nomatterwhat the odds, ifI believe in something I wil makeit
happen." People who express a high degree of agreement with a statement such
as that should perform well in certain jobs,
particularlythose in sales.
A study of real-estate agents found a high positive correlation between high
scores on the Proactive Personality Scale and objective measures of job perfor-
mance such as commission income, number of homes sold, and number of new
in va-
listings obtained (Crant,
1995). on nearly
Research 500 people employed a
riety of jobs found that proactivity correlated positively with salary. promotions,
and job satisfaction (Seibert, Crnt, & Kraimer, 1999)
Rejection of
coefficients for tests reach a perfect posiive correio
perfectly valid. No validity some margin for error in the prediction ofjoD Su
There is always
tion of +1.00. and sometimes other
Sometimesunqualified persons will be hired,
cess. unqualified or ineligibie
will be incorrecuy identified as
qualified applicants of error also applies
to other s the
test performance. (This type
the basis of their reduced when tests w
These false-positive errors can be
tion techniques.) selection
for the program. be
validities are chosen
highest predictive selection program should
errors, an employee
To minimize these allows for the col
technique. The use of several techniques
based o n a single
evaluationof much more information about a n applicant.
lation and
Faking. We mentioned
lection must be sensiti earlier that Chapter 4
sitive to the organizatio using1 tests Psychological Testlng
aie need of a job and
ate apply for a sales possibility of 121
the following questions: position.faking. employee
You areSuppose you nployee
in
se-
se-
a given test that desper-
I enjoy meeting new people. includes
I get along well with most Yes
1 find it easy to talk to people. Yes No
people. No
Yes No
You can easily
Swer. Unles thes
anticip
the way the
ese
characteristics
videthe company with a company expects
apply to you,
ll not be successful or lalse impression. You however, yoursalespersons
answers
to an-
do' not possess. In thesatisfied with the job may be hired, but you pro will
dicadvantage, but it is hard tolongconvince because probably
run,
then, faking test it requires abilities that
some responses avid job works
Fchical Issues. The seekers of this in to yoúr
ethical practices of all American advance.
Psychological Association is
psychologists,
demic laboratory research whether engaged in concerned about the
Droper conduct state that and teaching, or in employee clinical practice, in aca
iare of the persons with psychologists must protect the selection. Principles for
whom they deal. dignity,
violated in applying
code psychological
describes safeguards for tests to Unfortunately, this idealworth,
is
and wel-
sometimes
employee
. Test users.
the
distribution and use ofselection. The APA ethics
psychiological tests.
Persons who
be aware of the administer and interpret
and the principles
limitations
of
psychological psychological tests should
of test measurement and validation
should consider more
to
interpretation.
than one means of They must avoid bias and
standardized test
achieve accuracy
assessment. They must
administratiðn procedures and make adhere
in
2. Test recording and scoring test.results.
security. Actual test
every effort to
medium such questions
should never be
newspaper or magazine: It is reprinted into a public
as
sample questions (similar
a
permissible
but not items used in publish
to real
tual scoring of a test. questions) the ac-
Tests should be sold [The examples in this chapter are sample
only to questions.]
3. Test
interpretation: Test scores professionals who will
should be given safeguard their use.
terpret them. They should to
qualified to in only those
not be given to
SOurces human re- anyone outside the
the
department, such as the applicant's potential
supervisor has been trained to supervisor, unless
tested has the the interpret scores. The
4. Test know the test score and what it means.person being
right to
publication. Tésts should not be
released for u_e without adequate
background research to support the test
and current test manuals
developers' claims. Inlormative
data containing reliability. validity, and normative
should be made available.
curately, without emotional or Advertisements should describe tests ac-
persusive appeals.
wacy Issues. One aspect of psychological testing that has
under attack
ne use of questions about personal or intimate issues. Criticscome
onal probing is an unnecessary invasion of privacy. charge that such
dted when Individual freedom is vi-
organizations request or require information that cannot be shown
122 Part Two The Development of Human Resources
Personality Test
Store Sued Over
at Target Stores
for a job as a security guard
When Sibi Soroka'ap]lied about his religioue
he would be asked
in Califomía, he didnt know
didn't like it when
he
was. As parn of the
beliefs or his sex life. And he a person.
process, he had to take Psychscreen,
employment screening which contains items from two wel-known
ality test used by Target,Minnesota Multiphasic Personality Inventorv
psychological tests, the
Inventory.
and the California Psychological been invaded when hewas asked
had
Sorokà felt that his privacy afterlife. He was also
devil and a hell in'an
if he believed thère was a
of his own sex
attracted to members
asked whether he was strongly were entirely
sex. Questions like these
dreamed a lot about or ser.
or if he besides, what did
his religlous belieís
too personál, he said, and Soroka sued Tar.
to do with being a security
guard?
ual behavior have
right to privacy.
get for violatinghisdenied to prohibit fur.
Soroka's inotion for an injunction
The traljudgé Target Stores and
rüled that Psychscreen
ther üse.of the petsonality test by applicants. Soroka ap.
unreasonable device for screernirig job
was not an California Court of Appeals,
which ruled in his lavor.
case to the
pealed his about religion and sex, wrote the judges in
a 39.
w
is applying. re
performance of the job for which the person
to be related to
the background, trau
the right of an organization to investigate
people question applicants. But personal
questions adout
of job
court