Professional Documents
Culture Documents
Chap 05 - References & Testing
Chap 05 - References & Testing
References and
Testing
© 2013 Cengage Learning
Criminal Records
• Obtained from local and state agencies
• Check with each jurisdiction
• Only convictions can be used (EEOC Decision No. 72-
1460)
– “Reasonable amount of time” between release and
decision to hire
– In using convictions, employer must consider
• Nature and gravity of offense
• Amount of time that has passed since the conviction and/or
completion of the sentence
• The nature of the job held or being sought
© 2013 Cengage Learning
Credit Checks
• Purpose
– Predict motivation to steal
– Determine character of applicant
• Fair Credit Reporting Act
– Order through a Consumer Reporting Agency (CRA)
– Provide written notice to applicant to you will be checking credit
– Get applicant’s written authorization to check credit
– If adverse action is to be taken
• Provide applicant with “Pre-adverse Action Disclosure” which includes
copy of credit report
• Inform applicant that they will not be hired due to credit check and
provide name of CRA and notice of applicant rights to appeal within 60
days
http://www.youtube.com/watch?v=512GkwoZEFs
© 2013 Cengage Learning
Remembered
Processed %
Observed
Behavior
0 20 40 60 80 100 120
© 2013 Cengage Learning
• Invasion of privacy
• Negligent reference
• Defamation
© 2013 Cengage Learning
Defamation
• Three types
– libel (written)
– slander (oral)
– self-publication
• Employers have a conditional privilege that
limits their liability
© 2013 Cengage Learning
Ratings of Training
• Education
• Work-Related Training
• Military
© 2013 Cengage Learning
Does Education
Predict
Performance?
© 2013 Cengage Learning
Summary of Meta-Analyses
Meta-analysis Occupation K N ρ
Validity of GPA
• GPA is a valid predictor of performance on the
job, training performance, starting salary,
promotions, and grad school performance
• GPA is most predictive in the first few years after
graduation (Roth et al., 1996)
• GPA will result in high levels (d=.78) of adverse
impact (Roth & Bobko, 2000)
• People with high GPAs
– Are intelligent (r = .50; Jensen, 1980)
– Are conscientious (r = .34; Bevier et al., 1998)
© 2013 Cengage Learning
Validity of GPA
Meta-Analysis Results
r ρ
Work-Related Criteria
Job performance (Roth et al., 1996) .16 .36
Training performance (Dye & Reck, 1989) .29
Promotions (Cohen, 1984) .16
Salary (Roth & Clarke, 1996)
Starting salary .13 .20
Current salary .18 .28
Graduate School Performance (Kuncel et al., 2001)
Grades .28 .30
Faculty ratings .25 .35
© 2013 Cengage Learning
Lingering Questions
• Is the validity of education job specific?
• What is the actual incremental validity of
education over cognitive ability?
• Why would education predict performance?
– Knowledge
– Liberal arts skills
– Mental ability
– Motivation
© 2013 Cengage Learning
Physical Ability
• Used for jobs with high physical demands
• Three Issues
– Job relatedness
– Passing scores
– When the ability must be present
• Two common ways to measure
– Simulations
– Physical agility tests
http://www.youtube.com/watch?v=9BfqWGWzrfI
© 2013 Cengage Learning
Physical Ability
Physical Abilities (Fleishman & Reilly, 1992)
– Dynamic strength (strength requiring repetitions)
– Trunk strength (stooping or bending over)
– Explosive strength (jumping or throwing)
– Static strength
– Dynamic flexibility (speed of bending or stretching)
– Extent flexibility (Degree of bending or stretching)
– Gross body equilibrium (balance)
– Gross body coordination (coordination)
– Stamina
© 2013 Cengage Learning
Work Samples
• Applicants perform tasks that replicate actual
job tasks
• Advantages
– Directly related to the job
– Good criterion validity
• Verbal work samples (ρ = .48)
• Motor work samples (ρ = .43)
– Good face validity
– Less adverse impact than cognitive ability
– Provide realistic job previews
• Disadvantages
– Can be expensive to develop and maintain
© 2013 Cengage Learning
Assessment Centers
What are They?
• A selection technique that uses multiple job-related
assessment exercises and multiple assessors to
observe and record behaviors of candidates
performing job-related tasks
© 2013 Cengage Learning
Experience Ratings
• Past behavior predicts future behavior
– Experience is a valid predictor of future
performance (ρ = .27; Quinones et al.,
1995)
• Types of Experience
– Work
– Life
© 2013 Cengage Learning
Experience
• Evaluated through:
– Application blanks
– Resumes
– Interviews
– Reference checks
– Biodata instruments
© 2013 Cengage Learning
Experience
• Considerations
– How much experience?
– How well did the person perform?
– How related is it to the current job?
© 2013 Cengage Learning
Sullivan (2000)
1) Reduce or eliminate the number of years required in your
ads and replace them with “the demonstrated ability to
solve problems with our required level of difficulty.
2) Use simulations and actual problems to assess applicants.
3) Develop “future-oriented” questions for applicants.
4) Train evaluators and compensation professionals to put
less weight on experience of candidates.
5) Revise job descriptions to include level of difficulty.
6) Identify the amount and type of experience and
competencies that would predict job performance.
7) Check to see if there is a correlation between the number
of years of experience an employee has and their success
in your firm.
© 2013 Cengage Learning
Biodata
A selection method that considers an
applicant’s life, school, military,
community, and work experience
© 2013 Cengage Learning
Biodata Standards
Gandy & Dye, 1989; Mael, 1991
Good Biodata Items Bad Biodata Items
Historical Future or Hypothetical
How old were you when you got What position do you think you will
your first paying job? be holding in 10 years?
External Internal
Did you ever get fired from a job? What is your attitude toward friends
who smoke marijuana?
Objective Subjective
How many hours did you study for Would you describe yourself as
your bar exam? shy?
First-hand Second-hand
How punctual are you about coming How would your teachers describe
to work? your punctuality?
© 2013 Cengage Learning
Biodata Scoring
Variable Long Short Differences Unit Weight
Tenure (%) Tenure (%) in %
Education
Bachelor’s 59 15 +44 +1
Masters 1 5 -4 0
© 2013 Cengage Learning
Strengths of Biodata
Weaknesses of Biodata
Validity Issues
• Shrinkage?
• Good validity but not sure why
• Validity seems to drop when items based
rationally (job analysis) rather than
empirically
© 2013 Cengage Learning
© 2013 Cengage Learning
Personality Inventories
Personality is a collection of traits that
persist across time and situations and
differentiate one person from another
© 2013 Cengage Learning
Differences in Personality
Inventories
• Types of Personality Inventories
– Measures of normal personality
– Measures of psychopathology
• Basis for Personality Dimensions
– Theory based
– Statistically based
– Empirically based
• Scoring
– Objective
– Projective
© 2013 Cengage Learning
Validity of Personality
Meta-Analysis
Comparison of Meta-Analyses
Conscientiousness
Hurtz & Donovan Barrick & Mount Tett et al. (1991)
(2003) (1991)
Types of studies Only those Any test that could Only studies in
included in meta- developed to tap be assigned to a Big which a Big 5
analysis Big 5 5 dimension dimension was
hypothesized to be
related to
performance
k 42 123 7
n 7,342 19,721 450
Observed validity .15 .13 .12
© 2013 Cengage Learning
Evaluation of Personality
Strengths
– Relatively cheap
– Easy to administer
– Little adverse impact
– Predicts best when based on a
job analysis
Weaknesses
– Scale development
– Validity
– Faking
© 2013 Cengage Learning
Interest Inventories
• Tap an applicant’s interest in particular
types of work or careers
• Poor predictors of job performance (ρ = .13)
• Better predictors of job satisfaction
© 2013 Cengage Learning
Integrity Tests
• Estimate the probability that applicants
will steal money or merchandise
• Used mostly in retail, but gaining
acceptance for other occupations
© 2013 Cengage Learning
Electronic Testing
• Polygraph testing
Polygraph Testing
• Polygraph (lie detector) is a machine that
measures the physiological responses that
accompany the verbal responses an individual
makes to a direct questions asked by
polygraph operator.
© 2013 Cengage Learning
Personality-Based Integrity
Measures
Employee theft is just one element in a
larger syndrome of antisocial behavior of
organizational delinquency. Therefore,
overt integrity tests overlook a number of
other counterproductive behaviors that are
costly to the organization
© 2013 Cengage Learning
Graphology
• Concept
– A person’s handwriting is a reflection on his or her personality and
character
• Use
– 6,000 U.S. organizations
– 75% of organizations in France
– 8% of organizations in the United Kingdom
• Evaluation
– Few studies
– Validity depends on the writing sample (Simner & Goffin, 2003)
• Autobiographical (r = .16, p = .22)
• Non-autobiographical (r = .09, p = .12)
© 2013 Cengage Learning
© 2013 Cengage Learning
Drug Testing
• Use
– In 2001, 80% of U.S. organizations tested for drugs
– In 2003, 4.6% of applicants tested positive for drugs
– In 2007, 8.2% of employees admitted to using drugs in
the past month
• Drug users are more likely to
– Miss work
– Use health care benefits
– Be fired
– Have an accident
© 2013 Cengage Learning
Drug Testing
Forms of Testing
– Pre-employment testing
– Random selection at predetermined times
– Random selection at random times
– Testing after an accident or disciplinary action
Responses to the Presence of Drugs
– 98% of job offers withdrawn
– Current employees who test positive
• 25% are fired after a positive test
• 66% are referred to counseling and treatment
© 2013 Cengage Learning
http://www.youtube.com/watch?v=aVLDkXj4K2A
© 2013 Cengage Learning
Adverse Impact
Technique White- White- Meta-analysis
Black Hispanic
Cognitive ability 1.10 .72 Roth et al. (2001)
GPA .78 Roth & Bobko (2000)
Work sample .73 Roth et al. (2008)
Assessment centers .52 .28 Dean et al. (2008)
Job knowledge .48 .47 Roth et al. (2003)
Situational judgment .38 .24 Whetzel et al. (2008)
Biodata .33 Bobko et al. (1999)
Structured interview .23 Huffcutt & Roth (1998)
Recommendations .22 Aamodt (2002)
Personality .09 Schmitt et al. (1996)
References .08 Aamodt & Williams (2005)
Integrity tests .07 -.05 Ones & Viswesvaran (1998)
© 2013 Cengage Learning
Focus on Ethics
Using Personality Inventories
• In your class, your professor will probably ask you to take
the Employee Personality Inventory in your workbook.
After you do, consider whether or not you want your job
performance to be judged based on the results of such a
test. Would you say that this test would fairly predict your
ability to perform in certain jobs?
• Does it accurately portray how you would fit into an
organization’s culture or how you would get along with
others? If it doesn’t accurately portray you, would you then
say such a test is
• unethical?
• Should the tests be better regulated? Are companies right
in using them in their selection process?
© 2013 Cengage Learning
Focus on Ethics
Using Personality Inventories
• Do you see any other ethical concerns
related to using personality inventories?
• Is there a fairer and more ethical way for
companies to determine if applicants will fit
into the organizational culture and get along
with others?