Professional Documents
Culture Documents
Multiple Choice
1. Which one of the following would be most likely to establish that a test is grounded in
psychological theory?
A. the correlation between test score and external criteria
B. the correlation between the test scores of the same people at two different points in
time
C. a high coefficient alpha from a test of internal consistency
D. evidence of validity based on the test’s relationship with other constructs
Ans: D
Learning Objective: 8-1: Discuss the concept of a construct, and give examples of
theoretical constructs.
Cognitive Domain: Comprehension
Answer Location: Chapter Introductory Section
Difficulty Level: Medium
3. What did theorists challenge about using validity evidence based on test content
and/or validity evidence based on relationships with criteria to establish test validity?
A. They challenged the use of validity based on content because it was not based on
statistical analysis.
B. They challenged validity based on relationships with criteria because it did not
require reliable tests.
C. They challenged both because the test was not directly being linked to an accepted
theory of psychological behavior.
Miller, Foundations of Psychological Testing, 6e
SAGE Publishing, 2020
D. They challenged both because they did not rely on accepted ethical standards for
testing.
Ans: C
Learning Objective: 8-1: Discuss the concept of a construct, and give examples of
theoretical constructs.
Cognitive Domain: Knowledge
Answer Location: What Is a Construct?
Difficulty Level: Medium
6. Which one of the following evidences for validity the textbook suggests is most
associated with the traditional notion of construct validity?
A. evidence based on test content
B. evidence based on internal structure
C. evidence based on relations with other variables
D. evidence based on response processes
Ans: B
Learning Objective: 8-2: Explain how the 2014 Standards for Educational and
Psychological Testing treatment of constructs in testing differs from the more traditional
usage of the term construct validity.
Miller, Foundations of Psychological Testing, 6e
SAGE Publishing, 2020
7. When test users accept evidence of construct validity, they must also accept what?
A. underlying definition of the construct used in the validation process
B. evidence of validity for other tests of similar constructs
C. test as valid for all uses
D. validity of test takers' scores on the test
Ans: A
Learning Objective: 8-1: Discuss the concept of a construct, and give examples of
theoretical constructs.
Cognitive Domain: Comprehension
Answer Location: Construct Explication
Difficulty Level: Medium
Learning Objective: 8-3: Explain and give examples of the three steps of construct
explication.
Cognitive Domain: Knowledge
Answer Location: Construct Explication
Difficulty Level: Medium
11. We can divide the process of establishing evidence of construct validity into two
parts which include ______.
A. collecting data and analyzing the data
B. gathering theoretical evidence and gathering psychometric evidence
C. interviewing study participants and testing those participants
D. proposing a hypothesis and proving that
Ans: B
Learning Objective: 8-4: Explain the process of establishing evidence of validity based
on a test’s relationship with other constructs.
Cognitive Domain: Knowledge
Answer Location: Gathering Evidence of Construct Validity
Difficulty Level: Medium
12. When the scores on a test correlate strongly with scores on other tests that measure
the same construct, we say the test has ______.
A. evidence of validity based on content
B. evidence of validity based on relations with external criteria
C. convergent evidence of validity
D. discriminant evidence of validity
Ans: C
Learning Objective: 8-4: Explain the process of establishing evidence of validity based
on a test’s relationship with other constructs.
Cognitive Domain: Comprehension
Answer Location: Convergent Evidence of Validity
Difficulty Level: Medium
13. If test scores correlate with measures of constructs that an underlying theory says
are related, then we say the test has ______.
A. convergent evidence of validity
B. discriminant evidence of validity
C. evidence of validity based on content
D. concurrent evidence of validity
Ans: A
Learning Objective: 8-4: Explain the process of establishing evidence of validity based
on a test’s relationship with other constructs.
Cognitive Domain: Comprehension
Answer Location: Convergent Evidence of Validity
Difficulty Level: Medium
14. When test scores do not correlate with unrelated constructs, there is ______.
Miller, Foundations of Psychological Testing, 6e
SAGE Publishing, 2020
15. If the correlation between social studies test scores and statistics test scores is zero
(or not statistically significant), then the social studies test has demonstrated ______.
A. convergent evidence of validity
B. concurrent evidence of validity
C. discriminant evidence of validity
D. evidence of face validity
Ans: C
Learning Objective: 8-4: Explain the process of establishing evidence of validity based
on a test’s relationship with other constructs.
Cognitive Domain: Comprehension
Answer Location: Discriminant Evidence of Validity
Difficulty Level: Medium
16. In 1959, Campbell and Fiske designed a method for collecting evidence of reliability,
convergent validity, and discriminant validity in one study. They called it the ______.
A. exploratory method of factor analysis
B. confirmatory method of factor analysis
C. discriminatory method
D. multitrait–multimethod design
Ans: D
Learning Objective: 8-5: Explain how Campbell and Fiske’s (1959) multitrait–
multimethod matrix provides evidence of validity based on a test’s relationship with
other constructs.
Cognitive Domain: Knowledge
Answer Location: Multitrait–Multimethod Design
Difficulty Level: Medium
17. When a researcher chooses three constructs that are unrelated in theory and three
types of tests such as objective, projective, and a peer rating to measure each of the
constructs, she is conducting a ______.
A. multitrait–multimethod design
B. content validation study
C. generalizability study
D. factor analysis
Ans: A
Miller, Foundations of Psychological Testing, 6e
SAGE Publishing, 2020
Learning Objective: 8-5: Explain how Campbell and Fiske’s (1959) multitrait–
multimethod matrix provides evidence of validity based on a test’s relationship with
other constructs.
Cognitive Domain: Comprehension
Answer Location: Multitrait–Multimethod Design
Difficulty Level: Medium
19. When an underlying theory explains the relation between a predictor and a criterion
based on a psychological theory, there is ______.
A. concurrent evidence of validity
B. predictive evidence of validity
C. evidence of construct validity
D. convergent evidence of validity
Ans: C
Learning Objective: 8-4: Explain the process of establishing evidence of validity based
on a test’s relationship with other constructs.
Cognitive Domain: Comprehension
Answer Location: Evidence of Validity Based on Relationships With External Criteria
Difficulty Level: Medium
20. When a group of test items all share something in common that accounts for the
high correlations among them, we can say they all share a common ______.
A. cause
B. theory
C. nomological network
D. factor
Ans: D
Learning Objective: 8-6: Discuss the roles of exploratory and confirmatory factor
analysis in establishing validity.
Cognitive Domain: Comprehension
Answer Location: Factor Analysis
Difficulty Level: Medium
Miller, Foundations of Psychological Testing, 6e
SAGE Publishing, 2020
21. When researchers conduct a factor analysis procedure to see whether the factors
they proposed in a test really exist in the test?
A. exploratory factor analysis
B. confirmatory factor analysis
C. discriminant factor analysis
D. construct factor analysis
Ans: B
Learning Objective: 8-6:Discuss the roles of exploratory and confirmatory factor analysis
in establishing validity.
Cognitive Domain: Comprehension
Answer Location: Factor Analysis
Difficulty Level: Medium
22. The statistical procedure that researchers use to identify underlying components
that may exist in test without first proposing a formal model?
A. a goodness-of-fit test
B. construct explication
C. exploratory factor analysis
D. confirmatory factor analysis
Ans: C
Learning Objective: 8-6: Discuss the roles of exploratory and confirmatory factor
analysis in establishing validity.
Cognitive Domain: Comprehension
Answer Location: Exploratory Factor Analysis
Difficulty Level: Medium
23. Evidence of construct validity is provided when convergent validity correlations are
______.
A. higher than discriminant validity correlations
B. lower than discriminant validity correlations
C. the same as are discriminant validity correlations
D. similar as are discriminant validity correlations
Ans: A
Learning Objective: 8-5: Explain how Campbell and Fiske’s (1959) multitrait–
multimethod matrix provides evidence of validity based on a test’s relationship with
other constructs.
Cognitive Domain: Comprehension
Answer Location: Multitrait–Multimethod Design
Difficulty Level: Medium
Ans: C
Learning Objective: 8-1: Discuss the concept of a construct, and give examples of
theoretical constructs.
Cognitive Domain: Knowledge
Answer Location: Evidence of Validity Based on Content
Difficulty Level: Medium
25. Which one of the following provides an observable and measurable behavior for the
theoretical construct of success as an actor?
A. When the actor feels an emotion, the audience feels the same emotion in the same
strength and depth.
B. when the actor believes she has the underlying talent and the ability to express that
talent
C. when the actor experiences high levels of stage fright
D. when the actor brings in revenue at the box office under all conditions
Ans: D
Learning Objective: 8-1: Discuss the concept of a construct, and give examples of
theoretical constructs.
Cognitive Domain: Application
Answer Location: What Is a Construct?
Difficulty Level: Medium
A. .75; monotrait–monomethod
B. .75; heterotrait–monomethod
C. .89; heterotrait–heteromethod
D. .89; montrait–heteromethod
Ans: B
Miller, Foundations of Psychological Testing, 6e
SAGE Publishing, 2020
Learning Objective: 8-5: Explain how Campbell and Fiske’s (1959) multitrait–
multimethod matrix provides evidence of validity based on a test’s relationship with
other constructs.
Cognitive Domain: Application
Answer Location: Multitrait–Multimethod Design
Difficulty Level: Medium
A. .08; heterotrait–heteromethod
B. .08; heterotrait–monomethod
C. .40; heterotrait–monomethod
D. .40; heterotrait–heteromethod
Ans: A
Learning Objective: 8-5: Explain how Campbell and Fiske’s (1959) multitrait–
multimethod matrix provides evidence of validity based on a test’s relationship with
other constructs.
Cognitive Domain: Application
Answer Location: Multitrait–Multimethod Design
Difficulty Level: Medium
28. Which of the following is a statistical procedure whose purpose is to identify the
underlying constructs that contribute to an overall test score?
A. analysis of variance
B. multitrait–multimethod design
C. factor analysis
D. multiple regression
Ans: C
Learning Objective: 8-6: Discuss the roles of exploratory and confirmatory factor
analysis in establishing validity.
Cognitive Domain: Knowledge
Miller, Foundations of Psychological Testing, 6e
SAGE Publishing, 2020
29. Which one of the following does NOT provide evidence of construct validity?
A. standard error of measurement
B. evidence of validity based on relations with external criteria
C. evidence of validity based on content
D. factor analysis
Ans: A
Learning Objective: 8-4: Explain the process of establishing evidence of validity based
on a test’s relationship with other constructs.
Cognitive Domain: Comprehension
Answer Location: Gathering Evidence of Construct Validity
Difficulty Level: Medium
30. When an underlying theory explains the relation between a predictor and a criterion,
there is evidence of ______.
A. construct validity
B. criterion-related validity
C. predictive validity
D. concurrent validity
Ans: A
Learning Objective: 8-4: Explain the process of establishing evidence of validity based
on a test’s relationship with other constructs.
Cognitive Domain: Comprehension
Answer Location: Evidence of Validity Based on Relationships With External Criteria
Difficulty Level: Medium
Ans: D
Learning Objective: 8-6: Discuss the roles of exploratory and confirmatory factor
analysis in establishing validity.
Cognitive Domain: Knowledge
Answer Location: Confirmatory Factor Analysis
Difficulty Level: Medium
33. Which one of the following processes requires researchers to first specify a
hypothesis?
A. multitrait–multimethod study
B. content validity study
C. exploratory factor analysis
D. confirmatory factor analysis
Ans: D
Learning Objective: 8-6: Discuss the roles of exploratory and confirmatory factor
analysis in establishing validity.
Cognitive Domain: Comprehension
Answer Location: Confirmatory Factor Analysis
Difficulty Level: Medium
34. When test scores from a new test correlate with test scores from other tests that
measure related constructs, they provide ______.
A. concurrent evidence of validity
B. convergent evidence of validity
C. evidence of validity based on test content
D. predictive evidence of validity
Ans: B
Learning Objective: 8-4: Explain the process of establishing evidence of validity based
on a test’s relationship with other constructs.
Cognitive Domain: Comprehension
Answer Location: Convergent Evidence of Validity
Difficulty Level: Medium
Essay
Learning Objective: 8-1: Discuss the concept of a construct, and give examples of
theoretical constructs.
Cognitive Domain: Comprehension
Answer Location: Chapter introductory section
Difficulty Level: Medium
Miller, Foundations of Psychological Testing, 6e
SAGE Publishing, 2020
2. Explain and give examples for the three steps of construct explication.
Ans:
• Identify the behaviors that relate to the construct.
• Identify other constructs that may be related to the construct being explained.
• Identify behaviors related to similar constructs and determine whether these behaviors
are related to the original construct.
Learning Objective: 8-3: Explain and give examples of the three steps of construct
explication.
Cognitive Domain: Comprehension
Answer Location: Construct Explication
Difficulty Level: Medium
• The researcher chooses two or more constructs that are unrelated in theory and two or more
types of tests--such as objective, projective, and a peer rating--to measure each of the
constructs.
• A multitrait–multimethod correlation matrix presents all the correlations between a group of
different traits, attributes, or constructs, each measured by two or more different
measurement methods or tests.
Learning Objective: 8-5: Explain how Campbell and Fiske’s (1959) multitrait–
multimethod matrix provides evidence of validity based on a test’s relationship with
other constructs.
Cognitive Domain: Comprehension
Answer Location: Multitrait–Multimethod Design
Difficulty Level: Medium
questions than with their answers to the reading questions. As the test questions group
together, they form factors--underlying dimensions that measure the same trait or
attribute.
• In an exploratory factor analysis, researchers do not propose a formal hypothesis about
the factors that underlie a set of test scores but instead use the procedure broadly to
help identify underlying components.
• In confirmatory factor analysis, the researcher specifies in advance what he believes the
factor structure of his data should look like and then statistically tests how well that
model actually fits the data. The researcher relies on either existing theoretical or
empirical knowledge to design the model that will be tested. As with exploratory factor
analysis, the researcher can specify the number of factors that he expects to be able to
extract from the data. But unlike exploratory factor analysis, he can also specify in
advance a large number of other characteristics he believes will be present in the data,
such as which variables are most strongly associated with each factor and even whether
the factors themselves are correlated.
Learning Objective: 8-6: Discuss the roles of exploratory and confirmatory factor
analysis in establishing validity.
Cognitive Domain: Comprehension
Answer Location: Factor Analysis | Exploratory Factor Analysis | Confirmatory Factor
Analysis
Difficulty Level: Medium
6. Discuss the types of psychometric data that can provide evidence of construct
validity. Define and give an example of each.
Ans:
• Reliability/precision: Evidence of reliability/precision is important; otherwise, the test
scores may correspond to theoretical predictions one time but might not do so again. In
addition, the theory underlying psychological testing suggests that a test cannot have a
stronger correlation with any other variable than it does with itself (which is what
reliability is in practice), and therefore, we can use estimates of reliability/precision to
evaluate the strength of correlations with other variables that are related to the
theoretical construct.
• Convergent evidence of validity: If the test is measuring a particular construct, we expect
the scores on the test to correlate strongly with scores on other tests that measure the
same or similar constructs. This correlation provides us with convergent evidence of
validity.
• Discriminant evidence of validity: Just as we would expect some tests to correlate with
our new tests, there are other tests we would not expect to correlate with our test. When
the test scores do not correlate with unrelated constructs, we can say that the test is
demonstrating discriminant evidence of validity.
• Multitrait–multimethod design: Researchers can combine the need to collect evidence of
reliability/precision, convergent evidence of validity, and discriminant evidence of validity
into one study. The researcher chooses two or more constructs that are unrelated in
theory and two or more types of tests--such as objective, projective, and a peer ratin--to
measure each of the constructs. Data are collected on each participant in the study on
each construct using each method.
• Experimental interventions: Experimental interventions in which the test is used as a
dependent variable make a substantial contribution to the argument for evidence of
construct validity. If the underlying theory predicts that a course of treatment or training
Test Bank for Foundations of Psychological Testing A Practical Approach, 6th Edition, Leslie
Learning Objective: 8-4: Explain the process of establishing evidence of validity based
on a test’s relationship with other constructs.
Cognitive Domain: Comprehension
Answer Location: Gathering Psychometric Evidence
Difficulty Level: Medium
Il faut insister sur cette idée qu’en ne punissant pas les enfants,
on leur évite de mentir. En effet, ils emploient le mensonge comme
un bouclier. Ils se dissimulent derrière lui. C’est un moyen de cacher
la faute et d’éviter le châtiment. Si, lorsqu’ils ont commis une
maladresse, cassé quelque objet, ils savent qu’en l’avouant on ne
les grondera pas, qu’on ne les frappera pas, qu’on leur dira
simplement : « Ce n’est pas bien. Tâche de faire attention », qu’on
leur représentera le prix des choses, le soin qu’il en faut avoir, dans
ce cas-là, ils avoueront, ils ne mentiront pas. Ils auront acquis, pour
l’avenir, le précieux bénéfice de la franchise.
Argent.
Cette formule d’un fort banquier m’a toujours frappé et vaut qu’on
la creuse et la médite : « Si je n’étais pas honnête par nature, je le
serais par intérêt. »
Oui, c’est notre intérêt d’être honnête. C’est l’habileté suprême,
quoi qu’il y paraisse.
Ménage.
Une femme doit connaître à peu près le prix des choses que sa
cuisinière achète. Sans quoi, comment modérer la danse du panier ?
Un excellent entraînement pour l’adolescente, c’est d’accompagner
parfois la domestique aux Halles.
Et puis, il faut pouvoir au besoin mettre la main à la pâte,
connaître des principes et un peu de pratique culinaires. La patronne
qui réprimande sa cuisinière sans rien savoir du métier, manque
autant de prestige et frise autant le ridicule qu’un ingénieur qui
reprend un ouvrier sans pouvoir saisir l’outil et lui montrer comment
s’en servir.
De la parure.