Psychological Assessment
Validity(6)
Source: Cohen & Swerdlik (2018), Kaplan & Saccuzzo (2018)
Validity
- A judgement or estimate of
how well a test measures what
it is supposed to measure.
- Something valid if it sounds
meaningful.
- May diminish as the culture or
times change.
★ No test or measurement
technique is “universally valid”
for all time, for all uses, with all
types of test-taker populations.
Inferences - logical result or
deduction.
Validation - the process of gathering
and evaluating evidence about
validity.
- reference.
Validation Studies - yield insights
regarding a particular population of
test takers as compared to the
norming sample described in a test
manual.
● Local Validation Studies - are
necessary when the test user
plans to alter in some way, the
format, instructions, language,
or content of the test (so it is fit
for the test takers).
Face Validity - a test appears to
measure the person being tested
rather than what the test actually
measures.
- How you encourage test takers
by appearance.
Content Validity - describes a
judgement of how adequately a test
samples behavior representative of
the universe of behavior that the test
was designed to sample.
Test Blueprint - a plan regarding the
types of information to be covered by
the items, the number of items
tapping each area of coverage, the
organization of the items, and so
forth.
Validating Process:
1. Construct
2. Criterion
Categories of Validity:
Criterion-Related Validity - a
judgement of how adequately a test
score can be used to infer an
individual’s most probable standing on
some measure of interest—the
measure of interest being the
criterion.
- Relationship of score obtained.
★ Criterion - standard on which a
judgement or decision may be
made.
- To predict thinking/behavior.
★ Criterion Contamination -
occurs when the criterion
measure includes aspects of
performance that are not part
of the job when the measure is
affected by “construct-
irrelevant” factors that are not
part of the criterion construct.
Concurrent Validity - if the test scores
are obtained at about the same time
as the criterion measures are
obtained.
 Psychological Assessment

Validity(6)
Source: Cohen & Swerdlik (2018), Kaplan & Saccuzzo (2018)

- Extent to which test scores may - Gaano niya mamemeasure

be used to estimate an yung kailangan niya i-measure.
individual’s present standing on ★ Construct - an informed,
a criterion. scientific idea developed or
hypothesized to describe or
Predictive Validity - measures of the explain behavior.
relationship between test scores and a - Ano ang pinaka mababa
criterion measure obtained at a future sa test.
time. ★ Resilience - kapag tumaas grit.
★ Grit - to measure what it claims
★ Base Rate - the extent to which
to measure.
a particular trait, behavior,
★ Method of Constructed Groups -
characteristic, or attribute exist
demonstrate that scores on the
in the population.
test vary in a predictable way
★ Hit Rate - defined as the
as a function of membership in
proportion of people a test
a group.
accurately identifies possessing
- To validate a test.
a particular trait, behavior, etc.
★ Convergent Evidence - if scores
★ Miss Rate - fails to identify
on the test undergoing
having that particular
construct validation tend to
characteristic.
highly correlated with another
★ False Positive - miss; the test
established, validated test that
predicted that they do possess
measures the same construct.
a particular trait but actually
★ Discriminant Evidence - a
not.
validity coefficient showing
★ False Negative - miss; the test
little relationship between test
predicted they do not possess a
scores and/or other variables
particular trait but actually do.
with which scores on the test
★ Validity Coefficient -
being construct-validated
correlation coefficient that
should not be correlated.
provides a measure of the
- Unrelated test.
relationship between test
- There’s assumption.
scores and scores on the
★ Factor analysis - designed to
criterion measure.
identify factors or specific
★ Incremental Validity - the
variables that are typically
degree to which an additional
attributes, characteristics, or
predictor explains something
dimensions on which people
about the criterion measure
may differ.
that is not explained by
- “Loadings”
predictors already use.
★ Explanatory FA - estimating or
Construct Validity - judgement about extracting factors; deciding
the appropriateness of inferences how many factors must be
drawn from test scores regarding retained.
individual standing on variable called ★ Confirmatoy FA - researchers
construct. test the degree to which a
hypothetical model fits the
- Para tumibay, kumuha sa ibang actual data.
study.
 Psychological Assessment

Validity(6)
Source: Cohen & Swerdlik (2018), Kaplan & Saccuzzo (2018)

★ Factor Loading - conveys info

about the extent to which the
factor determine the test score
or scores.

Bias and Fairness

Bias - factor inherent in a test that

systematically prevents accurate,
impartial measurement.

- Prevention during test

development through a
procedure called Estimated
True Score Transformation.

Rating - numerical or verbal

judgement that places a person or an
attribute along a continuum identified
by a scale of numerical or word
descriptors known as Rating Scale.

★ Rating Error - intentional or

unintentional misuse of the
scale.
★ Leniency Error - rater is lenient
in scoring (Generosity Error).
★ Severity Error - rater is strict in
scoring.
★ Central Tendency Error - rater’s
rating would tend to cluster in
the middle of the rating scale.
★ Halo Effect - tendency to give
high score due to failure to
discriminate among
conceptually distinct and
potentially independent aspects
of a ratee’s behavior.

Fairness - the extent to which a test is

used in an impartial, just, and
equitable way.