Chapter 7 Item Analysis

In constructing a new test (or shortening or

lengthening an existing one), the final set of
items is usually identified through a process
known as item analysis.
Linda Croker

Both the validity and the reliability of any

test depend ultimately on the characteristics of
its items.

Two Approaches of Item Analysis

Qualitative Analysis
Quantitative Analysis

Qualitative Analysis
includes the consideration of content
validity (content and form of items), as well as
the evaluation of items in terms of effective
item-writing procedures.

 Quantitative Analysis
includes principally the measurement of
item difficulty and item discrimination.

1 Item Difficulty
1. Definition
The item difficulty for item i, pi , is defined
as the proportion of examinees who get that
item correct.

Though the proportion of examinees passing

an item traditionally has been called the item
difficulty, this proportion logically should be
called item easiness, because the proportion
increase as the item becomes easier.

2. Estimation Methods
Method for Dichotomously Scored Item
Method for Polytomously Scored Item
Grouping Method

 Method for Dichotomously Scored

Items

R
P
N

(7.1)

p is the difficulty of a certain item.

R is the number of examinees who get that item
correct.
N is the total number of examinees.