IMPROVIN Check Quality of Assessment

G Scores-Based, Accurate & Fair

CLASSRO
Effective Assessment

M-BASED
ASSESSME
Presenter: Cristel Sibug
01 Identify terms related to improving classroom-based
assessment test.

Analyze basic concepts, procedures and techniques for

02 judgemental item improvement and empirically based
procedures

03 Compute for difficulty index, Discrimination Index,

Distracter Analysis and Sensitivity to Instruction accurately
1. A 60 item exam with
45 items multiple choice
and 15pts essay (100
words). It will be given
for 40 minutes.
2. Who is the founder of the katipunan or KKK?
A. Andres bonifacio
b. Regine Velasquez
c. Manny Pacquiao
d. Xavier Gumabon
3. Identification type test given to Grade 3 pupils.
 1. A 40 items exam and 10pts essay (75 words) given at 60 minutes of the class.

2. Who is the founder of the katipunan or KKK?

a. Andres Bonifacio
b. Emilio Aguinaldo
c. Emilio Jacinto
d. Apolinario Mabini

3. Activities using simple instruction/method of assessment such as multiple choice or

matching type.
LEARNING OUTCOMES

IMPORTANCE?

To acquire procedures for improving a

classroom-based assessment test.

To provide practical and necessary ways for improving

teacher-developed assessment tools.
Judgmental Item-Improvement

makes use of human

knowledge in
reviewing the items.
 Who can be the judge?
TEACHER

● Own Review

PEER/
COLLEGIAL
● Open review
together
STUDENTS

● Item-improvement
questionnaire for
students
 CRITERIA FOR JUDGING ASSESSMENT
Adherence to item- specific Accuracy of
guidelines and general content
- Changes may occur
item-writing
commandments.
- Check how good the items
Absence of
content gaps
- Is it valid?

Contribution to score- Fairness

based inference - Due to
disadvantages
- Can the scores: Reveal? Infer?
Does it not make any difference?
Item-Improvement Questionnaire for Students
IS YOUR EXAM VALID?

• If any of the items seemed confusing?

• Did any items have more than one correct

answer?

• Did any items have no correct answers?

• Were there words in any items that

confused you?

• Were the directions for the test, or for

particular subsections, unclear?
 EMPIRICALLY BASED PROCEDURES

Distracter
Difficulty Index Analysis

- improving the quality of an item

using students’ responses to the
test.

Discrimination Sensitivity to Instruction

Index Index
 DIFFICULTY INDEX

An Item’s difficulty index is obtained by calculating the p value

(p) which is the proportion of students answering the item
correctly.

P=R/T

P is the difficulty index

R = Total Number of students answering the item right

T = Total number of students answering the item
 DIFFICULTY INDEX

The range is from 0% to 100% or more typically written as a

proportion as 0.0 to 1.00 (p-value), the higher the value the
difficult the item.

If P value is above 0.85 , the item is very easy and

should not be reused again.

If P value is below 0.20, the item is very difficult and

should be reviewed for possible issues
 Let’s do some exercise

ITEM 1:

There were 45 students

in the class who
ITEM DIFFICULTY (P)
responded to the item 1
and 30 answered it
# of people who answered correctly (R)
correctly
______________________________________
=
# of people who answered (T) ITEM 2:

In the same class, only

10 responded correctly
in item 2.
 Let’s do some exercise

ITEM 1: ITEM 2:

There were 45 students In the same class, only

in the class who 10 responded correctly
responded to the item 1 in item 2.
and 30 answered it
correctly
P= 10/45
= 0.22
P= 30/45
= 0.67 P= 0.22

P=0.67
 DISCRIMINATION INDEX

It determines how well the question can tell the difference

between high and low performers.
-

D = The item discrimination index

Ru = No. of upper group getting the item correct
Tu = Number of upper group

R1 = No. of the lower group getting the item correct

T1 = No. of lower group
 Range from -1.0 to 1.00
anythi ng lower than 0 should be rewritten or di scarded.

Negati ve disc rimination: -1.0 and 0

An Inde x of di sc rimination ar ound .20 is a bottom thr es hold.

An I ndex of disc rimination around .40 are gre at disc riminators .

An Inde x of di sc rimination at 1 i s a pe rfe ctly dis cr iminating.
 Let’s do some exercise

DISCRIMINATION INDEX (D)

DISCRIMINAT GROU
ION INDEX
- (D) P A B C D
1
UPPER 2 10 5 3
---
LOWER 2 0 12 6
D = The item discrimination index
Ru = No. of upper group getting the item correct
2
Tu = Number of upper group --- UPPER 2 4 10 4

LOWER 5 14 1 0
R1 = No. of the lower group getting the item correct
T1 = No. of lower group
 DISTRACTER ANALYSIS

- evaluating the effectiveness of our distractors.

- using techniques that is similar to ITEM DIFFICULTY
and ITEM DISCRIMINATION.
 Let’s do some
exercise P
ITEM 1:
-

Hg-Lg
ITEM DIFFICULT DISCRIMIN GROUP _________
Y INDEX ATION 20
N=40 (p) INDEX (D) A B C D

UPPER 2 10 5 3
1 --- ---
LOWER 2 0 12 6

2 --- --- UPPER 2 4 10 4

LOWER 5 14 1 0
 Answer P
ITEM 1:
D

Hg-Lg
ITEM DIFFICULT DISCRIMIN GROUP _________
Y INDEX ATION 20
N=40 (P) INDEX (D) A B C D Distracter A.
a. 0
UPPER 2 10 5 3 b. 0.5
1 0.42 --0.35 c. -0.35
LOWER 2 0 12 6 d. -0.15

a. -0.15
2 0.45 --0.50 UPPER 2 4 10 4 b. -0.5
c. 0.45
LOWER 5 14 1 0 d. 0.2
 SENSITIVITY TO INSTRUCTION INDEX

- To gauge if mastery learning has been attained, after a

designated or prescribed instructional period.
- It signifies a change in student’s performance as a result of a
instruction.
ideal item value is 1.00
S effective items fall between 0.00 and 1.00

RA is the number of pupils who got the item right after

instruction
RB is the number of students who got the item right before
instruction
T is the total of pupils who tried the item both times
 SENSITIVITY TO INSTRUCTION INDEX

The higher the positive value, the more sensitive the item is to
instructional effects.

Items with zero and negative values do not reflect the intended
effects of instruction.
01 Identify terms related to improving classroom-based
assessment test?

Analyze basic concepts, procedures and techniques for

02 judgemental item improvement and empirically based
procedures

03 Compute for difficulty index, Discrimination Index,

Distracter Analysis and Sensitivity to Instruction accurately