COMPUTER ADAPTIVE TEST AND ITEM RESPONSE THEORY

WHAT is CAT & IRT

Computerized adaptive testing (CAT) is a method for conducting tests that adapts to the examinee's ability level. Item Response Theory (IRT) is used to implement CAT and calculate ability of examinees.

WHY (Benefits)
Precise scores for test-takers of all ability level Test shortened by 50% Results shown immediately

HOW (The Algorithm)

We assume that we have a large question pool available in which all questions are characterized by 3 parameters: Item discrimination parameter It helps to differentiate between examinees of similar abilities. Difficulty parameter This has a value in the range -3 to +3. Higher the value higher is the difficulty level of the question Guessing parameter This has a value in the range 0 to +1.This denotes the probability of a guess being correct.

ALGORITHM
We assume that the examinee initially has Ability=0. 1. For every unadministered question the Item Information Function (IIF) is calculated and the question with maximum value is selected. The examinees response is recorded. Then the new ability of the examinee is calculated using the previous ability and already answered questions. If stopping criterion is not reached then go back to Step1 to find the next question to be given to examinee.

2. 3. 4.

ISSUES
All the items of the test must be pre-administered. New items must be mixed into the operational items of an exam called "pilot testing. This presents logistical, ethical, and security issues. Review of past items is disallowed.

THANKS