INDEX

CHAPTER#2 AND HOFSTEE

AND BEUK METHOD
Sr. Slide.
No. PARTICULARS No.

2.1 Purpose 2

2.2 Choosing a Standard Setting Method 4

2.3 Performance Level Labels and Description 6

2.4 Key Conceptualization 8

3.8 The Hofstee and Beuk Method 9 – 16

1
2.1.Purpose
 Choose Proper Use of Test: This can result in wiser decisions
about individual and programs than would be the case without
their use. This can also provide a route to broader and more
equitable access to education and employment.
 The purpose of a test derives
a) What a test look like
b) The conditions of administration
c) The kind of information reported to which
audiences
d) What sources of validity evidence must be gathered
e) The development and articulation of a test
 Helps in setting cut-scores

 Can take categorical decisions 2

2.1.Purpose
1. Primacy of purpose requires
₋The Role
₋ Timing
₋ Method of Standard Setting

These are best considered early enough to align with identified

purpose of test, the selected item or format and when there is
ample opportunity to identify relevant sources of evidence
bearing on validity of the categorical assignments and to gather
and analyze the evidence.

3
2.2. CHOOSING A STANDARD SETTING
METHOD
“There can be no single method for determining cut scores for all tests
or for all purposes, nor can there be any single set of procedures for
establishing their defensibility.”
Standard for Educational and Psychological Testing (1999, p.53)
1. The methodological choices for establishing performance
standards should be related to the purpose of the test.
2. The choice of method should related to the level of complexity
of the knowledge, skills and abilities assessed by the test.

3. One related to the complexity of the constructs and products to

be judged, is that of test format.
4
2.2. CHOOSING A STANDARD SETTING
METHOD
4. The number of performance categories (i.e., cut scores) that are
required. (For some test only a single cut score is required for the creation
of two categories e.g., Pass/Fail… However other testing programs require
that multiple cut scores be derived to create three or more categories.)
5. Admittedly, an extremely practical one-involves the extent of resources
available for standard setting.
6. A question often arises on using multiple methods. On balance, the use
and analysis of multiple methods is a policy decision and related on
standard setting as an aim in itself.
5
2.3.PERFORMANCE LEVEL LABELS & DESCRIPTION
Sample Performance Level Labels (PLLs) from K-12 Achievement
Testing Programs
No. LABELS SOURCE
National Assessment of Educational
1. Basic, Proficient, Advanced
Progress (NAEP)
Starting Out, Progressing, Nearing TerraNova, Second Edition
2.
Proficiency, Proficient, Advanced (CTB/McGraw-Hill)
Limited, Basics, Proficient,
3. State of Ohio Achievement Tests
Accelerated, Advanced
Far Below Basic, Below Basic, State of California, California Standards
4.
Basic, Proficient, Advanced Tests
Did Not Meet Standard, Meet State of Texas, Texas Assessment of
5.
Standard, Commended Performance Knowledge and Skills
Pre-functional, Beginner, Immediate, English Language Development
6.
Advanced, Fully English Proficient Assessment (Council of Chief State School Officers)
Partially Proficient, Proficient, State of New Jersey, High School
7.
Advanced Proficient Proficiency Assessment
6
 NEAP Performance Level Description
for Grade 4 Reading Tests
No. Performance Performance Level Description
Level Label

1. Advanced They should be able to generalize about topics in the reading

selection and demonstrate an awareness of how authors compose
and use literary devices. They will able to judge the texts
critically and give thorough answer that indicate careful thought.

2. Proficient They should able to demonstrate an overall understanding of the

text, providing inferential as well as literal information. They will
able to extend the ideas in the text by making inferences, drawing
conclusion and make connection to their own experiences.

3 Basic They should be able to demonstrate an understanding of the

overall meaning of what they read. They will able to make
relatively obvious connections between text and the ideas in the
text by making simple inferences.
7
2.4. Key Conceptualization
• Standard setting is the necessity of participants in a procedure
to form conceptualizations that will guide their judgements.
Theses conceptualization become key referents that participants
revisit frequently during the standard-setting process.
• These are also helpful in terms of interpreting the meaning of
resulting cut-scores.

8
 Standard setting Methods

• HOFSTEE AND BUKE

• Dr. Muhammad Iqbal

9
 Hofstee Method
• Hofstee method is that in which judges decide on the
minimum and maximum failure rate and acceptable pass park.

• One method of adjusting the cut-scores based on raters

impressions of difficulty of the test and possible pass rates is
the Hofstee method ( Mills & Milican. 1987; Cizek, 2006;
Burr et al, 2016).

10
 Continue….
• The method requires the raters to estimate four values:

1. The minimum acceptable failure rate

2. The maximum acceptable failure rate
3. The minimum cut-scores, even if all examinees failed
4. The maximum cut-scores, even if all examinees failed

11
 Procedure for implementing
the Hofstee Method
• This task requires each standard-setting participant to respond
to 4 questions and to assume that examines are first time test
takers.
• The four questions asked participants about following;
1. What is the highest percent correct cut score that would be
acceptable?
________ symbolizes as kmax (1)

2. What is the lowest percent correct cut score that would be

acceptable?
_________ symbolizes as kmin (2)

12
 Continue…
3. What is the maximum acceptable failure rate?
________ symbolizes as fmax (3)

4. What is the minimum acceptable failure rate?

________ symbolizes as fmin (3)

13
14
 Beuk Method
• The Beuk method rests in two assumptions: one about the
participants in the standard-setting process and one about the
process should be configured.

• According to Beuk, assumed that:

1. What passing score should be required?
________ Symbolized as x

2. What pass rate can be expected?

________ Symbolized as y

15
16
 Limitations:
• The method include four (for Hosftee Method) and two (for
beuk Method) questions in the final procedural evaluation.
• Both methods were developed in the context of examinations
which only pass/fail decision was necessary.
• We have to use Hofstee and Beuk method in conjunction with
other standard setting procedure.
• The Hofstee Method does not involve rating of every sibgle
item, so many subject matter expers (SMEs) recommended
that is should be use in concert with Angoff and Beuk Method.

17