Professional Documents
Culture Documents
EDTL6022PPTTOS and Tutorial For TOS&Itemwriting Feb2024
EDTL6022PPTTOS and Tutorial For TOS&Itemwriting Feb2024
2/29/2024
Ingrid Hunt Anderson PhD.
for a
Traditional Test Construct
2/29/2024
Building your House
Planning for Construction 3
2/29/2024
Ingrid Hunt Anderson PhD.
►Weigh Options for Cost of Construction
►Consider the Components for the Design
►Prepare a Blueprint-
to manipulate details of the design &
guide the Construction process
must include foundational elements eg. Foundation
to build on, framework
Test Blueprint/TOS 4
2/29/2024
Ingrid Hunt Anderson PhD.
Specifies what the test should cover for a Test and not what the curriculum covers
► An explicit plan that guides test construction
► Should describe the objectives and classify taxonomy levels
► Specifies sampling of content and how it will be covered
► Try these:
► What is the main purpose for a TOS?
► How will it help in ensuring the quality of a TEST paper?
►
What is a Table of Specification? 5
2/29/2024
Ingrid Hunt Anderson PhD.
► A two-way grid or matrix that guides the construction of a ‘quality’ test
► It weights the major content areas of the test in one direction and
taxonomic levels /skills of specific objectives in the other direction.
2/29/2024
Ingrid Hunt Anderson PhD.
learning or at the end of a period of
Why is a TOS important teaching –
in constructing a ‘quality’
a TOS provides a judicious plan of
Test paper?
action/guide for constructing a ‘quality
test’ paper – it helps to ensure balance
between the taxonomy levels of
‘thinking’ , content sampling, quantity
&type of items and scores.
2/29/2024
Ingrid Hunt Anderson PhD.
► Purpose of the test
► Aspects of curriculum/content to be covered by
the test
► An indication of the students (grade level) for
Test Blueprint whom the test will be used
► The weighting/quantities of items on the test
► Types of tasks that will be used on the test
► Note: there are different approaches to setting up
a TOS : ex. items quantities/ ratios; or score
points may be weighted based on teaching time
spent &/or importance placed on content area or
taxonomy-
Example of an (oversimplified)Test 8
Comprehension 5 6 4 15
Knowledge of Laws 1 2 2 5
and Principles
Total Marks 10 11 9 30
An example in English 9
Identify the Content /Subtopics to be assessed in
2/29/2024
Ingrid Hunt Anderson PhD.
the Unit/s of learning
►Content/Subtopics to be assessed:
►A. Story
►B. Characters
Step 1 – For each Subtopic, set out your Specific Objectives/Learning 10
Outcomes for Test Assessment that are plausible. & Give objectives a key
for purposes of following the test construct process eg A1, A2 etc.
2/29/2024
Ingrid Hunt Anderson PhD.
► SUBTOPIC A : STORY ► SUBTOPIC B : CHARACTERS
2/29/2024
Ingrid Hunt Anderson PhD.
► A1. State certain facts about the plot - ► A1 Remembering
► A2. Explain certain words & phrases ► A2 Understanding
in their own words
► A3 Evaluating
► A3 Make a critical appraisal of the
storyline ► A4 Creating
► A4. Writea similar short story in
Jamaican context
2/29/2024
Ingrid Hunt Anderson PhD.
Understanding
Applying
Analysing
Evaluating
Creating
Totals
Step 3:Draw up your TOS Grid to accommodate Taxonomy Levels along the left Vertical column
and Sub-Content Headings along the Horizontal as shown with Specific Objectives
Also insert columns for weightings (Wt). for Item Quantities, Item Types & Score Points as
shown.
Step 4 - Arrange your Objectives into their respective boxes to align with subtopics and taxonomies Insert your total
item quantity and total score points as shown.
The total item quantity/wt. assigned in this example is 15 items (i) worth 60 marks 13
Note Well: an objective must be used only ONCE. Your Objectives may not have included ALL of the Taxonomy
levels. However a balance of L/O & H/O is expected. (eg Application is not included here)
2/29/2024
Ingrid Hunt Anderson PhD.
Taxonomy Wt. Story Characters Total Item TYPES xQuan.
Levels Items x scores
2/29/2024
Ingrid Hunt Anderson PhD.
Levels Importance ITEM QUAN
QUAN (i) x scores
Remember 40% A1. State/Identify certain facts B 1. Write character sketches 6
ing about the plot
Evaluating 14% A3. make a critical appraisal of B3. Evaluate the characters 2
the storyline
2/29/2024
Ingrid Hunt Anderson PhD.
Remember 40% A1. State/Identify certain facts B 1. Write character sketches 6
ing =6 about the plot (4MC) (2SA)
Evaluating 14% A3. make a critical appraisal B3. Evaluate the characters 2
=2 of the storyline (1RE) (1RE)
2/29/2024
Ingrid Hunt Anderson PhD.
Levels QUAN i x scores
Remember 7 A1. State/Identify certain facts about B 1. Write character sketches (3SA) 7 A1. 4MCx1 = 4
ing 40% the plot (4MC) B1. 3SA x2= 6
Analysing 1 13% B2. Compare two characters (1SA) 1 B2. 1SAx 5=5
Evaluating 2 10% A3. make a critical appraisal of the B3. Evaluate the characters 2 A3. 1RE x10 =10
storyline (1RE) (1RE) B3. 1REx10=10
2/29/2024
Ingrid Hunt Anderson PhD.
to create a TOS for a Summative Test based on 2 Modules (Module A=12hrs& Module
B=24hrs) .
► Total teaching time for this Topic= 36 hrs.
► Start by identify the taxonomies for each Objective. Then organize your Objectives under
their respective Sub-topics and in alignment with their (Bloom’s)Taxonomies.
► Then calculate and insert your Item Weightings using Time spent on each Module
► Make the total items 25 (for select & supply responses). Make your total score points 100.
► You must always indicate the subject, topic, grade level at top of TOS
Taxonomy
Levels
TOT
AL
Module A-
The Nature of Assessment
Module B-
TECHNICAL REQUIREMENTS OF
19
ITEM QUAN i
/TYPES x
Wt. ASSESSMENT SCORES
2/29/2024
Ingrid Hunt Anderson PhD.
Remembering
Understand
ing
Applying
Analysing
Evaluating
Creating
Totals 25 i=100
Marking Guide for Tutorial - 40marks (this will not be recorded) 20
TOTALS
• TOS matrix adheres to the Model provided showing 12 objectives, correctly aligned with their taxonomy levels 6
2/29/2024
and subtopics.
• TOS matrix is properly balanced horizontally & vertically using item weightings (quantities) totalling 25 items.. 5
• Item types are clearly specified alongside the respective item quantities throughout and appropriate for each 5
Objective and Taxonomy level
• Item scores are appropriately assigned to item types and summate to total of 100 marks 4
• Four objectives from four taxonomy levels are identified and used to construct four Question items for a 4
traditional test .
• Each item construct, is appropriate for its choice of select or supply type, its objective content and taxonomy 4
level
• Each item construct meets all the criteria for its type, format & ‘good’ item writing guidelines 4
• The explanation of all 4 Item Constructs highlights the correct guidelines for item writing and Is supported by 8
literature where possible