Edu431

Assignment No1 writes by sohaib

Article 1

Improving the fairness of multiple choice question a literature review

Purpose of the study and explain why it’s important:

The Purpose of the study is to ”improve the quality of MCQs Question by improving
the fairness level through applying Secondary research ”(literature review is a
secondary research method).It is important because MCQs are time efficient and use
as a short exam,mostly used in summative assessment,and if they are poorly
constructed and unfair than tests are not assessing the cognitive knowledge of the
students.Thus,through the literature studies,it is provide that there is an evidence base
strategy to guidance how to write tests and their items in fairer manner.Several
researchers considered MCQs testing as a valid method of competence testing if they
are constructed well they assess the knowledge of students and higher order thinking.

Briefly discuss important concepts described in the article:

When the help of literature the authors describe several concepts such as exam
fairness which means how valid and reliable MCQs examinations are?Exam
fairness focuses on psychometric qualities,so on the bases of test measurement
tools and standards the flaws will be identifies in the order to improve MCQs
fairness.Exam fairness enable the students to demonstrate their
competency.Another concept is “consequential validity”,it is an important
concept.it focuses on the drive the students learning appropriately,thus
learning through proper assessment can be measured by content,format,and
timing and on subsequent feedback.
According to the law of causes and effect described that behind every
evaluation action.There is an equal educational reaction.So if exam fairness
will apply the students will more likely to do study instead just focus on
examination preparation.The author discussed”assessment by ambush”as
example of unfair exam.The author provide the question construction
guideline,as well with the help of literature studies the author demonstrated
about process of setting performance standards such as criterion-referenced
standard.Norm-referenced or holistic models,content-based procedures and
compromise model.
The author discussed the “basic MCQ Model”which is composed of two
parts,a “stem” that identifies the question or problem,and a set of “alternative
or possible answers”,a “key” is the best correct answer while “distractor”are
incorrect answers.The Mcq Model has two main formats True/false format and
singlebest answer family.
The author also discussed the concept of computer based MCQs and according
to the author computerized adaptive testing(CAT)is an example of fairness
exams and widely used by organizations around the world.

State what the key implications were and don’t overstate the importance
of their findings:
 1, MCQs based exams are reliable only because they are time efficient and a
short exam still allows breath of sampling of any topics.
2, It is difficult to judge the fairness of many medical exam,as UK universities
and royal colleges have been historically reluctant to publish any exam data.
3, If an exam is fair than students are more prone to study the subject rather
than studying the exam and vice verse.
4, Assessment by ambush leads the students to consequently learn the small
amount of details and skip the potentially important topics.
5, Excessive reuse of MCQs may be unfair as not all examines will have had
exposure to old questions.probably copying and circulation of MCQs by
students cant be avoided because it could be construed.
6, Content-based procedures are relatively simple but not in generally use.
7, Compromise models are less time consuming and probably reliable.

Key point you learned after reading the article:

 Main concepts discussed in the paper such as exam fairness,consequential

validity,and assessment by ambush,question construction,standard setting,reusing
MCQs questions,fairness and MCQs formats, true/false format and computer
based MCQs learned and these are really helpful.
 Assessment process leads learning in few four ways such as
content,format,timing and subsequent feedback.
 The important of MCQs based examination if they are conducted in fair manner.if
the MCQs testing is done on fair base than it is good choice to test cognitive
knowledge and more reliable statically.
 Basic MCQs model and its components.

Article 2

Classroom test Construction:The Power of a Table of specification view

Purpose of the study and explain why it’s important:

The purpose of the study is to build a coherence/consistency and unity

between the content that the teachers teach in the classroom and the exam/test
they take to the measure the students, progress overcome the mismatch
between the content which is examined in class and the material assessed on
an end of chapter/unit test.

Briefly discuss important concepts described in the article:

The author discussed about the TOS,which is a table of specifications TOS
also called a test blueprint,normally use to helps the teacher's so they may able
to arrange the objectives,instructions,and assessment during summative
tests.The authors elaborated how TOS helpful for the teachers such as it
guides what type of item they need to include in the exam along with
considering the class time spent on each objective with the cognitive level
 (using blooms taxonomy).The main purpose of the TOS is that the classroom
tests must be aligned to the content (subject matter)taught so students are able
to learn content significant way.
The author discussed the two sources of validity evidence that are essential to
classroom teachers the first one is evidence based on the test content and the
second is evidence of response process.Evidence based on test focuses on to
what extent a test measures what it is designed (or supposed)to measure.while
evidence of response process ensure that classroom tests assess the level of
thinking that was required for students during their instructional
experiences.TOS applies the blooms taxonomy,which have 6 levels of
thinking at low level taxonomy emphasize on recall memorization
identification and comprehension while at higher level the taxonomy
emphasizes on apply analyze evaluate and synthesize.with the examples the
author discussed the lower and higher level of taxonomy.
The authors further described that the TOS is a two way chart and helpful for
teachers in such a manner that it built a relationship among instructional
objectives,cognitive level of instruction and the amount of the test.in order to
obtain the evidence of test content for your classroom tests.teachers should
consider the amount of actual class time spent on each objective.
The author described that professional or teacher can made decision how
much items to include on any given test on the bases of number of objectives
in the unit,understanding of the students and the allocated time.

State what the key implications were and don’t overstate the importance
of their findings:

1. There are many approaches to developing and using a TOS advocated by

measurement experts.
2. In this article the author developed TOC approach for practical classroom
application to target the summative assessment.
3. The author emphasized that the measured(tested/assessed)objectives should be
reflected on what you are going to measure and already taught in the classroom.
4. If you only spent 10% of the instructional time on an objective,than the objective
should only count for 10%of the assessment.
5. The author demonstrated the TOS table of the Grade 5th Social studies chapter
6,in the table there were included 10 items tests(7 multiple choice items and 3
short answer items).
6. The content in the TOS was fully teacher decision on the bases of his/her
knowledge of the students,the classroom context and the role of this test in
relation to other assessment for the grade period.
7. The teacher must also decide whether the objective should be tested at a low or
high level based on the learning objective and how the content was taught.

A sample table of specification for fifth Grade social studies

Chapter6:The Middle Colonies

A B C D E F G

Instructional T P N Lower Highe

 objectives i e u level r
m r m knowle levels
e c b dge Appli
s e e Recall cation
p n r Identifi Analy
e t o cation sis
nt o f Compr Evalu
o f t ehensio ation
n e n Synth
T c s esis
o l t
pi a it
c( s e
m s m
in s
ut t :
e i 1
s) m 0
e

o
n

t
o
p
i
c
D 1.Identify the 1 1 1 1
a various 5 0 . Multipl
y groups who . 0 e
1 settled the 0 0 choice
middle 0
Atlantic %
colonies
2.Summarize 1 1 1 1 Short
the 5 0 . Answer
Contribution . 0
of different 0 0
religions and 0
culture groups %
to the
settlements of
the middle
Atlantic
colonies
D 3.Identify 1 6 . 1
a George 0 . 6 Multipl
y Whitefield as 7 7 e
an early 0 choice
 2 leader of the %
Great
Awaking
4.Evaluate the 2 1 1 1
impact of the 0 3 . Multi
Great . 3 ple
Awakening 3 3 choice
sermons on 0
English %
colonies.

Key point you learned after reading the article:

 I learned the main purpose of the TOC is to improve the validity of a teachers
evaluation against any assessments which he/she provided in the classroom.
 I learned about the validity concept along with the two source of validity
evidence that are evidence based on the test content and evidence.
 Based on response process.
 I understand that all types of items formats can be used to assess thinking at both
high and low levels depending on the context of the question.
 A TOS is one tool that teacher can use to support their professional judgment
when creating or selecting test for use with their students.
 The TOS can be used in conjunction with lesson and unit planning to help teacher
make clear the connections between planning instruction and assessment.
 The ideal test is one that students can complete in the time allotted with enough
time to brainstorm any writing portions and to check their answer before turning
in their completed assessment.

writes by sohaib