Professional Documents
Culture Documents
are easy to construct but good true false construction needs skill
Are good for young children and/or pupils who are poor readers.
Better: The Declaration of Independence states that all men are created equal.
Ambiguity is also introduced when an item deals with qualitative terms such
as more, few, heavier, lighter etc. Since these terms are vague, indefinite and
imprecise, different people may interpret them differently. To avoid such
problems, using quantitative terms is recommended. Examples:
Poor: John received a large number of votes in the election. How much is large?
These types of items may spoil the relation between the students and the teacher
and affect the validity of the test. The trick here is spelling. (Everest)
When the true-false item is used to test for cause and effect relationships, the
first proposition in the statement should always be true, with subordinate
clauses being written as either true or false.
Example:
For the correction type of true-false item, underline the word to be corrected.
Matching Type
Matching and multiple choice questions are similar in that they have a stem
question and alternatives. Matching questions have a group of answers to a group
of questions but multiple choices have several alternatives for one question.
The matching item type test consists of two parallel columns with each word,
number, or symbol in one column being matched to a word, phrase or sentence in
the other column. The items in the column for which the selection is made are
called premises and the items in the column from which the selection is made are
called responses.
The basis for matching responses to premises is sometimes self-evident, but more
frequently must be explained in the directions. The students’ task is to identify the
pairs of items that are to be associated.
Again, for each premise in column A, there should be several responses which
could serve as attractive choices for students who are doubtful about the correct
answers. Both homogeneity of the material and plausibility of responses tend to
minimize the opportunity for successful guessing on the part of the students and
should not let students get answers by elimination.
Nature and characteristics of Matching Type Items
Whenever learning outcomes emphasize the ability to identify simple relationships
(associations) between two things (factual information) and when a sufficient
number of homogeneous premises and responses can be obtained, matching type
test seems most appropriate.
We can also present matching type test with picture and word association. Here,
the students are asked to relate picture and word by matching the numbers labeling
different parts of the picture. Alternatively, the students can be asked to identify
positions on maps, charts, and diagrams. Regardless of the form of presentation,
the students’ task is essentially that of relating two things for which there is some
logical basis for association.
a) disturbance created by students shifting the page of the test back and forth
b) overlooking the responses appearing on another page
c) Wasting time by turning pages over. Generally, this factor adds to the
speed and efficiency of test administration.
Avoid giving irrelevant clues like having the name of one woman among ten
men and asking for the name of the actress who won the Academy Award
in 1963
Maintain grammatical consistency. E.g. All proper names, all common nouns,
all singulars, all plurals, all men, all women etc.
Every response in column B should be a plausible answer to some premises
in column A
Short answer items are somewhat a cross between the essay & other objective test
items. On one hand, like the essay items, they require recall rather than
recognition; on the other hand, they can be objectively scored. Short answer items
are suitable to measure a wide variety of relatively simple learning outcomes. Look
at the points mentioned below.
Knowledge of terminologies
E.g. Lines on weather map that join points of the same barometric
Pressure are called _____________ (isobars)
Knowledge of specific facts
E.g. Ulan Bator is the capital city of ________ (Mongolia).
Knowledge of principles:
E.g. what happens to pressure as are increases? __________ (decreases)
Short answer items have two varieties:
The question variety: the item is presented as a direct question
E.g. What is the longest river in the world? ___________________
The completion variety: the item is given in an incomplete statement.
E.g. The longest river in the world is ___________.
Advantages:
Limitations:
Write the item so that the required answer is both definite & brief to avoid
ambiguous responses. It should be written in such a way that it would have only
one correct answer.
Poor: World War II ended in___. Possible answers: Japan, 1945, Victory.
Do not take statements directly from textbooks/handouts to use as a base for short
answer items.
Oranges cost?
Avoid too many blank statements because their meaning will be lost &
The stem: The stem contains the problem, which can be stated as a direct question
or an\incomplete one. The direct question format has more advantages. The
response or options: These deal with a list of suggested answers out of which one
is a correct answer and the others are incorrect ones and are called distracters
(distract less knowledgeable students away from the answer/they attract them).
There are two varieties of multiple choice items:-
Best item variety –all are answers but one is the best, the difference is a matter of
degree.
Correct item variety –there is only one answer in e.g. mathematics, spelling etc.
These types of examinations have both advantages and constraints.
Advantages of multiple choice examinations
Generally, multiple choice items do not allow for the demonstration of more in-
depth knowledge and understanding of a topic. When considering which format to
use for assessing a particular course, or program, it is worth bearing in mind the
possibility of combining a number of examination formats within one assessment
task. For example, it is possible to include in an examination section multiple
choice questions, along with an essay-type question.
Interpretive Exercise
An interpretive exercise consists of objective test items that depend on a common
data. The data could be a reading passage, a map, a picture figure, chart, table etc.
Items interpretive exercise are called context dependent because they depend on
external sources. Interpretive exercise can measure a range of outcomes ranging
from simple knowledge to application level (Yalew, 2006).
Interpretive exercises make it possible to control the amount of factual
information given to students. We can give them as much or as little information as
we think desirable in measuring their achievement of a learning outcomes. In
measuring ability to interpret mathematical data, for example, we can include the
formula needed or require the students to supply them. In other areas, we can
supply definitions of terms, meaning of symbols and other facts or expect students
to supply them. The flexibility makes it possible to measure various degrees of
proficiency in any particular area.
Forms and uses of interpretive exercise
There are many forms and uses of interpretive exercise that it is impossible to
illustrate all of them. Interpretive exercises are used for the ability to:
recognize Inferences( drawing inferences by interpreting the data given to
them);
recognize Warranted and unwarranted generalizations(be able to determine
which conclusions the data support, which the data refute, and which the
data neither support nor refute;
recognize assumptions (ability to pinpoint underlying assumptions of a
given fact);
recognize the relevance of information(an outcome important to all subject-
matter areas and that can be measured at all levels of instruction);
Apply principles (presented with a certain phenomenon, the students may
be asked to identify a principle that can explain it).
They measure more learning outcomes than can be measured with single
objective test item.
They minimize the influence of irrelevant factual information on the
measurement of complex learning outcomes.
Limitations
It is difficult to construct the source material.
They demand heavy d reading ability.
Since they use objective test items, it is unsuitable to measure students’
ability to organize their ideas.
Interpretive exercises should be reserved for higher order objectives. They should
require students to provide knowledge beyond that is presented in the exercise or
interpretations limited to the factual information provided. In both cases, test items
should depend on the introductory material.
Assessing Essays
In assessing teaching-learning in general and a course in particular, guidelines are
as important as blue prints in designing and constructing for an engineer. In this
section, guidelines for course work assessment will be studied.
Essay assignments generally present students with questions which they must
research and respond to in a coherent and manner. Their answer should show
considered critical thought and be expressed clearly and eloquently. Students are
therefore measured not only on their knowledge, but also on their ability to apply
and to articulate this knowledge effectively.
This type of assessment can be used as a timed task, done under examination
conditions. However, it is more commonly used for open-ended assessments,
where essay questions are given to students with a set date by which the written
assignment is to be submitted.
Essays usually pose a single question, although it is possible to subdivide the task
into a number of individually weighted sections if tutors wish to ensure students
cover several topics. However, when using the latter style of essay question
students must be informed of the relevant mark weightings for each section.
Essay questions can also incorporate reference material (e.g. quotations or articles),
which students are required to analyze and then comment on critically. It is
important that staff ensure essay questions are not repeatedly re-used, and that the
ability of the question to produce successful measurements of learning outcomes is
constantly evaluated.
According to Lin and Gronlund (2000) essay tests allow for freedom of responses.
Students are allowed to select, relate and present ideas in their own words. But the
freedom is a matter of degree. In some instances that freedom is delimited to
specific size. In other cases, no restriction is put .So, based on the extent of
freedom, essay tests can be classified into restricted response essay tests and
extended response essay tests.
1. Restricted response essay tests usually limit both the content and the form of
the response. The content is usually restricted by the scope of the topic to be
discussed. Limitations on the form of the response are generally indicated in
the question. E.g.
a) Why is multiple choice items considered the most versatile type? Answer
in a brief paragraph.
b) Describe two situations that demonstrate the application of the
Newton’s Third Law of Motion. Do not use those examples
discuss in class.
2. Extended response essay tests put no restriction in either form or content.
Students can provide answers by organizing the way they like. However, in
spite of the fact that THIS freedom allows for the measurement of higher
order skills, scoring difficulties come into play. Examples of extended
response essay tests. E.g.
b) Write your own your own evaluation of the value of the New pre- service
Teacher Education System overhaul (TESO) in preparation of qualification or well
trained secondary school teachers.
Advantages of Essays:
As this is a commonly used form of assessment, both staff and students are familiar
with the tool.
They involve less continuous staff supervision.
By allowing students a greater length of time to complete the assessment,
essays provide students with the opportunity to produce carefully planned
and detailed answers.
They allow free responses.
They provide students with sufficient scope to demonstrate the depth and
breadth of their knowledge.
Constraints of Essays:
The emphasis on written technique may place some students at a disadvantage.
It can take effort and experience to create effective essay questions.
Marking essays can be time consuming for tutors (scoring is unreliable).
The longer word limits and time frame involved in essay writing can lead
students to be less succinct in their responses, and therefore affect the
validity of the assessment.
Students are more likely to include plagiarized material than some other
types of assessment.
They cannot measure a large amount of content or objectives.
They are subjected to bluffing.
Individual studies and dissertations require higher level writing that students are
expected to produce in undergraduate and graduate programs. This implies that
students would be judged in light of their ability to plan, organize, write and edit
the final text in order to produce a comprehensive and readable material. Besides,
students would be assessed in terms of their ability to come up with sound
arguments. Thus, individual studies and dissertations will allow them to be
acquainted with the knowledge of writing projects, term papers and reasoning.
Assessment of practice
Assessment of practice is a method of assessing practice in which students measure
their skills attitudes against a framework of relevant standards and competency in
relation to a particular set of skills and attitudes. It is developed with due attention
to relevant professional and /or regulatory body requirements. Therefore, it is
important for students to be armed with the knowledge and skills of assessment of
practice and its application in the university setting.
b) They must then submit a proposal for their research, including a provisional
title, for consideration by advisors. These proposals should outline any (required)
practical and/ professional elements of the proposed study, and the balance must be
approved by advisors.
c) Once the proposals have been agreed students are expected to engage in
thorough research on the agreed topic.
Dissertation
This type of assessment encompasses largely the same purposes as the former, and
measures similar learning outcomes and assessment criteria. However, this tool is
designed primarily to measure students at the graduate level and involves writing
over more extended periods of time. Dissertations are also physically larger,
usually consisting of around 15-30,000 words.
Unlike individual studies, the subjects that students choose to focus their
dissertations are not dependent on course, module or program content. Students are
responsible for selecting a topic which interests them. In this method of
assessment, students have much more freedom in selecting topics for research.
Students must submit a formal proposal for their research to their supervisor,
including a provisional title and illustrative bibliography. The submission date
should be made clear in advance, in conjunction with information detailing any
summative aspects of the task and applicable mark weightings.
Students and tutors must agree on a schedule1 for tutorial sessions at the start of the
process, including dates of subsequent meetings, and (where possible)
requirements from, or responsibilities of both students and advisors in relation to
each session. During these tutorial sessions, it may be helpful to organize work
schedules or agendas with students in order to provide a framework from which
1
they can base their research and writing. The formative benefits of these tutorials
can be supplemented by the incorporation of peer group sessions, i.e. student
presentations of research findings to peers.
Both types of assessment (to differing degrees) allow students to focus their
research on an area of study of particular interest to them.
These types of assessment tools are good preparation for students who may
be required to produce extended reports in their future employment.
Students may feel overwhelmed by the scope which this type assessment can
encompass, the work involved and/or the independent research and writing
involved.
The varieties of topics covered in these types of assessment may lead to problems
concerning supervision i.e. finding tutors with sufficient specialist knowledge to
support students.
Some students may have difficulty with the emphasis placed on organization and
presentation skills in these types of assessment.
The inevitable variations in style and content which occur in these types of
assessment may make the creation and application of assessment criteria which
consistently and accurately measure student’s work difficult.
The length and complexity of these types of assessment require staff to spend
longer marking than other methods.
Oral presentation
In this section we will discuss oral presentations. A brief description of oral
presentation is set out below and includes some of its advantage constraints. This
type of assessment requires students’ to produce an oral presentation on a specific
topic or question, in front of an audience of peers and internal examiner(s). Oral
assessment is a flexible tool, which may involve.
The main function of an oral presentation is to assess not only students’ knowledge
of a subject area, but also their ability to communicate their thoughts and relevant
information in a clear, coherent and confident manner. This function provides
tutors with evidence of students’ level of understanding regarding the subject
matter involved, especially if students’ are expected to participate in a discussion
or question session after the formal presentation.
Workload involved, and/or the independent research and writing involved.
The variety of topics which can be covered in these types of assessment may lead
to problems concerning supervision, i.e. finding supervisors or advisors with
sufficient specialist knowledge to support students.
Some students may have difficulty with the emphasis placed on organization,
writing and organization this type of assessment.
The inevitable variations in style and content which occur in this type of
assessment may make the creation and application of assessment criteria, which
consistently and accurately measure students’ work, difficult.
If the process is to be assessed as well as the product, there must be a clear strategy
for collecting written and/or verbal evidence to support any judgments staff must
make. For example, these assessments may involve students being required to
include minutes of group meetings, individual reflections, peer and/or self-
assessment of group contributions, personal logs, or to participate in interviews
and/or viva voce sessions. These types of tools are useful for collecting evidence of
individual student’s participation and performance within the group environment
and can aid tutors in assessing the group as a whole.
When assessing group work, there are a number of ways in which marks may be
allocated. Therefore, it is essential that students understand in advance how
marks are to be allocated within the group.
For example:
A single piece of work may be submitted, and each member of the group is
given an identical mark.
A single piece of work may be submitted, with each individual in the group
receiving a different mark.
The group work together, but each produce a piece of work which is
individually assessed.
The group work together to produce a joint submission for which they
receive identical marks, however, they also produce individual pieces of
work which are separately assessed.
This type of assessment may help reduce the workload for staff
Group assessments often allow tutors to set substantial tasks that would be
unreasonable if set for an individual assignment.
Group work allows students to acquire valuable interpersonal experience,
applicable to future work environments.
By encouraging students to work as a team and delegate responsibility, this
Type of assessment integrates formative opportunities which are not viable
in other methods of assessment.
Group work can encourage students to co-operate and engage with each
other, thus enriching their overall learning experience.
When group work is successful the outcome is better than any individual in
the group would have been able to manage on their own
Students who perform less well in written assignments may flourish in a
group work environment.
Group work encourages creative thinking.
Cooperative learning experiences, compared to competitive and
individualistic ones, promote higher achievement, greater motivation, more
positive interpersonal relations among students, more positive attitudes
toward the subject area and teacher, greater self-esteem and psychological
health, more accurate perspective taking and greater social skills
Groups can effectively cover large parts of the curriculum previously done
by the lecture method
A portfolio is one of the techniques that instructors use to assess the progress of
their learners on a continuous basis. The growing body of literatures supports the
pros of portfolios in assessing the performance of students. However, this doesn't
mean that it is free of limitations. As a result, this section is designed to equip
instructors with the knowledge and skill of using a portfolio in assessing students'
performance.
In other words, projects can be used to monitor students’ progress and achievement
and reports/reviews measure students’ achievement of learning outcomes with the
purpose of making progression and qualification for awards.
Practical and laboratory works can be accessed through a variety of ways although
it is most commonly done through the submission of written evidence of students’
experience and performance. The tools used are largely dependent on departmental
requirements and the level being assessed.
This section, therefore, deals with assessment issues in practical and laboratory
works. Under both sections, the concepts, advantages and disadvantages will be
discussed
Practical assessments can be flexible in measuring both the breadth and depth of
knowledge and skill which students have acquired. Instructors can use different
formats to test students with a number of short and relatively simple tasks which
can provide evidence of their abilities concerning the breadth of topics or skills.
For instance, if you want to assess a student’s typing skill on a computer, you may
use the following format.
Values
Poor (1) Fair (2) Good (3) Very good (4) Excellent (5)
Accuracy
Speed
Layout
Alternatively, by setting students a single task and providing a greater length of
time to complete the assessment, instructors can achieve a measurement of
students’ ability to work on complex problems and thoroughly test their knowledge
and understanding of a particular topic/area/skill.
There are a variety of ways in which practical laboratory work can be assessed
although it is most commonly through the submission of written evidence of
students’ experience and performance. The tools used are largely dependent on
departmental requirements, and the level being assessed.
Exercise
1. What is assessment?
2. What is the purpose of assessment?
3. How many types of assessments do you know?
4. What are the principles of assessment?
5. List and describe the various tools of assessment, including their
constructions, advantages & limitations
6. Are assessment, evaluation and measurement the same or different
things?
7. What is evaluation?
8. What is measurement?