Professional Documents
Culture Documents
2016 E.C
Arbaminch
Educational Measurement and Evaluation of Learning Reading
Material
Assessment
Assessment is a systematic basis for making
inference about the learning and development of
students… the process of defining, selecting,
designing, collecting, analysing, interpreting and
using information to increase students’ learning and
development.
Cont..…
Measurement
Measurement is a systematic process of obtaining the
quantified degree to which a trait or an attribute is
present in an individual or object. In other words, it is a
systematic assignment of numerical values or figures to a
trait or an attribute in a person or object. Measurement
uses a variety of ways to obtain information in a
quantitative form. Measurement can use paper and
pencil test, rating scales, and observations to assign a
number value to a given trait or behaviour.
Cont..…
Evaluation
Types of evaluation
1. Placement evaluation.
2. Formative evaluation.
3. Diagnostic evaluation.
4. Summative evaluations.
Cont.…
Placement Evaluation
This is a type of evaluations carried out in order to
fix the students in the appropriate group or class. In
some schools for instance, students are assigned to
classes according to their subject combinations, such
as science, Technical, arts, Commercial etc. before
this is done an examination will be carried out.
Cont.…
Formative Evaluation
This is a type of evaluation designed to help both the
student and teacher to pinpoint areas where the
student has failed to learn so that this failure may be
rectified. It provides feedback to the teacher and the
student and thus estimating teaching success e.g.,
weekly tests, terminal examinations etc.
Cont.…
Diagnostic Evaluation
This type of evaluation is carried out most of the time as a follow up
evaluation to formative evaluation. As a teacher, you have used
formative evaluation to identify some weaknesses in your students.
You have also applied some corrective measures which have not
showed success. What you will now do is to design a type of
diagnostic test, which is applied during instruction to find out the
underlying cause of students persistent learning difficulties. These
diagnostic tests can be in the form of achievement tests, performance
test, self-rating, interviews, observations, etc.
Cont.…
Summative evaluation:
It is called a summarizing evaluation because it looks
at the entire course of instruction or program and can
pass judgment on the teacher and students, the
curriculum and the entire system. It is used for
certification. Think of the educational certificates you
have acquired from examination bodies. This is an
example of summative evaluation.
Cont.…
Norm-Referenced
These are tests used to compare the performance of an
individual with those of other individuals of comparable
background. Individual in a norm-referenced testing has
meaning only when it is viewed in relation to the scores of
other individuals on the test. The success or failure of an
individual on this kind of test is, therefore, determined on
the basis of how he/she performs in relation to his/her
colleagues’ performance on the test.
Cont.…
Criterion-referenced tests
In contrast to norm-referenced tests criterion-referenced
tests are tests when the score of an individual on a given
test is related to a specific performance standard for
interpretation purposes. is equal to or greater than a
specified standard (i.e., the criterion) the examinee is said
to have passed; otherwise, she/he is deemed to have failed
the test or examination.
UNIT TWO
BLOOM’S TAXONOMY OF EDUCATIONAL OBJECTIVES
Taxonomy of Educational Objectives
Benjamin Bloom and a group of people involved in education
came up with a list of levels of difficulty in what you can do
with what you know. This group of different levels of describing
how you approach a problem is called taxonomy/classification:
1. Cognitive,
2. Affective, and
3. Psychomotor domains.
Cont.…
I: Choose the best answer from the alternatives given for each item
1. Which one of the following action verbs can be used in synthesis level of cognitive domain?
A. Write B. Transfer C. Distinguish D. Interpret
2. Which one of the following action verbs does not indicate learning outcome at the
evaluation level?
B. Decide B. Conclude C. Validate D. Discriminate
3. Which one of the following affective domains does the learner expected to develop
a consistent philosophy of life?
C. Organization B. Characterization C. Valuing D. Responding
4. Which one of the following action verbs can be used in synthesis level of
cognitive domain?
A. Write B. Transfer C. Distinguish D. Interpret
UNIT THREE
CLASS ROOM ACHIEVEMENT TESTS AND ASSESSMENTS
Use only homogeneous material in a set of matching items (i.e., dates and
places should not be in the same set).
Use the more involved expressions in the stem and keep the responses short
and simple.
Supply directions that clearly state the basis for the matching, indicating
whether or not a response can be used more than once, and stating where the
answer should be placed.
Make sure that there are never multiple correct responses for one stem
(although a response may be used as the correct answer for more than one stem).
Avoid giving inadvertent grammatical clues to the correct response (e.g., using
a/an, singular/ plural verb forms).
Arrange items in the response column in some logical order
(alphabetical, numerical, and chronological) so that students can
find them easily.
Avoid breaking a set of items (stems and responses) over two pages.
Use no more than 15 items in one set.
Provide more responses than stems to make process-of-elimination
guessing less effective.
Number each stem for ease in later discussions.
Use capital letters for the response signs rather than lower-case
letters.
The multiple-choice items (MCQs)
The multiple-choice item consists of two parts – a problem and a list of
suggested solutions. The problem generally referred to as the stem may be
stated as a direct question or an incomplete statement while the suggested
solutions generally referred to as the alternatives, choices or options may
include words, numbers, symbols or phrases. In its standard form, one of
the options of the multiple-choice item is the correct or best answer and the
others are intended to mislead, foil, or distract examinees from the correct
option and are therefore called distracters, foils or decoys. These incorrect
alternatives receive their name from their intended function – to distract the
examinees who are in doubt about the correct answer.
Advantages of the MCQs
The multiple-choice item is the most widely used of the types of tests
available. It can be used to measure a variety of learning outcomes from
simple to complex.
It is adaptable to any subject matter content and educational objective at the
knowledge and understanding levels.
It can be used to measure knowledge outcomes concerned with vocabulary,
facts, principles, method and procedures and also aspects of understanding
relating to the application and interpretation of facts, principles and
methods.
Most commercially developed and standardized achievement and aptitude
tests make use of multiple-choice items.
The main advantage of multiple-choice test is its wide applicability in the
measurement of various phases of achievement.
It is the desirable of all the test formats being free of many of the
disadvantages of other forms of objective items. For instance, it presents a
more well-defined problem than the short-answer item, avoids the need
for homogenous material necessary for the matching item, reduces the
clues and susceptibility to guessing characteristics of the true-false item
and is relatively free from response sets.
It is useful in diagnosis and it enables fine discrimination among the
examinees on the basis of the amount of what is being measured
possessed by them.
It can be scored with a machine.
Disadvantages/limitations of the MCQs
It measures problem-solving behaviour at the verbal level only.
It is inappropriate for measuring learning outcomes requiring the
ability to recall, organize or present ideas because it requires selection
of correct answer.
It is very difficult and time consuming to construct.
It requires more response time than any other type of objective item
and may favour the test-wise examinees if not adequately and skilful
constructed.
Measuring evaluation and synthesis can be difficult.
Inappropriate for measuring outcomes that require skilled
performance
Guidelines for preparing multiple-choice items
This is the type of test item, which requires the test to give very brief
answers to the questions. These answers may be a word, a phrase, a
number, a symbol or symbols etc. Supply test items can be in the form of
short answer or completion form. Both are supply-type test items
consisting of direct questions which require a short answer (short-answer
type) or an incomplete statement or question to which a response must
be supplied by an examinee (completion type). The answers to such
questions could be a word, phrase, number or symbol. It is easy to
develop and if well developed, the answers are definite and specific and
can be scored quickly and accurately.
Advantages of supply type items
No restrictions on response
No restrictions on No of pages
Originality required
Applicable in measuring higher level learning outcomes of the cognitive level such
as analysis, synthesis & evaluation level
Limitations/disadvantages of extended response essay items
o Scoring is difficult and unreliable (scorer unreliability)
Describe the processes of producing or cutting screw threads in the school technical workshop.
Why should the classroom teacher state his instructional objectives to cover the three domains
of educational objectives?
Open and Distance Learning is a viable option for the eradication of illiteracy in Ethiopia.
Discuss
Such items are directional questions and aimed at the desired responses.
Examples:
o Give three advantages and two disadvantages of essay tests.
Matching items
The matching test items usually consist of two
parallel columns. One column contains a list of
word, number, symbol or other stimuli (premises) to
be matched to a word, sentence, phrase or other
possible answer from the other column (responses)
lists.
The multiple-choice items (MCQs)
The multiple-choice item consists of two parts – a
problem and a list of suggested solutions. The
problem generally referred to as the stem may be
stated as a direct question or an incomplete
statement while the suggested solutions generally
referred to as the alternatives, choices or options
may include words, numbers, symbols or phrases.
Supply type items
This is the type of test item, which requires the teste to give
very brief answers to the questions. These answers may be a
word, a phrase, a number, a symbol or symbols etc. Supply
test items can be in the form of short answer or completion
form. Bothare supply-type test items consisting of direct
questions which require a short answer (short-answer type)
or an incomplete statement or question to which a response
must be supplied by an examinee (completion type).
Essay type items
1.Extended/Unrestricted/Open-ended/free response
2.Restricted/Closed-ended
Extended response items
No restrictions on response
No restrictions on No of pages
Originality required
Methods of evaluation
1. Attainment tests
2. Direct observation
3. Indirect observation
4. Unobtrusive measures
5. Curriculum analysis
6. Case studies
Cont.…
1. Attainment tests
set by the evaluator or other internally or externally
set tests. Attitudinal and other non-cognitive tests
may be included.
2. Direct observation
the evaluator attending meetings while the
curriculum is being developed as well as observing
implementation in the classroom.
Cont.…
3. Indirect observation
the use of interviews, checklist, questionnaires, teachers’
diaries, group discussion, conferences, etc. so as to obtain
feelings of participants.
4. Unobtrusive measures
the examination of physical evidence about how often text
books and other materials were used.
5. Curriculum analysis
the content analyzed for values and assumptions.
6. Case studies
curriculum development to be examined in detail.
Cont.…
Problems in Evaluation
1.The role of the evaluator
2. The timing of the evaluation
3. Distortion
4. Technical problems
5. Value Judgments
Cont.…
Techniques and Procedures of Evaluation
1. Consistency with objectives
Evaluation needs to have an integral relationship.
2. Comprehensiveness/Objectivty
√ Evaluation programs should also be as comprehensive
in scope as are the objectives of the school / curriculum.
3. Significant diagnostic value
This is concerned to the distinguishing of various levels
of performance or mastery attained and describes the
strengths and weaknesses in the process as well as in the
product of performance.
Cont.…
4. Validity
Validity, or the capacity of the evidence to describe what
was designed to describe, is even more important in
improving curriculum and teaching than dependability and
objectivity.
5. Unity of Evaluative Judgments
To measure behavior clearly and precisely, and to
note the differences among individuals accurately.
6. Continuity
Evaluation should be a continuous process and an
integral part of curriculum development and of
instruction.
Cont.…
The product model is results oriented. Grades are the prime objective,
with the focus lying more on the finished product rather than on the
learning process. The process model is more open-ended, and focuses
on how learning develops over a period of time.
Cont.…
Foundation of curriculum
1.Philosophical foundation
2.Economical foundation
3.Sociological foundation
4.Psychological foundation
5.Historical foundation
Cont.…
1.Philosophical foundation
Philosophy gives meaning to our decisions &
actions.
It attempts to understand all that comes with in the
bound of human experience.
Philosophical foundations refer to the philosophies,
values, ideals,& ideologies b/c they represent points
of view which guide the development of the
curriculum at a particular time.
Cont.…
1.Idealism
• only ideas can be known. Idealism believes in refined wisdom;
reality is a world within person’s mind; truth is in the consistency
of ideas and goodness is an ideal state to strive to attain. As a
result, schools exist to sharpen the mind and intellectual
processes. Students are taught the wisdom of past heroes.
2.Realism
• Realism asserts that objects in the external world exist
independently of what is thought about them.
• Realism believes in the world as it is. It is based on the view
that reality is what we observe. It believes that truth is what we
sense and observe and that goodness is found in the order of the
laws of nature.
• As a result, schools exist to reveal the order of the world and
universe. Students are taught factual information.
Cont.…
3. Perennialism
) Permanence is more real than change.
(1
4. Essentialism
• Essentialism is a uniquely American philosophy of education which began in the
1930’s and 1940’s as a reaction to what was seen as an overemphasis on a child-centered
approach to education and a concern that students were not gaining appropriate
knowledge in schools.
• The two origins of essentialism are idealism and realism.
• Essentialists believe that there exists a critical core of information and skill that an
educated person must have.
5. Experimentalism
• Experimentalism believes that things are constantly changing. It is based on the view
that
reality is what you experience. It believes that truth is what works right now and that
goodness
comes from group decisions.
• As a result, schools exist to discover and expand the society we live in. Students study
social
experiences and solve problems.
Cont.…
6. Existentialism
• Existentialism believes in the personal interpretation of the world. It is based on the
view that the individual defines reality, truth and goodness.
• As a result, schools exist to aid children in knowing themselves and their place in
society.
• As a result, schools exist to aid children in knowing themselves and their place in
society.
• Students learn what they want and discuss subjects freely.
7. Constructivism
• Learning is simply the process of adjusting our mental models to accommodate new
experiences.
• Learning is a search for meaning. Meaning requires understanding wholes as well as
parts. In order to teach well, we must understand the mental models that students use
to perceive the world. The purpose of learning is for an individual to construct his or
her own meaning, not just memorize the “right” answers and regurgitate someone
else’s meaning.
Cont.…
8. Reconstructivism
• Focus is on providing students the critical tools to be agents of
social change. Students explore controversial issues, analyze
world events.
• Progressivism: The goal is to help each student think rationally.
Student-centered approach. Project and problem-based learning.
• Postmodernism: Focus on helping students recognize that here
are no universal truths, and the traditional narratives of the
dominant culture must be deconstructed. Deconstruction through
dialogue. Critical pedagogy.
• Behaviorism: Free will is an illusion; students' behavior is
shaped in order
to reinforce proper learning and behavior. Drill and practice.
Cont.…
Competency-Based Education is given to the
performance of the workers.
this system is to provide guidelines to management
so as to set valid and reliable controls in place with a
view to have reasonable assurance of meeting their
business/training objectives by assuring that their
employees/trainees/students are well trained,
assessed, verified and proved to be competent at
work location and that they can discharge their
responsibilities in a safe and effective manner.
Cont.…
2.Clustered modules