So this discussion delivers you to a detailed
The principles of evaluation…those
discussion on the different types of materials
evaluation and there are different types of
materials evaluation because there is no single
evaluation is alike and we will also be providing
you in this discussion a comprehensible input
that would allow you to understand fully what is
being discussed.
So I know you are all very excited… Now what
are the Learning contents of this video lecture.
There are types of material evaluation, but
before we proceed let us take a look at this one
first. Evaluation are not the same because they
basically differ in purpose, personnel, formality,
and timing. So purpose, why are we evaluating?
What is the purpose why are we evaluating? You
should know your purpose. With the materials
evaluation. Why do we evaluate a material? Do
we evaluate ot because we want yo know if
these materials are effective for these group of
learners? Ow, do we want to evaluate it
because this material is in demand in the
market and its being used by teachers in
different regions of the world? So we have
different purpose. As well as the personnel.
Who demands the evaluation? Who asks you to
evaluate? Is it your academics head? Or are you
just wanting to evaluate for your own
knowledge that u want to know. How these
materials that u are using is best serving you or
whats its performance? Is it still useful ow
what? And formality. Just being required by the
department and you have to definitely conduct
that bc u need to report something about that.
Lastly timing. When do you evaluate a certain
material?do you evaluate it during the time it is
being used by the users? Or before the material
is utilized. So there is a specific timing.
In order for us to have an effective materials
evaluation we should always go back to our
principles.
are our basis. Why we woud say this and that.
That’s why we need to go back to the principles
of evaluation. Tomlinson gave us
principles..richard as well right? Daeve’s
discussion I suppose. So more or less they just
have the same gist, maybe presented differently
in words but if were going to analyze it, they
present a very similar presentation.
So let’s proceed with our first type of materials
evaluation.. the pre-use evaluation. From the
word itself “pre”, before. So before u use it.
Same with when u go to a mall or to a gadget
store to be specific. And youre trying to explore
and youre eying to bye a new cellphone. But
before doing it, you still have this what we call
the ‘pre-use evaluation’…same with any
materials…(basa sa ppt) so lets say you are the
one producing the materials, so before the
people who are usingn it there would still be
pre-use evaluation, you predict. What could be
the potential value of the materials for the
users? So you are tryin to predict. Everything is
a prediction because nbody has bought it yet.
So this is in the context of the one making it.
You predict. What is the potential value. Is it
good for the users? And the can be context-free
because we also know that we cannot get the
data from a certain pkace which used that
material that’s why It is context free… so similar
with the review of materials for a journal.. it can
also be a context influenced (basa)… and it
could also be context deoendent (basa) … it is
context dependent in the side of the potential
user for example the teacher.. the teacher is the
one whos gonna buy it. So u as a teacher u need
to think about ur class like “ahhh my studtent is
blah blah blah so I need to choose this one that
one” because the teacher should consider the
class in particular. Youre the one who knows ur
class. (basa) exactly! (example) so this is
impressionistic.
And then we have here frameworks for
generating evaluation criteria…(basa)
So they really propose that have to create when
we evaluate, it is preferrable to have a flexible
criteria.. and in 2002…(basa) SO context-
specific, it definitely considers when creating a
checklist, u consider the context, the users, the
place where it is being used, and the
circumstances. And Riazi (basa)….in order for us
to conduct a neutral analysis and carry out a
belief driven evaluation… that is why according
to Riazi we better have the survey for a teaching
learning situation.. which is also true. If there is
a survey of the teaching and learning situation,
more or less the analysis woyd be neutral..
because it is being based on facts…And in 2003
rubdy(basa) this is a very huge suggestion of
rubdy.. when u create a certain criteria to
evaluate the materials we have to consider the
psychological validity.. pedagogical validity…is it
valid in terms of pedagogy bc remember what
we are evaluating is a material well be using in
teaching… according to rubdy these things
should be considered, there should be an
interaction with these validities.
So I am not going to really dig deeper on the
criteria bc this is a very much higher level topic.
Im-just telling u that this is how we are going to
evaluate and when we evaluate ofc we need a
criteria… and these are their suggestions.
Mcdonough (basa).. so is it for a large group of
people? Is it easily adaptable? Dili ba maglisog
ang taga bukid ug gamit aning mga material? So
these are the things that according to
mcdonough, we need to create materials that
are suitable for this and that.
So Tomlinson and Masuhara (basa), proposed
the following criteria for us to come up with an
evaluating criteria,, so number 1.. (basa) okay,
we have to know, is it an evaluation question?
Number 2 (basa) okay… Basa
Dogma means something or a question already
hold an established opinion.. so if u ask it, there
is already… your opinion is already embedded in
the question, so u have to ask that.. (basa) so,
that is also a challenge, but we have to answer
these, bc according to them, these are the ff
questions we need to answer in order to create
an evaluating criteria.
Now, that is all about the pre-use evaluation. So
pre-use meaning BEFORE we use it. So now lets
see the second ttype of evaluation.. the whilst-
use evaluation. (basa meaning), so it can be
(basa) there is already a measure, its no longer a
prediction. U can already rely on the data bc its
already used by people. So same with a
cellphone, before u buy it that’s a peruse eval,
but by the time u are using it and ure going to
create a review on that, that after a week of
using it u found no problem. So there is already
a very good reference because you already
experienced it and limited to measuring what is
observabke. (basa) so this one here limited to
measure wht is observable. So the whilst Is only
to what we can observe based on how t he
learners are using the materials. Are the
instructions I ur material clear? So u can already
get a data of that question. And u cannot claim
to measure what is happening to the learners
brain. Only if its post…. U can already measure
that.. but if its during whilst eval,u observe first.
For example, u use this material, ga exam ka, u
use this examination material for ur learners
and then u realize that when u use that material
for ur examination or ur drill, students have a lot
of questions.. so that means it is not clear.. so u
have to modify first, u observe.. okay? But here
u don’t measure it yet , that woud be on the
post use eval.
So it can only measure short term (basa abot sa
ikaduha) remember we can only measure the
short term here bc if u would like to measure
the long term probably it would take months or
years somehow before u could say that “ahhh it
really retained in the brain of ur learner. (basa)
Nevertheless guys we really do thesedifferent
types of evaluation. Sometimmes unconciouly.
What does it measure? (basa tanan)
Because lets say u are using a certain material
but its too far to the learnners context.. so they
cannot relate, so next time youre gonna say like
“ahhh I am going to mmake it more localized..
and the practicality of the materials, make sure
the students can also use that especially if u ask
them to answer something..
And teachability of the materials.. is it easy to
teach or is it difficult? (basa) the appeal… is
there an appeal of the material? So with when u
meet somebody if that person has an appeal u
will be attracted right? Same with the material,
if the material u are using is appealing to
everyone then the high chance of them being
motivated and interested in ur class. There are
some things here that aree really interrelated
with one another right? Like the appeal of the
materials, so when its appealing of course it
would give motivation to the learners. So use it
jud. Because lets be honest guys, if u really find
the material very very very difficult u wouldn’t
appreciate it u don’t dare reading it somehow
right?
Lastky, the post-use evaluation. (Basa)…why?
Because pag tapos na its already done.. lets not
talk about the past. So its already done and we
evaluate the materials after It is being used.
(basa)
Questions basa
So if u can ask all these questions and the
students can give their answers then definitely
that would be ur basis for material modification.
So na modify n animo diba? (basa sa questions
balik) and from there youd say ahhh okay I
really have to add this and that maybe a portion
of th etopic is very discussed in a very surface
level that they really didn’t grasp the deeper
thought or concept about it.
Basa next questions)
*confident… example there is a material for
pronouncing a certain word and after they used
it di gahapon ka pronounce… does it give
confidence to the learners? No.. so it should be
what are the effects? If its is positive ang result
ofc u will be satisfied as well that it really gave
good effect. (basa again)
“did the teachers fin the materials easy t use?”
so that is another thing, if the material is too
difficult to use, students will never be interested
oof using the material. As much as possible, use
a student friendly material.
So in conclusion, the post-use eval can measure
the actual outcones of the use of the materials
and would provide u data on which reliable
decisions about the use, adaptation or
replacement of the materials can be made. So
because of post-use eval, u can come up with
these decisions.
Overall , Materials evaluation is initially a time-
consuming and difficult undertaking. It takes
time and approaching it in the principled,
systematic and rigorous ways suggested above
cannot only helpt to make and record
discoveries about the materials being
evaluated,, so it is really recommended for us to
evaluate.. because as teachers in the future, we
have to be very resilient no? bc everything
changes.. the learners our learners, the
curriculum and all that, we cannot use the same
material that u taught a decade ago, we cannot
use the exact same materials to the students u
are teaching now. That’s why evaluation is very
important. So that naterials being used can also
help the evaluators to learn a lot about
materials, about learning, and about
themselves.