In His Great Name

Farhangian Teacher Education University

Shahid Bahonar Faculty

Course: Material Evaluation (Content Analysis)

Week 6 &7

Winter & Spring 2021 (1399-1400)

(parishayeste@yahoo.com)
 Review: Some More Points on External Evaluation (EE)
 Cover,
 Blurb
 Table of contents
 Introduction
 Authors’ views on language,
methodology, etc.
 The way language is presented
and organized in units/lessons.
• Who are the intended audience?
• Their proficiency levels?
• Their age range?
• Their motivation?
• The authenticity of the
tasks/activities?
• The way (how) the materials are
presented?
• Teachers’ book?
• Vocabulary list?
• Core? Or supplementary?
• Visuals (charts, diagrams, figures,
tables)?
• Clear or cluttered layout?
• A balanced picture of the country
or biased one?
• Digital materials?
• tests?/assessment?
Review: Steps in Evaluating a Teaching Material /Task: Step s 1 & 2

Step 1: Choosing a task/text to evaluate

 Prospect 1 was evaluated in this study. little evidence, if any, exists showing
a systematic evaluation of this textbook which has been newly developed
by the country’s ministry of education (ME).

 The textbook is about 98 colored pages, including 10 units of different daily

life communication aspects designed for Iranian intermediate students
learning language in the school contexts.

 It has been specifically designed for secondary schools’ first grade students.

 Each unit presents at least 10 new vocabularies, a communicative feature

and the required language for it.

 And …………………………….. (The overall structure, format, skills)

 Steps in Evaluating a Teaching Material /Task
Bases on:
needs
Step 1: Choosing a task/text to evaluate
-flaws & inefficiency
-old & dated
Step 2: Describing the task -newly designed &
introduced materials
-empirical evidence for
Step 3: Planning the Evaluation supporting, adapting or
putting it/them aside.

Step 4: Collecting the information for the evaluation

Step 5: Analyzing the information

Step 6: Reaching conclusions and making recommendations

Step 7: Writing the report

How to Evaluate?
What makes our plan?
 Step 3: Planning the Evaluation

Planning any kind of evaluation involves “a working plan guiding

evaluators through the evaluation process”,

i.e. “how to carry out the evaluation”.

It involves working out answers to the following issues:

 Purpose of evaluation  Audience  Evaluator
 Content  Methods & Models  Timing
 Step 3: Planning the Evaluation (Cont’d)

These issues (questions) should not be seen as mutually exclusive. For

example, “objectives model evaluation” & “outcome model
evaluation” can be carried out together.

Evaluation planning should be undertaken concurrently with planning

the lessons, tasks, or any types of materials.
.
 Step 3: planning:
Important points involved in Planning the Evaluation/analysis

Audience;
Timing
Evaluator

Content
Method s&
model s Evaluation
Plan

Purpose
 Step 3: Planning:
Important points/questions involved in Planning the Evaluation/analysis

Questions Choices
1 Purpose (why?) • Objectives (i.e., objective model evaluation).
• Improvement (i.e., developmental model evaluation).
2 Audience (who for?) • Teacher: for him/herself.
• Teacher: for others.
3 Evaluator (who?) • Teacher (internal)
• Outsider (external)
4 Content (what?) • Student-based evaluation.
• Response-based evaluation.
• Learning-based evaluation.
5 Method (how?) • Documentary information.
• Tests.
• Observation.
• Self-report.
6 Timing (when?) • Pre- (before)
• In (during)
• Post (after)
 Step 3: A Practice on the third stage

Step 1: Choosing a task/text to evaluate

Step 2: Describing the task

Step 3: Planning the Evaluation

 Step 3: A Practice on the third stage
Complete this table based on the book you chose.

Questions Choices
1 Purpose (why?) • Objective-based evaluation
• Outcome-

2 Audience (who for?)

3 Evaluator (who?)

4 Content (what?)

5 Method (how?)

6 Timing (when?)
 Activity 1:
External Evaluation (deadline: two weeks from now)

 Choose one of the course materials (textbooks, tasks, units, …) you

work on this semester as the main source of the course. Maybe the
one you feel needs to be evaluated.

 Describe it only in one paragraph, along with the reason/s you why
you chose it (stage 1).

 Then evaluate it externally, based on the points we discussed up to

now. (2/3 sentences are enough)

 Please upload your assignment to LMS.

Deadline (Ordibehesht, 10th, 1400)

Good Luck