0% found this document useful (0 votes)
41 views87 pages

Monitoring and Evaluation of Projects

The document outlines the importance of Monitoring and Evaluation (M&E) in project management, emphasizing its role in ensuring effective implementation and timely adjustments. It defines M&E, discusses its functions, types, and the differences between monitoring and evaluation, while also highlighting the need for a well-designed M&E system. The session aims to enhance participants' understanding and technical capacity regarding M&E practices and tools.

Uploaded by

Belay Abeneh
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
41 views87 pages

Monitoring and Evaluation of Projects

The document outlines the importance of Monitoring and Evaluation (M&E) in project management, emphasizing its role in ensuring effective implementation and timely adjustments. It defines M&E, discusses its functions, types, and the differences between monitoring and evaluation, while also highlighting the need for a well-designed M&E system. The session aims to enhance participants' understanding and technical capacity regarding M&E practices and tools.

Uploaded by

Belay Abeneh
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPT, PDF, TXT or read online on Scribd

MONITORING

&
EVALUATION
of
PROJECTS

03/26/25 GIRMA KEBEDE 1


Reflection Exercise
1.What comes to your mind when you hear
the term M & E?

2. Have you ever attempted to undertake


M&E?

3.If yes what have you achieved or what


challenges have you faced?

4.What issues you need to be addressed &


questions to be answered for you in this
session (your expectations)?

03/26/25 GIRMA KEBEDE 2


PURPOSE OF THE SESSION
 At the end of this
session participants will;

 get clear insight in the


conceptual definition,
objectives and use of M
& E;

 enhance their
knowledge and
technical capacity on
how to set-up system &
develop tools for M & E
of programs/projects

 acquire knowledge on
how to develop and
select indicators for M &
E;

03/26/25 GIRMA KEBEDE 3


WHY M&E is Important During
Project/Program Implementation ?

 Whatever concentration is made on


project planning (financial, economic,
social, & technical feasibility studies),
projects inadequately managed during
implementation continue to fail or be
expensively delayed.

 Project Management is subject to many


influences which can hardly be foreseen
during the design (preparation) stage.

03/26/25 GIRMA KEBEDE 4


WHY M&E …
 Project plans can never be assumed perfect
and corrective measures are expected
during the course of implementation.

Particularly
– project objectives …
– planning assumptions…
– implementation methods,
– the project context, etc.

must be continuously questioned on the


basis of project implementation experience
and changes observed (internal and
external.)

03/26/25 GIRMA KEBEDE 5


WHY M&E …
Project management needs continuous flow of
information on these changes in order to be
able to mange properly the implementation.

 The best management instrument for


obtaining adequate flow of information is
establishment of M&E system.

 Hence, adequate attention should be paid to


design and use practicable M&E system to
ensure effective project implementation.

03/26/25 GIRMA KEBEDE 6


CONCEPTUAL DEFIN. OF M&E

Monitoring is a continuous process of


gathering, analyzing and interpreting
of information on the daily use of
inputs and their conversion into
outputs in order to enable timely
adjustment or correction on the
development programme/project
when necessary. Hence it is a basic
part of implementation management.

03/26/25 GIRMA KEBEDE 7


FUNCTIONS OF
MONITORING
a management tool that
contributes to effective and
efficient implementation

an internal project management


activity carried continuously
which help us:

03/26/25 GIRMA KEBEDE 8


FUNCTIONS …
 to identify shortcomings before it is too late
 as to know why progress fell short of
planned/expectations,
 to identify constraints and pointing the way
toward measures to overcome them.
 to adjust specific objectives (targets)
depending on the situation
(opportunities/obstacles) and revise the work
plan accordingly.

Monitoring is an essential part of good


management practice, and, therefore, an
integral part of day-to-day management
i.e. it must be integrated within the
project management structure.
03/26/25 GIRMA KEBEDE 9
Evaluation is a systematical and
periodical gathering, analyzing and
interpreting of information on the
operation as well as the effects and
impacts of a development
programme/project. It is an
assessment of;

 the overall performance and


 any impact resulted from the
program/project undertaken up to
the time it is done.

03/26/25 GIRMA KEBEDE 10


Assess Project Assess Project Determine
Goals, Objectives Activities
& Strategies wheather
implementation is
according to
schedule
Mobilize Track
Stakeholders, Enhance Progress
Teamwork & Build
Shared Commitment

Assess Output
Plan and Results
Program/project
Improvement
Purpose of
M&E Assess as the
targeted
Practice Bench-
beneficiaries are
Marking
reached

Identify Lessons
for change and
Enhance Improvement
Accountability

Gather
information for
Forecast
early warning
Ensure Quality Performance
03/26/25 Management GIRMA KEBEDE 11
MAJOR DIFFERENCE B/N M&E
MONITORING EVALUATION
To determine
 To determine the whether the
efficiency & objectives set
legitimacy of the were realistic,
application and use of given the
inputs as well as their capacities with
conversion into which & the
outputs circumstances in
which they had to
OBJECTIVES be fulfilled
To facilitate an To undertake
adjustment of activity review of things
plans, time schedules done i.e. to assess
or budgets (focuses the impact of the
on inputs, process, project activities
output and work plan) (focus on
effectiveness, and
relevance or
03/26/25 GIRMA KEBEDE impact) 12
It takes place Carried out
during the periodically i.e.
execution of a before the
FREQUENCY/ programme/ implementation of
project activity the programme/
REFERENCE project/ and on
PERIOD mid or different
It is a continuous
periods while the
feed back and
planned activities
feed forward
are on progress,
system that
upon completion
remains in force
as well as after it
throughout the
become
programme/
operational
project
implementation
stage

03/26/25 GIRMA KEBEDE 13


 It is a tool for Results are
PRIMARY project primarily used by
USERS managers to use funding agencies
in judging and and other relevant
influencing the institution in future
progress of program/ projects
implementation. design

DATA  Primarily Primarily


GATHERED quantitative qualitative

03/26/25 GIRMA KEBEDE 14


Common Features of
M&E
In many cases;

 both M&E use the same data


collection and analysis system

 most of the indicators for monitoring


may be included in the range of
information required for evaluation.

03/26/25 GIRMA KEBEDE 15


Participatory M & E
 It is a process in which primary
and other stakeholders
collaborate and take an active
part in assessing & evaluating
the performance and
achievement of a development
intervention.

03/26/25 GIRMA KEBEDE 16


03/26/25 GIRMA KEBEDE 17
Types of Monitoring

1. Process monitoring and


2. Impact monitoring.

or

1. Activity monitoring
2. Financial expenditure & physical progress
monitoring
3. Special diagnostic studies
4. Beneficiary participation & contact
monitoring

03/26/25 GIRMA KEBEDE 18


Process Monitoring deals
with:
- the use of resources,
- the progress of activities,
- the way the activities are carried out,
- the outputs/results achieved and
- how critical assumptions are
addressed

It is a means for reviewing and


planning work on a regular basis (to
take timely corrective action).
03/26/25 GIRMA KEBEDE 19
Impact monitoring
considers:
 Changes brought as a result of the
project/program intervention while
the project is still on progress
(economic, social, organizational,
technological, attitude, etc. or other
intended and unintended results over
a longer period).

 This is different from impact


evaluation or assessment

Formats for Monitoring.doc


03/26/25 GIRMA KEBEDE 20
EVALUATION
What & When do we Evaluate?

What ?
 Among others we have to assess:
– relevance of the project
– effectiveness and efficiency
– attainment of intermediate results
– whether the most needy or targeted
groups/individuals are being reached by the
project
– sustainability factors
– if expected benefits and impacts have been
realized
– lessons learned for the future.

03/26/25 GIRMA KEBEDE 21


 When ?
In addition to the time which is determined
during project planning/design, evaluation
may be carried when:
– monitoring report indicates an unexpected result
which is positive or negative

– management requires additional information for


decision-making

– key questions to be resolved are identified during


monitoring process

– major changes occur in critical elements or key


assumptions

– the need to extract key lessons learned arises.

03/26/25 GIRMA KEBEDE 22


Types of Evaluation
 can be seen in two ways i.e. in
periods of evaluation and by persons
involved in the evaluation process.

 Based on the Period

i. Ex-ante / start-up/ evaluation,


ii. On-going or mid-term /formative/
evaluation,
iii. Terminal /summative/ evaluation;
and
iv. Ex-post/impact evaluation.
03/26/25 GIRMA KEBEDE 23
Ex-ante/start-up Evaluation:

 it is an evaluation carried out before the


start of implementation

 includes the initial gathering of data


required for project formulation

 can be looked as a “base line” study in


which the situation of the project area, the
target group and its environment is
described

 data & information gathered through this


evaluation helps for the project design and
also at a latter stage to compare the effects
and impacts of the
03/26/25
programme or project. 24
GIRMA KEBEDE
On-going/mid-term/formative
Evaluation:

 It takes place while the implementation


of the planned project is on-progress or
in the mid of the project life

 It primarily focuses on project


performance and to see immediate and
intermediate results

 May help to analyze the relation


between outputs and effects/outcome
 …
03/26/25 GIRMA KEBEDE 25
On-going (cont’d…)

 Unlike monitoring, it does not deal


with daily problems, but produces
periodical assessment

 It is an important evaluation tool for


project success since it would provide
an opportunity for corrections on
some mistakes observed on the
implementation process

 Help to modify the design and


implementation strategies.
03/26/25 GIRMA KEBEDE 26
Major issues to be seen during
on- going evaluation include;
(not exhaustive list)
 organization structure and
management capacities of the project
 progress and problems in staff
recruitment and placement

 Efficiency in resource utilization


 procurement of necessary goods and
services from national and
international sources (in many
projects, procurement delays are a
major obstacle to effective
implementation)
03/26/25 GIRMA KEBEDE 27
 progress in establishing delivery
systems for supplying the
necessary project inputs and
services

 progress in output or physical work


(construction), including the quality
of work

 Progress in financial expenditure

 volume and quality of inputs and


services made available, etc.
 Note that at this stage evaluators
will not be able to assess the full
03/26/25
effects and impacts
GIRMA KEBEDE
of the project. 28
Terminal Evaluation
Known as a project completion
report

 Conducted when the funding for the


project comes to an end or certain
phase of the project is completed.

 The distinguishing features of


terminal evaluation are;
• it takes longer time for review of the
initial outputs and effects
• it undertakes a careful examination of
implementation performance
• it assess the sustainability of the
benefits accruing to the target
03/26/25
area/group from the project
GIRMA KEBEDE 29
Ex-post Evaluation

 Often called impact evaluation/


assessment
 Designed as in-depth study of the
impact of a project that has been
already executed or an intervention
(support) given for certain
development activities
 Carried some time after the
programme/project activity has
been terminated in order to
determine its impact on the target
group and the GIRMA
03/26/25 localKEBEDEarea. 30
Based on Evaluating
Persons:
1. Internal Evaluation:

 Performed by persons who have a


direct role in the programme/project
implementation

 Can be done by the management team


or persons assigned from the
implementing agency

 On-going evaluation can be performed


by internal evaluators

03/26/25 GIRMA KEBEDE 31


2. External Evaluation:

 It is carried by persons/institutions
from outside the
programme/project

 In most cases it is conducted by the


funding /sponsoring/ agencies with
formally designated persons
outside the project at fixed points
in time

 Terminal and ex-post evaluation is


often conducted by external
evaluators (in some cases also ex-
ante & on-going
03/26/25 GIRMAevaluation).
KEBEDE 32
Discussion Question
(15 minutes)

 As we have seen from the discussion M


& E is strongly believed as an important
management tool for successful
program/project implementation. But
many organizations are weak both in
setting up the M & E system and/or
properly using its outputs. As a result
excessive delay, cost over run, poor
objective achievements are observed in
many development interventions? What
do you think are the major reasons for
this problem?

03/26/25 GIRMA KEBEDE 33


World Vision Standard in
Evaluation Time & Coverage

 Time of Evaluation.doc

03/26/25 GIRMA KEBEDE 34


SETTING-UP MONITORING AND
EVALUATION SYSTEM
 An effective implementation of projects requires
putting in place appropriate and efficient M&E
system. The system aims at gathering,
processing, reporting and utilizing information in
the;
– progress of activities,
– achievement of outputs, outcomes and impacts of
projects.

 Hence before we proceed to actual M&E activity


we need to design and set-up a system.

03/26/25 GIRMA KEBEDE 35


 Precise design for M&E information system
may differ from sector to sector and from
project to project depending on each project’s;
- objectives,
- nature and
- environment
 The system designed must ensure effective
vertical and horizontal information flows
between the different levels of organizations.
 The two commonly used approaches in the
M&E system design are;
1. The conventional or “blueprint” and
2. The process approach

03/26/25 GIRMA KEBEDE 36


Conventional or “Blueprint” approach

 Here the project planning and appraisal


team specify;
- the M&E system’s objectives,
- the required data,
- the studies to be undertaken,
- the organizational placement of the unit,
- the personnel and budgetary needs, and
- the formats used and the reporting
mechanisms and time.

03/26/25 GIRMA KEBEDE 37


The “process” approach

 Permits project managers, partners and M&E


staff to develop formats to collect and
analyze data on the subjects and problems
they view as important for project
implementation.

In many instances a monitoring information


system can incorporate both approaches. A
broad design for the M&E system can be
blueprinted at the design and appraisal stage
of a project, and through out the
implementation process the staff can exercise
considerable flexibility in responding to new
challenges and opportunities emerged.
03/26/25 GIRMA KEBEDE 38
PREREQUISITES FOR A SUCCESSFUL
M & E SYSTEM
 Managers have to want the system & be
committed to its use
 Decisions on the data to be collected should
be based on the problems that will need to
be solved during implementation.
 Requirements for data collection have to be
adapted to realistic standards of accuracy,
timeliness & cost.
 The system has to be designed at an early
stage of project preparation & baseline data
collected well in advance.

03/26/25 GIRMA KEBEDE 39


How to Set up Monitoring
System ?
Step 1. Define the Management
Structure

– Who is to be served by the monitoring


system

– What are their management


responsibilities

03/26/25 GIRMA KEBEDE 40


Step 2. Clarify the Objectives

– What results are going to be achieved,


– which activities are carried out & their
timing and
– What important external factors and the
assumptions are there.

Use the LFM to show the casual


relationships between different levels
of project objectives.

03/26/25 GIRMA KEBEDE 41


Step 3. Analyse the Process

–A good description of the


transformation processes (input 
activity  output  outcome 
impact) for rational design of the
management information flow.

– Based on this decide what is


important to know and, what can be
ignored.

03/26/25 GIRMA KEBEDE 42


Step 4. Formulation of Manager’s
Question for Information

– The difficulty of monitoring in many


organizations &/or projects is in deciding
what is essential and what is not in the
monitoring process.

– As a result most monitoring systems


collapse because they are
 to ambiguous,
 time taking and
 resource consuming both to collect and
analyse information for decision-making.

– It is the responsibility of the manager to


formulate as precise as possible what
he/she wants to know. In most cases it is
related to monitoring of:
03/26/25 GIRMA KEBEDE 43
 Inputs /action/……> (Finance, Equipment,
Materials, Human resources, etc.)

 Results (products, outputs/services)

 Reaction (level of project purpose, effects)

 Impacts (level of the overall objectives)

 Context (e.g. assumptions mentioned in the log


frame matrix)

(This will be discussed in detail in section


which deals with information required for
M&E)

03/26/25 GIRMA KEBEDE 44


Step 5. Determine the Indicators

 State exactly what will be measured

 Identify the exact measurement.

03/26/25 GIRMA KEBEDE 45


How to Set up Evaluation System?
 Evaluation is carried to assess a
project/program implementation and
achievement periodically in a systematic
way. It focused usually on the:
– performance, (time, cost, quality standard)
– relevance, (response to the identified needs)
– effectiveness, (extent the project output &
purpose have been achieved)
– efficiency, (proper & optimal utilization of
resources)
– sustainability (how positive effects will
continue in the future) and
– impact (wider effects caused by the project)
depending on the type of evaluation carried.
03/26/25 GIRMA KEBEDE 46
Steps in Evaluation
The process of evaluation may consists the
following steps:

Step 1. Decision to Evaluation

Step 2. Prepare Terms of Reference


(TOR)
 todetermine what is to be evaluated (objective
and scope)
 the approach to be followed
 the expertise required, and
 other functional or technical specifications

03/26/25 GIRMA KEBEDE 47


Step 3. Select and/or Contract
Evaluation Team

Step 4. Planning and Preparatory


Work by the Team

– prepare time table and detail activity plan


– determine the methods to be used for the
evaluation
– prepare the instruments

Step 5. Implement the Evaluation


– collect relevant data
– analyse the data
03/26/25 GIRMA KEBEDE 48
Step 6. Prepare Draft Report

– produce draft report


– distribute to all relevant parties
– organize a meeting in which the findings are
discussed
– collect recommendations
– incorporate into the report

Step 7. Finalize the Report and Submit


to the Concerned Body

03/26/25 GIRMA KEBEDE 49


Steps in Developing Evaluation Tools
 Review project objectives
 Convert project objectives into evaluation
objectives
 Identify and list down key factors
 Select indicators for key factors
 Determine the key factor that should be used
for developing the evaluation tools
 Utilize the key indicators in formulating key
questions
 Check the relevance of the key questions to
the information needs
 Pre-test evaluation tools, orient evaluators on
the tools and put the tools to use
03/26/25 GIRMA KEBEDE 50
MAJOR INFORMATION
REQUIRED FOR M&E
1. Management/Administration Monitoring
Items to be Information to Sources of Use of
Monitored be Collected Information Information
Performance Staff/team Give staff support
1. Staff/ Achievement meetings and feed back
Personnel Absenteeism Records Training and staff

Issues Problems Staff reviews development


Supervision Improve
Expectations
Informal management
How staff work as practices
team meetings
Modify/clarify job
Whether Staffing Observation,
description, etc.
structure work, etc.
etc.
03/26/25 GIRMA KEBEDE 51
Fuel Log book of fuel Decisions about
2.Vehicles
Consumption and mileage replacing old vehicles
& Mileage Record sheets of when they become
Machinerie Repairs repairs spare uneconomical to run
s New parts, parts fitted Compare different

capital & Records of makes of vehicles


running costs money spent on Check mechanic

Performance, each vehicle performance


Meetings with Identifying problems,
etc
drivers eg. Excessive fuel
Observation, etc consumption

When to Suppliers, Obtain best value


3. Supplies
obtain catalogues, supplies
supplies inventory Obtain supplies on
Cost from stocks, etc. Time
different Stock keeping Maintain adequate
suppliers record system, stock levels, etc
Stock levels etc.
Items about

to run out
03/26/25 GIRMA KEBEDE 52
2. FINANCE
1.Project  Expenditure by Invoices & Predict

Budget & project vouchers expenditure for


Expenditure  Expenditure by Budget budgeting
budget head breakdown Compare costs of

 Balance of Analysis of different projects


budget budget and Identify areas of

remaining this expenditur excessive


year e, eg. Using expenditure,
 Regularly computer identify and
recurring items spread savings
of expenditure, sheets Compare costs

eg. Rent, with project


previous years achievements to
budget and assess cost-
expenditure effectiveness
 Rates of inflation

 Exchange rates,

etc

03/26/25 GIRMA KEBEDE 53


Salaries Staff Ensure staff are
2.Staff
Salary Tax, insurance, records paid according to
etc. Pay slips pay scale reflecting
Annual Salary nature of job and
length of service
increments records
Ensure other
Final pay
payments are
Other
made according to
payments: eg. correct procedure
health, Ensure all staff
allowance, staff
know what benefits
bonus, etc.
they are entitled to
When is cash Cash record To ensure sufficient
3. Cash
Flow needed for the system but not excessive
project? cash is available
Analysis Where will cash

come from?
What and when

are cash out


goings?
03/26/25 GIRMA KEBEDE 54
3. Program/Project Physical Progress
Monitoring
1.Results  What has been o Regular records  Plan future work
of done? of activities  Identify project

Activiti  What has not o Supervision successes


es/ been done but reports  Identify

Project was planned? o Periodic reports opportunities to


Output  What Problems o Meetings, build on strength
s have been workshops with  Identify
encountered? staff, project problems and
 How the partners and weakness, plan
problems have people affected strategies
been addressed? by the program  Review priorities
 How the external o Staff reviews  Identify training
situation has o Newspaper, needs
changed? radio  Identify needs
 Any other o Informal for further
relevant discussions information or
information to o Observation research, review
work of the or evaluation
o Surveys
03/26/25 project GIRMA KEBEDE 55
2.Project What is From Plan and schedule
Inputs needed where suppliers, activities
it can be other Monitor costs and
found organizations, budget accordingly
When it is government,
needed and etc.
when it will
be available
Cost

3. Progress Progress Information Modify strategy


of Program towards about key and/or objectives if
According to achieving indicators necessary
objectives Observation Feedback
Objectives
Are Identify need for
objectives still evaluation
relevant? Identify need for

further information
or improvements in
monitoring system

03/26/25 GIRMA KEBEDE 56


4. The Way How are Indicators Show need to
the Program decisions made? which show change
is Are the people degree of management
who are participation style
Managed
/Style of supposed to be Meetings, Identify need to

involved really discussions change methods


Work/
involved? Observation to encourage
Do the more
partners /people participation
affected by the Identify problems

work/ program in relationship


staff feel a sense between
of ownership of partners/people
the Program? affected by the
program/staff
and address
them

03/26/25 GIRMA KEBEDE 57


5. Background Have there been Surveys On-going

Information on any significant Sources of collection of


Target political, information baseline data
economical, or about which can be
Population and
environmental politics, used to evaluate
Context developments progress
economics
affecting target Meetings Response to
population? changing
with other
Have there been situations rapid
agencies,
any government response to
developments officials emergencies
affecting the Observation Keep in touch
program? with relevant
How is the work by other
population agencies
changing in
terms of the
characteristics
the program is
hoping to
influence?
03/26/25 GIRMA KEBEDE 58
HOW DO WE GATHER INFORMATION
FOR MONITORING?

1. Progress Reports

• Common in all projects

• Prepared at regular intervals

• Frequency vary according to status &


complexity of the project

• The report should be concise &


informative
03/26/25 GIRMA KEBEDE 59
2. Progress Review Meetings

• Review meeting would help to identify and


take timely action where and when problems
arise or prevent from occurring.

• Frequency of the meeting depends upon the


nature and time-scale of the project. But
should not be carried more frequently than
weekly.

• Minutes should carefully recorded and signed

• Do not allow discussions to be personalized in


such meetings.

03/26/25 GIRMA KEBEDE 60


3. Site Visits

 Important means of communication in the


monitoring & control of project physical
activities progress.

 Has to be done to have an in depth


impression in the performance of the
project.

 Has to be conducted in a participatory way


before progress review meeting is arranged.

 Time of visit depends on location and nature


of the project
03/26/25 GIRMA KEBEDE 61
How to organize M&E Unit?
 To serve as a management tool,
monitoring system that fit the
management system should be
organized at each level of
management. The organizational
arrangement and staff size depends
on the project type.

 The staff of M & E unit can contribute,


among others, in the following
activities.
03/26/25 GIRMA KEBEDE 62
 Sort, summarize, and disseminate the
information flowing from the various
units and staff engaged in implementing
the project.
 Analyze the administrative files and
records pertaining to the project
implementation.
 Collect and analyze data from the
intended beneficiaries of the project to
supplement the available records and
reports.
 Identify problems being encountered by
the project and conduct diagnostic
studies bearing on these problems
 Maintain in a retrievable format
(document) the various data series
overtime as an aid to later evaluation
 Prepare reports GIRMA KEBEDE
03/26/25 63
MAJOR PROBLEMS OF THE
M & E PROCESS
 Inadequate or lack of M&E unit and
staff both at the project level and
higher implementing body. In most
cases M & E system is not either
properly established or not
provided adequate attention and
resources where it exists.

 Poor accountability for failures and


inadequate reward for special
efforts made on the successful
project implementation.
03/26/25 GIRMA KEBEDE 64
 Limited training opportunity for M&E
personnel in projects or offices
where the unit exists.

 Limited information source on


project progress (poor
documentation). Even when
information is available it doesn't
answer the right questions.
Frequently where the system exists
it focus only on quantitative financial
aspects and physical implementation
of the program/project.

03/26/25 GIRMA KEBEDE 65


 Late arrival of information required
for monitoring.

 Too costly to collect information.

 Disregard of previous M&E findings


in the design of new projects.

 High mobility of project staff


disrupting continuity of M&E
functions.

03/26/25 GIRMA KEBEDE 66


INDICATORS
DEVELOPMENT &
SELECTION FOR
M&E

03/26/25 GIRMA KEBEDE 67


What is an indicator ?
 Indicators are an objective measure of change
or results brought about by an activity or
an output from an activity.

 Indicators are designed to provide a


standard against which to measure, or
assess the progress of an activity against
stated targets, towards:
– delivering inputs (input indictors),
– attaining outputs (output indicator) and
– achieving objectives (effect and impact
indicators).

03/26/25 GIRMA KEBEDE 68


 Indicators are signals which show;

 Whether we are on the right track &


direction,
 How far we have progressed
 How far we still have to go to reach our
destination/objectives and
 Problems encountered to reach the
intended targets,

 Indicators can be :
 Quantitative, measuring tangible effects, or
 Qualitative, dealing with judgments
03/26/25 GIRMA KEBEDE 69
 Quantitative indicators are often
expressed in;

– A ratio (like teacher: student; hospital bed:


population, etc.)
– A percentage (part of the total)
– Actual number (10, 15, 40, etc.)
– A rate (say from 1000, 10000, etc.)

 Indicators are recommended to be


developed with project partners,
because it helps in;

– building consensus,
– drawing on each other experience and
– strengthening the collaboration of project
management staff, beneficiaries, donors,
cooperating agencies, etc.
03/26/25 GIRMA KEBEDE 70
 Indicators can be used to measure
progress /change/ of all sorts within a
project, broadly relating to the process
and the result/impact of implementation.

Process indicators are those which


show whether the planned activities are
actually being carried out effectively.

Result/Impact indicators are used to


assess what progress is being made
towards reaching the project’s objectives
and what impact the work has had on the
different groups of people affected by the
work.

03/26/25 GIRMA KEBEDE 71


Project Objective: ‘Introduction of modern family
planning practices in area X’.
PROCESS INDICATORS RESULT INDICATORS
INPUT/ACTIVITY OUTPUT OUTCOME/ IMPACT
INDICATORS INDICATORS PURPOSE INDICATORS
INDICATORS
No. of training No. of people No. of families Rate of
1 delivered for trained how to using different decrease in
household heads on use modern birth control family size
how to use modern birth control practices
birth control practices. practices. Rate of
Amount of No. of women
2 contraceptives offered with
% growth of

women who
decrease in
morbidity &
distributed for child the service adopted the use of mortality rate of
bearing mothers contraceptives childerns &
No. of consultation/ No. of mothers
3 meetings/ held to advocacy No. of families Same as above
establish an advocacy groups benefited from Same as above
group on improved established improved family
family planning planning practices
practices introduced by the
03/26/25 advocacy groups
GIRMA KEBEDE 72
 Indicators essentially develop from
objectives. Thus it must be stated
clearly and unambiguously.

 Particularly goal and purpose


statements often tend to be
ambiguous. It frequently happens
that a project purpose is interpreted
to mean as many different things as
there are different people involved in
the project.
03/26/25 GIRMA KEBEDE 73
For example, a statement of purpose
such as;
“change in sexual behaviour of youths
in high schools located in town X”
is liable to have different meanings for the
various people concerned with the project.
There might be different indications which
shows as behaviour in sexual practices had
indeed improved. Thus to avoid confusion
and ambiguity, we have to develop from the
outset a sharply set of indicators/s/ what
shows changed sexual behaviour practices
are.
03/26/25 GIRMA KEBEDE 74
Indicators Selection

 Choice of appropriate indicators is a task


that requires
- Experience and skill,
- through understanding of the information
needs of management at various levels,
- Knowledge of how best to obtain the data
for the indicators and
- the limits imposed by both costs &
techniques.

03/26/25 GIRMA KEBEDE 75


 The development and selection of
indicators should be participatory as
far as possible.

 The list of indicators has to be


limited. Otherwise as the list grows
larger, so does the number of
inappropriate indicators, which can
doom an information system.

03/26/25 GIRMA KEBEDE 76


Steps in Selecting Indicators
 Step 1. Clearly state the result statement or end-of-
project status

 Step 2. Develop how this can be achieved in terms of


outputs and activities (inputs)

 Step 3. Develop a list of alternative indicators

 Step 4. Assess the alternative indicators against set


criteria such as cost, timeliness, validity,
specificity, etc.

 Step 5. Select only the most appropriate, which can


measure what is important about the project
objectives using the selection criteria

03/26/25 GIRMA KEBEDE 77


Criteria for Developing & Selecting
Effective Indicators
Result oriented: should focus at
measuring result expected from the
project

Direct: should always be direct as much as


possible. Proxy indicators could only
preferred when direct indicators are
not possible or difficult to use for
different reasons.

Objective: could be understood without different


interpretations.
03/26/25 GIRMA KEBEDE 78
Unidimensional/Independent: output indicators
cannot be used to prove
achievement of purpose and
purpose indicators achievement of
goal.

Quantitative: (Whenever possible): However,


there are instances where
qualitative indicators could be
desired or even more useful.

Disaggregated:(Whenever possible) use


disaggregated indicators. Eg. By
sex, age, geographical location,
education level, etc.
03/26/25 GIRMA KEBEDE 79
Simplicity/Unambiguous Definition: Simple and clearly
defined in the project’s context. For example, what
does a ‘user’ of a project-supplied services such as
condom distribution mean? Does it include all persons
who bought the condom, or those who sometimes use
it or only those who strictly uses during every sexual
intercourse?

Validity/consistency: The values of the indicators


should stay valid/constant as long as they are
collected in identical condition, no matter who does
the collecting.

Specificity: Should measure specific conditions that


the project aims to do & change.

Sensitivity: should be highly sensitive to changes in a


project situation.

03/26/25 GIRMA KEBEDE 80


Cost-Effectiveness/Ease of Data Collection: Identify
and select indicators for which data, time and
resources (budget) is available.

Relevance/Reliable: Should be relevant to project


objectives and measure what is expected to
achieve.

Timeliness: Should be sensitive to the time it is done


and possible to collect the data reasonably
and quickly.

Targeted: Must be targeted in terms of:


- quantity……> (how much/many)
- quality ……..> (how good/well)
- time …………> (by when)
- target group….> (to whom)
- place …………..>(where)

03/26/25 GIRMA KEBEDE 81


Direct and Proxy Indicators

 Some times it is not possible to observe


and measure project results directly

 In such situations indirect or proxy


indicators have to be used (see the
example below).

03/26/25 GIRMA KEBEDE 82


 Example: effectiveness of ‘behavioral change
communication in HIV/AIDS prevention’ projects
may best be measured directly by reduced death
rates related to the virus. But these are difficult
to determine over short period of the project life.

 What indicators do you suggest to be used in


such situation?

Proxy indicators, such as;


 Sales of condom say per month,
 Number of new anti-aids clubs established and
 Increase in number of people practicing voluntary
counseling and testing (VCT) may be used as
indicators.

03/26/25 GIRMA KEBEDE 83


Examples of Direct and Proxy Indicators

Project Direct Proxy


Objectives Indicators Indicators
Increased % change in % increase in no. of livestock
Household monthly/ (expressed in value terms
Income annual % increase in savings
household Improvement in physical state of
income the household (i.e. tin roof,
additional rooms, etc.)
Improved Reduced % increase in families using family
Health prevalence of planning methods
Status in diarrhea % increase in households using
Target Area diseases protected water source
‘Y’ Decrease % % increase in households with a
of children vegetable garden for home
who are consumption
under-weight % increase in deliveries attended
03/26/25 GIRMA KEBEDE 84
by trained TBAs
Discussion Question
 What do you think are the major
challenges in developing and
selecting indicators?

03/26/25 GIRMA KEBEDE 85


U
YO
K
N
A
T H

03/26/25 GIRMA KEBEDE 86


Exercise on Indicators Development
To understand the distinctions between activity (input), output, effect and impact
indicators, let us consider a project which is devised to raise awareness on the
impact of child prostitution and sexual abuse through advocacy activity in 15 high
schools in Addis Ababa. The main objective of the project is to increase knowledge
and raise awareness among students and school community members to prevent
and control the spread of STDs (including HIV/AIDS) and reduce school dropouts
among female students due to the above problem.

The main activities of the project included, among others,


 Select and train school promoters
 Prepare and produce posters, pamphlets and videos
 Arrange schedule for each targeted schools
 Provide education at each selected school

Question
What do you think are the indicators for activities, outputs, outcome /objective/ and
impact this Project?

Procedures to be followed;
 Try to clearly state the goal and objective/s/
 Identify the outputs expected in order to achieve the objective/s/
 List the major activities to be accomplished to achieve the expected outputs
 Develop indicators for each of them
 Develop a logical framework matrix, which can be used for M & E of the project.

03/26/25 GIRMA KEBEDE 87

You might also like