Introduction to

Monitoring and Evaluation

Objectives of session
 Definitions: Monitoring and Evaluation
 Rationale for M&E
 Review elements of an M&E plan
 Steps toward constructing the M&E plan
 Implementing the M&E plan
 Monitoring - Evaluation
 Monitoring is the
 Evaluation is the use of
routine process of specific study designs and
special studies to
data collection and measure the extent to
measurement of which changes in desired
progress toward health outcomes are
program attributable to a program’s
objectives. interventions.

Interventions Outcome
 Rationale for M&E
 M&E help to make informed decisions
regarding ongoing programs

They facilitate effective and efficient use of resources

They determine whether a program is right on track
and where changes need to be considered

 M&E help stakeholders conclude whether

the program is a success
 M&E preserve institutional memory
Three Primary Uses of Evaluation Findings
 Rendering judgments

Summative evaluations of program’s overall
effectiveness
e.g., audit, renewal, quality control, accreditation

 Facilitating improvements

Formative evaluation to improve program
e.g., program’s strengths/weaknesses, progress

 Generating knowledge

Conceptual use of findings
e.g., generalization, theory building
 What is an M&E Plan?
 An M&E Plan is a document that describes
a system which links strategic information
obtained from various data collection
systems to decisions that will improve
health programs.
 Fundamental document to ensure:
Accountability
Measure of success
 Functions of an M&E Plan
 State how the program is going to measure
what it has achieved (ensure accountability)
 Document consensus (encourage
transparency and responsibility)
 Guide M&E implementation
(standardization and coordination)
 Preserve institutional memory

M&E plan is a living document and needs to be

adjusted when a program is modified.
 Functions of an M&E Plan:
by level of the health system
 Facility (primary data collection):
• Manage patients/clients
• Supervise providers
• Manage logistics
• Report to district HIS and vertical programs and community

 District:
• Allocate resources
• Report to provincial/national

 National (Comprehensive vs. Vertical Programs)

• Allocate resources
• Collect national data
• Report to international donors and other stakeholders
 Elements of M&E Plan
1. Brief project description
2. Purpose(s) of M&E plan
3. Brief history of M&E plan development
4. Evaluation framework
5. Indicator system
6. Information system (data sources)
7. Impact evaluation design
8. Dissemination and utilization plan
9. Adjustments to M&E plan
1. Brief project description

Include:
 objectives/results

 implementation responsibility

 dates/duration

 geographic focus

 resources
 2. Purpose(s) of M&E plan

Specify purpose for:

 performance (process) monitoring
 impact evaluation
3. Brief history of M&E plan
development
Helps to define:
 shared vision (internal/external)
 source and extent of interest/commitment
4. Develop Evaluation Framework
(Log Frame, Results, Conceptual)

Show:

Primary components

Levels and units of action

Causal sequence

Component-related indicator(s)
5. Develop Indicator system

Organized by framework component

Attributes
• Name of indicator
• Description/definition
• Unit of measurement
• Data source (primary/secondary)
• Baseline/target value(s) by year(s)
• Frequency of data collection
• Responsibility
• Reporting plan and frequency
6. Information Systems
(Data sources)
Develop:
 Information systems for collecting data for
indicators
 Diagram data collection, processing,
analysis, and reporting system
 Data collection tools (routine vs. non-
routine)
• patient records
• registers
• survey instruments
7. Select impact evaluation design
Decide on design:

Experimental vs. observational

Quasi-experimental (post-test, pre- and
post-test with no control)

Implementation plan

Execution responsibility
(internal/external)
8. Dissemination and utilization plan
Decide on:

Databases for information storage

Clearly defined users

Schedule and timeliness

Dissemination methods
• Reports (schedule and audience)
• Media
• Speaking events

Information-utilization models
9. Adjustments to M&E plan


Program changes can occur, affecting the
original M&E plan for both performance
monitoring and impact evaluation

M&E plan is a living document and needs

to be adjusted when a program is modified.
 Steps toward constructing the M&E plan
 Preparing to build the plan
 Constructing the evaluation framework
 Identifying potential data sources
 Selecting and defining indicators and their
values
 Designing the impact evaluation
 Developing a reporting schedule and system
 Planning for mid-course adjustments
 In implementing the M&E plan
 Utility - serve practical information needs of
intended users
 Feasibility - be realistic, prudent, diplomatic
and economical
 Propriety - conducted legally, ethically, and
with regard to those involved in and affected by
the evaluation
 Accuracy - reveal and convey technically
accurate information