Monitoring and Evaluation:

Frameworks
Learning Objectives
At the end of the session, participants will be able to:
• Identify and differentiate between conceptual
frameworks, results and logical frameworks,
and logic models
• Design goals and objectives for specific intervention
programs
• Design frameworks for specific intervention programs
• Discuss how frameworks are used for M&E planning
Module Outline
• Review components of an M&E Plan
• Introduction to frameworks
– Conceptual Frameworks
– Goals and objectives
– Results and Logical Frameworks
– Logic models
• Exercises developing frameworks
• Interface between frameworks and M&E planning
• Work on group project
Why are frameworks useful?
Designing frameworks assists to develop:
• Clearly understood program/project goals and
measurable, long-term, short-term, and intermediate
objectives
• Clearly-defined relationships between
program/project inputs, processes, outputs, and
outcomes, and between program/project activities
and the external context (environmental factors)
• Sound implementation and M&E plans
Types of Frameworks
• Conceptual Frameworks
• Results Frameworks
• Logical Frameworks
• Logic Models
Conceptual Frameworks
(a.k.a. research or theoretical frameworks)

Diagrams that identify and illustrate the relationships between all relevant
systemic, organizational, individual, or other salient factors that may influence
program/project operation and the successful achievement of program or project
goals.

M&E Purpose:
• To show where program fits into wider context
• To clarify assumptions about causal relationships
• To show how program components will operate to influence outcomes
• To guide identification of indicators
• To guide impact analysis (causal pathways)

Similar frameworks:
• Proximate Determinants
Conceptual Frameworks
Individual
characteristics
Healthy Health
Service practices status
utilization

Institutional Program
Program supply
capacity sustainability

Technical
inputs
Conceptual Frameworks
National Tuberculosis (TB) Program
External Factors
• Demographic: TB infection
(age, gender)
• Socio-economic:
(education, occupation) Health Systems
• Environmental: (DOTS) TB Morbidity
(war, weather) • Availability • Prevalence
• Access • Incidence
• Utilization • HIV co-infection TB
• Case Detection • MDR-TB mortality

Program Factors
Co-morbidity
• Political commitment TB Knowledge
• HIV
• Donor involvement • Stigma
• Malnutrition
• National TB program • Treatable
• Alcoholism
• Symptoms
• Diabetes
Source: MEASURE Evaluation 2004 (draft)
Conceptual Frameworks
Causes of malnutrition in society
Child malnutrition,
Outcomes
death and disability

Inadequate Disease Immediate

dietary intake causes

Underlying
Insufficient Inadequate Poor water/sanitation causes at
access to food maternal & child & inadequate health household/
care practices services family level

Quantity & quality of actual

resources - human, economic and
Basic
organizational – and the way they
causes at
are controlled
societal
level
Potential Resources:
environment, technology, people
Source: UNICEF, State of the World’s Children, 1998
Activity
• Get into groups of 4 or 5
• Develop a conceptual framework for
utilization of family planning/maternal
and child health services
– Identify factors that influence health-service
utilization
– Arrange factors into a conceptual framework
• After 30 minutes, a member of each group
will share the framework with all
participants
Goals and Objectives
• Goal: a broad statement of a desired, long-term
outcome of the program
• Objectives: statements of desired, specific, realistic
and measurable program results
 SMART
• Specific: identifies concrete events or actions that will take place
• Measurable: quantifies the amount of resources, activity, or change
to be expended and achieved
• Appropriate: logically relates to the overall problem statement and
desired effects of the program
• Realistic: Provides a realistic dimension that can be achieved
with the available resources and plans for implementation
• Time-based: specifies a time within which the objective
will be achieved

Source: GAP 2003

Goals and Objectives
National AIDS Committee (NAC) 2005 Strategic Plan
• Goal: Prevent the spread of HIV epidemic and
minimize its impact on nation by 2009
• Objective 1: Reduction of HIV prevalence in nation
• Objective 2: Improved health and quality of life of
people infected & affected by HIV/AIDS
• Objective 3: Strengthened capacity of NAC and
stakeholders to respond to the HIV/AIDS epidemic
at all levels through improved research, M&E and
improved management and coordination
Goals and Objectives: Activity
Child malnutrition,
death and disability Outcomes

Inadequate Disease Immediate

dietary intake causes

Underlying
Insufficient Inadequate Poor water/sanitation
causes at
access to food maternal & child & inadequate health
household/
care practices services
family level

Quantity & quality of actual

resources - human, economic and
organizational – and the way they Basic
are controlled causes at
societal
level
Potential resources: environment,
technology, people
Source: UNICEF, State of the World’s Children, 1998
Results Frameworks
Diagrams that identify steps or levels of results and illustrate the
causal relationships linking all levels of a program’s objectives
Purposes:
• Provides a clarified focus on the causal relationships that
connect incremental achievement of results to the
comprehensive program impact
• Clarifies project or program mechanics and factors’ relationships
that suggest ways and means of objectively measuring the
achievement of desired ends
Other terms used:
• Strategic frameworks
 Results Frameworks
Goal: Improved Health Status
and/or Decreased Fertility

Objective: Improved Use of Health/FP Services

and/or Appropriate Practices

IR1: Access/Availability IR2: Quality IR3: Sustainability IR4: Demand

IR1.1:Commodities/Facilities IR2.2: Provider Performance IR3.1: Policy IR4.1: Attitude

IR1.2: Equity IR2.3: Training/Supervision IR3.2: Health Care Finance IR4.2: Knowledge

IR2.4: Information System IR3.3: Private Sector IR4.3: Community Support

Source: David Marsh, 1999

Results Frameworks
Tuberculosis (TB) Control Programs

SO1: Increase tuberculosis case-detection rate to 70%

IR1: Increased availability IR2: Increased demand

of quality services for quality services

IR1.1: Services increased IR2.1: Customer

knowledge of TB improved

IR1.2: Practitioners’ skills

and knowledge increased IR2.2: Social support for
TB practices increased

IR1.3: Improved
program management Source: MEASURE Evaluation, 2004 (draft)
Results Frameworks
Donor/USAID Reproductive Health Program

SO1: Increased Utilization of Family Planning/Reproductive Health Services

IR1 Strengthened sustainability IR2 Expansion of high quality FP/RH

of FP/RH Program services in the public and private sectors

IR1.1 Improved policy IR2.1 Increased availability of

environment for the provision postpartum and post-abortion FP services
of FP/RH services in the public
and private sectors IR2.2 Increased accurate knowledge
of clients about modern contraceptive
methods and FP services
IR1.2 Strengthened NGO
advocacy for FP program
IR2.3 Improved job performance of
health providers, trainers, and administrators
Source: USAID/Turkey Performance Monitoring Plan, 1998-2001
Results Frameworks
FIVE-YEAR GOAL: Foundation Established for
Reducing Famine Vulnerability, Hunger and Poverty

SO 14: Human capacity and social resiliency increased

IR 14.1: Use of high impact health, IR 14.2: HIV/AIDS prevalence IR 14.3: Use of quality primary
family planning, and nutrition services, reduced and mitigation of the education services enhanced
products, and practices increased impact of HIV/AIDS increased

IR 14.2.1: Reduced risk behavior IR 14.3.1: Community

IR 14.1.1: Community support participation in the management
for high impact health and delivery of primary education
IR 14.2.2: Mother-to-child
interventions increased services strengthened
transmission of HIV reduced

IR 14.1.2: Availability of key IR 14.3.2: Planning, management,

IR 14.2.3: Access to care and
health services and products and M&E for delivery of primary
treatment for people living with
improved education services strengthened
HIV and AIDS increased

IR 14.1.3: Quality of key IR 14.2.4: Care and support for

orphans and vulnerable children IR 14.3.3: Quality of primary
health services improved education improved
expanded

IR 14.1.4: Health sector IR 14.2.5: A more supportive IR 14.3.4: Equitable primary

resources and systems environment for responding to education services strengthened
improved HIV/AIDS

Source: USAID/Ethiopia Integrated Strategic Plan, February, 2004 (revised draft)

Logical Frameworks
Present a standardized summary of the project and its logic.
Purposes:
• Summarizes what the project intends to do and how
• Summarizes key assumptions
• Summarizes outputs and outcomes that will be monitored
and evaluated
Other terms used:
• Logframe matrix
Logical Frameworks
Project Description
Goal: The broader development
impact to which the project
contributes - at a national and
sectoral level.
Purpose: The development
outcome expected at the end of
the project. All components will
contribute to this.
Component Objectives: The
expected outcome of producing
each component's outputs.
Outputs: The direct measurable
results (goods and services) of
the project which are largely
under project management's
control
Activities: The tasks carried out
to implement the project and
deliver the identified outputs.
Performance Indicators Means of Assumptions
Verification
Measures of the extent to which a Sources of information
sustainable contribution to the and methods used to
goal has been made. Used during collect and report it.
evaluation.
Conditions at the end of the Sources of information Assumptions
project indicating that the Purpose and methods used to concerning the
has been achieved and that collect and report it. purpose/goal linkage.
benefits are sustainable. Used for
project completion and
evaluation.
Measures of the extent to which Sources of information Assumptions
component objectives have been and methods used to concerning the
achieved and lead to sustainable collect and report it. component
benefits. Used during review and objective/purpose
evaluation. linkage.
Measures of the quantity and Sources of information Assumptions
quality of outputs and the timing and methods used to concerning the
of their delivery. Used during collect and report it. output/component
monitoring and review. objective linkage.
Implementation/work program Sources of information Assumptions
targets. Used during monitoring. and methods used to concerning the
collect and report it. activity/output
linkage.
 Logical Frameworks
Taskforce on Communicable Disease Control
in the Region X: Tuberculosis
GOAL PERFORMANCE MEANS OF ASSUMPTIONS
INDICATORS VERIFICATION
A. Reduced A. Notification rate A. Annual notification - A dual HIV/TB epidemic
burden of TB reports (surveillance) causing increase in TB
to reach incidence does not occur
global - Control of private
average levels practitioner and
B. Further pharmaceutical sectors to
development prevent MDR
of multi-drug B-1. Treatment B-1. Annual reports on
outcome of treatment - Prevalence of resistance to
resistant TB outcome second-line anti-TB drugs
(MDR-TB) B-2. Prevalence of (cohort analysis)
low enough at the outset so
prevented Multi-Drug B-2. Periodic reports on as not to seriously
Resistance in “new” surveillance of anti- compromise treatment
and previously TB drug resistance success ratio
treated TB patients
 Logical Frameworks

Taskforce on Communicable Disease Control

in the Barents and Baltic Sea Regions: Tuberculosis
PURPOSE PERFORMANCE MEANS OF ASSUMPTIONS
INDICATORS VERIFICATION
Implementing 1. Coverage of TB programmes 1. Annual reports - Stable political situation,
cost-effective in line with international 2. Annual reports sustained political commitment
measures for the recommendations and financing
3. National/local
prevention and 2. Proportion of patients annual - Sufficient numbers of
control of TB defaulting out of patients notification competent health-care personnel
operating within treated reports in the government sector
civil and 3. Proportion of previously (surveillance)
penitentiary treated cases among all
health services 4. Annual record
cases. reviews during
in the Task 4. Proportion of patients on
Force area site visits
ambulatory treatment out (consecutive
of all patients treated series of
patients)
 Logical Frameworks
Taskforce on Communicable Disease Control
in the Barents and Baltic Sea Regions: Tuberculosis
(only one output and related activity shown here)
OUTPUTS PERFORMANCE MEANS OF ASSUMPTIONS
INDICATORS VERIFICATION
1. Relevant persons motivated to
8.1. Number of participate
8. Measures to increase pamphlets / posters 8.1. Material produced /
awareness of TB and its printed and distributed 2. Professional interest, sufficient
treatment among all members distributed annually financing
of the community developed 8.2. Awareness of TB 8.2. KAP or other surveys 3. Target groups interested in (their)
and tested among target groups (before/after) health and able to participate

ACTIVITIES INPUTS MEANS OF ASSUMPTIONS

VERIFICATION
8.1 Identify groups at risk for TB
8.2 Develop advocacy material Financial management
suitable for all target groups (not reports
only risk groups)
8.3 Organize health education
directed at all target groups
8.4 Involve the mass media
Activity
• Return to small groups from previous activity
• Develop goals and objectives for a program
aimed at increasing utilization of FP/MCH
health services
• Develop a results or logical framework for
this program
• In 45 minutes, a member of each group will
share the goals, objectives, and framework
Logic Models
Diagrams that identify and illustrate the linear relationships flowing
from program inputs, processes, outputs, and outcomes. Inputs or
resources affect processes or activities which produce immediate
results or outputs, ultimately leading to longer-term or broader
results, or outcomes.
Purposes:
• Provides a streamlined interpretation of planned use of
resources and desired ends
• Clarifies project/program assumptions about linear
relationships between key factors relevant to desired
ends
Other terms used:
• M&E Frameworks, Logical Frameworks
 Logic Models: Training

INPUT PROCESS OUTPUT OUTCOME IMPACT

Develop Conduct Practitioners Increase in Declining

clinical training trained in new clients served morbidity
training events clinical by (newly) levels in target
curriculum techniques trained population
providers
Logic Models
Voluntary Counseling and Testing (VCT)
Problem Statement: HIV infection rates continue to rise, underscoring the importance for people to
know their serostatus, develop personalized risk-reduction strategies, and access care and treatment services.

INPUTS PROCESSES OUTPUTS OUTCOMES IMPACTS

Financial Supervision and Clients (HIV+ Risk

Resources training for VCT and -) develop behaviors HIV
personnel People and adhere to decreased transmission
Demand for know their personalized rates decreased
Services Provide pre-test HIV status HIV risk-
counseling reduction Increase in
Infrastructure care,
HIV+ Clients prevention, and
Provide HIV testing
VCT MIS** HIV+ people develop and treatment
adhere to HIV
are referred services for
personalized incidence
VCT protocols, Provide post-test to HIV+, HIV-,
HIV care, decreased
guidelines, and counseling appropriate and discordant
training services support, and couples
documents** Refer HIV+ clients treatment plans
to appropriate
Counseling services (PMTCT, Health HIV
and Testing care and support, outcomes of morbidity
Client Continuity of
Personnel* treatment) HIV + &
records are care is improve mortality
HIV test kits available available
Maintain patient decreased
records
Referral Service Program and
system for Complete reports are services are
prevention & reporting produced improved
Tx services** requirements
Results Framework
Tuberculosis (TB) Control Programs
SO1: Increase tuberculosis case detection rate to 70%

IR1: Increased availability IR2: Increased demand

of quality services for quality services

IR1.1: Services increased IR2.1: Customer

knowledge of TB improved

IR1.2: Practitioners’ skills

and knowledge increased IR2.2: Social support for
TB practices increased

IR1.3: Improved
program management
Source: MEASURE Evaluation, 2004 (draft)
 Logic Model
Portion of model for tuberculosis control relating
to increasing demand for quality services

INPUT PROCESS OUTPUT OUTCOME IMPACT

•Human and •Distribute •Brochure •Increased •Decreased TB
financial brochure to distributed to customer infection,
resources to health clients of knowledge of morbidity, and
develop and facilities facilities TB transmission mortality
print an and treatment
•Meet with
educational
physicians to •Increased
brochure
promote demand for
distribution of quality TB
brochure services
Activity

• Return to small groups from previous

activities
• Develop logic models for one of the activities
of your program to increase utilization of
FP/MCH health services
• After 20 minutes, a member of each group
will share one of the logical frameworks
Frameworks for M&E Planning
• Purposes:
– clarifying assumptions, goals, and interrelationships
between factors relevant to the project or program
– defining objectives
– selecting activities
– defining levels of performance and desired results in
terms of planned activities and realistic, objective
impacts
• Monitoring and evaluation plans incorporate:
– program managers’ assumptions and objectives, in a
given context
– a schematic design displaying the directional linkages
between key program elements and/or planned results,
and other relevant factors
 Summary of Frameworks
Type of Brief Description Program Basis for Monitoring
Framework Management and Evaluation
Conceptual Interaction of various Determine which No. Can help to explain
factors factors the program results
will influence
Results Logically linked Shows the causal Yes – at the objective
program objectives relationship between level
program objectives
Logical Logically linked Shows the causal Yes – at the output and
program objectives, relationship between objective level
outputs, and activities activities and
objectives
Logic model Logically links inputs, Shows the causal Yes – at all stages of the
processes, outputs, relationship between program from inputs to
and outcomes, and inputs and the process to outputs to
activities objectives outcomes/ objectives
References
• AusGuide. The Logical Framework Approach.
http://www.ausaid.gov.au/ausguide/ausguidelines/1-1-1.cfm
• Bertrand, Jane T., Magnani, Robert J, and Rutenberg, Naomi, 1996.
Evaluating Family Planning Programs, with Adaptations for Reproductive
Health, Chapel Hill, N.C.: The EVALUATION Project.
• Global AIDS Program. (2003) Monitoring and Evaluation Capacity Building
for Program Improvement Field Guide, Version 1. U.S. Centers for Disease
Control and Prevention, Atlanta, GA.
• Marsh, David. 1999. Results Frameworks & Performance Monitoring. A
Refresher by David Marsh (ppt)
http://www.childsurvival.com/tools/Marsh/sld001.htm
• Tsui, Amy. 1998. Frameworks (ppt). Presented at the Summer Institute,
University of North Carolina, Chapel Hill.
• Tsui, Amy. 1999. Frameworks (ppt). Presented at the Summer Institute,
University of North Carolina, Chapel Hill.
• UNICEF. 1998. State of the World’s Children.
Group Projects
• Form groups for your group projects
• For your project, develop
– Goals and objectives
– Conceptual framework
– One other framework: results, logical or logic model