IMPACT EVALUATION OF

DEVELOPMENT PROGRAMS/PROJECTS

OVERVIEW

Lương Vinh Quốc Duy

 Position of impact evaluation

Year 0 Year t

Project
apprasal Impact evaluation

2
Impact evaluation
Supply evidence to answer “whether the changes in well-
being are indeed due to the program intervention and not
to other factors” (Khandker et al., 2010, p. 07).
Help to identify the changes in outcome that are directly
attributable to a program, project, or policy (Gertler et al.,
2016).
For example:
Impact evaluation may help to answer whether a poverty
alleviation program has actually increased beneficiaries’
income.
Impact evaluation may help to answer whether a change
in people’s habit or behaviour has actually resulted from
the previous community mobilization efforts.
* Community mobilization efforts:
3 Activities, program, event,… that persuade people change their habits
 The terms programs/projects may include:
Direct service interventions. E.g. vitamin A for small children,
iodized salt to be used country-wide.
Community mobilization efforts. E.g. charity funding, garbage
classification.
Research initiatives. E.g. research grants.
Advocacy work. E.g. minimum wage policy.
Training programs
Poverty reduction programs, projects, policies.
Programs, projects carried out by enterprises to expand
production and market share.
…

4
 Impacts of the pandemic

HEALTH ECONOMIC

• Life expectancy • GDP

• Mental wellbeing • Unemployment
• Service quality at the • Inflation
hospitals • Income
• … • …

5
 Why impact evaluation is important

 To inform policymakers of what to change or focus in

the next programs, projects, or policies.

 To inform policymakers of where to spend their

limited resources.
 To increase social accountability (responsibility).

 To promote innovative approaches in conducting later

programs, projects, or policies.

6
Basic steps in impact evaluation
 Step 1: Choose method or approach. Determine the
indicator/variable used to evaluate the impact, the object
and the number of observations in the research sample
 (the focus of our course)
 The selection should be based on the availability of
resources that can be mobilized.

 Step 2: Develop a plan (resources)

 Step 3: Execute the plan
 Step 4: Write the report
Note:
The above steps can be carried before or after the project has been
launched (except Step 4).
7
Methods and Approach for Impact
Evaluation

Quantitative methods
T-test
Econometrics

Qualitative approach
Case study

8
Impact evaluation principle
Before the project After the project

Before-After
Comparison

Beneficiaries Nonbeneficiaries
or or
Recipients Nonrecipients

With-Without
Comparison
9
 Impact evaluation principle
Before the project After the project

Before-After
Comparison

Beneficiaries Nonbeneficiaries
or or
Recipients Nonrecipients

With-Without
Comparison
10
 Impact evaluation principle

Recorded Actual
impacts = impacts + Bias

11
Major difficulties in conducting an impact
evaluation
Geographical, cultural, social differentiations.

Differences in personal and family backgrounds.

Limited resources.

12