U472 PROJECT EVALUATION FRAMEWORK

OUTCOME EVALUATION
The purpose of outcome evaluation is to assess the long-term effects of the project. Outcome evaluation usually
relates to the goal and purpose of the project.

PROJECT PURPOSE:

Purpose
To (write purpose statement here).

Key Performance Indicators/ Measures/Methods Samples

Domains of Change
1. 1 1.
2. 2 2.
3. 3 3.

Evaluation question: (what is it that you really want to know about the outcome?)
<Type here>

IMPACT EVALUATION
The purpose of impact evaluation is to measure the medium term impacts of the project, usually immediately after
project implementation is completed. Impact evaluation usually relates to the objectives of the project.

Objective 1: (xxx)
To (write objective statement here).

Performance Indicators / Domains Measures/Methods Samples

of Change
1.1 1.1 1.1
1.2 1.2 1.2
1.3 1.3 1.3

Evaluation question: (what is it that you really want to know about this impact?)
<Type here>

Objective 2: (xxx)
To (write objective statement here).
Performance Indicators / Domains Measures/Methods Samples
of Change
2.1 2.1 2.1

U472 Evaluation Framework and Evaluation Plan Template 1

2.2 2.2 2.2
2.3 2.3 2.3

Evaluation question: (what is it that you really want to know about this impact?)
<Type here>

Objective 3: (xxx)
To (write objective statement here).
Performance Indicators / Domains Measures/Methods Samples
of Change
3.1 3.1 3.1
3.2 3.2 3.2
3.3 3.3 3.3

Evaluation question: (what is it that you really want to know about this impact?)
<Type here>

Objective 4: (xxx)
To (write objective statement here).
Performance Indicators / Domains Measures/Methods Samples
of Change
4.1 4.1 4.1
4.2 4.2 4.2
4.3 4.3 4.3

Evaluation question: (what is it that you really want to know about this impact?)
<Type here>

PROCESS EVALUATION
The purpose of process evaluation is to determine the extent to which the project is delivered as designed. Process
evaluation usually relates to the activities of the project.

Determine who should answer the following questions, how you would like the questions to
be answered, and what tools you will use to answer them.

1. How well was the project implemented?

WHO? HOW & TOOLS?

2. Did the project reach the intended target recipients?

WHO? HOW & TOOLS?

U472 Evaluation Framework and Evaluation Plan Template 2

3. What proportion of the target recipients actually participated in the project?

WHO? HOW & TOOLS?

4. Was the project acceptable to the recipients?

WHO? HOW & TOOLS?

5. What was the satisfaction level of the recipients?

WHO? HOW & TOOLS?

FORMATIVE EVALUATION
The purpose of formative evaluation is to test the design of the project with a sample of the target population
(prior to implementation) in order to determine how well it has been developed to achieve the desired change.

Who should participate in the formative evaluation? (Sample?)

What methods should used to conduct formative evaluation?

What questions should be asked?

What should be done with the results of the formative evaluation?

DATA COLLECTION REQUIREMENTS SUMMARY

Data set 1: (measure/method + sample - taken from your objectives)

<Type here>

Evaluation Type: (Formative, Process, Impact or Outcome)

<Type here>

U472 Evaluation Framework and Evaluation Plan Template 3

Resource requirements (human, structural, IT & financial):
<Type here>

Data set 2: (measure/method + sample – taken from your objectives)

<Type here>

Evaluation Type: (Formative, Process, Impact or Outcome)

<Type here>

Resource requirements (human, structural, IT & financial):

<Type here>

Data set 3: (measure/method + sample – taken from your objectives)

<Type here>

Evaluation Type: (Formative, Process, Impact or Outcome)

<Type here>

Resource requirements (human, structural, IT & financial):

<Type here>

Data set 4: (measure/method + sample – taken from your objectives)

<Type here>

Evaluation Type: (Formative, Process, Impact or Outcome)

<Type here>

Resource requirements (human, structural, IT & financial):

<Type here>

Data set 5: (measure/method + sample – taken from your objectives)

<Type here>

Evaluation Type: (Formative, Process, Impact or Outcome)

<Type here>

U472 Evaluation Framework and Evaluation Plan Template 4

Resource requirements (human, structural, IT & financial):
<Type here>

EVALUATION TIMING

Data Set When

Formative

Process

Impact

Outcome

ETHICAL ISSUES TO CONSIDER

How will informed consent be obtained from the respondents to the evaluation?

How will you ensure that all data collected is kept in strict confidence?

How will you ensure that respondents know they have the right to withdraw from the evaluation?

How will you ensure that no unnecessary information is collected from the respondents?

How will you ensure that the respondents of the evaluation remain free from coercion?

How will you ensure that the researcher/evaluator is value free and not in a conflict of interest?

How will ensure that the researcher/evaluator does not withhold findings of the evaluation study?

U472 Evaluation Framework and Evaluation Plan Template 5

 U472 EVALUATION PLAN

Introduction:
(This section introduces the major sections of the plan as well as the primary people involved in writing the plan.)

Background:
(This section describes any information that is needed to provide the reader with an understanding of the
background of the U472 project that is being evaluated.)

Purposes:
(This section thoroughly describes the purposes of the evaluation. A single plan can address a variety of purposes,
but all must be delineated clearly. Evaluation is always a political process and all parties must accept the purposes
for the evaluation to be successful.)

Limitations:
(This section spells out any limitations to the interpretation and generalisability of the evaluation. It should also
describe potential threats to the reliability and validity of the evaluation design and instrumentation.)

Audiences:
(This section specifies all the primary and secondary audiences or consumers of the evaluation. In general, it is
recommended to open the evaluation up to as many people or agencies as you can.)

Decisions:
(This section is probably the most difficult, but it should be included if the evaluation is to have meaningful impact
on decision-making. Trying to anticipate the decisions that can be influenced by an evaluation takes creativity and
trust. Many developers do not wish to anticipate negative outcomes for their efforts, but these must be
considered.)

Ethical Considerations:
Take from your answers to “Ethical Issues to Consider”

U472 Evaluation Framework and Evaluation Plan Template 6

Questions:
(A key element of a sound evaluation plan is careful specification of the questions to be addressed by the evaluation
design and data collection methods. The clearer and more detailed these questions are, the more likely that you will
be able to provide reliable and valid answers to them.)

Methods & Sample:

(This section describes the evaluation designs and procedures and who will participate in the evaluation. There are
scores of designs and hundreds of procedures that can be used. The keys to success are matching these options to
the purposes and questions of your client and keeping within the budget and time line of the study.)
Cut and paste your Data Collection Requirements Summary and Evaluation Timing Table

Instrumentation:
(This section describes all the evaluation instruments and tools to be used in the evaluation.)
May already be specified in above section

Logistics:
(This section spells out who will be responsible for the various implementation, analysis, and reporting aspects of
the evaluation.)

Time Line:
(This section presents the schedule for implementation, analysis, and reporting of the evaluation.)

Budget:
(This section "costs out" the finances for the evaluation.)

U472 Evaluation Framework and Evaluation Plan Template 7