Terms of Reference

Effectiveness and Impact Assessment of COWASH-

Supported Training Conducted in Oromia and SNNP
Regions from 2004, 2005 & 2006 EFY
(WWW.CMPETHIOPIA.ORG)

1 INTRODUCTION AND BACKGROUND

The main purpose of the COWASH project is to strengthen the enabling

environment for rural WASH services through training, capacity and investment
support in selected regions of Ethiopia and to scale up the CMP approach to
sector-wide implementation.

The design, provision and monitoring of community management training is one

of the main mechanisms through which the capacity of key actors in rural WASH
is strengthened. Internal monitoring and external assessments in other regions
suggest that COWASH training is strengthening the capacity and performance of
key actors at different levels of responsibility in rural WaSH.

The purpose of this assignment is to carry out an independent assessment of the

effectiveness of COWASH’s Community Management Project (CMP) training (in
order to strengthen its design, delivery, monitoring and evaluation), and to
assess the impact of CMP training on the provision of safe, sustainable WaSH
services (in order to strengthen the evidence base for future training).

The COWASH team has developed a capacity development strategy1 which

includes the types of trainings, minimum capacity requirements and training
impact assessment indicators. Based on the plan a training impact assessment 2
has been carried out in two regions and a report developed by the FTAT which
has enabled the project to act and improve on some of the methodologies used.

Indicators to monitor and evaluate training are categorized on four levels:

1) Assessment of training by participants at the time of the training,
2) Assessment of training by participants after the training,
3) Assessment of the effectiveness of training by comparing learning
objectives against learning outcomes,
4) Assessment of the impact of the training.
This assignment should focus on the third and fourth categories, i.e. on the
effectiveness and impact of CMP training.

1
See “Capacity Development Plan to Accelerate WASH Development in the Rural
Areas of Ethiopia” on
http://www.cmpethiopia.org/media/cowash_capacity_building_strategy_jan_15_
2015
2
See COMMUNITY–LED ACCELERATED WaSH (COWASH) PROJECT Training
Impact Research FINAL REPORT Sept 2014 on
http://www.cmpethiopia.org/media/training_impact_research_2014.

1
The major CMP trainings carried out are:

A) Regional level trainings where woreda staff are trained by Federal

COWASH Team and Regional Support Unit (RSU) staff:
a. CMP Management Training of Trainers (ToT)
b. CMP appraisal and site selection training
c. WASHCO-CMP management ToT training
d. Operation and Maintenance Management ToT training
e. CLTSH ToT training

B) Woreda level trainings where Kebele and WASHCO staff are trained by
woreda level staff:
a. Kebele WaSH Team Training
b. WASHCO CMP management training
c. O&M training for pump attendants and caretakers
d. Artisan training

2 SELECTED TRAININGS WHICH IMPACTS TO BE ASSESSED

The effectiveness and impact of the trainings in the table below are selected to be
assessed with individuals, structures and institutions at woreda and community
level:

Region level Woreda level

CMP Management ToT Training to the Kebele WaSH Team Training in CMP to
Zones and Woredas the Kebeles
WASHCO-CMP management ToT WASHCO CMP management training to
training to the Zones and Woredas the WASHCOs
O&M ToT training to the Zones and O&M training to the pump attendants
Woredas and caretakers

Most of the training materials used in the above trainings can be found:
http://www.cmpethiopia.org/page/225.

The training topics listed in the table above have been selected as the best
examples of the flow of the trainings from regions to woredas and from woredas
to kebeles and communities. The mechanisms and methodologies through which
skills and knowledge are transferred from region to woreda must be well
communicated to staff at kebele and community level.

3 OBJECTIVES OF THE CONSULTANCY SERVICES

 To conduct an independent assessment of the effectiveness of CMP training in

order to make informed recommendations to strengthen its design, delivery,
monitoring and evaluation (including materials, methodologies, indicators and
logistics).

 To conduct an independent assessment of the impact of the knowledge and

skills development resulting from CMP training on the wider WaSH
environment; on the capacity of institutions, organisations and structures to

2
 undertake their roles and functions, and in turn on the provision of
sustainable, effective and efficient rural WaSH. The purpose of the impact
assessment is to identify the gaps and strengthen the evidence base for
future programming.

4 SCOPE OF WORK

The consultant is to carry out the effectiveness and impact assessment of the
above pre-selected CMP trainings in Oromia and SNNP regions.

Before field work, the consultant should go through all the training materials,
manuals, plans and reports related to the courses selected. The consultant should
also study the training impact assessments and research previously undertaken
and all other relevant project documentation, especially work plans and progress
reports concerning the EFY 2004, 2005 and 2006 EFY. Moreover, the consultant
should interview the relevant Federal COWASH TA Team members with respect to
the timing of trainings, possible changes in implementation plans, cascading of
the trainings, management models carried out in the implementation of COWASH,
selection of the trainees and other issue that might affect the data collection,
analysis and recommendations emanating from the assessment.

After careful desk research, the consultant should design the methodology and
assessment tools and then carry out field work in the two selected regions
(Oromia and SNNP) and zones and woredas selected by the consultant. The idea
is to find out how the trainees who participated in the six selected training
occasions have been performing in their duties and are performing at the time of
the evaluation. Performance, knowledge and skills requirements are set out in the
COWASH Human Resource Capacity Development strategy document
(http://www.cmpethiopia.org/media/cowash_cb_strategy).

5 EXPECTED OUTPUTS OR DELIVERABLES

On the basis of the desk study and interviews with COWASH TA team, the
consultant should produce:

1. Inception report including at least:

a. Literature review and definitions of terms and concepts
b. Detailed approach and methodology to conduct the assessments3
c. Detailed time and activity schedule
d. Assessment questionnaires and tools

On the basis of feedback on the inception report plus field work to collect and
analyse the data, the consultant should produce:

2. Final report for the 2 regions not exceeding 20 pages excluding

appendices, including at least:

3
Note the proposed methodology must be a scientifically accepted with respect to
sampling in project zones, woredas, kebeles, stakeholders and community
representatives.

3
 a. An executive summary of the rationale for the assessment, the
approach and methodology applied, and the main findings and
recommendations.

b. An assessment of the effectiveness of the CMP training in enabling

rural WaSH actors at the different levels to effectively know and
implement the learning objectives of the training. (assess training
objectives against learning outcomes).

c. Recommendations with respect to design, delivery, monitoring and

evaluation of the CMP training, informed by the effectiveness
assessment.

d. An assessment of the short and long term impacts of the knowledge

and skills developed (as a result of the CMP training) on the wider
WaSH environment; on the capacity of institutions, organisations
and structures to undertake their roles and functions, and in turn
on the provision of sustainable, effective and efficient rural WaSH.

e. Recommendations with respect to strengthening the impact of the

CMP training on the wider WaSH environment; on institutions,
organisations and structures responsible for sustainable WASH.

3. An overall report summarizing findings and recommendations from all four

regions. Amhara and Tigray training impact research has been carried out
in 2006 EFY.
4. An assessment of the COWASH capacity building strategy document and
its impact indicators, together with a set of tools to systematically monitor
and evaluate the effects and impacts of future training.

The products are to be submitted to the COWASH Chief Technical Advisor in MS

Word in hard and a soft copy. The Final Report is to be presented also in short,
clear and descriptive Power Point presentation.

COWASH will organize a one day workshop with the relevant stakeholders in
Addis Ababa where the consultant is to present and defend the findings and
recommendations.

6 EXPECTED CONSULTANCY INPUTS AND TIMING

The consultancy is expected to be carried out during a period of February to

March 15, 2015

7 APPROACH AND METHODOLOGY

The methods to be used in this assessment can be selected freely but they must
be clearly defined in the consultant’s proposal.

4
8 CONSULTANT QUALIFICATION REQUIREMENTS

The consultant shall have roves readiness for independent work in the field and
should have extensive academic experience in education or facilitation or a
related field. Experience in conducting trainings and/or other pedagogical tasks
and practical experience in training impact assessments are mandatory
requirements. Knowledge and experience in the field of Water supply, Sanitation
and Hygiene (WaSH) environment in Ethiopia and internationally is a strong
advantage. Knowledge of community management of rural WASH is a strong
asset. The consultant shall have minimum of 5 years cumulative experience in
either bi-lateral or multilateral projects and at least 10 years relevant professional
experience and sound command in English, Oromifa and Amharic. A proven
communication in Oromifa and Southern region is considered as an asset.