Terms of Reference (ToRs) - Project Final Evaluation

Providing Early Recovery Support to the Affected Population

A. Background/Context

According to National Disaster Management Authority (NDMA), due to 2022 monsoon flooding more
than 662,466 houses were partially damaged, and another 287,412 were fully damaged. In addition,
approximately 800 schools, 149 bridges, and 3,451 km of roads have been affected. At least 1 million
people are in need of humanitarian assistance in Pakistan due to the floods. There is an urgent need
to make basic lifesaving WASH services functional, taking into account the safety and well-being of
children and women in particular. Flood water has resulted in the accumulation of silt in the irrigation
channels. Which has diminished the ability of the communities to irrigate their fields. Nearly 73% of
the livestock owners have reported loss of livestock. In the agriculture sector, protection of livestock
assets and rehabilitation of irrigation infrastructure are identified as the top most needs for early
recovery.

B. Project Objective

Goal: To provide early recovery support to the affected population

Outcome A: Increased access to clean drinking water for flood affected communities in target areas
and provide better facilities for Newborn babies and Mothers.
Output A.1: Provided clean water through the construction/rehabilitation of hand pumps including
soakage pits, pads, and drainages to flood affected communities.
Output A.2: Conduct hygiene promotion sessions with flood affected communities.
Output A.3: Provision of hygiene Kits and Mosquito Nets for the flood affected community with poor
Hygiene situation.
Outcome B: Improved learning environment for children enrolled in schools in flood affected target
areas.
Output B.1: Completed minor repair and rehabilitation of damaged schools in flood affected areas.
Output B.2: Provided TLM Kits and basic equipment to damaged schools.
Output B.3: Back to school activities including school disaster/safety plans.
Outcome C: Increased protection services to communities
Output C.1: Provided village level grant or in kind to implement improvements resulting from Women
Safety Audit. Repair or rehabilitation of safe houses in District Dadu and Badin.
Output D.1: Provided livelihood support through grants (Agriculture)
Output D.2: Provided livelihood support through in-kind kitchen gardening kits (Agriculture)
Output D.3: Conducted Livelihoods, DRR Training and kitchen gardening training with IEC Material.
Output D.4: CARE will provide 02 goats for each beneficiary at Dadu and 01 Calf for each beneficiary at
Badin.
Output D.5: Poultry birds will be provided for those females who has the interest to start its business
of egg selling and meanwhile she meets the nutrition need of her family as well with this production.
Output D.6: CIP will provide training to the farmers on livestock and poultry management through its
partner FRDP.
Output E.1a: Conditional Cash grants for entrepreneurship will be provided to skilled poor flood
affected women for the sake of their livelihood support.
Output E.2: Before the conditional cash disbursement beneficiaries must receive training on business
development and record keeping for the small business(entrepreneur).
Output E.2: Multipurpose Cash Assistance provided for the beneficiaries of flood affected communities.

C. Purpose and scope of Final Evaluation

The overall objective of this evaluation is to understand and document the main contributions, results
and changes brought on by the DEC funded project to the partners and the lives of project participants.
The specific objectives of the evaluation were to;
• Make an overall assessment of the performance of the project, paying particular attention to the
outcomes and outputs of the project against its objectives before as well as after the intervention.
1
• Assess the intended and unintended outcomes of the project and determine the level of the
project’s contribution to these outcomes and contribution to flood response effort during the
project timeframe.
• Assess the relevance, effectiveness, efficiency, and sustainability of project strategies and
activities.
• Identify practices, key lessons learned and propose practical recommendations for follow-up
interventions.

D. Target Audience
The targeted audience for the evaluation included community members of flood effected districts of
Dadu and Badin.

E. E. Evaluation Scope
Thematic Scope: The evaluation will focus on the following sectors;
• Rehabilitation activities in schools;
• Rehabilitation of hand pumps and other WASH activities;
• Distribution of Agriculture & Livestock grants;
• Provision of Kitchen Gardening packages;
• Cash transfer programing.

F. Areas of Enquiry
The final evaluation will further inform the achievement of all the indicators mentioned against each
of the objectives mentioned below.
Results
1. Increased access to clean drinking water for flood affected communities with improved Hygiene
practices
2. Improved learning environment for children enrolled in schools
3. Increased protection services to communities
4. Increased livelihood services to communities

Indicators
1. No. of water points rehabilitated/constructed
2. No. of water points rehabilitated/constructed
3. No. of HHs receiving hygiene sessions
4. No. of HHs receiving hygiene sessions
5. No. of HHs receiving hygiene sessions and Kit
6. No. of HHs receiving hygiene sessions and kit
7. No. of HHs receiving hygiene sessions and Kit
8. No. of HHs receiving hygiene sessions and kit
9. No. of schools rehabilitated/constructed
10. No. of schools rehabilitated/constructed
11. No. of schools provided with TLM kit and basic equipment
12. No. of schools provided with TLM kit and basic equipment
13. No. of schools with updated School safety plans
14. No. of schools with updated School safety plans
15. No of village level grant or in kind to implement improvements Safe house rehab or repair
16. No of village level grant or in kind to implement improvements safehouse rehab or repair
work
17. No. of households provided with livelihood support through conditional grants
18. No. of households provided with livelihood support through conditional grants
19. No. of households provided with kitchen gardening kits
20. No. of households provided with kitchen gardening kits
21. No. of beneficiaries trained on agriculture, livestock and DRR
22. No. of beneficiaries trained on Agriculture, livestock and DRR
2
 23. No. of beneficiaries provided with (MPCA)cash vouchers
24. No. of provided animals vaccinated and dewormed
25. no. of beneficiaries provided with livestock kit
26. No of beneficiaries trained on livestock management
27. No. of households provided with poultry birds
28. No. of beneficiaries trained on poultry management
29. No. of households provided with poultry kits
30. No. of households provided with livelihood support through conditional grants for
entrepreneurship.
31. No. of beneficiaries trained on business plans development
32. No. of beneficiaries oriented about CRM and FAM system

G. Indicative Methodology

The indicative methodological approach for this evaluation includes retrospective research to
document pre as well as post intervention changes. The consultant/Firm is expected to review project
documents and beneficiaries’ data. A mixed of quantitative and qualitative techniques/methods to be
employed for data collection to get the information related to the indicators before and after
intervention. Quantitative methods will have focused more on assessing achievement of the project’s
intended objectives as well as significant changes attributable to the project. Qualitative methods will
document success stories and impacts/results attributable to the project. A quantitative survey
questionnaire will capture quantitative data to show changes in the short-term outcomes and how
perceptions and attitudes have changed since the start of the project.

a. Sampling Design
A multi-stage clusters random sampling process to be adopted for the household survey whereby
districts, UCs and villages to be sampled from project area. The selection will be done using simple
random sampling. The sample will be allocated across UCs in the target districts using probability
proportionate to size (PPS) so that the UCs with a higher number of registered participants contributed
a bigger sample compared to that with a smaller number of registered participants. Within the villages,
simple random sampling to be used to select respondent households who took part in the project
intervention and ensure that each household has an equal chance of getting selected to be the study.
On the other hand, purposive sampling will be applied for the qualitative interviews. Purposive
sampling will allow the selection of respondents who had rich and sufficient information about the
project.

The firm will develop an interview questionnaire with the household, participants of the project, and
community elders and stakeholders. For key informant interviews, the firm will develop customized
questionnaires for each participant. The analysis of the data will include a descriptive analysis of all
the variables and a determination and analysis of associations among them. The researcher will reflect
on the data overall and trend in each of the areas and the implications would it have on the project.

b. Data validation and Entry

Data quality will be given particular attention. At least 15% spot check by the field supervisor at the
end of the day and 25% back check to be ensured. Consistency and redundancy checks will be built
into the data entry system to minimize typing errors.

H. Evaluation Team and Responsibilities

The selected firm will work closely with CARE in Pakistan team for their input into all final evaluation
activities. The selected firm will undertake the following key responsibilities.

Key Responsibilities

3
a. Evaluation Design:

— Review project documents.;

— Develop evaluation approach/methodology, design including sampling plan in consultation
with CIP;
— Develop data collection questionnaires for the survey, assessment, FGDs, interviews, and key
informants;
— Develop and share inception reports along with data collection questionnaires.

b. Data Collection:

— Formatting and printing all questionnaires according to CIP specifications;

— Detail training of interviewers on respondent selection and interviewing techniques. Conducting
a role-play and demonstration to train the data enumerators and pre-test the
tool/questionnaire.
— Training of data entry teams in the use of data collection and entry instruments.
— Supervising the field administration of the questionnaire;
— Supervising the data entry process using an appropriate software package (e.g. SPSS);
— Taking charge of all the logistics related to the study;
— Informing local authorities about the administration of the evaluation.

c. Data Entry and Analysis:

— Editing and coding responses and entering and processing data;

— Analyzing collected data using SPSS and MS Excel and submitting a complete standard report;
— Submit the cleaned data set in the requested format (preferably in EXCEL format).

d. Quality Control:

— The firm will implement quality control measures to ensure a high level of interviewer
performance. A full description of these measures and the results of the quality control must
be included in the final report.
— The firm shall ensure that every respondent can be matched to a questionnaire and an
interviewer.
— The time and duration of the interview must be recorded and included in the final dataset.

e. Report Production and Presentation:

— Detailed plans for tabulation and analysis (of both qualitative and quantitative data)
to be presented to and approved by CARE in Pakistan.
— Preparation of consolidated report (50 pages) for consortium partners and sharing with project
management for feedback and input.
— Amendment of draft report incorporating project management and stakeholder's input and
production of the final report
— Submitting all the documents related to the study (filled questionnaires, qualitative process
transcript, electronic versions of the collected data, and so on)
— Final consolidated evaluation report in an agreed format
— PPT Presentation of analyses of data and findings.

I. Intellectual Property Rights

A contract for this project will only be awarded on the condition that all information, reports, and
plans, both print and electronic that may have been designed specifically for this project, in whatever
format, will belong to CARE in Pakistan. The Firm may not use the data for their research purposes, nor
license the data to be used by others, without the written consent of CIP.
4
J. Timeframe and Payment Schedule

The study must be completed and submitted to CIP within 45 days after the date of the award of the
contract. The firm will propose a timeline with built-in slack time and obligates itself to adhere strictly
to the survey schedule proposed. Failure to observe the schedule may result in a penalty at the
discretion of the Client. Below is the breakdown of activities with time;

Activities Days Date Payment (%)

Inception Report 05 Days Mar 20, 2024 20%

Data Collection 10 Days April 15, 2024 10%

Data Analysis and Draft report 10 Days April 25, 2024 30%

Final report 05 Days May 5, 2024 40%

K. Deliverables

The following are the expected deliverables:

Output 1:
— Inception report
— Survey questionnaires
— Detailed Sampling plan
— Protocol/Instructions for field assistants
— Quality Assurance mechanism
Output 2:
— Data sets
— Data Analysis Plan
— Draft Report

Output 3:
— Final Report, brief reports, PowerPoint, and datasets

L. Selection Criteria
The general eligibility criteria of the firm (may be included depending on the kind of firm we are
looking for;
• The firm must be registered under the security and exchange commission of Pakistan;
• The firm may be located in any part of the country but should have work experience in Sindh
and Baluchistan provinces of Pakistan;

The submitted proposals will be evaluated using following set of criterions;

A. Technical Proposal
• Appreciation of the TORs and Qualifications, if any
• Previous Experience (details of assignments of similar nature successfully completed by the
firms in previous years, maximum 5; for each assignment, please mention the title, duration,
client, total cost, the role of the firm, a brief description of services rendered by the firm
and attach sample reports.
• Approach and methodology of data collection, data analysis, and report writing (including
how to manage the assignment, quality control mechanism for data collection, kind of
software to use for data analysis, the work plan in the form of a Gantt Chart; team
composition and personnel inputs; without any mention of the professional fees)
B. Organization Capacity
5
 • Credentials of the Firm (Organization, core competency, experience, and human resources;
annual turnover for last three years & annual turnover on similar assignments for last three
years not more than 2 pages)
• The firm must have 5 years of past previous experience in similar assignments.
• The firm must have successfully completed at least one assignment of similar nature in the
last 5 years.
• The firm will be responsible for getting NOC required to conduct such study.

C. Team Composition: CVs of the proposed personnel and commitment of their availability for
the (duration of the) assignment. The firm should have well-qualified team members (FSL
Specialist, Livestock Specialist, WASH Specialists, M&E Expert and quantitative and qualitative
research experts). In addition, Team Leader will be someone with proven experience in
participatory evaluation and emergency response approaches.
D. Financial Proposal: The financial proposal for the study will be submitted along with the
proposal but in a separate envelope. The financial proposal should cover, professional costs,
travel costs, boarding and lodging, data collection cost, taxes, and other costs. Please share
your financial cost as per below.
E. Interview: The shortlisted firms will go through an interview process before selection.

Below are the criteria for the selection of a firm. Marks in each criterion will be equally divided
among the parameters mentioned. The shortlisted firms will go through an interview process for final
selection.
A Technical proposal/approach (weightage 30%) Scores
A Proposal (weightage 30%)
A.1 Understanding of the Assignment and geographic context 5
A.2 Plan for desk review of secondary sources and project documents for validation of 5
findings from primary data
A.3 Sampling methodology and size 5
A.5 Methodology of tool development and Data collection (skills to collect robust 5
qualitative and quantitative data, data collection plan, data analysis plan
A.6 Disaggregated data, data quality assurance 5
A.7 Timeline clear and adequate timelines 5
B Organization Capacity (weightage 20%)
B.1 Demonstrated relevant experience of conducting similar research in past five years 20
(one study=5, if four studies are conducted then 20 marks)
C Team Composition (weightage 20%)
C.1 Adequacy of team composition, profiles, and experiences. Appropriateness of team 20
to complete the assignment.
D Financial (Weightage 20%)
D.1 Total budget proposed for competing the research study 20
E. Interview (weightage 10%)
E.1 Interview Marks based on panel discussions/presentation 10
Summary
A. Technical proposal/ approach 30%
B. Organization Capacity (weightage 20%) 20%
C. Team Composition (weightage 20%) 20%
D. Financial (weightage 20%) 20%
E Interview (weightage 10%) 10%
Total Marks obtained

M. Application

6
In case any clarification is required on TORs, please contact the Focal person of CARE International
through landline number 051-4939102 or 102. During office working days (Monday to Friday) before
3:00 PM, Mar 5, 2024, or write an email to PAK.Procurement@care.org.

Eligible and interested consultant/service provider must submit their application package with
required documents and information in two separate sealed envelopes for “Technical proposals” and
“Financial Proposals” through a registered courier or by hand to the below address by or before
March 11, 2024.

Address:

ATTN: Procurement Committee – CARE International in Pakistan.

Plot#1-E, Street 46, Bazar-4, Class III,

Sector I-8/2, Islamabad.

Phone: 051- 4939102-3