Technical Impact Evaluation Study

Technical Impact Evaluation Study of the “Muhuri Kahua Flood Control,
Proposal Drainage and Irrigation Project (Revised)”under the IMED (SL-01)
Form 5A4
A. TECHNICAL APPROACH AND METHODOLOGY
A-1: Understanding of the Project and Assignment
4.1 Introduction
This proposal intends to respond to the requirement of the Evaluation Sector of the
Implementation Monitoring and Evaluation Division (IMED) of the Ministry Planning for
Conducting Impact Evaluation Study of the Project “Mahuri-Kahua Flood Control, Drainage
and Irrigation Project (Revised)” aiming to the socio- economic and environmental impacts
associated with irrigation schemes and identify major problems and constraints of irrigation
development and remove of drainage congestion and endorse post-monsoon excess surface
FORM 5A4: General Approach, Methodology & Work Plan

water flow by excavation/ Re-excavation of drainage channel/khals and erection of drainage
structures The project was implemented by the Bangladesh Water Development Board
(BWDB) under the Ministry of Water Resources from July 2004 to June 2010 with the cost of
Tk.13929.39 lakh.
4.2 Background of the Sector
Flood management in riverine Bangladesh has been considered as a top priority for last few
decades. The high water levels in the major rivers during monsoon cause floods drainage
congestion and over-bank spillage of their tributaries, which is often exacerbated by runoff
from coincident high local rainfall. Sometimes, periodic severe flooding is also common
covering 37 percent or more of the country in one out of every 10 years. However, an
environment friendly mechanism is yet to be designed for enhancing integrated flood
management. The present water management plan will address the issue properly. In this
backdrop, present project has been formulated a parted from action plan for comprehensive
drainage management.
The project area is scheduled commencement in FY: 2004-2005 as per PCP approved by
ECNEC as the project has also been included in ADP of 2004-2005 under sectoral block
allocation.
The project area is situated in Feni district on north-east proximity of Feni Town at the south
eastern part of Bangladesh. The project area is surrounded by Tripura State of India and hilly
terrain in the north-east and north-west. In south-east south-west direction, Feni River and
kalidas-pahalia River is flowing respectively. Most of the part of parshuram Fulgazi upazilla in
Feni district lies in proposed area. The project area has a natural north to south descending
slope with a relatively steep gradient of 1.33.the area is approachable by road c6004n5cat56n
netwar2 r64nd the year. The Fen –arsh4ra0-Be336n5a road, Chagalnaya-Parshuram road
and Feni-Chagainaya road is located in the north west, north east and southern direction
respectively.
The project area is mainly dispersed in basin area of three rivers. Muhuri, Kahua and Selonia.
These river system along with their tributaries and charas on the east and west and the
internal lkals constitute natural drainage network if the area. The Muhuri, Selonia and the
charas originate from hills in india with major segments of their catchments lying beyond the
country’s border. Heavy monsoon rainfall across the border generates excessive flow in these
rivers and chars. flowing downstream, the river and chars, particularly those of Muhuri and
Kahua rivers. Such short-duration but disastrous flash floods inflict serious damage to
standing crops seedlings and devastate the area infrastructures. Over the years, recurrence
1
of such floods justifiably has created a strong feeling of insecurity among the people in the
area.
Deposited, neither any comprehensive water management Program was so far taken to
reduce intensity of recurrence flash in the area nor any appropriate and/or comprehensive
study was conducted on this complex hydro morphological regime to initiate an integrated
water management plan. However some piecemeal innervations were scattered taken to
mitigate flash floods and removal of drainage congestion. For example, dwarf embankment
was created in 1955-56 on both banks of Muhuri feiver that was later on enhance to marginal
dyke by resection. Besides, floods bypass named as Khulna River was excavated in 1965-66
to mitigate flash food havoc of hilly stream (from Muhuri river near Pashuram at length out of
Total70.00km marginal dyke was enhanced as interior dyke under FFW programme.
4.3 Rationale of the Project
The hydrology of the proposed project area is mainly government by the rivers, Muhuri, Kahua
and Selonia which originate in Tripura hills and traverse through Indian Territory before

entering into Bangladesh. There are several chars within the project area originating from the
hills of Tripura state of india.
T aman is predominantly the main crop in the project area follows by Baro. Pre-monsoon flash
flood and monsoon flood enters into the vast cultivated land along the left bank of Selonia
River breaching the existing embankment on the Muhuri and the Kahua. Yield of T aman is
low and suffers from drought during the maturing stage. So supplement irrigation during
September- October will enhance the yield of Aman crop. The Baro Crops of the project area
needs irrigation and soils the case with wheat and other cereal crop. Some of the identified
khals, chharas are required to be re-excavated to facilitate the post monsoon drainage.
4.4 Objectives of the Project
Main objective of the project is to provide comprehensive flood control and drainage facilities
and augmentation of surface water flow for ensuring year round irrigation facilities in order to
increase agricultural production as well as increase of per capita income for local income for
local dwellers in the project area. Another important objective of the project is to enhance
livelihood of local dwellers not merely during project period but also afterwards for sustainable
rural economic development viz. generation of income & employment opportunities and
motivation of private sector in development trend.
The project area covers gross & net benefited area of 35,871 ha. And 25,936 ha.
Respectively. Present Irrigation coverage around project area is 15600 ha and targeted
irrigation command area is to16900 ha. To be achieved onwards completion of proposed
project.
The specific objectives & targets of the project by virtue of execution of proposed
comprehensive water management programme are as under:
 Restore full flood free environment in project area by construction of embankment

required water control structures
 Removal of drainage congestion and endorse post-monsoon excess surface water
flow by excavation/ Re-excavation of drainage channel/khals and erection of drainage
structures;
 Ensure safety of flood control embankment from river- bank erosion, river scouring,
water section erosion and cyclones/tidal surges etc;
 Enhancement of irrigation management programme throughout erection of required
water control structures, rubber dam, development of irrigation canals, irrigation inlets
as required.
2
4.5 Components of the Project

The project was undertaken the following components activities to achieve the objective:
 Land acquisition
 b. Construction of food embankment
 c. Construction of regulator
 Surface Drainage Outlet
 Irrigation inlet
 Rubber Dam
 Re-excavation of Drainage Channel.
 Bank Protective Work
4.6 Objectives of the current assignment

The objective of the impact evaluation study of the IMED is to:
 To review the target and actual progress of items of work implemented under the
project and provide reasons for any deviation.
 To observe and comment on the present functional status of major item of work in the
area (Embankment water control structures, rubber dam, development of irrigation
canals, irrigation inlets etc.) to be selected for survey.
 To assess the socio- economic and environmental impacts associated with irrigation
schemes and identify major problems and constraints of irrigation development.
 To examine whether the provision of PPA 2006, PPR 2008 and Procurement
Guideline of Donors were followed properly in the procurement process (Invitation of
tender, evaluation of tender, approval procedures, contract awards etc) of the
packages (goods, works and services).
 To apply SWOT analysis as to review the strengths, weaknesses, opportunities, and
threats toward implementation of project activities.
 To review the project design and implementation status of major components of the
project.
 To assess the impact of the project on socio-economic development with sustainability
and mainstreaming women in the rural areas through creating employment
opportunities.
 To assess a comparison analysis of life standard of rural communities before and after
this project implementation.
 Arrange a national level workshop to present the draft final report for dissemination of
the study findings and finalize the report incorporating workshop inputs.
 To recommend measured and lessons for more effective and sustainable
management of project activities and replication of best practices in future projects.
4.7 Scope of Work

The study design and field works plan will be based on the following components of the
project. Sampling of the evaluation study will be made on the basis of coverage of work and
area mentioned below:
SL Coverage of work Area Coverage
i Address all the stated objectives Construction of embankment 100% of the covered
water control structures, rubber dam, development of irrigation area.
canals, irrigation inlets etc. of current assignment
ii Interviewing direct beneficiaries and non- beneficiaries
3
iiiConsultative meetings/in-depth interviews with key officials and

concerned stakeholders
iv FGD meetings with local elite, local administration, concerned
officials of water board
The specific scope of work of the consultant has furnished below:
i) Consultants will have to carry out of the evaluation study following necessary steps
on the basis of the evaluation objectives considering the project components
mentioned in scope of services.;
ii) Consultants will have to organize a local level workshop in the project area to hold
discussion with the stakeholders and beneficiaries during data collection;
iii) Consultants will have to prepare an evaluation report based on data collected from
the project areas and get approval from the authority concerned; and
iv) Consultants will also have to present the draft report in the national level workshop
for dissemination of the study findings and finalize the report incorporating
workshop inputs.

A-2: General Approach and Detailed Methodology
4.8 Understanding of the Assignment
The objective of the study is to assess the implementation status of the project and impact on
the Mahuri-Kahua Flood Control, Drainage and Irrigation Project. However, gathering
knowledge on the target and achievement including present functional status of the project,
the consultant will review and assess the implementation status of the project in respect of
procurement process examination, Restore full flood free environment in project area by
construction of embankment required water control structures; Removal of drainage
congestion and endorse post-monsoon excess surface water flow by excavation/ Re-
excavation of drainage channel/khals and erection of drainage structures; Ensure safety of
flood control embankment from river- bank erosion, river scouring, water section erosion and
cyclones/tidal surges etc. A wide range of efforts such as inception of assignment with BWDB
and IMED personnel at local and national level, and others, numerous field visits, interview
with BWDB officials, beneficiaries at their areas, discussion with the officials of Mahuri-Kahua
flood control, drainage and irrigation, Ministry, relevant officials from government and private
sector will been made to understand the key methodological and contextual issues regarding
the study. To ease the whole study process constant and continuous communication with
BWDB and IMED officials and with knowledgeable and influential leaders will be maintained
by the consulting firm throughout the study. This section describes the technical aspect of the
methodology and sampling strategies of the study in detail. In line with this, the section also
provides a comprehensive description of the methodology for ensuring Quality Assurance and
Quality Control (QAQC) measures for conducting data collection, recording, cleaning/storing
and analyzing data.
4.8.1 Description and justification of the general approach and Specific method and
techniques: The consultant’s strategy and approach and methodology of the study will be
practical and achievable and free from ambiguities to ensure high quality and on time delivery
of the outputs. The strategy and approach and methodology and tools for implementing the
study are described in the following paragraphs.
The impact evaluation study will be designed promptly after signing of contract with the client.
This will involve preparation of study tools-questionnaire for impact evaluation study and
checklist for focus group discussion, and checklist of issues to be shared with participatory
and non-participatory observation. Key indicators will be first selected and agreed with the
client and based on that questionnaire for study and checklist for focus group discussion, and
checklist of issues to be shared with participatory and non-participatory observation will be
4
prepared and tested and sufficient copies will be produced. The study design will also include
finalization of work program in consultation with the client.
4.8.2 Review of existing literature and secondary sources data and initial consultation
meetings: Detailed review of existing documents on concept, definition, classification and
methodology for assessing the implementation status of the project components and results of
project support and services, previous similar works done in the past in different countries and
benefit from the findings in designing the proposed study, implementing it, analyzing the
feedback the data, and preparing reports. The review of relevant documents and secondary
sources information will be done by the senior members of the study team prior to finalization
of methodology and data gathering instruments. The consultants will review all the existing
literature and documents prepared for the project, progress report, DPP, evaluation report and
PCR, tools and formats for conducting impact study and its consequences based on the
selected indicators and baseline/BBS/BWDB report. The consultants will collect relevant
literatures from the IMED and BWDB offices. The consultant will list the main factors such as

installation of new pumps, reconstruction of existing pump houses, present functional status of
irrigation, and increases of irrigated areas, crop intensity and crop production, and decrease
loss of crop and water etc. The consultants will analyze the impact and implications of the
project from its implementation status.
4.8.3 Consultation with key professionals: An initial meeting with the IMED and BWDB
authority (including the Project Director) will be held and agreements will be made on sample
framework and pre-test and survey instruments.
4.8.4 Sources of Data: The study will be conducted to generate the stipulated primary data.
Prior to generation of primary data, the relevant secondary information on the study including
documents/reports will be obtained from the IMED and BWDB authority and reviewed. To
develop the study instruments accurately and to reveal the inherent characteristics of various
dimensions of the impact evaluation study and its contribution to the economy, the secondary
data will be carefully scanned and will be collated with the study data. For generating the desired
primary data, the proposed census and sample study will be conducted using an appropriate
sampling design and a study instrument (questionnaire).
4.8.5 Conceptual Framework: The conceptual framework for the assignment has developed
based on the meticulous reviews of the available literature/documents on the project and
based on understanding of the TOR provided by the client. While analyzing the TOR, special
thought has put on understanding the objectives, the scope of work, the suggested approach
and methodology and the time allocated to undertake the assignment. The consultant will
inspect and directly approach to the sample beneficiaries at four Upazillas of Feni District in
addition of FGDs and KII. The consultant will keep close contact with all stakeholders whose
advice and cooperation will make the study successful. The consultants’ approach applies a
conceptual framework of the level of interactions and probable study organization involving all
concerned at Figure 4.1 in the next page.
5
Figure 4.1: The Conceptual Model for Impact Evaluation
Household Baseline
Impact Survey
Evaluation of CHTDF
Study
Review available Reconnaissance Field Review TOR &

data/reports visit previous reports
Scope
 Collection and processing of data

 Determination of achievements of the project objectives and examine procurement process
 Assessment of the changes in crop productivity/intensity, reduction in cost and loss of crops and loss of

water
 Assessment of the impact of project activities to the rural community
 identification of strengths and weakness and make recommendations
Framing Methodology
Review of officials Inspection & Observation FGD/KII Survey

Records
Reviewing progress of delivery of input & Assessment of the Impact of the

output target achieved project
Analysis & Interpretation
Ascertain the implementation status of the project as per project objective, effectiveness of
project towards increasing rural employment opportunities, standard of livings and reducing
overall poverty situation of the rural community
Comparison between, `Before’ & `After’ operation and skills of BWDB personnel for effective operation of M-
K flood control, drainage and irrigation regulator
Assess impact of the Project
6
4.9 Approaches
4.9.1 General Approach: The consultants as part of their approach to accomplish the
objectives of the study will assess the capacity building of the concerned officials of BWDB
including the impact of Restore full flood free environment in project area by construction of
embankment required water control structures, Removal of drainage congestion and endorse
post-monsoon excess surface water flow by excavation/ Re-excavation of drainage
channel/khals and erection of drainage structures; Ensure safety of flood control embankment
from river- bank erosion, river scouring, water section erosion and cyclones/tidal surges etc;
enhancement of irrigation management programme throughout erection of required water
control structures, rubber dam, development of irrigation canals, irrigation inlets as
required,indicators, at the project areas as a result of project intervention.
4.9.2 Specific Approach: The consultant’s approach will be in line with the main objective of
the study that seeks to gather information and provide complete picture on the implementation
status of the project, including Restore full flood free environment in project area by

construction of embankment required water control structures; Removal of drainage
congestion and endorse post-monsoon excess surface water flow by excavation/ Re-
excavation of drainage channel/khals and erection of drainage structures; Ensure safety of
flood control embankment from river- bank erosion, river scouring, water section erosion and
cyclones/tidal surges etc; enhancement of irrigation management programme throughout
erection of required water control structures, rubber dam, development of irrigation canals,
irrigation inlets as required.
In addition, the study will carry out SWOT analysis to identity strengths and weaknesses for
proper management and functioning of the Mahuri-Kahua drainage and irrigation pumps.
4.9.3 Strategy and Approach/Methods and Techniques: The consultants consider that the
study comprise of two major activities
(a) Review and Assessment: Review the implementation status of the project such as
procurement, construction of embankment required water control structures, Removal
of drainage congestion and endorse post-monsoon excess surface water flow by
excavation/ Re-excavation of drainage channel/khals and erection of drainage
structures; Ensure safety of flood control embankment from river- bank erosion, river
scouring, water section erosion and cyclones/tidal surges etc; enhancement of
irrigation management programme throughout erection of required water control
structures, rubber dam, development of irrigation canals, irrigation inlets as required.
(b) Identification of bottlenecks and Recommendations: Identify the strengths and

weakness observed in proper management and functioning of regulator which is
control the flood.
4.10. Methodology
The methodology for the present impact study will use system-wide approach, which is both
detailed and participatory. This approach involves wide-ranging and sequenced discussion
with IMED and BWDB professionals and officials related to assess the implementation status
of the project and results of the project support and services. The study will involve the use of:
(i) formal and non-formal interviews; (ii) semi-structured interviews by means of focus group
discussions and (iii) field survey through structured questionnaire, Collection of primary and
secondary information, reviewing the available reports and a series of reconnaissance field
visits by a team of consultants to the project area. The reconnaissance field visits covered
substantial part of the project area. During the field visit the consultants interacted with the
BWDB concerns personnel of the study.
7
The reconnaissance field visits including the interaction with the project/BWDB officials and
others will subsequently integrate into the conceptual model towards the formulation of the
detailed methodology of the present study. While the conceptual model crystallize different
ideas into a simple form for carrying out the study, the detailed methodology provide the
modes of implementation including study design, sampling procedures, preparation of
questionnaire, training of enumerators, framing of analytical techniques and the output
generation.
The consultants will use different methodologies for the various activities involved in
implementing the proposed work plan within the framework of approach. The consultants will
collect secondary data from various sources; administer survey to collect data of beneficiaries
to know their use of water, crop intensity, yield of crops, crops loss and water loss,
employment, and poverty level etc, hold small working meetings with key officials and
informants of BWDB, ministry local elite, local administrators, teachers, religious leader, and
women’s representative in the project areas. The consultants propose to follow simple
methodologies for each of the activities and capture quality data and feedback for the impact

study. The consultants based on the objectives of the study and strategy and approach of the
study plan to carry-out the study using secondary and primary data sources collected using
both quantitative and qualitative methods and appropriate tools. The consultants’
methodology and work plan is designed following paragraphs in a holistic fashion so that the
study is completed on time and generate useful information and produce a report after in-
depth analysis of information and feedback. The activities and how these would be carried out
is discussed in brief in the following paragraphs along with the tools that would be used.
The consultants consider that there should be a common understanding of the study inputs
and outputs including approach and methodology and tools right before the study starts to
ensure a successful study as expected by the client. The consultants will undertake a short
field visit and then initiate several quick meetings with the client and reach a consensus of the
approach and methodology and tools and outputs and timeline. This will also include selection
of indicators, preparation of tools/questionnaires, monitoring and supervision plan, plans for
data triangulation and validation plan, data analysis plan, report outlines, etc.
4.10.1 Description of different stakeholders to be involved in the proposed activities:

BWDB officials, project concerns personnel, key officials of the BWDB, farmers, water user
association, local elite, teachers, and local administrators at the project areas etc will be
involved in survey activities.
4.10.2 Nature and extend of the involvement of the local stakeholders: Local
stakeholders will be involved in study activities such as selection of supervisors and
enumerators, identifying, listing and locating the beneficiaries, and collection of data from
different respondents, conducting FGDs and KII.
4.10.3 Coordination with BWDB and IMED: The consultants will coordinate with respective
BWDB offices to get their advice and make good relations and environments with the
beneficiary’s of water user associations and others for smooth survey and data collection
work. With the help of local elites, local administrators, socially aware gents and ladies and
suggestions from the BWDB engineers, the consultant with supervisors and enumerators will
reach the target beneficiaries to collect information, conducting FGDs and Key Informant
Interviews. Collaboration between the consultant and BWDB will be forged throughout the
study in the phases of preparation, pre-testing and finalization of data collection instruments
as well as training of the field staff. Moreover, during data/information collection, concerned
IMED/BWDB staff will be invited to observe the activities of the consultants. In addition to that,
the consultants will discuss when necessary with the officials of IMED/BWDB.
8
4.10.4 The Proposed Study Design
Full discussion on the study design covering various issues is considered important to select
the appropriate design to facilitate the assessment of the impact of the project intervention at
the later stage of project implementation (after the baseline survey). The designs appropriate
for impact study is true experimental design. The concepts used are those developed by
Compbell and Stanley (1996)
Figure 4.2: True Experimental Design

Time
Project group
Survey RA P1 P2
Group
Control group C1 C2

In the design, all subjects are randomly assigned (RA) to both project group (beneficiary) and
control group (non-beneficiary) of the project in upazilas. The two measurements P 1 and P2
refer to project groups at baseline and project study time (present study), which C 1, and C2
refer to study period respectively.
Hypotheses: P2 > C2 for indicators like average overall performance, etc.

True experimental design is the strongest design in terms of validity.
Gross out Come = P2 – P1 = effect of project and other factors (in BWDB project)
Gross out Come = C2 – C1 = effect of other factors (in non- BWDB projects/groups)
Effect of intervention = (P2 – P1) – (C2 – C1)
= (P2 – C2) – (P1 – C1)
= P2 – C2 if P1 = C1 (at the baseline)
If (P2 – C2) is statistically significant, then the impact is evident.
Figure 4.3: The simplified model of the project implementation process
Input Intervention Output Outcome Assessment

and process
Implementation refers to the transformation of input through a set of technical and

organizational system and procedures, assumed to be different for different components and
locations, produce a specified output, outcome and impact. The consultants will develop P 1
for the indicators, BWDB project groups and C1 for non-project groups indicators at the
baseline.
If the difference in the levels of indicators between the project and control group is statistically
significant, at the end of the project, then it would indicate that the impact of the project is
evident.
The current level of the indicator is Pc and the baseline level was Pb. The null hypothesis is Ho;
Ho: Pc = Pb = P
HA = Pc ¹ Pb
9
The estimates of Pc and Pb are pc and pb respectively.
The test statistic t is defined as
½Pc – Pb½
t = ----------------------------- with 2n-2 degrees of freedom
{Pc (1-Pc)} + {Pb (1-Pb)
-----------------------------
n
Pc and Pb are estimates based on independent samples, each of size n respectively. If n is
very large then the value of 2n – 2 is large and the degrees of freedom is also large.
The overall situation may be represented as follows (Figure 4.6).

Figure 4.4: Sample Groups
Impact Evaluation Study
Project –MK Flood control

Control group
Drainage &irrigation-BWDB
Baseline situation/Secondary
Similar data
Baseline situation or near similar
Performance indicator
Performance indicator
MK Irrigation
Intervention
+ other factors
Other
Level of performance indicators Level of performance indicators

Contrast after certain time
after certain time
Level of performance indicators Level of performance indicators

after completion of MK irrigation
Contrast after completion of M K Irrigation
If the difference in the levels of indicators between the project and control group/non-project is
statistically significant, at the end of the project, then it would indicate that the impact of the
project is evident.
The consultant will also use project log frame as a tools of impact assessment which has
been presented below:
Table-4.1: Log frame
Narrative summary Objectively Verifiable Means of Verification Important
Indicators (OVI) (MOV) Assumptions (IA)
Program Goal:
 Self reliance in food  Ensure Security  Evaluation Report
grain production against droughts & of the National FY
 Poverty Reduction flood hazards gross Plan.
Strategy of Gov & net area 28697 ha  National
 Environmental & 20749 ha environmental
improvement respectively. report
 Accelerated  Secured natural and  Regional /
1
0
Macroeconomic human resources National Business

activities  Accelerated agro- reports
based business  2nd PRSP
activities.
Program Purpose:
 Boosting up crop  Incremental paddy  Report of XEN of  GOB Policy
production with production of Feni O&M Division  National Water
reducing extent of 32651.84 mt.  Mid-term Management
damage  Employment Evaluation Report Plan
 Reducing rural generation by IMED
poverty with  Ensure safety of
increased income & crops from drought
employment & flood and lives &
properties
 Sustainable Water
Management

Outputs:
 Comprehensive  Covering gross &  Monitoring report  Active
FCDI facilities in net benefited area of BWDB; participation of
project area 28697 & 20749 ha.  Progress Report the people
 River erosion respectively of O&M Division;  Formation
mitigation  cropping intensity  Field Report of the farmer’s group
 Overall socio- increased from Feni O&M for on-farm
economic present 159% to Division. activities.
enhancement for 185%
local dwellers &
environmental up
gradation
Inputs:
 Embankment –  Tk. 5640.90 Lakh  DPP of the project  Required ADP
122.78 km.  Tk. 916.27 Lakh  Field verification budget allocation
 Regulator – 6 nos.  Tk. 546.33 Lakh  Field report of the and placing of
 SDO – 16 Nos.  Tk. 3618.38 Lakh SDE and XEN fund in the field
 Protective work –  Tk. 399.94 Lakh  Measurement on time.
6.30 km.  Tk. 493.77 Lakh Book the work  Land acquisition
 R/E of Channel –  Tk. 625.60 Lakh  Quality control in time
66.59 km.  Tk. 1657.90 Lakh monitoring and  Approved
 Rubber Dam – 1 No. supervision of design.
 Irrigation Inlet – 130 work
Nos.
 Land Acquisition –
73.77 ha.
4.10.4.1 Beneficiary and Non-Beneficiary Survey
The population under the study universe is constituted to review the different aspect of
implementation status of the project and its impact on irrigated areas, crop production, crop
intensity, and capacity of BWDB personnel for reduction of cost and loss of water and crop
through installation of new pumps and renovation of pump houses etc. Thus, it is appropriate to
determine a representative sample size of beneficiaries at first.
A definite principle of statistics is followed for sample selection and calculation which is also
used in case of higher study. A sample survey should be properly planned and carefully
executed in order to avoid inaccuracies. As there is no list of family beneficiaries so using
Cluster sampling should be appropriate for it. Sample number determination using cluster
sampling Formula is given below:
1
1
2
Z ×q
n = 2 × Designeffect
r ×p
n= sample size (sample number upon finite population)
p= Flood is controlled through construction of river embankment and establishment of drainage
pump. We assumed that about 70% flash flood is reduced due to the project intervention,
Therefore p=0.70
q = 1-p=1-0.70=0.30
z is the standardized normal vitiate which is 1.96 at 5% level of significance with 95%
confidence interval
r is the relative variation (or relative error) which we assumed for this study is 5% (if the error
level is 10 then r =0.05)

2
(1 .96 ) ×0 .30
n= ×1. 82
(0 . 10)2 ×.70
Design effect 1.82, with 95% confidence level and 5% minimum error level, sample number
n= 1198.58. After round the total sample beneficiaries is estimated at 1200.
The sample size will be 1200 by using round figure of 1198.58 for direct beneficiaries for
project area of Feni district. In the project area bear 4 upazilla. Therefore, four upazilla of project
intervention, a sample of 1200 beneficiary households is expected to be representative and will meet
our purpose. In addition, 50% of the non-beneficiary sample (600) will be considered for control group
data collection to compare the changes of outcome variables of the project.
Using 95% confidence level with maximum 5% margin of error we have obtained a
representative sample size n = 1800 (Program Group-1200, Control Group-600 respondents)
for this study. The respondents of the study will cover beneficiaries including water user
association and non-beneficiaries etc. The sample will be stratified by program group and
control group. The consultant is assuming that the most disaggregated analysis for which
precise data is required are based on upazila.
The above formula is used as a guide to ensure representativeness of the sample. However, the study
team determines the size of the sample keeping in mind the time and budget constraint after
consultation with the IMED/BWDB officials. An approximate size of the sample could be 1800
households, including both beneficiary (1200) and Non-beneficiary (600), which fits well in the time
and budget framework as well as in the above formula.
However, in order to reach such beneficiaries we shall adopt two-stage random sampling
procedure. Firstly, in total four upazilas of Feni district. Secondly, then totally 1800 (round
figure) beneficiaries and non-beneficiaries will be selected by using stratified random sampling
procedure on the basis of drainage system and irrigation water users and non-users list and
location, and level of users from the upazila.
In order to reach stipulated beneficiaries and non-beneficiaries, the consultant will collect flood
control embankment inhabitant list from the BWDB database before the study. Such action is
aimed at identifying targeted users in the upazila. From this sampling frame the allotted
number of respondents will be deduced and adjusted to make up the total number of 1800. In
case the required numbers of respondents are not available in the selected upazila’s the
adjacent upazila will be selected.
1
2
Table 4.2: Allocation of Project Beneficiaries and Non-Beneficiaries

District Upazilla Sample Respondents
(100%) Beneficiaries Non-Beneficiaries
(other than beneficiaries in
adjacent areas)
Feni District Feni Sadar 300 150
Fulgazi 300 150
Porshuram 300 150
Chhagolnaiya 300 150
Total 1200 600

4.10.4.2 Qualitative Analysis
Qualitative methods are being increasingly used in baseline data and impact/social
assessments as credible and reliable method of data collection. They provide clear insights in
to people’s perceptions and deeper understanding of local contexts, complex coping strategies,
major priorities and solutions used by people. Qualitative techniques will be used primarily to
collect in depth/ perceptual information on selected indicators related to the study. Of the
central methods, the Participatory Rural Appraisal (PRA) would be one of the central
methodological approaches for addressing the present assignment.
Thus, we have decided to adopt Participatory Assessment for the present study. Among
various participatory approaches, the most pertinent one for the present study is
“Stakeholders’ Analysis” and Participatory Rural Appraisal (PRA) will be the most
appropriate technique.
In this analysis the most appropriate tools to be used are suggested as follows:
Qualitative Analysis
FGD KII Physical Observation

& Assessment
4.10.4.3 Types of Instruments and Respondents to be used for data collection
(a) Questionnaire for Beneficiary: The project beneficiary (Mahuri-Kahua irrigated

farmers, water users association) will be filled in a set of pre-designed questionnaire
encompassing issues to assess whether project has ensured more use of agricultural
lands and optimum use of irrigated land, changes in crop productivity/intensity,
reduction in cost and loss of crops and loss of water and drainage. In addition whether
project has any impact in increasing rural employment opportunities, standard of
livings and reducing overall poverty situation of the rural community.
(b) Questionnaire for Non-Beneficiary: The non-project respondents other than
beneficiaries who are not getting any benefit from the project will be filled in a set of
pre-designed questionnaire encompassing issues to the above in same questionnaire.
(c) Guidelines for Focus Group Discussion: The target audiences local elite, local
administration, teachers, religious leaders, water user association, beneficiaries, etc
and project partners regarding different activities of Flood control regulator pumps and
1
3
its effective utilization in the field level will be participated in the FGD. Two FGD will be
organized in each project upazila and control areas with 20 participants. The FGD will
be conducted at a venue, which is convenient for the participants and allows them to
speak freely. Out of total 12 FGDs. 8 FGDs at least two in each sample project upazila
where 160 participants and rest 4 FGDs in control areas where 80 participants will be
covered under this method of opinion collection and validation of the study findings.
(d) Checklist Questionnaire for Key Informant Interview (KII): Out of total 20 Key
Informant Interviews (KIIs), 16 KIIs, four from each upazilla and rest 4 KIIs at BWDB
HQ, Dhaka will be consulted about the project activities regarding project management
and procurement including skills on operation and maintenance of M.K flood control
,drainage and Irrigation pumps, canals etc to increase irrigated areas from 100,000 ha
to 142,000 ha, contract management, project planned and actual period, costing,
strengths, opportunities, weakness and threats etc of the projects.

(e) Physical Observation of News Pumps and renovating of pumps houses
including canals: The consultant will visit and observe functional status of installment
of new pumps and renovation of pump house and re-excavation of water flow
channel/canal etc and its coverage
4.10.4.4 Summary of the data and information collection is presented below:

Table 4.3: Summary of Sample size for the Study
Sample Upazila Sample Size (Statistical Reprehensive) Physical Total
District Observati sample
Project Group Control- Group on Number
FGD KII Non- FGD
Beneficiary beneficiary
participants Participant participants
Dhaka - - - 4 - - - 4
Feni Feni Sadar 300 40 2 150 20 79 591
Fulgazi 300 40 2 150 20 79 591
Porshuram 300 40 2 150 20 79 591
Chhagolnaiya 300 40 2 150 20 79 591
Total 4 1200 160 12 600 80 316 2,368
Table 4.4: Number and Types of Respondents
Activity Participants/ Respondents No of Respondents Category

Respondents
A. Quantitative Survey
A1. Survey: Beneficiaries such as M.K flood control
(Direct Interviews with Beneficiaries 1,200 ,drainage and Irrigation facilities users
Questionnaire) farmers and water users association
A2 Survey: Non-Beneficiary 600 Non-beneficiary respondents who are not
(Direct Interviews with getting any benefit of the M.K flood
Questionnaire) control ,drainage and Irrigation project
B. Qualitative Survey
B1. FGD- Guidelines Program Group: 8 FGDs 160 All categories of beneficiaries includes
with 20 participants in household and industrial set up, local elite,
each FGD local administrators, teachers, religious
Control Group: 4 FGDs 80 leaders and women’s representative
B2. KII –Checklist (i) Project Management 04 Senior Officials related to project
Questionnaire Personnel management and planning includes
financial aspects of the project
(ii) key officials/ 8 Officials of BWDB
informants of BWDB
1
4
officials
B3. Physical Inspection Construction of flood 123 km MK flood control and drainage area
and Observation Embankment
-Checklist Construction of regulator 6 MK flood control and drainage area
Rubber Dam 1 Kahua River
Surface drainage outlet 16 MK flood control and drainage area
irrigation inlets 103 (Nos) MK flood control and drainage area
Re-excavation of 67 km MK flood control and drainage area

drainage channel etc
Total Sample for the Study 2368

4.10.4.5 Implementation and Data Management Plan
The implementation and data management plan includes data collection, data management,
processing, analysing and report writing with work plan and quality assurance of the data
collection and management etc.
a. Quantitative Survey
4.10.4.5.1 Beneficiary Survey: From the targeted beneficiaries list of selected upazila, the
required number of respondents will be randomly selected using a Simple Random Sampling
(SRS) procedure. This will be provided unbiased parameter estimates with minimum standard
errors (s.e.). At par with of the explicit emphasis given in the study, proper care will be taken
on the farmers and water user association. The main fieldwork activities for the study will be
involved generating relevant information using questionnaire and checklist. The data collection
strategies will be included all possible techniques and methods in order to ensure the highest
level of participation from targeted respondents to get in-depth feedback from the individuals’
interviewees and fish related persons/organization. Stakeholder Consultation Meetings will be
arranged at the project office before the main fieldwork. It will be arranged to inform the
stakeholders about the study and requested for maximum cooperation from their side.
4.10.4.5.2 Selection of Respondents: The respondent will be selected from each selected
Upazila. After selecting the location and identifying the respondents randomly from the location
data collection will be conducted using structured questionnaire to cover the required numbers
of respondents so that the representative samples of data can be obtained.
b. Qualitative Survey
4.10.4.5.3 Focus Group Discussions (FGDs): There are certain traditional social behaviors,
which cannot be fully captured by structured interviews. Focus Group Discussion (FGD)
method is therefore, needed to get insight into these social behaviors. In an FGD session,
participants of similar profile will be covered. All FGDs will try to identify the area of making
provision for user-friendly interventions for different target groups and stakeholders in the
respective communities both from public and private perspectives, and on the other hand, will
clarify the cause and effect relationships under quantitative study. Size of each FGD session
will be within the range of 15-20 participants. The consultants through the field staff will identify
the potential participants for the FGD during interviewing the sampled respondents. Suitable
locations will be selected for easy access of participants. The FGD sessions will be guided by
a facilitator or moderator encouraged talking freely and spontaneously about the issues of
study. Under the supervision of one senior professional, the FGD sessions will be guided by
one experienced facilitator. Discussions will be recorded in a tape recorder and in black and
white. One experienced facilitator/or a member of the team will record the key points covered
in course of discussions. Findings will be compiled using both kinds of field records i.e. taped
1
5
record and notes. Eight (8) FGDs will be conducted two in each upazila for beneficiary and rest
four (4) FGDs will be conducted one in each upazilla for non-beneficiary. The proposed FGDs
intend to probe the following issues:
 Present functional status of major inputs/activities of sampled area
 Perception of the benefit from excavation and Re-excavation of the flood control
embankment
 Benefit to restore full potential irrigation efficiency of M.K irrigation project
 Enhancement of annual paddy production
 Role of Muhuri- Kahua flood control, drainage and irrigation project to increase
irrigated area for agricultural production
 Changes in crop productivity/intensity, reduction in cost and loss of crops and loss of
water
 Impact of project activities towards increasing rural employment opportunities
 Assessment of project strength and weakness in proper management and functioning

of flood control embankment.
 Recommendation for improvement of the project impact
4.10.4.5.4 Key Informants Interview (KII): As stated earlier in the proposal, the consultant
will interview target respondents from the project areas. A total of maximum 16 KII will be
studied at least 04 from each Upazilla and rest 04 from project concerned personnel. They will
be interviewed using guidelines. The respondent will be selected based on successful
intervention of the project activities from each of the upazila. The information collected shall
cover the interventions of the project on key sub outputs of the project. The type of issues to be
consulted depends on the persons to be interviewed. Some examples are given below:
A. Concept, Design and Objective of the Project

 Project relevance to the needs of the sector
 Whether the project activities were fully implemented?
 Were project objective achieved as targeted in the DPP?
 Present functional status of major inputs/activities
B. Project Management and Implementation
 Which office was responsible for overall management of project at the HQ?
 Who were entrusted with responsibility of management at the Field level?
 Which office was responsible for preparation of the technical specification of the
tenders
 Did you follow PPR 2008 provision for procurement process of the packages (goods,
works and services)?
 What were the selection criteria of the goods and contractors?
 Was the work completed fulfilling all the technical specifications of the contract?
 How much was the performance of the contractor in terms of the compliance of the
technical specifications?
 Which office was responsible for monitoring the project implementation at the field
level?
 Who was responsible for quality control of materials, management of materials,
quantity and timeliness at the field level?
 Did the contractor and or the client carry out field tests according to the technical
specifications?
 Which office was responsible for analyzing the field monitoring reports?
 Whether the monitoring reports contained any non-conformance by the contractor?
 How many cases of non-compliance of the actual with the technical specifications
were reported?
 How were the cases mitigated? 1
6
 Was the contract value at par with the schedule price? If not, why and how the issue
was resolved?
 What were the major constraints in implementing the project?
 Do you consider the longevity of the new pumps and equipment as per standard
requirement?
 Is there any regular maintenance works carried out?
 What additional needs to be done to attain fullest capacity of pumps?
 Do you face any financial budget allocation and management problem?
 Does fund was good enough to achieve the target?
 Did you able to utilize cent percent of fund? If not, why?
C. Impact of the Project

 Does project able to restore full potential irrigation efficiency of M.K flood control,
drainage & irrigation project

 Does it enhance annual paddy production
 Does project help to increase irrigated area
 Impact on crop productivity/intensity, reduction in cost and loss of crops and loss of
water
 Impact of project activities towards increasing rural employment opportunities
 Assessment of project strength and weakness in proper management and functioning
of MK flood control regulator
 Recommendation for improvement of the project impact
 Best practices of the project and lessons learned to replicate best practices in the
management of similar irrigation projects.
4.10.4.5.6 Development of Methods, Tools, and Checklist : As indicated in the approach
and methodology that the consultants will collect four sets of data and feedback first one
through statistical data study using structured questionnaire, second one through PRA using
focus group discussion methods and checklists and third through KII. Fourth methods through
field visit for physical observation. The first set will provide quantitative data and the second to
fourth set will give qualitative information and feedback. While the four sets will be compared
each other in few areas, the sets will be complementary in general. Some data can be in both
quantitative and qualitative form while some are better in either quantitative or qualitative
form.
The consultants propose to develop both quantitative and qualitative tools after complete
review of project related documents and extensive discussions with the IMED and BWDB
concerned officials and also quick field visits. The consultants will choose relevant indicators
to measure various effects and impacts. The consultants will brainstorm and finally share with
the project concerned officials and finalize the indicators and questionnaires for statistical
studies, checklist for PRA/FGD and KII. Though it is not possible to prepare in advance good
quality study tools (questionnaire and checklist) with limited knowledge about the project and
beneficiaries, the consultants have prepared one set of sample questionnaire and checklist in
English (Appendix 2) just for demonstrating general knowledge about the type of project
activities and beneficiaries and issues involved. The questionnaire will be finalized after
discussion with IMED during the execution of assignment and finalize for using in the field and
translate into Bangla for ease of data collection. The sample questionnaire and checklist are
just specimens and subject to complete remaking through extensive participatory exercise as
explained. The consultants will make advance actions and engage experts prior to
commencement of the contract to undertaking these exercises. Likewise the specimen
sample questionnaire and checklists the consultants have also prepared a sample tentative
list of major indicators as follows that is also subject to complete remaking during
implementation. The indicators are tentative and only indicative. The indicators have been
prepared following the indicators mentioned in TOR.
1
7
Classification Indicators
Demographic Age, sex, religion, marital status, occupation, education, land, assets, and
characteristics liabilities
Flood Control Does the flood control and drainage facility of the project ensure
Changes in Crop Does increase area of crop production, does increase productivity, per/hectare
Productivity yield, pattern of crops, types of crops, does irrigation help to introduce HYV
Crop Intensity Does irrigation help to increase crop intensity, how many seasons crop are
produced and types of crops, does paddy production increase overall
Reduction in Does project help to reduce drainage congestion, does it ensure to get more
drainage sanitation
congestion

Reduction in input Does project facilitated to ensure irrigation water, does it reduce cost of water,
cost of production does overall input cost of water reduce,
Reduction in Water Does project ensure loss of water, does project safe environment through use of
Loss surface water, does project have any negative impact of environment; does
project reduce cost of water
Increasing Does project ensure employment generation though agro-industries,
employment transportation of agricultural products and tertiary services in addition of
generation production and processing, does project increase income and expenditure of
farmers,
Reducing poverty Does daily food intake increase? Are they able to send their children to school,
doctors and other social services, do you have pure drinking water facilities, do
you attend social meeting, role of water user association, are you a member of
water user association etc
4.10.4.5.7 Development and Finalization of Questionnaire: The draft questionnaire has

been prepared based on the objectives and scope of work and the needs and indicators for
the study as indicated in the TOR, proposed approach and methodologies, and the long
experience of the firm in similar assignments. The study questionnaire has developed to
capture necessary indicators specified in the TOR and to fulfill the objectives of the study. The
questionnaire will further review by the project consultants and then discuss with the client for
finalization. Upon approval from the client, the field-testing of the questionnaire will be
conducted. The information based on indicator will be collected by interviewing the
respondents directly through a structured questionnaire.
The questionnaire will be thoroughly reviewed by the experts at different stages. Additions
and modifications will be made during meetings with experts and BWDB/IMED authorities.
After the final approval of the contracting authority the questionnaire will be put to pre-testing.
Pre-testing of the questionnaire will be done at least in two locations as far as possible
nearest to Project headquarters at Dhaka, the consultants will invite IMED/BWDB to observe
the pre-testing of the questionnaires and study instruments. The main objective of the pre-
testing is to test the adequacy and contents of the questionnaire, and the field operational
aspects of the sampling scheme. Length of interview, perception of field enumerators and
respondents, skipping, phrasing, terminologies used, sequence of topics, adequacy of training
of field staff, etc. will be tested through the pre-testing operations. On the basis of pre-testing
results and in consultation with IMED necessary modifications and improvements will be
incorporated into the questionnaire.
The study will be conducted by a group of enumerators guided by a supervisor for each
upazila, the supervisor of each group of enumerators will allocate the respondents of the
respective district catchment areas at the time of administration of survey in consultation with 1
8
the local appropriate agencies. The number of respondents being small compared to the area
of each upazila and the total customer, the supervisors will use purposive random sampling of
beneficiary for administration of survey. The supervisors will select the area where particular
beneficiary people are concentrated and allocate number of respondents according to the
project areas. The supervisor will list the areas and select the respondents fulfilling the criteria
and number in the particular project areas. Thus area will be purposively chosen from each
upazila/sadar and the total allocation to the particular upazila is reallocated according to the
customers. Thereafter, the supervisor will list all beneficiaries of the randomly selected and
required number of beneficiaries for administration of surveys.
4.10.4.5.8 Recruitment and Training of Field Staff: Selection of field enumerators will be
made through an interview board headed by the Team Leader. The other experts and
representatives of the firm will be present. The field supervisors preferably having master’s
degree and enumerators having bachelors degree with agricultural/Water
resources/Engineering background will be employed for the purpose of supervision and data

collection from the field. Considering the nature of study, the enumerators and supervisors will
be selected having knowledge and previous experience in conducting similar studies and data
collection in the similar area. Intensive training will be provided to the field staff so as to keep
uniformity of the data collection techniques and approaches among all the field enumerators,
and to maintain the desired quality of data. A three day training course will be organized for
the data collection team. The first day will be devoted to theory, followed by one day of
practical training in the field for pre-testing and sharing field experiences with each other and
experts. The third day will be for reviewing the field experience. Apart from the foundation
lectures on how to fill-in the questionnaire, group discussions, role playing in the classroom,
and question and answer sessions will be arranged. The experts and the senior key personnel
of the firm will provide the training.
The training programs will be of two types: (a) basic training and (b) advanced training.
The basic training will include:
 background and objectives of the impact evaluation study;
 brief idea about M.K flood control, drainage and irrigation of the BWDB project activities
 brief on the methodology of the impact study;
 drawing of samples;
 establishing rapport with beneficiaries;
 interview techniques;
 clear understanding of the questionnaires and checklists;
 group discussion on questionnaires; and
 role play on questionnaires.
The advanced training will be designed for the field supervisors. The training will cover the
following areas:
 detailed methodology of the impact study;
 methodological procedure for conducting focus group discussion;
 sampling techniques;
 team supervision and management;
 role of supervisors;
 detailed instructions on the contents of interview questionnaires and checklists;
 field editing of interview questionnaires and checklists;
 record keeping system; and
 other related issues.
Emphasis will be given on the field supervisors in order to make them fully able to collect relevant
and qualitative data. The training will include classroom lectures as well as field practice to the
1
9
trainee participants in actual interview situation. Broadly, the training program will aim at
generating definite skill and enthusiasm among the field staff.
4.10.4.5.9 Quality of Field Staff - Qualification and Experience of the Field Staff: The
Enumerators will be graduates and supervisors will be post-graduates having interest and
commitment and sufficient experience in similar field study. After the training, the field
enumerators and supervisors will be assessed through a process of individual scrutiny and
consideration of the performance in the field practice. The best ones among the successful
trainees would be finally selected. Considering that few field enumerators might not be finally
selected and few might dropout, the consultants will train additional field enumerators. If the
number of acceptable enumerators exceeds the number actually needed, the excess
acceptable field enumerators will be retained as reserve and for doing editing at the head
office. The client will be invited to participate in the orientation and selection process.

4.10.4.5.10 Type of data to be collected: Information on beneficiary and non-beneficiary
including water users association for irrigation water uses and socio-economic characteristics
of each individual beneficiary member will be obtained by interviewing the farmers on the first
visit to the beneficiary. Information on changes in crop productivity/intensity, crop loss, water
loss, employment and poverty etc will be collected by interviewing the responsible members
of the beneficiary.

4.10.4.5.11 Method of Data Collection: Direct personal interview approach will be adopted
for collection of primary data. This method is effectively related to the collection of data
directly from the beneficiary. The field enumerators will personally contact the respondents
and obtain desired information by explaining the objectives of the study to the respondents.
Each enumerators will be provided with an identity card (to hang outside the front pocket of
the shirt), a set guideline for code and data collection system and overall administration of the
study, a check list to ascertain the target beneficiary and, the designed and pre-tested
questionnaire for data collection and administration of the study. The data collection work will
be carried out by four field study teams. Each field team will be consisted of field enumerators
under one supervisor. The supervisor will supervise field study activity on full time basis. The
supervisors in addition to obtain data through checklist will also be responsible for supervision
of fieldwork, field editing of questionnaires, and management of all sorts of logistic support for
the team. The supervisors will collect all the filled in questionnaires from the enumerators at
the end of the days and the supervisors will check the schedules and discussed with the
enumerators for improvement in the following days (if any deviation is observed). After
collecting all the filed in questionnaires from the enumerators of a location, he will send them
by special messenger to the project office in Dhaka for further action and punching in the
computer software designed for the study.
A comprehensive instruction manual on data collection will be prepared for the field
enumerators to help them in conducting interviews efficiently and to maintain standard
procedures. Each team will be responsible for collecting data from the selected upazila. It is
the responsibility of supervisors to distribute the work of enumerators in the upazila and the
selected area so that data collection work may be completed within four weeks from the start
of the field study in the survey including the movement from one upazila to another upazila of
the project.
4.10.4.5.12 Inspections and Supervision of Field Work: The supervisors will be responsible
for overall implementation of the study. They will supervise the field works of the field
enumerators. The specialists while in field visit will observe the participation and cooperation
of beneficiary and non-beneficiary households in survey work. In addition to the supervisors,
the consultants will undertake monitoring of field survey activities in selected places to
oversee the survey activities to ensure quality. They will undertake field visits in selected
2
0
areas at random to verify and confirm the survey findings with the actual situation. More
impotently, the consultants will participate in some Focus Group Discussion (FGD). The
consultants will also observe formally and non formally the collection of information. They will visit
the survey area and thoroughly observe the project intervention.
4.10.4.5.12.1 Project Quality Assurance Measures: The highest possible care will be taken
in ensuring a high quality of collected data and information. A system of Total Quality
Management (TQM) will be instituted which comprised of all systematic arrangements and
activities directed towards safeguarding, maintenance and promotion of quality throughout the
study period. To ensure appropriate quality of the collected data/information, quality control
will be maintained in various steps in this study with quantitative and qualitative research
endeavors. Quality will be ensured in all the indicators, triangulation, analysis and reporting. A
sound quality control system will be developed to adequately monitor the quality of data
collection. For this purpose, experts, supervisors and quality enumerators will be deployed.
They will move constantly around the sample spots; and ensure quality data through: (i) field
checking, and (ii) data monitoring. Field checking will be undertaken in both ‘presence’ and

‘absence’ of the field teams. ‘Checking in presence’ will be done through verification of the
work of a field team in a sample area during the time of the questionnaire survey and
qualitative studies. ‘Checking in absence’ will be done through verification of the work of a
field team in a sample area after the team leave the site, having completed its assigned work
in the area. During their field checking, the expert will perform re-interviews, and check the
data accuracy. ‘Field checking in presence’ will be conducted for all field enumerators
/facilitators, while ‘field checking in absence’ will be done at randomly selected sites.
a. Detailed description of measures to be taken to ensure the quality of

services
The consultants will ensure high quality of data and feedback through a number of
methodologies and tools and strategies. The quality measures will be ensured right from
design to writing reports through sampling, preparation of tools, recruitment of good quality
staff, administration of survey, close guidance and supervision at all stages, and in-depth data
analysis. High emphasis of quality data input and high quality analysis and presentation will be
attached. Therefore, the consultants will pay attention on the quality of questionnaire, quality of
field staff, selection procedures for the field staff, training of field staff, supervision, re-interview,
editing of filled in questionnaire at field level and actions followed, and provision for
reward/penalty for doing excellent/poor work. The quality control mechanisms have been
briefly described later in the proposal in the work plan.
Quality Control: Appreciating that both client and the consultants emphasize highly on the
quality of output, the consultants plan to undertake strict quality control measures. The ultimate
output will be of high quality if measures are taken right from design to writing reports through
sampling, preparation of tools, recruitment of good quality staff, administration of survey, close
guidance and supervision at all stages, and in-depth data analysis. High emphasis of quality
data input and high quality analysis and presentation will be attached. Therefore, the
consultants will pay attention on the quality of questionnaire (schedule), quality of field staff
(qualification and experience of the field staff), selection procedures for the field staff, training
of field staff, supervision, re-interview, editing of filled in questionnaire at field level and actions
followed, and provision for reward/penalty for doing excellent/poor work. The quality control
mechanisms are briefly described in the following paragraphs.
Quality of Questionnaire (Schedule): The questions must be simple, clear, easily

understandable and free from ambiguities. These must be pre-tested before administration in
the field. Appropriateness of the questions will be specially looked into. The questionnaire will
be translated into Bangla and printed with wide spaces and neatness.
2
1
Quality of Field Staff (Qualification and Experience): Field staff (supervisors and
enumerators) will be graduates or post-graduates having interest and commitment and
sufficient experience in similar field survey. After the training, the supervisors and enumerators
will be assessed through a process of individual scrutiny and consideration of the performance
in the field practice. The best ones among the successful trainees would be finally selected.
Considering that few supervisors and enumerators might not be finally selected and few might
dropout, the consultants will train additional supervisors and Enumerators. If the number of
acceptable supervisors and enumerators exceed the number actually needed, the excess
acceptable supervisor and enumerators will be retained as reserve and for doing editing at the
head office. The client will be invited to participate in the orientation and selection process.
Training of Field Staff: The selected staff will be given rigorous orientation training on the
concept of the project, survey objectives, purpose, and meaning of each indicator and
associated questions. The training methods will be practice oriented and followed by field
exercise. Highly qualified and experienced trainers will be involved. Rigorous training will be

provided in both classroom and field conditions.
Manuals (Guidelines and Instruction) for the Field Staff: Comprehensive manuals will be
prepared in Bangla for ease of perfect data collection by the enumerators and supervisors and
it will serve as guide at the field to remove any ambiguity and misunderstanding.
Inspection and Supervision of Field Work: All the professional experts will supervise the
field works of the enumerators and supervisors so that enumerators can seek instructions on
the concepts, definitions and difficulties encountered in carrying out the field work under the
actual operational conditions. All members of the consultant team will undertake monitoring of
field survey activities at randomly selected places to oversee the survey activities to ensure
quality and take part in directly through re-checking sufficient number of filled in questionnaire
as feasible target will be set by the team leader for all other experts. All the experts including
the team leader will undertake field visits in selected areas at random to verify and confirm the
survey findings with the actual situation. The field supervision will be carried out as per a pre-
set supervision plan. Field supervision will be supported by sufficient top supervision by the
expert members of the team. The supervisors will supervise and look after the works of the
Enumerators. This close supervision will ensure the interview quality and minimize
location/area based difficulties and ensure data quality. The expert team members will visit the
survey spots at random according to the schedule of the fieldwork. They will be responsible for
organizing training, preparing fieldwork schedule and resolving problems in the field. They will
get in touch with both the supervisors and enumerators during their field visits. In addition they
will directly conduct physical observation and few capacity assessments activities.
Re-interview: On an average, questionnaires of 10% spot will be re-interviewed to ensure
quality of data collected by the enumerators. This will minimize errors. This will be done by
supervisors and the experts. If there is any considerable difference in data collected by field
enumerators during re-interview, the spot will be repeated by another person.
Editing of Filled in Questionnaire at Field Level and Actions Followed: The supervisors
will arrange a feedback session in the districts at least once in a week preferably in weekend.
Every filled in questionnaire would be edited at the field level by the supervisor at the end of
the feedback session. The purpose of editing would be to detect: (i) non-response, (ii)
incomplete response, (iii) inappropriate response, and (iv) in-consistency through direct check
and cross check. The next day the omissions/errors detected will be corrected with
observations. The filled in questionnaire and other information gathered from the field will be
sent to consultants’ office after completion of one week. The schedules from the re-interview
will be compared by the supervisors. After the process of editing is over, compilation work will
start. Data will be further checked by designated staff on sample basis at the project office of
the consultants.
2
2
Provision for Reward or Penalty for doing Excellent or Poor Work: For ensuring quality of
data at all stages-preparing questionnaire guidelines, orientation, selection of field staff,
supervision, data collection plan, provision for reward and penalty would be made and strictly
enforced.
4.10.4.5.13 Data Management, Processing and Analysis

Linking the deliverables according to their inter dependents: On completion of field
data/information collection phase, the Study Team will organize a day long feedback session
with field personnel to get some deeper insights on certain issues, and to get some qualitative
information which can substantiate quantitative data/information on the basis of field level
observation and experiences.
Data/Information Management: Data management, processing and analysis include registration
of the questionnaires, code construction, coding, data verification and quality control, data

punching, data processing and finally the analysis to facilitate the required output generation. As
soon as the filled in questionnaires will be received from the field, the questionnaires will be
recorded in a registration book which note identification numbers are the household’s status.
The registration of questionnaires facilitate storing and handling during the data processing
stage. More specifically the data management comprised the following activities: (a)
registration of data/data input, (b) data processing, and (c) report preparation. Apart from
these, due to qualitative nature of field information, activities primarily included detailed
transcription of the FGDs recorded in brown sheets and cassette recorder by the transcriber,
under the direct supervision and guidance of the experts in the qualitative assessments and
analysis. Triangulation will be done by cross checking data/information from different
categories through different methods (Interview Schedules, FGDs, stakeholder discussion
meetings etc.).
Computer aided data processing and analysis technique will be employed for which a systematic
approach is needed, where each and every activity has to be properly identified.
Data Origination. The filled-in questionnaires will be considered as the source of raw data and
for effective and accurate analysis and quality output generation. The following activities will be
undertaken on the collected data.
Editing and Coding of Questionnaires: During data collection form the respondents, some
errors may creep in various forms such as inaccuracy, incompleteness, inconsistencies etc.
Each questionnaire, will therefore, be edited and coded before entry into the computer.
Coding of information will initially be done by coders with guidance of the Experts and then
verified by coding verifiers provided by the firm as extra manpower. Editing of the
questionnaire will be undertaken in order to ensure that the questionnaires has been
accurately and completely out by the enumerators and that were consistent with the
responses.
The consultants will mainly rely on manual verification of entered data with the questionnaires.
Devising suitable in-built computer programs will further strengthen this.
Data Input to Computer. Data input to computer will include (a) developing appropriate
computer program and (b) data entry operation. The computer programmer in consultation with
the team leader, experts and the concerned personnel of IMED/BWDB will design software
suitable for the study. Keeping the objectives of the impact study in view, the consultants will use
the most suitable program (Excel, MS Access, SPPS) as necessary.
Data entry and processing: The filled-in questionnaires will be considered as the sources of
raw data. For effective analysis and quality output generation, the following activities will be
undertaken on the collected data:
 Filing the filled-in questionnaires and checklists;
2
3
 Editing and coding the questionnaires and checklists for entry into the computer; and
 Quality control and coding of open-ended responses.
The filled-in questionnaires and checklists will be collected, filed and batched according to
different strata and task programs to enable easy operation for later processing steps (editing,
coding, entry, etc.). The edited and coded questionnaires will be dispatched to computer
operators for data entry/punching to the software installed for this purpose. The entire work will
be undertaken under the supervision and guidance of team leader and computer programmer.
Data collection and data entry will be done simultaneously to facilitate timely completion of the
work. After the completion of fieldwork, the completed questionnaires will be returned to the
consultants project office immediately for data processing. The processing operation
consisted of central editing, coding of answers to open-ended questions, data entry and
editing inconsistencies found by the computer programs. A suitable software package will be
used for data entry. All possible in-built conditional, logical and range checking procedures will

be incorporated in the data entry program to detect mistakes done by the entry operator
during the data entry. Twenty percent of the questionnaires will be selected at random for re-
entry for the purpose of quality checking and if any error is found the remedial measures will
be taken.
Frequency tables will be prepared for all the variables and necessary cross tables consistent
with the survey objectives will be prepared.
Data Analysis: The consultants plan to analyze collected data and information regarding
flash flood control, drainage & irrigation system. The data obtained through survey will be
analyzed for project aggregate. However, the data will be disaggregated by gender (to see
equal opportunity of employment and equal wage), production and processing, and economic
development, etc. The consultants will develop data analysis tools (programs) after finalization
of data collection tools (questionnaire and data collection sheets) as an advance action so
that data can be entered as these are collected from farmers one by one (as they are
completed). The consultants prefer MS Access and SPSS programs for data processing.
Primary data tables will be generated for all major indicators as its measurements and will be
annexed to the main report. However, secondary analysis will also be undertaken for selected
indicators and presented in text tables after in-depth analysis through crossing relevant
interrelated indicators and proxy indicators.
Data Analysis by Category of Upazila: The consultants will analyse data separately for all
the seven upazila for showing differences of Project interventions by area, Project and
control/non project data will be analyzed separately. Each indicator will be shown separately
from the collected data tabulate for making comparison among the categories of upazilas,
district, cropping season in project and control/non-project interventions.
4.10.5 Preparation of Report (Reporting Phase)
The report will use standard format for presenting data and report writing so that the findings
can be easily compared the present data with control/baseline of the indicator. The consultant
will hold discussion meetings with the client at different stages of the assignment and keep the
client informed of the phase-wise progress of work in addition to providing the following
outputs:
Type of Content of the Report Due date Number
Report
Draft The draft inception report will include the study 15 days 10 copies
Inceptio design and data collection instruments (DCls). The
n Report report will also includes the work plan along with
detailed task, specific manpower allocation and
details of surveys and data collection needed, actions
2
4
taken and progress on these activities. Staffing

requirements, transport, office accommodation and
other relevant matters should also be mentioned.
Final The Final Inception report including survey design 25 days 10 copies
Inceptio and data collection instruments (DCls) will be
n Report submitted to the IMED in incorporating comments
and suggestions of IMED within 2 days after received
the feedback from the IMED Technical and Steering
Committee.
Draft The consultant will prepare Draft Report for 80 days 15 copies
Report presenting to the Technical and Steering Committee
for approval according to the requirement as
described in TOR. All the experts under the
leadership of Team Leader will be involved in
preparation of draft report for the survey.

The draft Report will contain information on analysis
of data and draft results. It will also contain tables,
charts and detailed analytical framework, findings
and recommendations.
Draft On the basis of comments and suggestions of the 100 days 50 copies
Final technical and steering committee of the IMED on the
Report Draft Report, a comprehensive Draft Final Report will
be prepared. The report will contain detailed
objectives of the survey study, methodology applied,
all tables, charts, figures and analysis of the tables,
findings and recommendations.
Final The consultant will prepare Draft Final Report for 120 days Printed 50
Report presenting in the National Level Workshop/Seminar copies (40
incorporating the comments and suggestion of copies of
steering committee. Bangla
and 10
On the basis of comments and suggestions of the
copies of
participants in the National Level Workshop, a
English)
comprehensive Final Report will be prepared. The
with soft
report will contain detailed objectives of the survey
copy in
study, methodology applied, all final tables, charts,
CD
figures and analysis of the tables, findings, strengths
and weakness and recommendations.
B. Work Plan
4.11 Work Plan

The work plan is primarily aimed at identifying the tasks that will be involved in the proposed
study. It will also give an attention to developing a task schedule and an appropriate staffing
schedule of professional consultants and supporting staff for conducting the impact study. An
understanding of the tasks to be addressed by the study team will be facilitated through an
analysis of the objectives of the study. Such an analysis will lead to an identification of the major
areas of activity, which, in turn, will suggest detailed tasks to be undertaken as well as appropriate
methodology and measuring instruments.
The firm will try its best to carry out efficiently the obligations of the services. The entire work
will be divided into in four phases in a number of tasks to be performed by the study Team.
Each task will be broken down to a set of activities. The activities will be arranged in sequential
order in a timeframe and will be assigned to the concerned member or group of members of
2
5
the team. Thus the main activities are arranged in a time bound work plan as shown in Table 4.5
below and also shown in bar chart format in FORM 5A5.
Table 4.5: Detailed Work Plan
Phase Duration in Major Tasks and Output

Days
Phase A - 15 days Activity 1: Mobilization and Setting up Office
Inception and  Preliminary discussion with IMED Authority and
Design Phase meeting the team member of the survey and all
sort of correspondence

 Mobilization of team with recruitment of required
support staff
 Establishment of separate cell with all equipments
and logistics for this assignment
 Organizing meetings of professional personnel
with client
 Collection of existing available literature and
secondary data
Activity 2: Review the project requirement and
develop, design and field testing of the impact
evaluation study instrument
 Review existing documents. project proposal
 Review previous assignment/baseline report
works done in the past and benefit from the
findings in designing the proposed survey,
implementing it, analyzing the feedback the
data, and preparing reports.
 Revision of TOR, data collection, proposed
methodology and work program, and discussion
with Project Authority
 Finalization of methodology and work program, in
consultation with Project Authority
Activity 3: Sampling of the Survey
 Designing sampling strategy based on
methodology
 Determining statistical valid sample size on
agreed-upon methodologies
Activity 4: Accomplishment of training of
enumerators and supervisors and field testing
 Preparation of training plan, field work protocols
according to agreed methodologies
 Preparing study manual for the enumerator and
supervisor, including instructions on data
collection and guideline to handle problems
 Recruitment of supervisors and enumerators
 Conducting training for enumerators and
supervisors on draft questionnaire and manuals
including responsibility for logistics and facilities
 Finalization of beneficiary list in consultation with
IMED
 Field testing on instruments and checklists (2 2
6
days)
 Finalization of instruments and checklists
Activity 5: Develop Baseline survey schedule with
time frame
 Finalization of Time line of the survey data
collection from the field in consultation with the
client
 In house discussion on inception report and its
finalization and Approval from the client
Phase B - Field 30 days Activity 6: Implement & supervise field data
Work/Data collection, data input, cleaning
Collection  Placement of enumerators & supervisors at the
respective upazila
 Coordination with BWDB local staff
 Preparation of materials and providing of

equipment, logistics etc.
 Data collection from fields through: administering
the instruments (questionnaires, checklists & FGD
guideline etc.)
 Field visits by the professional personnel for
supervision and monitoring of data collection
activities
 Conducting FGD/KII with the assistance of field
supervisors and client
 Organize regional level workshop at the place
advised by the client
 Checking, editing of the collected data
 Discussion with BWDB/IMED for the purpose of
study and monitoring of data collection
Phase C - Data 35 days Activity 7: Analyze and synthesize data; and
Processing, prepare report and program indicator tracking
Analyzing and
report writing  Designing Data Entry and Processing program
and data entry into computer
 Preparation of initial results in output tables of the
study
 Discussion with local partners, IMED on about
initial results
 Data analysis and synthesis
 Preparation of draft report on the study
Workshop/ 40 days Activity 8: Conduct presentation of draft final

Meetings report
 Organize Workshop to present results and
findings of draft and draft final report at TC, SC
and stakeholders of national level
 Examine the suggestion and recommendations
from the workshop and address them and
incorporate in the final report
Activity 9: Deliver final report, documents, files,
and database in excel sheet both in soft and hard
copies
Phase D- No. of Day  Submission of Inception Report
Reporting 15 days
80 days  Submission of Draft Report
2
7
100 days  Submission of Draft Final Report
120 days  Submission of Final Report
C. Organization and Staffing Schedule

4.12: Study Organization: Effective implementation of the study will require qualified,
accommodative, hard working, and physically fit manpower including office and field support
staff and counterpart client’s staff support and facilities. In view of this, firm has selected an
experienced team of consultants for the implementation of this study, who have extensive
experience in impact evaluation study including agriculture, fisheries and livestock sector
particularly through their work for development partners and financing institutions in
Bangladesh and other part of the world.

The consultants estimate that in order to satisfactorily implement the study the consultants
emphasized the following while teaming the experts and field support staff.
4.12.1 Field Team: In proposing a team of experts to implement the tasks under the Study, the
consultants made an analysis of the tasks to emphasize high degree of co-operation, co-
ordination and, team synergism. The consultants have proposed a strong team of four experts
(some with national and international experience) as shown in the Staffing Schedule and CV of
the Technical Proposal for quantitative study and qualitative data. Further the consultants also
plan to provide the services of a team of field staff which is calculated on the basis of work load
as follow:
4.12.2 Calculation of Enumerators:
Work Quantity Unit Total man-days

Beneficiary-Interview 1200 6 Respondents/day 200
Respondents ./man-day
Non-Beneficiary-Interview 600 6 Resp./man-day 100
respondents
Focus group discussions 12 FGDs 1 man-days/FGD 12
Key Informant Interviews 12 KII 1 man-day/case 20
Physical Observation 126 (Nos) 10/day/man-day 13
200 (km) 5km/day/man-day 40
Total 385
Total 16 enumerators for 30 days will be required to complete the data collection. The
enumerators will be divided into four groups for four districts and number of enumerators will
be proportional to the number of respondent in the districts.
District Group No of enumerators in the No of Supervisors
group
Feni Sadar 1 4 1
Fulgazi 1 4 1
Porshuram 1 4 1
Chhagolnaiya 1 4 1
Total 4 16 4
Each group will be guided by a supervisor. Supervisors and enumerators will be recruited
having sufficient educational background and experience in data collection/study activities.
Four field study teams, each team consists of desired number field enumerators in different
districts and one supervisor on full time basis will be deployed for supervising field study and
data collection in each district. In addition to above, two field enumerators and one supervisor 2
8
for re-study will be deployed. Emphasise will be given to recruit at least 25% enumerators from
the female eligible candidates.
4.12.3 Study Team: With a view to achieving optimum benefit and best results of the study, the
consultants propose three categories of personnel to implement the consultants' key activities,
viz. (i) Key Professionals (ii) Study Field Staff, and (iii) Office Support Staff and Logistic
Support. The positions and input are given below:
Table 4.6: Study Team
Person-
SL Position Name
days
A. Key Professionals
1 Team Leader-Evaluation Expert Eng. Aftab Ahmed Ansari 120

2 Engineer Dr. Mohammad Shiddiqur Rahman 45
3 Socio- Economist Mr Humayan Kabir 45
4 Statistician Md. Mokhlesur Rahman 30
B. Study Field Staff
Field Supervisors (4 Nos) To be finalized during study 120
Enumerators (16 Nos) do 480
C. Office Support Staff
Secretary cum Account Mr Rezaul Islam 120
Data Entry Operators (2 Nos) Mr Noyon, and Alam 30
Office Assistant Md Jasim 120
4.13 Organization and Staffing Schedule

The outputs of the services under the study will be delivered according to the reporting
schedule. The team of experts headed by the Team Leader will perform all the activities in
collaboration with each other. The staffing schedule of both professional consultants and
support staff have been prepared based on the proposed methodology, work program and the
TOR of the study and presented in the FORM 5A7 in this section and the Flow chart for study
organization is presented in Figure 4.6 but Task Matrix of the consultants has been
furnished in Figure 4.7 after the staffing schedule of Form 5A7.
2
9
Figure 4.6: Flow Chart for Study Management
IMED of Ministry of BWDB

Planning
DG, Evaluation Sector

IMED

Team Leader
Engineer Socio-Economist Statistician
Survey FGD
Physical KII Survey
Manager
Firm
Administr
ation & Fulgazi, Chhagolnaiy
Logistics
Feni Sadar Porshuram
Support a
Data Data Entry Data Analysis Draft Feedback

Collection Operator Management and Report Report from TC
and Processing Writing
Final Report Workshop and Draft Final Report based on

Recommendation SC comments and suggestions
Comments
Legend: Operational Linkage Coordination linkage
3
0
3
1
Figure 2.3: Work Plan

MONTH 1 MONTH 2
SL
NO Activity Week
1 2 3 4 5 6 7
Phase A. Inception and Design Phase
1 Mobilization of team with required support staff
2 Establishment of office with all equipments and logistics
Organizing meetings of professional personnel with UN Women and
3
others
Participate in the planning meeting at the beginning of the survey design
4
with relevant stakeholders
5 Collection of existing available literature and secondary data
Review relevant document such as research reports, logical & result
6
framework project document etc
Revision of TOR, data collection instruments (questionnaires and
7 checklists), proposed methodology and work program, in consultation
with client
Finalization of methodology along with detailed work plan including

8 timeframes and responsibility matrix for this assignment in consultation
with the UN Women
9 Recruitment of enumerators and supervisors
10 Training of the field staff on draft instruments and checklist (3 days)
11 Field testing on draft instruments and checklists (1 day)
12 Finalization of instruments and checklists
In house discussion on inception report and its finalization and approval
13
from UN Women
Phase B. Field Data Collection Phase
14 Finalization and printing of instruments
15 Collection of beneficiaries listing and finalization of respondents
Collect data from appropriate target audiences through: administering
16 the instruments (questionnaires, checklists, etc.
17 Collect case statistics from relevant offices of local administration
Develop and submit data quality control mechanism and ensure quality
18
of the data Manage and Analyze data by using appropriate software
Field visits by the professional personnel for supervision and monitoring
19
of data collection activities
Conduction the full quantitative baseline data involving detailed fact
20
finding, research and analysis of area under review.
21 Conducting FGD/KII with the assistance of field supervisors and client
22 Checking, editing of the collected data

Develop and submit data analysis plan incorporating the feedback of
23
Generate output table and share UN Women concerns
Phase C - Data Processing , Analyzing and report writing
Finalize and installation of computer programming and software for data
24
processing
25 Data Entry and Processing and preparation of dummy tables
Analyzing the processed data and analytical report of the baseline
26
study
27 Preparation of draft final report
28 Organize Workshop to present results and findings of draft final report

Examine the suggestion and recommendations from the workshop and
29
address them and incorporate in the final report
Finalization of report on the basis of comments and suggestions made
30
in the workshop stakeholder
Phase D. Reporting
31 Submission of Draft Inception Report
32 Submission of Final Inception Report
33 Submission of Draft Final Report
34 Submission of Final Report
Legend Activity Report
3
2

Technical Impact Evaluation Study

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Technical Impact Evaluation Study

Uploaded by

Copyright:

Available Formats

Technical Impact Evaluation Study of the “Muhuri Kahua Flood Control,

Proposal Drainage and Irrigation Project (Revised)”under the IMED (SL-01)

A. TECHNICAL APPROACH AND METHODOLOGY

A-1: Understanding of the Project and Assignment

FORM 5A4: General Approach, Methodology & Work Plan

4.2 Background of the Sector

4.3 Rationale of the Project

FORM 5A4: General Approach, Methodology & Work Plan

4.4 Objectives of the Project

 Restore full flood free environment in project area by construction of embankment

4.5 Components of the Project

4.6 Objectives of the current assignment

FORM 5A4: General Approach, Methodology & Work Plan

4.7 Scope of Work

iiiConsultative meetings/in-depth interviews with key officials and

FORM 5A4: General Approach, Methodology & Work Plan

4.8 Understanding of the Assignment

FORM 5A4: General Approach, Methodology & Work Plan

Figure 4.1: The Conceptual Model for Impact Evaluation

Review available Reconnaissance Field Review TOR &

 Collection and processing of data

FORM 5A4: General Approach, Methodology & Work Plan

Review of officials Inspection & Observation FGD/KII Survey

Reviewing progress of delivery of input & Assessment of the Impact of the

Analysis & Interpretation

Assess impact of the Project

FORM 5A4: General Approach, Methodology & Work Plan

(b) Identification of bottlenecks and Recommendations: Identify the strengths and

FORM 5A4: General Approach, Methodology & Work Plan

4.10.1 Description of different stakeholders to be involved in the proposed activities:

4.10.4 The Proposed Study Design

Figure 4.2: True Experimental Design

FORM 5A4: General Approach, Methodology & Work Plan

Hypotheses: P2 > C2 for indicators like average overall performance, etc.

Figure 4.3: The simplified model of the project implementation process

Input Intervention Output Outcome Assessment

Implementation refers to the transformation of input through a set of technical and

The estimates of Pc and Pb are pc and pb respectively.

The test statistic t is defined as

The overall situation may be represented as follows (Figure 4.6).

FORM 5A4: General Approach, Methodology & Work Plan

Impact Evaluation Study

Project –MK Flood control

Level of performance indicators Level of performance indicators

Level of performance indicators Level of performance indicators

Macroeconomic human resources National Business

FORM 5A4: General Approach, Methodology & Work Plan

4.10.4.1 Beneficiary and Non-Beneficiary Survey

FORM 5A4: General Approach, Methodology & Work Plan

Table 4.2: Allocation of Project Beneficiaries and Non-Beneficiaries

FORM 5A4: General Approach, Methodology & Work Plan

FGD KII Physical Observation

4.10.4.3 Types of Instruments and Respondents to be used for data collection

(a) Questionnaire for Beneficiary: The project beneficiary (Mahuri-Kahua irrigated

FORM 5A4: General Approach, Methodology & Work Plan

4.10.4.4 Summary of the data and information collection is presented below:

Table 4.4: Number and Types of Respondents

Activity Participants/ Respondents No of Respondents Category

Rubber Dam 1 Kahua River

Surface drainage outlet 16 MK flood control and drainage area

irrigation inlets 103 (Nos) MK flood control and drainage area

Re-excavation of 67 km MK flood control and drainage area

FORM 5A4: General Approach, Methodology & Work Plan