TP and FP Final

Consultancy Service On Baseline Survey for Strengthening of Food and Nutritional Security of Vulnerable Households in Borena Zone
COSULTANCY SERVICE FOR FINAL EXTERNAL EVALUATION OF
CXONSULTANCY SERVICE FOR ENDLINE EVALUATION SURVEY OF THE SECURITY &

LIVELIHOOD (FSL), HEALTH & SRH AND PROTECTION INCLUDE OF
GENDER-BASED VIOLENCE (GBV) INTERVENTIONS
(Technical Proposal)
Consultant
Beles Engineering PLC

(Experts in Water, Land and Environment)
Client
November 2023
Addis Ababa, Ethiopia
Consultants: BELES Engineering PLC Client: Plan International
i
Endline Evaluation Survey of The Food Security & Livelihood (FSLl), Health & SRH And Protection Include of Gender-Based Violence
(GBV) Interventions 2023
TABLE OF CONTENTS
1. INTRODUCTION................................................................................................................................................. 1
1.1. BACKGROUND OF THE PROJECT...................................................................................................................................1

1.2. BRIEF DESCRIPTION OF THE CLIENT AND THE PROJECT.....................................................................................................2
1.3. OVERVIEW OF THE CONSULTANT.................................................................................................................................3
2. OBJECTIVE, SCOPE, CONCEPTUAL FRAMEWORK AND OUTCOME INDICATORS....................................................5
2.1. OBJECTIVE OF THE FINAL EVALUATION:........................................................................................................................5

2.2. SCOPE OF THE ENDLINE EVALUATION:..........................................................................................................................5
2.3. CONCEPTUAL FRAMEWORK..........................................................................................ERROR! BOOKMARK NOT DEFINED.
2.4. OUTCOME INDICATORS................................................................................................ERROR! BOOKMARK NOT DEFINED.
2.5. EVALUATION CRITERIA.................................................................................................ERROR! BOOKMARK NOT DEFINED.
2.6. TARGET GROUPS...................................................................................................................................................... 8
3. METHODOLOGY................................................................................................................................................. 9
3.1. APPROACHES AND STEPS...........................................................................................................................................9

3.2. PLANNING AND DATA COLLECTION SURVEY DESIGN......................................................................................................12
3.3. DATA COLLECTION METHODS...................................................................................................................................12
3.4. SAMPLE SIZE......................................................................................................................................................... 14
3.5. SURVEY QUESTIONNAIRE DESIGN AND PRE-TEST..........................................................................................................15
3.6. INTERVIEWERS SELECTION, RECRUITMENT, TRAINING AND SUPERVISION...........................................................................15
3.7. DATA PREPARATION AND MANAGEMENT....................................................................................................................16
3.8. DATA ANALYSIS AND REPORTING..............................................................................................................................17
4. STAFFING......................................................................................................................................................... 18
5. ACTIVITY AND STAFFING SCHEDULE................................................................................................................. 21
5.1. ACTIVITY SCHEDULE......................................................................................................................................................21

5.2. STAFFING SCHEDULE.....................................................................................................................................................21
ANNEXES............................................................................................................................................................. 24
ANNEX 1: CURRICULUM VITAE...................................................................................................................................25

ANNEX 2: TESTIMONIAL LETTERS...............................................................................................................................26
ANNEX 3: COMPANY PROFILE.....................................................................................................................................27
ANNEX 4: LEGAL DOCUMENTS....................................................................................................................................28
ANNEX 5: COMPLETED, STAMPED TERMS OF REFERENCE AND STAMPED COPY OF TENDER INSTRUCTION.......29
Consultants: BELES Engineering PLC Client: Plan International
ii
Endline Survey of The Food Security & Livelihood Protection Include of Gender-Based Violence Interventions 2023
1. INTRODUCTION
1.1. Background of the Project
Somaliland and the Somali Region in Ethiopia has been facing complex, multilayered crisis for
the past three decades, Insecurity and conflict compounded the effects of recurrent droughts,
floods and more recently, Covid-19 and desert locust infestations, causing major humanitarian
crisis. COVID-19 had had severe impact and measures restricting movement, closure of
government offices and schools have increased risks of child protection and sexual and
gender-based violence. In the worst affected areas, people are forced to migrate to survive,
some people send children with relative to remote towns or villages where they are forced to
seek income.
Three consecutive failed rainy seasons affected the Horn of Africa with severe consequences of
acute food insecurity among pastoralists and farmers, increased risks for children as more
children are left alone, displaced in search of livelihoods, increased child exploitation and
violence and abuse against children, especially girls and child forced marriage and Female
Genital Mutilation (FGM) increase.
Plan International, Plan International Ethiopia and Plan International Somaliland/Somalia

have been working together with their local implementing partners (Pastoralist Concern in
Ethiopia; and Taakulo in Somalia/Somaliland) to save lives and alleviate the suffering of
displaced families and host communities by addressing basic needs and protection risks that
affect children, adolescent and young women.
A total of 8,552 people is being assisted through this project in the cross-border areas. 480
women (230 Somalia/Somaliland and 250 Ethiopia) have received cash transfer to cover basic
needs. 1,200 women aged 14-24 (600 Somalia and 600 Ethiopia) received dignity kits and
information sessions on SGBV response services. In Somaliland, 12 volunteers from 3 villages
are trained in SGBV prevention and response and child protection and have conducted
information sessions on available services targeting 600 people. In Ethiopia, 60 gender club
leaders in schools received training on protection and SGBV in order to disseminate it to the
school population and their families (250 people). In Somaliland, 300 children and adolescents
(at least 55% girls and adolescents) are assisted and 50 children and adolescents received
emergency transfers and 200 community leaders, 20 health staff, 20 social services staff (at least
60% women) will receive training and sensitization on gender-based violence. In Somaliland,
12 trained volunteers will disseminate information among the responsible services in the area.
6 safe spaces (4 Somaliland and 2 Ethiopia) providing services to 6,000 children and
adolescents will be strengthened.
Consultant: Beles Engineering PLC Client: Plan International 1

Plann International Ethiopia (Client) invited competent independent consultants to carry out
this terminal evaluation based on the logical framework addressing the same beneficiaries
accounted during the baseline survey (if there is any). The multidisciplinary service provider
Beles Engineering PLC with wide experience in project evaluation and having working
experience in the Somali region is happy to present this proposal to bid for the work.
1.2. Brief Description of the Client and the Project

To realize this, Plan has been using its guiding theoretical approach to working with
vulnerable children, especially girls so that they can learn, lead, decide, and thrive. We are
relentless in driving change to advance children’s rights and equality for girls by working
together with children, young people, our supporters, and partners. As an independent
development and humanitarian organization, we work alongside children, young people, our
supporters, and partners to tackle the root causes of the challenges facing girls and all
vulnerable children. We support children’s rights from birth until they reach adulthood and
enable children to prepare for and respond to crises and adversity. We drive changes in
practice and policy at local, national, and global levels using our reach, experience, and
knowledge. For over 80 years, we have been building powerful partnerships for children, and
we are active in over 75 countries. Plan International Ethiopia has been operating in Ethiopia
since 1995. In realizing its vision and mission, Plan International Ethiopia operates in eight
regional states and one City Administration of Ethiopia (Oromia, Amhara, SNNP, Gambella,
Afar Benishangul Gumuz, Tigray regions, and Sidama regions, and Addis Ababa City
administration). The general program of our organization mainly focuses on improving early
childhood care, providing education for all children, keeping children safe from violence, and
supporting communities to prepare for emergencies including responses to the influx of
refugees
Plan International is an international, humanitarian, child-focused development organization

without any religious, political, or governmental affiliations it strives to achieve lasting
improvements in the quality of life of deprived children through a process that unites people
across cultures and adds meaning and value to their lives. Plan international is independent of
government and have no political or religious affiliation. Its purpose is to strive for a just
world that advances children's rights and equality for girls. It has been building powerful
partnerships for children for more than 80 years, and are now active in more than 70 countries.
Plan’s global strategy has a specific focus on girls, as they are often the most marginalized and
most often left behind. It has committed itself to the ambitious target of reaching 100 million
girls over 5 years, to ensure they can learn, lead, decide, and thrive. This is its contribution to
reaching the sustainable development goals and in particular the goals on gender equality.
Plan’s organization is transforming itself to meet an enormous challenge everywhere it works.
It needs bold, forward-thinking, and innovative individuals to lead country's operations,
driving change and delivering results that will allow reaching its target of 100 million girls.

Plan International's programs in Ethiopia focus on Child Protection, Education, Water,

Sanitation and Hygiene (WASH), Food and Economic Security, Humanitarian Response, and
Resilience Building that it is implementing in Amhara, Oromia, Southern Nations,
Nationalities, and Peoples' (SNNP), Gambella, Afar and Benshangul-Gumuz Regional States
and Addis Ababa City Administration. Common to these, issues of gender and disability are
also integrated and mainstreamed in all programs. The general program of Plan International
Ethiopia mainly focuses on improving early childhood care, providing education for all
children, keeping children safe from violence, and supporting communities to prepare for
emergencies including responses to the influx of refugees.
Plan International Ethiopia has been implementing Responding to IDP Needs and Building
Resilience in Tigray and Amhara (RINBRITA) Project since December 2021 in Amhara
(Dehana and Sinhala) and Tigray (Bizet and Ganta Ahfeshum. It is now at the verge of
completion and hence, Plan International Ethiopia (Client) invited competent independent
consultants to carry out this terminal evaluation based on the logical framework addressing
the same beneficiaries accounted during the baseline survey (if there is any). The
multidisciplinary service provider Beles Engineering PLC with wide experience in project
evaluation and having working experience in the Somali region is happy to present this
proposal to bid for the work.
1.3. Overview of the Consultant

Beles Engineering PLC is a multi-disciplinary consultancy firm, engaged in the provision of
professional services in a wide range of fields including baseline, midterm and endline
evaluation of different projects, master plan study and design in Ethiopia and other countries
(especially in Rwanda and Uganda), water resources, highway and bridge designs, agriculture,
environment, natural resources and rural development studies and tailor-made training
services in a wide range of fields.
The company has Grade I (the highest grade) license from the Commission of Environment,
Forest and Climate Change to conduct Environmental Auditing and Environmental and Social
Impact Assessment (ESIA) study and preparation of Environmental Management Plan and
development studies. Beles has conducted internationally and nationally accepted studies for
many baselines, midterm and end line evaluation of different projects. It has also different
licenses from different Ministries including the Ministry of Water and Energy and Ministry of
Construction.

Beles is established and managed by highly-qualified professionals with many years of

practical experience in their respective fields of specialization. Beles wisely selected from
important areas of professional involvement to expand its contribution in the development
endeavors that will have national and international significance. Beles has created conducive
working environment for multi-disciplinary and integrated professional services for on time
delivery of quality results to its clients.
To carry out the final evaluation of this project, it has organized highly qualified experts with
wide experience in project evaluation of similar nature. Experts who know very well the
cultural and socioeconomic condition of target communities and the region at large will form
the evaluating team and thus the work will be carried on effectively and efficiently and
produce a standard comprehensive evaluation report to the client.

2. OBJECTIVE, SCOPE, EVALUATION CRITERIA AND OUTCOME

INDICATORS
2.1. Objective of the Final Evaluation:
2.1.1. General Objective:
To conduct a comprehensive assessment of the project's performance, results, and
contributions to enhancing the well-being and living conditions of the target population, in
accordance with the project's objectives and key outcome indicators.
2.1.2. Specific Objectives
Specific objectives of the Endline evaluation Survey include:
• Collect and analyze disaggregated data on project-based indicators outcomes level.
• Producing endline evaluation, with an analysis that distinguishes gender, age, and
other vulnerabilities.
• Develop recommendations for future projects.
2.2. Scope of the Endline Evaluation:

Scope of the endline evaluation survey could be seen from the study period, study area and
study population perspectives.
Study area: Dehana and Sinhala is Woredas in the Amhara Region of Ethiopia. It is named for
one of the five clans of the Agaw. Part of the Wag Hemra Zone, Dhana, and Sinhalais are
bordered on the south by the Semien (North) Wollo Zone, on the west by the Tekezé River
which separates it from the Debub (South) Gondar Zone, and the Semien (North) Gondar
Zone, on the north by Zikuala, on the northeast by Soqota, and on the east by Gazbibla.
Ganta Afeshum and Bizet is woredas in the Tigray Region of Ethiopia. Part of the Misraqawi
Zone, Ganta Afeshum is bordered on the south by Hawzen, on the west by the Mehakelegnaw
(Central) Zone, on the north by Gulomahda, and on the east by Saesi Tsaedaemba. Towns in
Ganta Afeshum include Bizet.
Study period: the study will be conducted for about 80 days (from December to 19 February
2024) including the development of tools, review, data collection, and final report.
Study Population: The study participants will consist targeted households and individuals
currently living in the project areas. Target Population is 149,889 in four Woredas.
Additionally, secondary data will be collected from all Woreda health offices, disaster & risk
management, and Child & women affairs offices.

2.3. Evaluation criteria, question, and evaluation Matrix:

As per the Terms of referenced, the following criteria will be used for the evaluation.
(NB: analysis to be based on disaggregated data to ensure gender equality is included

throughout)
• Desk reviews of
Relevance • Key • Interviews with secondary data
1. To what extent did the project informant beneficiaries.
meet the immediate needs of interviews • Interview with
the target population? (Extent • Document • Document members of the
to which activities are tailored review review Project/and
to local needs, increasing project
ownership and participants
accountability).
2. Were activities and strategies

of the project appropriate and
responsive to the needs of the
target population? Why/why
not
Effectiveness • Health • Desk reviews of
3. To what extent have the outputs facility HMIS secondary data
led to the realization of project • Survey data and
• Interviews with
outcomes, as well as to unintended SC/OTP and
• Key Project Staff
positive or negative effects, TSFP
informant
particularly in the areas of food registration book • Interview with
interviews
security, SAM/MAM services, implementing
•
healthcare, SRH services, and • Document partners
Government
protection services? review
Woreda/zona • Interview with
• Observation l report project
-How effective was the project in
beneficiaries.
reducing vulnerabilities, enhancing • Review • Beneficiaries
protection, and promoting the checklist interview in the
dignity and self-reliance of the target HF
population?
• Health Center
-Are there specific challenges or MCH
limitations in the project's design, registration book
implementation, or contextual factors and reporting
that have influenced its effectiveness format
in achieving its goals?

Sustainability • Key • Desk reviews of

4. How has the project contributed to informant • Annual work secondary data
strengthening the capacities of interviews plans • Interviews with
targeted CSW, government staff, • Survey • Evaluation Project staff
and CBCPS members in SGBV and reports from • Interviews with
case management? Woreda sectoral implementing
- What mechanisms and strategies office partner
were put in place to ensure the • project staff • Interview with
sustainability of the positive changes
• Implementing beneficiaries
and benefits achieved by the project in
the long term? partners • Observations
- To what extent are the project's •
outcomes likely to be maintained by Beneficiaries
the target population and relevant interview
stakeholders?
Coordination • Key • project • Observations

5. How well aligned and informant document
• Interviews with
coordinated have project activities interviews
• Evaluation Project staff
been with relevant humanitarian • Survey reports
• Interviews with
actors, and with what
implementing
consequences?
partner
Children’s rights, gender, and
• Key • project staff • Interview with
inclusion
informant beneficiaries
6. How and to what extent have the •
interviews
elements of gender transformative Implementing • Observations
and disability-inclusive projects • Survey partners
been practiced at the project level? • Beneficiaries

2.4. Expected Outcomes

To enable the most vulnerable Internally Displaced Peoples (IDPs) and their host communities
who are affected by complex humanitarian crisis meet their immediate lifesaving
humanitarian needs and strengthen their resilience through improved sustainable Nutrition,
SRHR and protection services in four Woredas of the Tigray and Amhara regions, Ethiopia.
To this end the following outcomes are expected at the end of the project.
OUTCOME 1: Crisis-affected and displaced girls and boys under five years of age and
pregnant and nursing/lactating women suffering from Acute Malnutrition (AM)
have increased food security and access to SAM/MAM services.
OUTCOME 2: Crisis-affected and internally displaced girls, boys, women, and men, including
host communities, have improved access to Healthcare and SRH services
OUTCOME 3: Crisis-affected children, adolescents, and youth are protected from gender-
based violence, abuse, neglect, and exploitation, and survivors have access to
quality protection services and psychosocial support.
2.2. Ethical consideration;
The evaluating teams need to secure permission to undertake the assessment from both
zonal and Woreda officials (from Zone Health and respective Woreda Health Offices and
DRM). The purpose of the survey will be explained to the respondents and consent to
participate in the study will ask prior to the interview using an oral ‘Informed consent’
approach as outlined in the structured questionnaire. The informed consent included
essential information such as statements of potential risks, benefits, and the right to decline
participation.
Confidentiality of the identity of respondents will be discussed and confirmation secured

with respondents prior to the interview. Coding is based on the household number instead
of names to ensure further confidentiality of respondents. During the survey, we ensured
ethics and child protection in the data collection process. Specifically, the consultant(s) shall
explain how appropriate, safe, and non- discriminatory participation of all stakeholders will
be ensured and how special attention will be paid to the needs of children and other
vulnerable groups. In addition, the consultant will sign an organizational code of conduct
before starting the working process.
3. METHODOLOGY
3.1. Approaches and Steps
A cross-sectional assessment will be conducted in the project implementation areas. The
methodological approach to the intended final evaluation will be generally a mixed methods
approach combining secondary data collection (literature review) and primary data collection
(including quantitative and qualitative methods), and considering gender, age and disability
approaches. It will also involve desk review of relevant project documents (proposal narrative
and financial proposal, periodic reports, challenges encountered and attained achievements);
manage overall data quality assurance, field data collection methods.
The evaluation methodology will be participatory and inclusive in which the following key
stakeholders including Plan International Ethiopia country office and field level emergency
staffs (If any), community leaders, host community’s representatives, relevant government
authorities (Health, Education, Women and Children, Water and Energy) experts will actively
participate. Therefore, all project beneficiaries involved will have the opportunity to have their
voices heard and may want to contribute to the final evaluation.
While all stakeholders are important, special emphasis will be placed on ensuring that
children (both boys and girls), youth and the families who are direct victims and/or
vulnerable to risk of sexual and gender-based violence are heard, enabled to communicate
their priority needs, and participate in the evaluation process. Other stakeholders whose
participation will be important to assess the impact of the response include parents (both
mothers and fathers) of those children who are participating on response activities. Local
community leaders, frontline workers, volunteers working with the response, members of
child protection committees, WaSH committee members, religious leaders, youth and social
workers will also be consulted in assessing the impact of the response.
In this regard Beles Engineering Plc. will develop a specific and detailed evaluation design
based on the following mixed methods of information gathering:
o In-depth interviews with key informants and/or qualified individual

respondents

o Focus group discussions with children, boys and girls, of different ages and
youth
o FGD with women and men parents/caregivers of children attending the
response activities
o Structured and semi-structured interviews with relevant stakeholders.
o Desk review of program documents, including financial records.
o Participant observation.
o Case-studies based on the most significant change technique, and
o Use mobile device for data collection (mandatory)
Apart from these, it will also create new tools and additional methods to address all the project
indicators easily adjust to the context. The assigned evaluation team will use participatory and
qualitative methods for data collection and data analysis, along with quantitative methods for
measuring the changes, in line with the overall theory of change of the project – as identified
above.
A household and institutional, including Faith Based Organizations (FBOs), survey will be
necessary for this purpose. Primary and secondary data are expected to be gathered using a
mixed method to evaluate program implementation. Thus, the evaluation will involve
collecting the following data:
Quantitative data: It will be used to measure indicators of the project expressed in terms of
numbers/percentages (quantitative indicators). Information will be collected using
questionnaire which will be administered to a sample of households. Beles Engineering Plc.
will determine the sampling technique and size which would be representative and adequate
to detect the changes observed and does basic descriptive statistics.
Qualitative data: Qualitative information will be collected through Focus Group Discussions
(FGDs), Key Informant Interviews (KIIs) and Interviews with key stakeholders and a wide
variety of participants including school teachers, students, priests, church leaders, members of
congregations, idir leaders, job brokers, the judiciary and police, representatives of sector
bureaus and offices at regional, zonal and Woreda levels and others to complement the

information collected through quantitative approaches.
Secondary documentation: Desk review of related documents like the project proposal and
periodic monitoring and evaluation field visit reports will also be important to establish key
insights on the effective evaluation of the implementation of the project.
In the process of the project evaluation the following approaches shall be employed.
• Participatory review techniques to ensure the review are conducted in a collaborative
manner with consultation between implementing partners and target groups.
• A mixture of primary/secondary and quantitative/qualitative data collection and
analysis from the target area.
• A combination of desk-based and field research, including a household and institutional
survey in line with existing monitoring and evaluation plans.
• Use of relevant secondary data and project documentation e.g. baseline survey &
midterm evaluation report, annual monitoring report, functionality survey and Project
efficiency test reports and timely follow up reports etc.
• Field research to establish project results, using an appropriate sample size. It is expected
that field research will be carried out in all the project areas through means of Key
Informant Interviews and Focus Groups Discussion, etc.
Data collection instruments - In order to get reliable results from the evaluation, Beles
Engineering PLC will plan the evaluation processes and activities to details. At this stage it is
not appropriate to present the detailed data collection instruments for household survey, focus
group discussion and key informant interview. Ones the logical framework of the project is
presented to details and the general project proposal documents, the questionaries, check lists
and related guidelines including formats for ethical issues will be presented with the inception
report ones the consultant is selected.
Steps in the data collection and analysis process - A successful survey work needs to be
clearly defined, smoothly processed, thoroughly analyzed and timely conducted. To this end,
the survey work can be split into the following major tasks and in order to be successful, the
evaluation will be properly implemented at each step. The steps include: Planning and survey
design; Data collection; Data access; Data management and preparation; Data analysis and

Reporting
Details of the activities that will be included in these major work packages are discussed in the
sections below.
3.2. Planning and Data Collection Survey Design

The data collection instruments (questionnaires and check lists) will be prepared based on the
log-frame of the project or indicators and expected outcomes. Care will be made in capturing
all the required issues to get appropriate data that captures all the required information.
Defining target assessment areas

Selection of the areas where the evaluation will be carried out is a three-stage process. The first
is identification of the target communities. The second step is identification of representative
villages/localities as there are different localities to consider and the third is defining the
sample size.
Assessment areas have already been selected. Thus the Evaluation will be conducted in 4
districts of Amhara (2) and Tigray (2). However, there may be marked variations in
biophysical and socioeconomic circumstances of the population/interviewees within the target
area and hence representative samples should have to be drawn from the large population
based on those major variables that could affect the project outcomes and impacts.
The definition of survey areas and households is best done by initial rough stratification of the
target areas which are relatively homogeneous with respect to household circumstances
(particularly food security).
Target Assessment area Selection - theoretically, selecting a single survey area or Kebele
bearing all the different target groups could be advantageous in terms of the logistics
requirements and the ease to manage the field activities.
However, it is difficult to find a single locality or village where all the major target groups
exist. Therefore, one or more area(s) will randomly be selected from among the
localities/villages within the target project area.

3.3. Data collection Methods

Various data collection methods will be employed and these include qualitative and
quantitative methods. To collect qualitative information at the selected communities and target
village/locality, an inventory or status of community-level appropriate technology facilities
will be developed through focus group discussions, Key informant interviews, historical
profiles (project proposal, baseline survey and midterm evaluation documents) and direct
observations.
The process also includes capturing of photographs and videos (preferably using digital
camera) of all events and other observations during the survey that helps to realize the impact
of the project and the findings will be inserted in the evaluation report, while the quantitative
data will be collected both by the survey team members and enumerators that will be
recruited in the target areas.
Focus Group Discussions (FGDs) - A cross checking/validation and elaboration responses for
the HH survey questionnaires will be collected using FGDs with developed checklist. The
FGDs also help to enrich the data/information requirements of the evaluation, which is
difficult or impossible to generate with a household survey. It involves wide variety of
participants including school teachers, students, priests and church leaders, members of
congregations, iddir leaders, job brokers, the judiciary and the police.
Key Informant Interviews (KIIs) - Key informant interviews are qualitative in-depth
interviews with people who know what is going on in the community. The purpose of key
informant interviews is to collect information from a wide range of people including
community leaders, professionals, or residents who have first-hand knowledge about the
community. To enrich data/information requirements of the survey, key informant interview
and direct observation will be used. It has the following main advantages:
1. Because information comes directly from knowledgeable of the people, key informant
interviews often provide data and insight that cannot be obtained with other methods.
2. Key informant interviews provide flexibility to explore new ideas and issues that had not
been anticipated in planning the study but that are relevant to its purpose.

Household Interviews (HHIs)- It is assumed that reliable firsthand information could be

extracted from direct beneficiaries. Hence, the evaluating team will focus on parents (both
mothers and fathers) of those children who are participating on response activities. Therefore,
House Hold Interviews will be conducted in the evaluation process. Size and type of the
household to be interviewed are determinant and critical factors to be considered when
conducting household interviews.
3.4. Sample Size

Selected sample sizes will be representative and ensure valid conclusions. A representative
sample must not only be random, but must also be large enough to reflect all the victims of
sexual abuse and commercial sex working and families and owners of bars, night clubs and
brothels in the project areas. Well established statistical procedures for determining sample
sizes on the basis of the variability within the sample cannot be formally applied for this type
of survey. Nonetheless, consideration of the variability within the target groups is important
in determining sample size. Generally, statistically acceptable sample number shall be chosen
in consultation with the client.
In selecting households to be surveyed multi-stage sampling method will be used. First

parents of the children (recipients of the support) shall be stratified based on economic status
of each household. This stratification shall create more homogeneity among the population.
As this is a terminal evaluation, attempt will be made to account the target households chosen
during the baseline survey (if there is any). If that is not the case, the number of households for
the survey will be considered based on established method to calculate sample size form the
target communities. Sample size estimation will consider 10% acceptable error (precession),
50% reasonable estimate for the key proportion to be studied (P=0.5) and 95% confidence
interval. The following Cochran’s formula will be used to estimate the sample size among the
target population.
Z 2∗P (1−P)
N=
D2
Where, N = number of samples (in this case number of households/respondents)
Z = Standard value for 95% confidence interval (1.96)

P = Proportion
D = precision
The issues to be addressed will be defined based on the logical framework of the project. For
this properly structured and designed data collection instruments will be developed and
submitted during the inception report to get approval by the client.
Once the target households are defined surveying can be started, but, all listed interviewees
may not participate. In such a case “replacement households" will also be drawn up to enable
substitution of individuals included in the original sample who are not available for the
interview or who do not meet the sample requirements. At least 10 % replacement households
will be drawn up from the total respondents. However, the consultant has decided to consider
the replacement as actual respondents.
3.5. Survey Questionnaire Design and Pre-test

The design of survey questionnaire begins by reviewing what is known from secondary data
sources and then developing a list of additional data needs. The evaluating team will then
decide on the type of question and then each question will be carefully and clearly worded so
as to communicate the intended meaning of the inquiry. This will be helped when appropriate
local terminology and measurement units are used. The questions will then be arranged in a
logical progression from the household’s perspective, starting with simple, more general
questions and proceeding to the nonspecific, difficult and sensitive areas. Finally, the team will
decide on the appropriate layout and length of the questionnaire and to take time to train
interviewers who will then assist in pretesting the questionnaire.
Pretesting is a trial run during which the questionnaire is administered to a limited number of
key informants (KIs) who will then be asked if they had problems understanding the question.
The pre-test will also provide an opportunity to check the data analysis techniques proposed.
Finally, the questionnaire will be revised and updated together with the data collectors. The
design of a questionnaire should not only take into account the best way in which to ask
questions, but should also consider ways to increase the efficiency of data collection and
processing.

3.6. Interviewers Selection, Recruitment, Training and Supervision

The evaluating team needs to select interviewers carefully to help assure that their survey
produces useful data. While the characteristics of good interviewers may vary from survey to
survey, they should generally have friendly, yet professional approaches to their work.
Various criteria will be used in choosing good interviewers and the qualities that will be
looked at in this survey to select interviewers include personality, language, education, local
area knowledge, sex, motivation, honesty and residence in the area.
The evaluating team will share these criteria with proponent’s staff and its partners who will
be facilitating the processes to screen and hire the interviewers from within the target areas
and sample Kebeles that will be identified.
Training Interviewers - Interviewers should complete a training session if they are to

adequately conduct the interviews. Overall, the training session is intended to provide
interviewers with background on the surveys, purpose and to ensure the interviewers know
how to administer the questionnaire. Ideally, all interviewers should ask questions in the same
way so the responses will be the same as if all interviews were conducted by the same
individuals. Thus, the approach to a training session is to produce a team of interviewers who
administer the questionnaire uniformly without biasing the results.
Preparation for the training begins while the questionnaire is still being developed. At this
time the evaluating team needs to begin writing an instruction manual for the interviewers.
Supervising The Interviewers - Once the interviewers have been trained, the field team leader
or coordinator normally supervise the interviewers throughout the field survey period,
providing the necessary logistical support, keep up the interviewers moral and spot check for
falsified interviews. The field coordinator supervisory role includes collecting and editing
questionnaire, checking questionnaire for legibility, completeness, consistency and accuracy.
Discussing problems with the interviewers and when necessary, shifting the interviewers'
assignment. Thus, the coordinator should visit interviewers regularly, supervising their work
closely and respond to their personal problems and needs.
3.7. Data Preparation and Management

The goal of the data preparation and management stage is to get the data ready for analysis.
When examining a new data set, performing data verification and cleaning will help to ensure
that the analytical results are accurate. Two Data Clerks will be employed to assist the survey
team in verifying and cleaning the data collection from the field and this will thus enable to
prevent the risk of analyzing bad data and consequently, getting bad results. During the data
preparation and management step, “codebook” information, which is variable definition
information, will be set up and this includes variable names, variable formats and descriptive
variable labels (data such as gender or income level or education level) and value labels
(numbers assigned to data, such as “1” for male, “2” for female). This information is stored in
the data “dictionary" of the SPSS software that will be used to store and analyze the final
evaluation data that will be collected.
3.8. Data Analysis and Reporting

The data collection will be analyzed to report the results or indicators requested by the
proponent. The goal of reporting is to create easy-to-understand results from the data analysis
that the client can quickly understand and act upon. The parameters for the descriptive
statistics are mainly mean, mode, standard errors and percentages and these are used to
characterize household’s appropriate economic status. The next step is to analyze those actors
and factor relationships determining households access to effort experiences, conduct technical
feasibility of marketing systems, define modality of sustainable development, define technical
specification for basic infrastructures and resource endowments. This entails analysis
involving multiple variables that affect households use and practices relating to food security
and related issues and integration, challenges and prospects.
Finally, the data collected will be put in appropriate platform (SPSS) for analysis and
presentation. The basic statistics should provide detailed information on all deliverables
indicated in the log frame and key project indictors showing clearly the achievements and
gaps of the project including its sustainability.
3.9. Ethics and Safeguarding Considerations

Team members of the terminal evaluation will take into account ethical issues listed in the Terms of
Reference designed for the assignment. These are:

The evaluation team will comply with policies from the country agency on Child Protection, Code of
Conduct, and Safeguarding Protection Policies (Child Protection Policy, Disability, Gender Inclusion, and
Age Policy, Protection of Beneficiaries from Sexual Exploitation, Abuse, and Harassment Policy, Anti-
Fraud, and Bribery and Corruption Policy).
In addition, the following ethical issues will be adhered to:
 Consent: It is important to always get the consent of the interviewees or children's parents or
guardians when doing an evaluation interview with them or when using their story as part of
the evaluation case study. Informed consent can be verbal or written; whichever the evaluation
team thinks is recommended for the person who is part of the evaluation.
 Confidentiality: It is important to respect confidentiality during this evaluation. For example, it

can be useful to use pseudonyms for children when using their names in a case study in a
report or to codify the names of communities for the identification of the children. A good
practice is that an interviewee is asked first whether a researcher can share information before
they tell their information to anyone else. But a researcher should not promise to keep secrets
from other team members, as this could create problems in the future. It is good to let people
know from the outset that the information they share with the evaluator may be shared with
other members of the team. There are some occasions when it may be necessary to break
confidentiality; this is when the child is threatened or in danger.
 Privacy: It is important to respect the privacy of a child and not ask invasive questions. While an
adult may be able to say, "No, I don’t want to answer that," a child may not be able to say that
they feel uncomfortable. It is always good to give the child the right not to answer any
questions and to let them know that is OK.
 Expectations: It is important that the interviewee's expectations be not unrealistically raised in

the survey. Therefore, an evaluator should not make promises that they cannot keep.
 Response Plan: In order to ensure that children and other project stakeholders who disclose
experiences of violence and abuse during data collection can be provided with the necessary
forms of care and support, it is essential that a response plan be in place. An integral part of a
response plan is to have a clearly mapped and documented referral pathway that safely links
survivors to supportive and competent services, such as medical care, mental health and
psychosocial support, police assistance, and legal and justice support. The evaluator must work
closely with the contracting agency to ensure a response plan is in place before the initiation of
data collection for this evaluation. Further guidance is available.
 Data protection and Data sharing: Embedding data protection features and data privacy-
enhancing technologies directly into the evaluation design and including risk mitigation
measures will avoid the risk of compliance failure. Enforce data protection mechanisms to
prevent irresponsible or unauthorized access to and use of data. All staff with access to data
should use password-protected laptops and tablets. Data must be secured in line with
organizational regulations. Data is to be maintained in a password-protected, encrypted
database maintained on secure servers in accordance with the organization's record retention
policies. The consultant understands and agrees not to use or disclose any data collected or
reports received to any third parties, including any foreign or domestic researchers or
companies. the copyright passes to the entity contracting the study. The client will be
responsible for the dissemination of the assessment findings.
 Integrity: the consultant or consulting firm will have the responsibility to express issues that
are not mentioned in the Terms of Reference if it would be necessary, in order to have a
comprehensive analysis of the project
 Independence: the consultant or consulting firm has to guarantee independence from the
study.
 Incident: in case there are incidents during the fieldwork, the consultant or consulting firm
should immediately inform the focal person of WISE, and if deemed essential, WISE will inform
and discuss with responsible government officials. If the problems are not communicated on
time as mentioned before, the case cannot be used to justify the unsuccessful results of the
study.
 Safeguarding: Adherence to client’s Code of Conduct, Child Safeguarding Practices, and

Confidentiality when interviewing or photographing children Gender mainstreaming is key to
the Project and the donor; therefore, the lead consultant will have to ensure that the research
team is gender balanced, ensuring that female enumerators are available to interact with
female beneficiaries and vice versa. The external consultant shall report any safeguarding or
child protection concerns as soon as possible and within 24 hours to Plan Ethiopia’s
Safeguarding Focal Points and perform child protection and safeguarding background on all
their staff involved in evaluation activities, including contractors.
 Training: All enumerators will be trained on data collection tools, targeted people and
locations, inclusion and exclusion criteria, obtaining informed consent forms, data handling,
data quality assurance, data protection and ethics, and confidentiality. Finally, yet importantly,
the enumerators will sign a confidentiality MoU or a Non-Disclosure Agreement.

4. STAFFING
The consultant has organized evaluating two teams consisting of highly qualified and well
experienced professionals. The teams will be led and the assignment will be coordinated by a
high level professional.
The table below summarizes the core team members who will be assigned for the terminal
evaluation. The curriculum vitae of the key professionals is annexed.
Table 4.1: Staffs to be assigned for the project
Expertise and Project

No Name Qualification Experience
Assignment
He will oversee the
activities of the He has over 30 years’ experience in
project and deeply project management, data analysis and
Tenalem PhD in
1 involved in report report writing of project evaluation
Ayenew Hydro-Geology
writing and data and development studies.
analysis
He has more than 19 years of work

M.A. in public health experience of managing development and
He will undertake public
2 Aschalw Tolla with sociology humanitarian response programs,
health and
background specifically on WASH, public health and
socioeconomics aspect
emergency response projects.
He will be responsible He has over 15 years’ experience in
to thoroughly conducting socio-economic baseline,
investigate the social midline and final evaluation as field
dimension of the research data collector, field research
Zelalem community with supervisor, coordinator and he has worked
3 M.Sc.
Temesgen specific emphasis on over 15 years in many development
the livelihood of studies and coordinate many similar
children, women, young projects.
and adolescent boys
and girls
She will be She has over 25 years of work
responsible to assess experience of different capacities and
the overall traditional also has wide range of exposure and
M.A in Gender and cultural setting participation in different local and
4 Adanech Shumie Studies and legal frame work international forums on gender issues
devised for child and
women protection
against abuse and
violence

Expertise and Project

No Name Qualification Experience
Assignment
He has over 40 years’ experience in

different positions including Secondary
Education program expert, education
program supervisor Program
coordinator and Graduate Assistant,
Temesgen BA in Gender and
5 project Officer of the Ambassador’s
Mengistu Management Education expert
Girls Scholarship Program (AGSP)-
USAID empowerment of girls and
women, Education in Emergency
Response project coordinator, HR
Manager, etc.

5. ACTIVITY AND STAFFING SCHEDULE

5.1. Activity Schedule
The proposed time frame i n t h e T e r m s o f R e f e r e n c e to conduct the final evaluation is
eighty one (81) days (December 2023-Feruary 19, 2024). Though the time seems sufficient for
the assignment, the project areas where the final evaluation will be conducted are 4 Woredas
in 2 different regions. Therefore, Beles Engineering will assign 2 teams consisting of 2
experienced and knowledgeable staff professionals each for the work and will deliver the
evaluation report on time without compromising quality and accuracy.
The chart below summarizes the activity schedule for the final evaluation based on our
past experience.
5.1. Activity Schedule

5.2. Staffing Schedule

The project involves a multi-disciplinary staff engagement. Different team members may
be engaged at different times. But, the following table shows simplified staffing schedule of
the project.
Table 5.2. Staffing Schedule

ANNEXES

Annex 1: Curriculum Vitae

Annex 2: Testimonial Letters

Final Evaluation Technical Proposal 2023
Annex 3: Company Profile

Annex 4: Legal Documents

Annex 5: Completed, Stamped Terms of Reference and Stamped Copy of

Tender Instruction

Financial Proposal For Endline Evaluation Survey of The Food Security &
Livelihood (FSLl), Health & SRH And Protection Include of Gender-Based
Violence (GBV) Interventions
1. Summary of Fees
Unit
A Professional Fee Unit Qty Rate Total
Mont 1.8 60,000.0
Tenalem Ayenew h 5 0 111,000.00
Mont 1.8 60,000.0
Abiyot Assefa h 5 0 111,000.00
Mont 2.7 60,000.0
Zelalem Temesgen h 0 0 162,000.00
Mont 2.7 60,000.0
Almaz woldetensaye h 0 0 162,000.00
Mont 2.7 60,000.0
Temesgen Mengistu h 0 0 162,000.00
Total-A 708,000.00
2. Summary of Reimbersable
Unit
B. Perdiem Unit Qty Rate Total (Birr)
Tenalem Ayenew Days 30 2,000.00 60,000.00
Abiyot Assefa Days 30 2,000.00 60,000.00
Zelalem Temesgen Days 30 2,000.00 60,000.00
Almaz woldetensaye Days 30 2,000.00 60,000.00
Temesgen Mengistu Days 30 2,000.00 60,000.00
Total-B 300,000.00
Unit
C. Tarnsport Unit Qty Rate Total (Birr)
10,000.0
Car Rent Days 30 0 300,000.00
Fuel Litre 730 80 58,400.00
Total C 358,400.00
Uni
D. Data collection Unit t Unit Unit
40,000.0
Supervisor's and Data collector's fee LS 1 0 40,000.00
45,000.0
Debriefing Meeting Cost LS 1 0 45,000.00
20,000.0
Data encoders LS 1 0 20,000.00
Total D 105,000.00
E. Consumables and Uni
communication Unit t Unit Unit

10,000.0
Stationary and photocopy LS 1 0 10,000.00
Communication cost LS 1 6,000.00 6,000.00
Total-E 16,000.00
Uni
F. Miscelaneous Unit t Unit Unit
Filed consumables LS 1 5,000.00 5,000.00
35,000.0
Overhead costs LS 1 0 35,000.00
Total F 40,000.00
Total Reimbersable (B+C+D+E+F) 819,400.00
Grand Total (A-F ) 1,527,400.00
15% VAT 229,110.00
1,756,510.0
Grand Total (A-F + VAT) 0

TP and FP Final

Uploaded by

Document Information

Original Description:

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

TP and FP Final

Uploaded by

Copyright:

Available Formats

Consultancy Service On Baseline Survey for Strengthening of Food and Nutritional Security of Vulnerable Households in Borena Zone

COSULTANCY SERVICE FOR FINAL EXTERNAL EVALUATION OF

CXONSULTANCY SERVICE FOR ENDLINE EVALUATION SURVEY OF THE SECURITY &

Beles Engineering PLC

Consultants: BELES Engineering PLC Client: Plan International

1.1. BACKGROUND OF THE PROJECT...................................................................................................................................1

2. OBJECTIVE, SCOPE, CONCEPTUAL FRAMEWORK AND OUTCOME INDICATORS....................................................5

2.1. OBJECTIVE OF THE FINAL EVALUATION:........................................................................................................................5

3.1. APPROACHES AND STEPS...........................................................................................................................................9

5. ACTIVITY AND STAFFING SCHEDULE................................................................................................................. 21

5.1. ACTIVITY SCHEDULE......................................................................................................................................................21

ANNEX 1: CURRICULUM VITAE...................................................................................................................................25

Consultants: BELES Engineering PLC Client: Plan International

Plan International, Plan International Ethiopia and Plan International Somaliland/Somalia

Consultant: Beles Engineering PLC Client: Plan International 1

1.2. Brief Description of the Client and the Project

Plan International is an international, humanitarian, child-focused development organization

Consultant: Beles Engineering PLC Client: Plan International 2

Plan International's programs in Ethiopia focus on Child Protection, Education, Water,

1.3. Overview of the Consultant

Consultant: Beles Engineering PLC Client: Plan International 3

Beles is established and managed by highly-qualified professionals with many years of

Consultant: Beles Engineering PLC Client: Plan International 4

2. OBJECTIVE, SCOPE, EVALUATION CRITERIA AND OUTCOME

2.2. Scope of the Endline Evaluation:

Consultant: Beles Engineering PLC Client: Plan International 5

2.3. Evaluation criteria, question, and evaluation Matrix:

(NB: analysis to be based on disaggregated data to ensure gender equality is included

2. Were activities and strategies

Consultant: Beles Engineering PLC Client: Plan International 6

Sustainability • Key • Desk reviews of

Coordination • Key • project • Observations

Consultant: Beles Engineering PLC Client: Plan International 7

2.4. Expected Outcomes

Confidentiality of the identity of respondents will be discussed and confirmation secured

o In-depth interviews with key informants and/or qualified individual

Consultant: Beles Engineering PLC Client: Plan International 9

Consultant: Beles Engineering PLC Client: Plan International 10

information collected through quantitative approaches.

Consultant: Beles Engineering PLC Client: Plan International 11

3.2. Planning and Data Collection Survey Design

Defining target assessment areas

Consultant: Beles Engineering PLC Client: Plan International 12

3.3. Data collection Methods

Consultant: Beles Engineering PLC Client: Plan International 13

Household Interviews (HHIs)- It is assumed that reliable firsthand information could be

3.4. Sample Size

In selecting households to be surveyed multi-stage sampling method will be used. First

Consultant: Beles Engineering PLC Client: Plan International 14

3.5. Survey Questionnaire Design and Pre-test

Consultant: Beles Engineering PLC Client: Plan International 15

3.6. Interviewers Selection, Recruitment, Training and Supervision

Training Interviewers - Interviewers should complete a training session if they are to

3.7. Data Preparation and Management

3.8. Data Analysis and Reporting

3.9. Ethics and Safeguarding Considerations

Consultant: Beles Engineering PLC Client: Plan International 17

 Confidentiality: It is important to respect confidentiality during this evaluation. For example, it

 Expectations: It is important that the interviewee's expectations be not unrealistically raised in

 Safeguarding: Adherence to client’s Code of Conduct, Child Safeguarding Practices, and

Consultant: Beles Engineering PLC Client: Plan International 19

Table 4.1: Staffs to be assigned for the project