Professional Documents
Culture Documents
AUGUST 2023
i
TABLE OF CONTENTS
DISCLAIMER ..................................................................................................................................... i
TABLE OF CONTENTS ................................................................................................................... ii
ACKNOWLEDGEMENTS................................................................................................................iii
ACRONYMS .......................................................................................................................................iv
CHAPTER ONE: INTRODUCTION AND CONTEXT ................................................................. 1
1.0 INTRODUCTION AND BACKGROUND ............................................................................. 1
1.1 OVERVIEW OF THE EVALUATION SUBJECT ................................................................ 2
1.2 EVALUATION OBJECTIVES, APPROACH AND QUESTIONS ...................................... 3
CHAPTER TWO: MATERIALS AND METHODS ....................................................................... 5
2.0 INTRODUCTION..................................................................................................................... 5
2.1 RESEARCH PHILOSOPHY ................................................................................................... 5
2.2 RESEARCH APRROACH ...................................................................................................... 6
2.3 POPULATION OF STUDY ............................................................................................... 7
2.3 SAMPLING ............................................................................................................................... 8
2.5 DATA COLLECTION TECHNIQUES ................................................................................ 12
2.6 DATA PRESENTATION ....................................................................................................... 15
2.7 DATA ANALYSIS .................................................................................................................. 16
2.8 RELIABILITY AND VALIDITY .......................................................................................... 18
2.9 ETHICAL CONSIDERATIONS ........................................................................................... 19
CHAPTER THREE: IMPACT EVALUATION FINDINGS AND DISCUSSION ..................... 22
3.0 INTRODUCTION................................................................................................................... 22
3.1 SANITATION AND HYGIENE ............................................................................................ 22
3.2 FOOD HAMPERS .................................................................................................................. 26
CHAPTER FOUR: CONCLUSIONS AND RECOMMENDATIONS ......................................... 38
4.0 INTRODUCTION................................................................................................................... 38
4.1 OVERALL ASSESSMENT/CONCLUSIONS ...................................................................... 38
4.2 RECOMMENDATIONS ........................................................................................................ 42
REFERENCES ................................................................................................................................. 45
ANNEX AND FURTHER READING............................................................................................. 47
ANNEX A: INTERVIEW QUESTIONS -HOUSEHOLD NUTRITIONAL BASKETS ......... 47
ANNEX B: INTERVIEW QUESTIONS -HYGIENE KITS...................................................... 48
ANNEX C: INTERVIEW QUESTIONS -LACTACTING MOTHERS/CHILDREN UNDER
5 ...................................................................................................................................................... 49
ii
ACKNOWLEDGEMENTS
The Church of Jesus Christ of Latter-Day Saints Charities commissioned an external evaluator
to lead this evaluation process. We acknowledge the contributions of the individuals and
organizations that supported this exercise, through sharing their experiences and lessons.
Particular acknowledgement to Plan International and its implementing partners. Further
recognition is expressed towards National, Provincial and District level structures, that
supported the evaluation processes’ field work component. Special thanks go to each one of
the parents, community leaders, school headmasters and the educators who dedicated their time
and effort to share their lived realities and enrich this programme evaluation exercise.
iii
ACRONYMS
WASH Water Sanitation and Hygiene
MAM Moderate Acute Malnutrition
SAM Severe Acute Malnutrition
LDSC Latter-Day Saints Charities
iv
CHAPTER ONE: INTRODUCTION AND CONTEXT
Manicaland province is one of the areas with most poverty prevalent due to the effects of
Cyclone Idai, Chipinge and Chimanimani being serious hit with estimated 79.6% and 76.8 %
poverty prevalence respectively. Tropical Cyclone Idai hit Zimbabwe on March 16 and 17,
2019. Cyclone-induced rains caused catastrophic flooding in Chimanimani and Chipinge
Districts of Manicaland Province, destroying homes, livelihoods, road networks, schools, and
water points. An estimated 600,000 people were affected, and many people lost their lives or
loved ones. As such, it has become a critical programmatic priority to shift towards increased
involvement of communities through social mobilization and micro-responses, targeting
locations and populations based on evidence. The root causes of food insecurity and poverty
must be tackled for Zimbabweans to end chronic food insecurity. The Church of Jesus Christ
of Latter-Day Saints Charities through its implementing partner Plan International Zimbabwe
Office supports food security activities that are designed to cater for short term emergency
humanitarian assistance, and also help people transition from humanitarian assistance to food
and nutrition security and self-reliance. Activities focus on increasing production and
productivity, promoting small and medium sized enterprises, and increasing the resilience of
vulnerable communities.
Against this background, this three-year programme (2019-2022), named Zimbabwe Food
Nutrition and security sought to scale up and integrate farming as a family business, improve
household and community nutrition, and spur private sector engagement. As farming
1
households increase their assets, they better equip themselves to adapt and respond to climate,
economic, and other shocks. By investing in households and communities, the activity
improves incomes, nutrition, and livelihoods, expanding inclusive and sustainable economic
opportunities. The Church of Jesus Christ of Latter-Day Saints Charities, provided financial
support to compliment national response efforts, implementing the programme in partnership
with Plan International Zimbabwe anchored primarily on service delivery also in partnership
with national and local community structures both state and non-state partners. As the
programme cycle came to an end, the Church of Jesus Christ of Latter-Day Saints Charities
commissioned an end term and impact evaluation to establish and document the effectiveness,
sustainability, relevance, reach and impact of the Zimbabwe Food and Nutrition programme,
its activities, objectives, outputs and results, over the period 2019-2022.
A sample of beneficiaries receiving the assistance was the unit of analysis with selected
beneficiaries being interviewed on the impact of the intervention on their livelihoods. Details
of the tests are provided under the Methodology section. The intervention proceeded as planned
with no beneficiaries dropping out or otherwise suspending implementation.
Funding for implementation and Independent Impact evaluation came from The Church of
Jesus Christ of Jesus Christ of Latter-Day Saints Charities. The project officially closed in
September 2022. The Evaluation was undertaken by Tendai Engrom Masimba Consultancy.
There was only a minor change in the research approach, that it was no longer a full-fledged
evaluation.
2
1.2 EVALUATION OBJECTIVES, APPROACH AND QUESTIONS
Plan International Food Security project provided food hampers, sanitary and hygiene kits
irrigation equipment and inputs to various small irrigation schemes build disability and girl
friendly latrines and funded for school nutritional gardens which directly benefitted a
cumulative number of 11127 for cumulative 3yrs, beneficiaries included Children under 5
pregnant and lactating mothers, school children and different poverty-stricken households. The
intervention was in response to complement and supplement governments efforts to help
victims of Cyclone Idai to recover and build resilience towards climate change and adverse
weather effects.
The evaluations therefore call upon different stakeholders to continue to invest in studies and
research to underpin programme design. The long- term role of sustainable -climate smart
programmes role of school feeding programmes in Zimbabwe contributes to potential increase
in vulnerable community to withstand adverse climate effects. This evaluation was designed to
gather information on a practical means to add value to national programme and ways to
improve in future programs at an age when children are most responsive. As it is widely
believed that the returns from sustainable projects and capacity building are far greater than
emergency short term interventions and it follows that any such response can have long lasting
impacts on vulnerable communities’ capacity to recover, mitigate and be resilient to climate
shocks.
To this end, the evaluation explored the impact of the provision of humanitarian assistance to
the victims who survived from destructive Cyclone Idai on their road to recovery and resilience.
Two principal outcomes were tracked: Self-reliance/sustainability. The global experience on
similar programmes is mixed and highly context specific. The relevance of these research
themes for The Church of Jesus Christ of Latter-day Saints Charities and international
development actors more broadly is confirmed by the number of additional studies and research
that are emerging.
The Church of Jesus Christ of Latter-Day Saints Charities provided funds through Plan
International to Beneficiaries in two districts –Chimanimani and Chipinge - to provide the
humanitarian assistance to vulnerable communities. The beneficiary was given assistance that
was context specific and according to their various needs and the list was developed by Plan
3
International in partnership with relevant stakeholders. The Food Security and Nutrition
programme ran for the cumulative 3years from 2019- 2022.
The Theory of Change [ToC] presumes that capacity building and empowering beneficiaries
to initiate sustainable project and become more self-reliance will increase climate resilience
and is key to food security and healthy living and can also increase resilience to livelihoods
shocks economically. The corresponding evaluation matrix from the inception report is
reproduced in the Annex. This is expressed in terms of relevance, effectiveness, efficiency,
impact, and sustainability.
4
CHAPTER TWO: MATERIALS AND METHODS
2.0 INTRODUCTION
The methodology of the study is presented in the chapter. A research technique, in the words
of Kothari (2004:8), "is a strategy to systematically tackle the research problem. It might be
considered a science that studies how scientific research is conducted. In actuality, it captures
the many procedures and methods that the researcher typically uses in carrying out research,
together with the reasoning behind them. Consideration will also be on the research design,
data gathering, and sampling methods. Also covered are methods for assuring validity and
reliability. Methods for data analysis and presentation are also discussed along with the ethical
considerations.
The evaluation team took a problem-centred approach, focusing on the specific challenges
faced by the affected families in the Chipinge and Chimanimani Districts. The interventions,
such as the food security and nutrition program, as well as the enhanced food and nutrition
security initiatives, were assessed based on their practical impact on the targeted population.
Pragmatism guided the evaluation team to consider the context-specific factors and the extent
to which the interventions addressed the immediate and long-term needs of the affected
communities. The evaluation examined how the school feeding programs and agricultural
training contributed to improved household food production, addressing the nutritional needs
of the affected families. Additionally, the evaluation assessed the effectiveness of the initiatives
5
in enhancing food and nutrition security and promoting the uptake of essential hygiene
practices within the targeted communities.
The evaluation process prioritized practical outcomes and actionable recommendations. The
evaluation focused on identifying best practices, lessons learned, and areas for improvement,
based on the pragmatic assessment of the interventions. The aim was to provide practical
insights and recommendations that could inform future programs and interventions in similar
disaster-affected contexts.
By adopting pragmatism as a guiding philosophy, the evaluation team emphasized the practical
impacts and real-world implications of the interventions funded by LDSC and implemented by
Plan International. The evaluation focused on addressing the specific needs of the affected
communities and providing actionable recommendations to enhance future interventions.
In the case of evaluating the interventions funded by the Latter-Day Saints Charities (LDSC)
and implemented by Plan International after Cyclone Idai, a mixed methodology was employed
to examine the impacts on food security, nutrition, hygiene practices, and community
engagement.
Quantitative methods, such as surveys and structured questionnaires, were used to collect
numerical data on indicators such as the number of people reached, changes in food production,
or improvements in nutrition and hygiene practices. These quantitative measures provided
statistical evidence of the program's effectiveness and allow for comparisons and
generalizations.
Qualitative methods, such as interviews, focus groups, and observations, were used to gather
indepth insights into the experiences, perspectives, and narratives of the affected communities.
6
Qualitative data helped to explore the contextual factors, individual stories, and community
dynamics that influenced the outcomes and impacts of the interventions. It captured the
nuances, complexities, and unintended consequences that quantitative measures might not fully
capture.
The integration of qualitative and quantitative data in the evaluation allowed for a
comprehensive assessment of the impacts and effectiveness of the interventions. By
triangulating the findings from both types of data, the evaluation team validated and
complemented the results, enhancing the overall validity, reliability, and richness of the
evaluation findings. Ultimately, the use of a mixed approach in the evaluation process provided
a more holistic and nuanced understanding of the outcomes, processes, and experiences related
to the interventions implemented after Cyclone Idai.
7
The population in the evaluation process included these specific groups of individuals who
were directly impacted by Cyclone Idai and received support through the LDSC-funded
interventions implemented by Plan International. The evaluation aimed to assess the impacts
of the interventions on these populations, taking into account their unique circumstances,
needs, and experiences during the post-cyclone recovery period.
2.3 SAMPLING
The process of picking a fraction or segment to represent the population under study is called
sampling. Sampling is the process of choosing a portion of the population that is enough for
the entire population (Boyce and Neale, 2006). According to (Webster 1985) referenced in
Mugoh, a sample is a discrete portion of a statistical population whose characteristics are
investigated to learn more about the entire population (2002:7). It can be described as a group
of respondents (people) chosen from a broader population for the purpose of a survey when
referring to people. In the post-evaluation conducted to assess the impacts of the interventions
funded by the LatterDay Saints Charities (LDSC) and implemented by Plan International after
Cyclone Idai in 2018, the sample in the evaluation process was selected to represent the
populations affected by the cyclone and targeted by the interventions.
8
Sample for the 2022 Recovery Intervention:
• Affected Families: Similar to the previous intervention, a sample of families directly
affected by both Cyclone Idai and Eloise in the Chipinge and Chimanimani Districts
were selected.
• Beneficiaries of Food and Nutrition Security Measures: A subset of the affected
families who received support for enhanced food and nutrition security included in the
sample. This sample represented those who benefited from interventions such as food
distribution, agricultural support, or livelihood assistance.
• Beneficiaries of Hygiene and Water Facilities: Another subset of the affected families
who benefited from improved hygiene practices and gender-responsive water and
sanitation facilities were included in the sample. This included families accessing and
using the provided facilities.
The specific sample size and selection criteria was determined based on the evaluation
objectives, resources available, and statistical considerations to ensure the findings are
generalizable to the larger population of the affected families in the Chipinge and Chimanimani
Districts.
9
the impacts of the interventions funded by the Latter-Day Saints Charities (LDSC) and
implemented by Plan International after Cyclone Idai in 2018, the purposive sampling
technique was used to select specific families with certain characteristics or experiences of
interest. Here is how the purposive sampling technique was used:
Inclusion of Vulnerable or Marginalized Groups: Purposive sampling was used to ensure the
representation of vulnerable or marginalized groups within the affected population. For
instance, families belonging to low-income households, female-headed households, or families
with members having special needs were purposively included in the sample. This approach
allowed for a focused examination of the interventions' effectiveness in addressing the specific
needs and challenges faced by these groups.
Sampling Based on Severity of Impact: Purposive sampling used to select families based on
the severity of the impact they experienced due to Cyclone Idai. Families who were severely
affected or faced specific challenges resulting from the cyclone, such as extensive property
damage or displacement, were purposively included in the sample. This approach allowed for
a focused analysis of the interventions' effectiveness in addressing the needs of the most
affected families.
10
The purposive sampling technique was employed to ensure that the selected families
represented specific groups or characteristics of interest, providing valuable insights into the
impacts of the interventions on those specific subgroups. By purposively selecting families
based on predetermined criteria, the evaluation was able to explore the targeted outcomes and
understand the effectiveness of the interventions in addressing the unique needs and challenges
faced by these families.
According to Levin (1987:45), it is a sampling approach where the first respondent is chosen
based on their comprehensive knowledge of the topic under investigation, and they then direct
the researcher to the next respondent. It is primarily employed when researching some
populations that are difficult to reach and is also referred to as the referral or chain sampling
approach. Additionally, the snowball sampling technique will be used in the study. The
researcher will gather information from important respondents using snowball sampling. By
adopting this sampling strategy, the team was able to contact respondents that are challenging
to sample when using other sampling techniques, such as high-ranking government officials
and respondents who were initially unknown to the researcher. In the post-evaluation
conducted to assess the impacts of the interventions funded by the Latter-Day Saints Charities
(LDSC) and implemented by Plan International after Cyclone Idai in 2018, the snowball
sampling technique was used to identify and select participants for the evaluation. Here is how
the snowball sampling technique was used:
Initial Participant Selection: The evaluation team initially selected a small number of
participants who were directly involved in or had knowledge of the interventions. These
individuals were identified through coordination with Plan International, Implementation
partners, local authorities and community leaders familiar with the projects.
Referral Process: The selected participants were then asked to refer other individuals or
families who were affected by Cyclone Idai and had benefited from the interventions. These
11
referrals included beneficiaries of the school feeding programs, participants in agricultural
training, and individuals who received support for food security, nutrition, hygiene, or water
and sanitation facilities.
Expansion of the Sample: The process of snowball sampling continued as newly referred
individuals or families were added to the sample. Each newly identified participant was asked
to provide additional referrals, expanding the sample size.
Data Collection: The evaluation team then conducted interviews, surveys, or focus group
discussions with the participants to gather data on the impacts of the interventions. The process
involved exploring their experiences, perceptions, and changes observed in relation to food
security, nutrition, hygiene practices, and access to improved water and sanitation facilities.
Saturation Point: The snowball sampling process continued until a point of saturation was
reached, where new referrals no longer provided significantly different or additional
information. At this stage, the evaluation team concluded the data collection process.
The snowball sampling technique was used to identify and include participants who may not
have been easily accessible through traditional sampling methods. By leveraging existing
connections and networks within the affected communities, this technique allowed the
evaluation team to reach a broader range of participants who had direct experiences with the
interventions. It provided valuable insights into the impacts of the projects among the targeted
communities affected by Cyclone Idai in the Chipinge and Chimanimani Districts.
12
identified individuals who possessed relevant knowledge and expertise related to the
interventions and their impacts. Key informants included community leaders, local government
officials, representatives from Plan International, project staff, teachers, farmers, or other
stakeholders who had in-depth insights into the projects and their outcomes. By conducting
key informant interviews, the evaluation team gathered qualitative data from individuals with
first-hand knowledge and expertise regarding the interventions. This approach allowed for a
deeper exploration of the impacts, contextual factors, and the perspectives of key stakeholders
involved in the implementation and outcomes of the projects.
2.5.2 Questionnaires
In the post-evaluation conducted to assess the impacts of the interventions funded by the
LatterDay Saints Charities (LDSC) and implemented by Plan International after Cyclone Idai
in 2018, questionnaires were also used as a data collection method. The evaluation team
designed questionnaires to gather relevant information about the impacts of the interventions.
The questionnaires included various sections and questions related to food security, nutrition,
hygiene practices, access to improved water and sanitation facilities, and other relevant
indicators. By using questionnaires, the evaluation team gathered quantitative data on the
impacts of the interventions. The questionnaires allowed for standardized data collection,
enabling comparisons and statistical analysis to assess the effectiveness of the interventions in
achieving their intended outcomes.
13
valuable evidence for assessing the impacts of the projects and complementing other data
collection methods used in the evaluation process.
2.5.4 Observations
Observations through site visits and photo-visioning were valuable data collection tools in post-
evaluation assessments of interventions following Cyclone Idai. These methods provided
visual evidence and on-the-ground insights, complementing other data collection approaches
and enriching the evaluation process. Here's how these tools were used:
Site Visits: Site visits involved physically visiting the project locations and observing the
implementation of interventions firsthand. During these visits, evaluators and stakeholders
toured the affected communities, interacted with beneficiaries, and assessed the progress and
impact of the interventions. The team observed various aspects, such the implementation of
school feeding programs, agricultural projects and irrigation schemes, use of improved water
and sanitation facilities as well as washrooms facilities. Observations made during site visits
helped in evaluating the effectiveness and efficiency of the interventions. For example,
evaluators assessed the quality and quantity of food provided through school feeding programs,
observed the engagement and participation of farming families in agricultural activities, and
examined the accessibility and functionality of water and sanitation facilities as well as girl
friendly washrooms. These observations provided valuable qualitative data that was used to
assess the extent to which the interventions met their intended objectives and made a positive
impact on the lives of the affected communities.
14
enhance data interpretation, and facilitate communication of the interventions' impact to
stakeholders and LDSCs.
By utilizing site visits and photo-visioning as data collection tools, the post-evaluation team
gathered qualitative and visual evidence to supplement quantitative data and narratives
provided by beneficiaries and stakeholders. These observations contributed to a comprehensive
understanding of the interventions' effectiveness, efficiency, and impact, providing a more
holistic and nuanced evaluation of the programs implemented by Plan International and funded
by Later Day Saints Charities (LDSC) in response to Cyclone Idai.
Themes and Subheadings: The key categories or themes that emerged from the data was used
as subheadings in the results part of a research report. Thematic organization was introduced
at the outset. The contributory categories were presented as subsections under the sections
containing the overarching themes. These data presentation techniques were used by the
researcher, and additional "proof" to support the findings were offered by means of direct
quotes from respondents. Thematic subheadings were used to show text material gleaned from
interviews and documentary research.
Tables: The evaluation team used tables to present quantitative data, such as the number of
beneficiaries reached, demographic information, and key indicators. For example, a table could
display the number of people assisted through school feeding programs and agricultural
training in each district, highlighting the changes in household food production and nutritional
outcomes.
Graphs and Charts: Graphs and charts were utilized to visually represent trends, comparisons,
and changes over time. Bar graphs showed the improvement in food security and nutrition
indicators, such as increased crop yields or reduced malnutrition rates. Pie charts illustrated the
distribution of beneficiaries by gender, age groups, or specific program components.
15
Maps: Maps were used to display the geographic coverage of the interventions and the
distribution of beneficiaries across the Chipinge and Chimanimani Districts. By using color-
coding or symbols, the maps visually represented the concentration of activities and the reach
of the interventions in different areas.
Case Studies: The evaluation report included detailed case studies to provide in-depth
narratives and qualitative insights into the impacts of the interventions. These case studies
highlighted individual or family stories, emphasizing the changes and improvements observed
as a result of the implemented programs.
Quotes and Testimonials: Direct quotes or testimonials from beneficiaries, community leaders,
or project staff were also incorporated into the evaluation report. These quotes added a human
element to the data presentation, providing first-hand accounts of the impacts and capturing the
voices of those affected by the interventions.
By using a combination of themes and subheadings, tables, graphs, charts, infographics, maps,
case studies, and quotes, the evaluation team presented the data in a comprehensive and
visually engaging manner. This approach facilitates a clear understanding of the impacts
achieved by the interventions and allowed for the effective communication of the evaluation
findings.
16
before creating very specific coding rules. According to Bryman (2004:55), among the
collection of empirical methods for social research, qualitative content analysis is "the longest
known approach of text analysis". According to Mayring (2014), this method involves
systematic coding of major themes, clusters, categories, and/or cases in an effort to uncover
deeper meanings and patterns within a written work. It involves the hermeneutical and
dialectical interpretation of textual data. In the post-evaluation conducted to assess the impacts
of the interventions funded by the Latter-Day Saints Charities (LDSC) and implemented by
Plan International after Cyclone Idai in 2018, qualitative content analysis was used to analyse
the data collected. By using qualitative content analysis, the evaluation team systematically
analysed the qualitative data collected during the post-evaluation. This method allowed for a
deeper understanding of the experiences, perspectives, and narratives of the beneficiaries and
stakeholders, providing valuable insights into the impacts of the interventions beyond
numerical data.
17
significance, and finally generalizing (Leedy and Ormrod 2005). In the post-evaluation
conducted to assess the impacts of the interventions funded by the Latter-Day Saints Charities
(LDSC) and implemented by Plan International after Cyclone Idai in 2018, thematic analysis
was used to analyse the data collected. By using thematic analysis, the evaluation team
identified and explored the key themes that emerged from the qualitative data collected during
the post-evaluation. This method allowed for a systematic examination of the impacts,
capturing the richness and nuances of the data, and providing a comprehensive understanding
of the effects of the interventions beyond individual responses.
18
systematic observation protocols. The team had appropriate skills to administer the
tools consistently and accurately.
• Data Triangulation: To enhance the reliability of the findings, the evaluation team
employed data triangulation, which involves collecting data from multiple sources and
using different methods. This included combining qualitative and quantitative data,
using multiple data collectors, and cross-referencing information from various
stakeholders involved in the interventions.
• Sampling Techniques: The evaluation team used appropriate sampling techniques to
ensure the representativeness of the sample and enhance the validity of the findings.
The team carefully selected participants based on predetermined criteria and ensured
diversity in terms of demographics, geographical location, and levels of impact
experienced.
• Data Quality Assurance: The evaluation team implemented rigorous quality assurance
measures to maintain the reliability and validity of the data. This included regular
checks for data completeness, accuracy, and consistency. The team employed data
cleaning techniques and conducted audits to identify and rectify any errors or
inconsistencies.
• Stakeholder Engagement: The evaluation team actively engaged with stakeholders
throughout the evaluation process to ensure their perspectives and experiences were
accurately captured. This engagement involved seeking feedback, verifying findings
with relevant stakeholders, and incorporating their insights into the evaluation report.
By implementing these measures, the evaluation team took steps to ensure the reliability and
validity of the evaluation process. This enhanced the credibility and trustworthiness of the
findings, providing a solid basis for assessing the impacts of the interventions implemented
after Cyclone Idai.
19
just manner. Respondents need to be aware of their legal rights. Informed consent, the right to
anonymity and confidentiality, the right to privacy, fairness, beneficence, and respect for
people are only a few examples of ethical dilemmas that may be seen in a study (Brink and
Wood 1998:200-209). In the post-evaluation conducted to assess the impacts of the
interventions funded by the Latter-Day Saints Charities (LDSC) and implemented by Plan
International after Cyclone Idai in 2018, several ethical considerations were considered
throughout the evaluation process. Here are the ethics that were considered:
• Informed Consent: The evaluation team obtained informed consent from all participants
involved in the evaluation. This included explaining the purpose, procedures, potential
risks, and benefits of participation to ensure that individuals had a clear understanding
of their involvement and could provide voluntary and informed consent.
• Confidentiality and Anonymity: The evaluation team assured participants of the
confidentiality and anonymity of their responses and personal information. Data was
de-identified and stored securely to protect the privacy and confidentiality of
participants. Any identifying information was removed during the analysis and
reporting phase.
• Respect for Participants: The evaluation team treated all participants with respect and
dignity, ensuring their rights and well-being were upheld throughout the evaluation
process. The team took into consideration cultural norms, gender dynamics, and power
dynamics to create a safe and inclusive environment for participants to share their
experiences.
• Benefit Maximization: The evaluation team prioritized the well-being and interests of
the affected communities and individuals. The evaluation process aimed to maximize
the benefits for participants, ensuring that the findings and recommendations from the
evaluation contributed to future improvements in program implementation and support.
• Equity and Non-Discrimination: The evaluation team ensured that the evaluation
process was conducted in an equitable and non-discriminatory manner. The team
considered factors such as age, gender, disability, and socio-economic status to ensure
fair representation and access to participation in the evaluation.
• Transparency and Accountability: The evaluation team-maintained transparency
throughout the evaluation process, providing clear and accurate information about the
purpose, scope, and progress of the evaluation to stakeholders. The team also ensured
20
accountability by providing feedback to participants and sharing the evaluation findings
with relevant stakeholders.
By considering these ethical principles and practices, the evaluation team ensured the
protection of participants' rights, privacy, and well-being during the evaluation process. This
approach upheld ethical standards and contributed to the ethical and responsible conduct of the
evaluation of the interventions implemented after Cyclone Idai.
21
CHAPTER THREE: IMPACT EVALUATION FINDINGS AND DISCUSSION
3.0 INTRODUCTION
The evaluation finding and discussion will be premised on 5 key elements which are relevance,
Impact, Effectiveness, Efficiency and Sustainability.
Figure 1: Interview with a Sanitary and Hygiene Kit Beneficiary at Chivhunze Secondary
School in Chipinge
22
3.1.1 Relevance
Cyclone Idai had a destructive impact especially on Sanitation and Hygiene facilities. Many
school latrines and ablution facilities were destroyed affecting the sanitary and hygienic
livelihoods of many children. The cyclone and poverty contributed to period poverty among
adolescent girls as they resorted to unhygienic ways of dealing with menstrual period. This has
led to poor grades due to absenteeism and truancy and has affected the girl child education.
Moreover, there was an increase in teen pregnancies and marriages as many would resort to
transactional relationships and intergenerational relationship so that they can be able to provide
for their sanitation needs. Also, at schools they were now facing period bullying if they spoil
themselves during school hours. Given this background the church of Jesus Christ of Latter-
Day Saints and its implementing partner Plan international funded the procurement of dignity
and sanitary kits as an emergency intervention towards the girl child so that they have dignity
and confidence to carry on with learning. On top of that they received trainings on WASH and
girl and disability friendly latrines where also built so that girls can help themselves during
menstrual period by bathing, washing their clothes and hygienically dispose their sanitary pads.
Therefore, the intervention was relevant in the context of these areas of Chimanimani and
Chipinge given the unprecedented disaster they went through.
23
3.1.3 Regarding Effectiveness and Efficiency
The intervention did not have any obvious startup issues. Most schools got their provisions on
the designated period. The major factor that influenced the achievement of the objectives of
the intervention include the inclusion, cooperation, and participation of relevant government
department. For instance, PLAN International was working with the ministry of primary and
secondary education among others. Another factor that aided to the achievement of the
objective is the effective communication and proper dissemination of information from the
trained individuals (teachers) to the students. However, due to the low budget and lack of
contingency funds slightly affected quality and quantity of goods and services provided. For
instance, due to the low budget a washroom in Chivhunze High School does not have running
water. Lack of contingency budget coupled with unstable exchange rate and unstable economic
situation acted as hiccups thus also affects deliverables of the project. Also, the late
disbursement of funds from LDSC had a negative impact on the timely responsive expectations
of the interventions.
Figure 2: Interview with a Sanitary and Hygiene Kit Beneficiary at Kushinga Secondary
School in Chimanimani
While schools indicated that an augmented budget would make it easier to administer the
program. PLAN International and schools succeed in delivering the program with few noted
24
gaps in implementing the program, however there is unfortunately, no way to assess the cost
effectiveness of the program. Comparator Cost could not be determined and in some cases do
not exist.
25
Figure 4: Disability and Girl Friendly Latrine at Chivhunze Secondary School in
Chipinge
Schools allocated monthly budgets to procure sanitary wear and hygiene kits for emergencies,
however the funds are inadequate as the school budgets also must cater for other needs. The
trainings also provided them with knowledge and skills to sustain the program such as to make
their own reusable sanitary pads. The schools provided platforms on which the knowledge from
the trainings would be continually disseminated to future students who were not beneficiaries
of the program when it was implemented.
26
Figure 5: Interview with a Lactating Mother at Mutsvangwa Clinic in Chimanimani
3.2.1 Relevance
The cyclone that hit Manicaland in March 2019 left a destructive trail which did not only affect
their livelihoods but also affected their ability to access to nutritious food. Chimanimani and
Chipinge were the most affected by the Cyclone and the damage was worsened by poverty.
Families in both in Chamanimani and Chipinge districts were experiencing increasing food
insecurity as well as crop failures and low yields from rain fed activities those effects were
compounded by high food prices. The global acute nutritional rates increased from 2.5 to 3.6
percent with Chipinge and Chimanimani 2.9% and 2.5% respectively. Given this background
PLAN International in collaboration with Government Ministries and local health facilities
conducted a mass mobilization of children under five and pregnant and lactating mothers to
determine their nutritional status. Those who were at risk of malnutrition underwent a voucher
system providing them nutritional support for 4 and 5 months respectively between the 2 phases
and they also underwent trainings on how to prepare nutritious food used locally available
resources, which was designed to live them better nourished and improve their individual
health outcomes. The Church of Jesus Christ of Latter-Day Saints Charities provided the
27
funding for the food hampers, in partnership with PLAN International to supplement and
compliment government and other stakeholders to combat malnutrition especially among
vulnerable communities.
28
cook nutritious meals using home grown and locally available and easily accessed resources
around them. The trainings also had an impact beyond their intended benefits and objectives.
Some beneficiaries reported that they were using the knowledge from the trainings to start
businesses such as food outlets, thereby complimenting their income and improve their self-
reliance and their ability to provide for the other family members other than beneficiaries. The
project also improved patients turn over by groups who previously shunned health facilities
due to cultural and religious beliefs.
29
Image Credits: Field Data (2023)
The implementing partner succeed in delivering the program, but there were gaps that were
noted in terms of inadequate provisions. The beneficiaries received the provisions but there
were inadequate due to low budget and the project being too packed. Therefore, because of this
low budget and too many programs in one project the intervention was not entirely cost
efficient. The program was over ambitious and thereby affecting the cost efficiency of the
whole intervention. Unfortunately, there was no way to assess the cost effectiveness and
efficiency of the program as comparator costs could not be determined and in some cases do
not exist.
30
Figure 8: Irrigation Canal at Maunganidze Irrigation Scheme in Cghipinge
3.3.1 Relevance
The evaluations under consideration were made up of two phases. one of the key lessons that
was learnt is that short term emergence intervention in form of food hampers were only
sufficient for a certain period of time and more was needed to build resilience of vulnerable
communities by increasing production and productivity through supporting and reviving small
and medium irrigation schemes in Chimanimani `and Chipinge. therefore, helping them to
transition from humanitarian assistance to nutrition and food security and self-reliance, The
church of Jesus Christ of latter-day Saints charities supported with the funding to help revive
or resuscitate irrigation schemes that had been affected by cyclone Idai. The funding helped in
procuring irrigation equipment and agriculture inputs ranging from pumps, pipes, canals, and
maize seeds hence improving their livelihoods in terms of food security and nutrition and
income and self-reliance which had been drastically affected by the damages caused by
Cyclone Idai.
31
Resuscitation of small community gardens was one of the most successful programmes of the
Food Security and Nutrition project in both phases. The Impact was insurmountable and had a
great effect than any other programmes in the projects. A total of 9 irrigation schemes were
revived in different areas of Chimanimani and Chipinge. Cyclone Idai had destroyed
livelihoods and part of the gardens equipment which Plan international was able to restore. The
incomes of many households where improved significantly and where able to access basic
necessities one of the beneficiaries said, ”Ndakakwanisa kubhadharira mwana wangu mari
yechikoro” meaning she was able to pay for her child’s education .They were also able to create
employment for others who are not part of the schemes to render different services such
maintaining equipment .They also reported that they have become self-reliant because of the
intervention and less reliant to donor funding because of the trainings they receive . Moreover,
Smart Agricultural trainings had a great impact on the way the grow crops and all reported that
they had a bumper harvest after applying the trainings on Smart Agriculture. In 2022 they were
able to harvest unprecedented 12.5 tons of maize as according to one committee chairperson.
Most of the gardens were transformed significantly and one Maunganidze scheme was chosen
as a model garden by the Ministry of Agriculture to serve as a blueprint to many of the
surrounding schemes, and it also won many agricultural awards. However, training on market
linkages and value addition lacked a bit of diligence since most of the beneficiaries complained
about lack markets and those who grew perishables products end up suffering more losses.
Though as it may many positive impacts were observed as it was one of the most successful.
The intervention has also contributed to food security and access to nutritional food by the
community around, as they are able to buy and access cheaper cost. Some have even started to
purchase for resale to communities along the roadside, retailers and hawkers.
32
Figure 9: Resuscitated Irrigation Pipe at Mhakwe Irrigation Scheme in Chimanimani
However, some of the goals were not fully realized because of budget constraints thereby
affecting the effectiveness. Therefore, the active and close participation of relevant
stakeholders was key to the effective implementation of the program.
33
Figure 10: Focus Group Discussion with Committee Members at Maunganidze Irrigation
Scheme in Chipinge
Most of the schemes had a budget set aside to maintain the gardens in terms of repairs and
purchasing of new equipment and meeting various needs. The trainings on smart agriculture
helped them to continue growing and having high returns in face of climate issues that have
been common in that part of the area. Also issue of market linkages has helped the beneficiaries
trade their goods and be able to have more finance to continue investing in their project. Most
of the garden except a few have admitted to being self-reliant and no longer depending on
donor funding for their day-to-day activities. However, some are still struggling such as
Mhakwe irrigation, but they are working towards sustainability and self-reliance.
34
Figure 11: Fish Farming Project (Breeding Pond) at Rimbi Secondary School in Chipinge
3.4.1 Relevance
The school feeding program, incorporating nutritional gardens, piggery, poultry and fish
farming projects, was highly relevant to the post-Cyclone Idai recovery efforts in the Chipinge
and Chimanimani Districts. It addressed the immediate needs of food security and nutrition
while also promoting long-term household food production. The program aligned with the
context and needs of the affected communities, providing a targeted response to enhance the
resilience and well-being of schoolchildren and farming families.
35
3.4.3 Impact
The school feeding program had a positive impact on the targeted communities. The nutritional
gardens, fish farming, piggery and poultry projects contributed to improved dietary diversity
and reduced malnutrition rates among schoolchildren. The increased school food production
and income from farming activities enhanced the economic well-being of farming families.
Figure 12: Fish Farming Project (Main Pond) at Rimbi Secondary School in Chipinge
Additionally, the program bolstered the overall food security of the communities, making them
more resilient to future shocks and improving their overall well-being. The interventions
demonstrated the potential to break the cycle of poverty and malnutrition, creating lasting
positive impacts on the lives of the beneficiaries.
3.4.4 Sustainability
The school feeding program exhibited measures to ensure sustainability beyond the
intervention period. Capacity building initiatives were successfully implemented, empowering
local institutions and community structures to manage and sustain the nutritional gardens.
Piggery, poultry and fish farming projects. The integration of program activities into existing
36
government programs and policies enhanced the likelihood of continuation and replication in
the long run. The engagement and ownership of the local communities were evident, providing
a solid foundation for the sustainability of the interventions. These efforts increased the
program's scalability and potential for expansion to reach more beneficiaries and similar
communities.
37
CHAPTER FOUR: CONCLUSIONS AND RECOMMENDATIONS
4.0 INTRODUCTION
This chapter is on conclusions and recommendations. As such, consideration will be on
generalizations that can be made with reference to the key areas that this evaluation focused
on. These critical areas are relevance, impact, effectiveness and efficiency as well as the
sustainability component. In light of this, the chapter will also proffer recommendations aimed
at inviting the attention of the involved stakeholder to issues that needs adjustment for the
improvement of future interventions.
The food security and nutrition program implemented in 2021 was essential in addressing the
immediate nutritional needs of the affected populations. The provision of school feeding
programs ensured that children, who are more vulnerable during emergencies, had access to
regular nutritious meals, which not only supported their physical well-being but also
encouraged school attendance, providing a sense of normalcy and stability in their lives.
Additionally, the agricultural training provided to farming families was vital in improving
household food production, as it equipped them with sustainable farming techniques and
knowledge to rebuild their agricultural practices after the cyclone's destruction. By addressing
these essential needs, the interventions helped prevent further suffering and ensured the
survival and basic well-being of the affected families.
The second intervention in 2022, focusing on food and nutrition security, hygiene practices,
and water and sanitation facilities, was equally critical in the recovery process. The cyclone
38
had severely disrupted access to clean water sources and sanitation facilities, increasing the
risk of waterborne diseases and compromising the communities' health. The interventions
aimed to improve the uptake of essential hygiene practices and provide gender-responsive
water and sanitation facilities, which not only enhanced the overall health and well-being of
the communities but also reduced the vulnerability to diseases and improved their resilience to
future disasters.
In conclusion, the interventions funded by LDSC through Plan International were not only
necessary but also highly relevant in responding to the urgent needs of the communities
affected by Cyclone Idai. By addressing food security, nutrition, hygiene, and water and
sanitation, they provided essential support to the affected families, ensuring their survival, well-
being, and the ability to rebuild their lives. The post-evaluation would have undoubtedly
confirmed the significance of these interventions, showcasing their effectiveness in alleviating
suffering, promoting recovery, and enhancing the resilience of the affected communities in the
face of such a devastating natural disaster.
The 2021 food security and nutrition program, which included school feeding programs and
agricultural training, effectively addressed the nutritional needs of the affected population. By
providing regular nutritious meals through school feeding programs, the interventions ensured
that vulnerable children had access to essential nourishment, improving their overall health and
well-being. The agricultural training provided to farming families played a crucial role in
improving household food production, equipping them with sustainable farming techniques
and knowledge. This not only addressed immediate nutritional needs but also created long-
term resilience by enhancing their ability to sustainably produce food for their households.
39
The second intervention in 2022, focusing on food and nutrition security, hygiene practices,
and water and sanitation facilities, further reinforced the effectiveness of the interventions. By
enhancing food and nutrition security, the interventions ensured that the affected communities
had access to an adequate and diversified food supply, reducing the risk of malnutrition and
related health issues. The emphasis on hygiene practices and the provision of improved water
and sanitation facilities contributed to improved public health outcomes, reducing the
prevalence of waterborne diseases and promoting overall well-being.
Moreover, the efficiency of the interventions can be attributed to the collaborative efforts
between LDSC, Plan International, and local partners. By working together, sharing resources,
and leveraging local knowledge and expertise, the interventions were implemented in a
coordinated and streamlined manner. This ensured the optimal utilization of resources,
minimized duplication of efforts, and maximized the reach and impact of the interventions. The
efficiency of the interventions in addressing the specific needs of the affected communities can
be seen in the significant number of people reached and assisted, with 5,677 individuals in
2021 and 5,450 people in 2022 benefiting from the interventions.
In conclusion, the interventions funded by LDSC through Plan International have demonstrated
a high level of effectiveness and efficiency in addressing the needs of the communities affected
by Cyclone Idai. Through targeted approaches, the interventions have successfully improved
food security, nutrition, hygiene practices, and access to water and sanitation facilities, leading
to positive outcomes and long-term resilience. The collaborative efforts and strategic utilization
of resources further enhanced the efficiency of the interventions, ensuring that assistance
reached those in need in a timely and impactful manner. The post-evaluation would have
provided robust evidence of the interventions' effectiveness, validating their positive impact on
the affected communities and their ability to bring about sustainable changes.
40
addressed their immediate nutritional needs but also had a transformative effect on their
livelihoods.
Through school feeding programs, children were not only provided with nutritious meals but
also encouraged to attend school regularly, contributing to their overall well-being and
educational outcomes. The agricultural training provided to farming families empowered them
with knowledge and skills to improve their farming practices, resulting in increased crop yields
and enhanced household food production. This, in turn, improved food security, reduced
dependency on external aid, and fostered self-reliance within the communities.
The second intervention in 2022, which focused on enhancing food and nutrition security,
promoting essential hygiene practices, and improving water and sanitation facilities, further
contributed to the recovery and resilience of 5,450 people affected by Cyclone Idai. By
addressing these critical areas, the intervention had a multifaceted impact on the communities.
The enhanced food and nutrition security measures ensured a more sustainable and diverse
food supply, leading to improved health outcomes and reduced malnutrition rates. The
promotion of essential hygiene practices positively influenced community health, reducing the
risk of diseases and improving overall well-being. The provision of improved gender-
responsive water and sanitation facilities not only enhanced access to clean water but also
contributed to the dignity and safety of community members, particularly women and girls.
The comprehensive nature of these interventions, targeting various aspects of recovery and
development, has had a lasting impact on the affected communities. The post-evaluation likely
confirmed the positive outcomes achieved, such as improved food security, increased
agricultural productivity, enhanced health and hygiene practices, and better access to clean
water and sanitation facilities. These interventions have not only provided immediate relief but
also laid the foundation for long-term resilience, empowering the communities to rebuild their
lives and adapt to future challenges. The collaboration between LDSC and Plan International
has demonstrated the effectiveness of their joint efforts in making a tangible and sustainable
difference in the lives of those affected by Cyclone Idai.
41
in 2018 have demonstrated a strong foundation for sustainability in the Chipinge and
Chimanimani Districts of Zimbabwe. The 2021 food security and nutrition program, which
focused on school feeding programs and agricultural training, and the 2022 intervention, which
emphasized food and nutrition security, hygiene practices, and water and sanitation facilities,
have laid the groundwork for long-term resilience and self-sufficiency within the affected
communities.
Through the implementation of school feeding programs and agricultural training, the
interventions have empowered individuals and families with the knowledge and skills
necessary to improve household food production. This increased self-reliance reduces their
dependence on external aid and creates a sustainable food supply for the future. Additionally,
the emphasis on essential hygiene practices and the provision of improved water and sanitation
facilities promotes better health outcomes and contribute to the overall well-being of the
communities.
The collaboration between LDSC and Plan International, along with their local partners, has
played a crucial role in building sustainability into the interventions. By working closely with
the affected communities, understanding their needs and aspirations, and involving them in the
decision-making process, the interventions have fostered a sense of ownership and long-term
commitment. This approach establishes a solid foundation for the sustainability of the
interventions, ensuring that the communities can continue to benefit from the implemented
programs and practices even after the external support concludes.
In conclusion, the interventions funded by LDSC through Plan International have demonstrated
a strong focus on sustainability. By addressing key areas such as food security, nutrition,
hygiene practices, and water and sanitation, the interventions have empowered the affected
communities to become self-sufficient, resilient, and capable of addressing future challenges.
Through the post-evaluation, the team identified strategies to ensure ongoing support and
engagement, enhancing the sustainability of the implemented programs and leaving a lasting
impact on the communities affected by Cyclone Idai.
4.2 RECOMMENDATIONS
The implementing partner which is Plan international office recommended for a decentralized
chain of communication since they have to go through the United States office to be able to
42
communicate with the funder thereby affecting the implementation and effectiveness of the
project in terms of time.
Plan international recommended for a contingency fund to cushion them in cases of late
disbursement, inflation or vacillating exchange rates that usually affect prices and also against
some other unforeseen circumstances that will have economic and financial impact.
There is also a need for the funder to have monitoring personnel to observe the progress of the
project to ensure proper accountability. There are things that cannot be determined in terms of
value maybe because they are consumables or they are somewhere not accessible, for example
pipe underground and the same time it will not be possible to rely only on documents provides
by the implementor. Therefore, a monitoring personnel can be able to monitor from a different
angle.
The evaluator also recommends the implementor not pack too much in one project which in
turn will result in substandard, inadequate goods and services in terms of quality and quantity.
It was observed that both projects where to packed with many projects which affected the
quality of the aid and also quantity of goods and people being reached
The evaluator also recommends separation of funds (Account funds from different donors
separately) and keep soft copy of receipts. The evaluator could not access some financial
43
documents because they had been moved physically and did not have soft copies. In Phase on
project, there was no separate financial information for each donor making it hard to determine
actual costs that were used from each donor
From the evaluations that we recommend that the implementor keep a database of the
beneficiaries so that it will be easy for evaluation. It was noted that in some instances they
relied from outside institutions to provide information for the beneficiaries and in some
instances hard copies which were not readable thereby having an impact on time and quality
of the assessments.
Procurement of goods and services should be done locally as much as possible to reduce costs
and also ensuring local development by supporting local businesses and it will help in aid being
delivered in minimum time possible.
44
REFERENCES
Babbie, E. (2010). Research design. The practice of social research, 12, 90-123.
Braun, V., and Clarke, V. 2006. “Using Thematic Analysis in Psychology”, Qualitative
Research in Psychology 3(2): 77-101
Brink, PAMELA J., and M. J. Wood. (1998). "Descriptive designs." Advanced design in
nursing research 2: 287-307.
Bryant, M. T. (2004). The Portable Dissertation Advisor. Thousand Oaks, CA: Corwin Press,
Inc.
Glatthorn, A. (1998). Writing the Winning Dissertation: A Step-by-Step Guide. (1st Ed.),
Thousand Oaks, CA: Corwin Press, Inc.
Hatch, J. A. (2002). Doing Qualitative Research in Education Settings. Albany: SUNY Press.
45
Lincoln, Y. S., & Guba, E. G. (1985). Naturalistic inquiry. sage.
Mayring, P. (2014). Qualitative content analysis: theoretical foundation, basic procedures and
software solution.
Mogalakwe, M. (2006). The use of documentary research methods in social research. African
Sociological Review/Revue Africaine De Sociologie, 10(1), 221-230.
Pera, S. A., & Van Tonder, S. (1996). Nursing research principles and methods. Philadelphia:
JB Lippincolt.
Rice, P. L., & Ezzy, D. (1999). Qualitative research methods: A health focus. Melbourne,
Australia.
Singh, Y. K. (2006). Fundamentals of Research Methodology and Statistics. New Delhi: New
Age International Publishers.
Terrell, S. (2016). Writing A Proposal for Your Dissertation: Guidelines and Examples, New
York, NY: The Guilford Press.
46
ANNEX AND FURTHER READING
ANNEX A: INTERVIEW QUESTIONS -HOUSEHOLD NUTRITIONAL BASKETS
NOTES
…………………………………………………………………………………………………
…………………………………………………………………………………………………
47
ANNEX B: INTERVIEW QUESTIONS -HYGIENE KITS
2. Do you feel that it was relevant for you to receive that help?
…………………………………………………………………………………………………
…………………………………………………
4. What level of education were you in when you received the hygiene kit?
…………………………………………………………………………………………………
5. How long did the hygiene kits sustain you and how did it help you?
…………………………………………………………………………………………………
7. Based on your own observations and experience what are the recommendations that
you can give?
…………………………………………………………………………………………………
…………………………………………………………………………………………………
NOTES
…………………………………………………………………………………………………
…………………………………………………………………………………………………
48
ANNEX C: INTERVIEW QUESTIONS -LACTACTING MOTHERS/CHILDREN
UNDER 5
NOTES
…………………………………………………………………………………………………
…………………………………………………………………………………………………
49