Professional Documents
Culture Documents
Yhf Project Monitoring Overview January
Yhf Project Monitoring Overview January
2020
JANUARY-JUNE
MONITORING
YEMEN
REPORT
HUMANITARIAN
FUND
THE YHF THANKS ITS DONORS
FOR THEIR GENEROUS SUPPORT IN 2020
CREDITS
This document was produced by the United Nations Office for the Coordination of Humanitarian Affairs (OCHA) Yemen. OCHA Yemen wishes to
acknowledge the contributions of its committed staff at headquarters and in the field in preparing this document.
The designations employed and the presentation of material on this publication do not imply the expression of any opinion whatsoever on the part
of the Secretariat of the United Nations concerning the legal status of any country, territory, city or area or of its authorities, or concerning the
delimitation of its frontiers or boundaries.
The Yemen Humanitarian Fund (YHF) 97 per cent of 8,158 beneficiaries
completed all planned monitoring visits interviewed indicated that they were
from January to June 2020 despite access satisfied with services they received through
constraints and COVID-19 travel restrictions. YHF-funded projects.
The Fund improved the monitoring coverage The YHF Beneficiary Feedback and
of its projects compared with 2019. Complaints Mechanism was launched and
674 beneficiaries provided feedback.
Rehabilitation of
water systems to
provide sustainable
solutions for 1,000
households using
solar energy in
Khanfar district -
Abyan Governorate.
Photo by Samah A.
Mahmood for UN/
OCHA.
This report outlines details of the Yemen Humanitarian Fund As part of its commitment to increase Accountability to
(YHF) monitoring activities from January to June 2020, Affected Populations (AAP), the YHF launched a Beneficiary
analyses monitoring results and provides a summary of key Feedback and Complaints Mechanism (BFCM) in February
recommendations shared with partners. The report builds on 2020. The mechanism allows beneficiaries to directly call or
two earlier YHF monitoring reports covering January 2018 to send a text message to a dedicated toll-free phone number
June 2019 and July to December 2019. and provide complaints or feedback regarding YHF-funded
projects. Between February and June 2020, feedback was
Despite access challenges, COVID-19-related travel restrictions
received from 674 beneficiaries on 28 YHF-funded projects.
and other constraints, the YHF conducted 62 monitoring visits,
The Fund shared the feedback received with Implementing
meeting all its monitoring requirements for this period. However,
Partners (IPs) and tracked the actions taken by partners until
the YHF changed the modality of many monitoring missions
complaints were resolved. Most complaints received related to
from the OCHA Humanitarian Financing Unit (HFU) staff visits
minor dissatisfaction with the assistance provided.
to monitoring by Third Party Monitoring (TPM) providers.
Some of the key challenges for YHF monitoring in 2020
The results of the monitoring conducted between January
included travel restrictions; continued bureaucratic
and June 2020 indicated that while 61 per cent of projects
impediments, such as the need for prolonged negotiations
monitored demonstrated good performance, 34 per cent
with national and sub-national authorities to secure travel
underperformed but this was justified by the operational
permits for TPM contractors; inadequate technical skills
context, and 5 per cent underperformed and this was not
demonstrated by some TPM monitors; some poor quality TPM
justified by the context. The YHF took necessary follow-up
reports; and some YHF partners being slow to provide support
actions on the monitoring results to ensure the most efficient
for monitoring visits.
and effective project delivery possible.
The YHF reached 8,158 people through remote call Beneficiary
Verification Surveys (BVS). The surveys were conducted by
trained data collectors according to structured questionnaires.
The respondents were randomly selected from distribution
lists and constituted a representative sample of project
beneficiaries. Out of the 8,158 beneficiaries interviewed, 97 per
cent expressed satisfaction with the services they received.
TABLE
OF CONTENTS
02 INTRODUCTION
03 MONITORING REQUIREMENTS
04 MONITORING COVERAGE
04 Field Site Monitoring
04 Remote Call Monitoring (RCM) and Beneficiary Verification Surveys (BVS)
05 Beneficiary Feedback and Complaints Mechanism
06 MONITORING FINDINGS
06 Utilization of monitoring findings
06 Project implementation performance
07 Common findings across clusters
09 Findings from Beneficiary Verification Surveys
09 Findings from Beneficiary Feedback and Complaints Mechanism
19 ANNEX:
19 Feedback and Complaints Categories
INTRODUCTION
Interview with a
displaced person who
benefited from health
and nutrition services
provided by a mobile
team in IDPs site,
AlMukha district, Taiz
Governorate.
During the period under review, Yemen continued to be Project monitoring is a critical part of the management
the world’s worst humanitarian crisis, driven by conflict, of the YHF programme cycle and a key component of the
economic collapse and the continuous breakdown of public Fund’s accountability framework. It enables the Fund to
institutions and services. An estimated 24.3 million people, systematically assess progress made towards achieving the
80 per cent of the entire population, required some form of targets of YHF-funded projects, verify the accuracy of results
humanitarian assistance. The situation in 2020 has been reported by partners and provide assurance to stakeholders
further exacerbated by the COVID-19 pandemic and severe on the delivery of YHF-funded assistance to affected
underfunding of the humanitarian response. By August 2020, communities. YHF monitoring and reporting activities have
the Yemen Humanitarian Response Plan (YHRP) was only the following key objectives:
21 per cent funded, with US$ 712 million received out of the
• Verifying partners’ progress in delivering project outputs
required $3.4 billion.
and activities, checking the use of resources as per
The YHF makes funding directly available to humanitarian the projects’ budget, and verifying partners’ internal
partners operating in Yemen so they can deliver timely and monitoring and reporting systems.
effective life-saving assistance to those who need it most. • Seeking feedback from beneficiaries and verifying the
Donor contributions to the YHF are unearmarked and are beneficiary targeting process.
allocated by the Fund to eligible partners through an inclusive • Triangulating information collected through monitoring
and transparent process in support of top-priority interventions and other means, identifying gaps and trends in
set out in the YHRP. humanitarian operations, as well as reflecting on best
In 2019, 24 donors contributed $169 million to the Fund, with 73 practices and lessons learned.
per cent of the funding coming from the top 5 donors: Denmark, • Using findings and recommendations for results
Germany, the Netherlands, Sweden and the United Kingdom. management, risk mitigation and public information.
These generous contributions, and the balance from 2018, • Strengthening partnership and coordination between
allowed the YHF to allocate $239.4 million to 154 top-priority OCHA, IPs, local authorities and affected communities.
projects throughout Yemen in 2019. In line with the overall
reduction of funding to YHRP in 2020, the fundraising target for
the YHF was reduced to $100 million this year, of which $71.6
million was already contributed or pledged by August 2020.
Training of partners
and local authorities
on site management
coordination in
AlMukha, Taiz
governate.
The YHF’s monitoring requirements for each project are defined the YHF was able to meet all its monitoring requirements in this
by the operational modalities outlined in the Fund’s Operational period, which is an improvement on 2019.
Manual. The monitoring requirements are determined by the
type of implementing partner and its assessed risk level, the Since the travel restrictions were imposed in response to the
duration of project activities and the size of the project budget. COVID-19 outbreak, OCHA staff have been unable to conduct
When necessary from a risk management point of view, the YHF field monitoring visits in person. Consequently, the YHF adjust-
can conduct additional monitoring beyond the requirements ed the modality of these visits to TPM, which allowed the Fund
specified by the operational modalities. Consequently, the YHF to continue meeting its monitoring requirements. This change
monitors nearly all the projects it funds. resulted in a larger proportion of TPM compared with OCHA HFU
staff monitoring in 2020 than in previous years. Nevertheless,
Once the monitoring requirements are defined, the Fund develops the Fund retained a direct connection with the beneficiaries
a detailed monitoring plan, which includes the planned dates of of YHF-funded projects through remote call monitoring and
each monitoring mission. The YHF continuously adjusts these through the BFCM, which supplemented the outcomes of TPM.
planned dates depending on the current status of each project.
For instance, a change of project end date due to a receipt of No-
Cost Extension, a change in the operating environment, or delays
in obtaining the necessary sub-agreements from the authorities,
will result in the revisions of monitoring dates. This allows the
Fund to monitor projects at the optimal times in their cycle.
1 Several more monitoring missions were initiated in the reporting period but are not part of this report as the reports were not finalized by early July.
Based on monitoring requirements, the YHF identifies appropriate field monitoring modalities and organizes field visits for each
project. The field monitoring is supplemented by information that is gathered through the phone-based BVS and the BFCM.
1 Some projects have to be monitored more than once, hence the number of monitoring missions is higher than the number of monitored projects.
performance rating:
43% 7%
• Outstanding performance – assigned when monitoring findings 27%
indicate that project implementation and quality of response
exceeded expectations and is on track to exceed project 57% 67% 100% 100%
targets.
• Good performance – assigned when findings indicate that Good Performance Underperforming
but Justified
Underperforming
and not Justified
project implementation progressed well against the workplan,
is on track to achieve project targets and demonstrates good *None of the monitored projects were awarded a rating of 'outstanding performance' or
'no performance'.
quality implementation.
• Underperforming but justified – assigned when project
progress is less than expected against work plan but there is 5 per cent of projects received a rating “underperforming and not
valid justification for underachievement. justified”. No projects received a rating of “outstanding performance”
• Underperforming and not justified – assigned when project or “no performance” during this period.
progress is less than expected against work plan and the IP Overall, the proportion of projects which received a rating of “good
does not have a valid justification for underachievement. performance” remained similar as in the previous period (July to
• No performance – assigned when there is no tangible progress December 2019). However, the proportion of projects with “good
in implementation. performance” increased since the first half of 2019, which can be
Between January and June 2020, 61 per cent of the monitored attributed to the improved quality of recommendations provided
projects received a rating of “good performance”, 34 per cent of earlier in the year and the close follow up by the HFU team on
projects received a rating of “underperforming but justified”, and recommendations and action points.
1 As of 2020, CCCM separated from Shelter and NFIs and became an independent cluster. However, since this report covers monitoring of projects approved in 2019, Shelter, NFIs and CCCM is presented as one
cluster.
50%
41%
22%
20%
13% 7%
4%
*One project monitored may include more than 1 cluster, which is why the total does not amount to 100%.
TYPE OF ASSISTANCE
Cash Ceramic water Delivery Kit Dignity Kit Emergency Food in-kind/ Hygiene Kits
assistance filters Shelter Kit voucher
Male
87.9% 86.9% N/A N/A 91.3% 95.8% 86.3%
Satisfied
Cash Ceramic water Delivery Kit Dignity Kit Emergency Food in-kind/ Hygiene Kits
assistance filters Shelter Kit voucher
Female
85.1% 83.3% 75% 99.2% 88.9% 96.4% 85.3%
Satisfied
2 This figure refers to beneficiaries who indicated that they were either “satisfied” or “somewhat satisfied”.
5 33
1 18%
2%
1% 39
33.9%
140
52%
182 75
122
48% 16 67%
65.3%
14%
16 34 1
4% 9% 0.9%
Minor dissatisfaction Major dissatisfaction Major breach Request for information Positive feedback
(code of conduct,
mismanagement, fraud etc.)
3 Subsequent follow up on the remaining one complaint indicated that it was not related to a YHF-funded project.
Photo by Mahmoud
Fadel-YPN for UN/
OCHA.
A total of 31 field visits were conducted to 23 Summary of key findings associated with
projects with WASH components. The main poor implementation performance
activities monitored included: rehabilitation • Water wells were not covered exposing
and maintenance of water schemes; the wells to pollution and leaving
construction, rehabilitation and maintenance community members, especially children,
of sanitation systems; construction, at risk of falling down the well.
rehabilitation and desludging of family latrines; • Poor installation of water pipes resulted in
operationalization of water supply systems the waste of water due to leakages.
and provision of capacity building for operation
• Lack of proper drainage at water
and maintenance of water systems; water
collection points resulted in pollution due
chlorination and water quality surveillance
to stagnant water.
activities; distribution of hygiene kits and
hygiene promotion activities including training • Some hygiene kits distributed did not
of Community Health Volunteers (CHVs) in include all the required items or fewer
items than specified.
hygiene promotion; and provision of water
trucking services. • Beneficiaries indicated that ceramic water
filters did not last long.
Fifty-five per cent of monitoring visits to
• Quality of some sewer systems and
projects with WASH components awarded
rehabilitated latrines was poor.
a rating of “good performance”, 39 per cent
awarded “underperforming but justified” and • Water supply points for some supply
6 per cent awarded “underperforming and not systems were installed in locations a long
way from where beneficiaries live.
justified”. The proportion of WASH components
that received “good performance” increased • Local stakeholders requested payments
from 43 per cent in the second half of 2019 to during the beneficiary registration process
55 per cent in the first half of 2020. Moreover, for hygiene kits.
the proportion of those categorized as
“underperforming and not justified” decreased
from 14 per cent in the second half of 2019 to
7 per cent in the first half of 2020.
HEALTH
A total of 28 monitoring visits were conducted • In some HFs, delays in setting up ORCs
to 19 projects with Health components. The and DTCs and population movements due
main activities monitored included: provision of to conflict resulted in fewer cholera cases
general primary, secondary and referral health treated than were targeted.
services; provision of health services through • Immunization services in some HFs were not
supported Medical Mobile Teams; provision of tracked properly due to the lack of vaccine
reproductive health and immunization services, cards. In addition, due to the lack of referral
including support for cold chain systems; support cards, HFs used phone calls to refer cases to
to Diarrhoea Treatment Centres (DTC) and Oral another HFs putting the quality of the service
Rehydration Corners (ORC); provision of medical and service tracking activities at risk.
supplies and equipment to targeted Health • WASH facilities in some HFs were out of use
Facilities (HFs); provision of support to targeted due to a lack of running water.
HFs; and incentives to health workers. • Damaged or dysfunctional medical equipment
Fifty-four per cent of monitoring visits to projects was provided to some HFs and some
with Health components awarded a rating equipment provided to HFs was not used due
of “good performance”, 39 per cent awarded to a lack of electricity.
“underperforming but justified” and 7 per cent • Medical supplies were stored in a poor and
awarded “underperforming and not justified”. unsafe manner in some HFs due to the lack of
The proportion of Health projects that were storage facilities.
categorized as “good performance” decreased • In some HFs the health workers and CHVs
from 73 per cent in the second half of 2019 to 54 received inadequate training and in some
per cent in the first half of 2020. of the HFs the CHVs services were not
adequately tracked and recorded.
Summary of key findings associated with poor • There was inadequate coordination with
implementation performance District Health Officers (DHOs) and other
• HFs received operational costs and incentives stakeholders during the identification of
for fewer months than originally planned targeted HFs and implementation of activities.
due to bureaucratic and other operational • Beneficiaries complained that key HF staff
constraints. were absent from the facilities during
service hours.
A total of 16 field monitoring visits were Summary of key findings associated with
conducted to 10 projects with FSA poor implementation performance
components. The main activities monitored • Local authorities interfered resulting
were delivery of food and cash/voucher in IPs having limited or no control over
assistance to beneficiaries. In addition to beneficiary registration and verification
verifying the delivery of assistance to those activities, which mainly affected targeting
targeted, monitoring examined the process of processes.
beneficiary registration and verification, and • Some registration committee members
attempted to assess the level of beneficiary requested money from beneficiaries and
satisfaction. refused to register people who refused
Sixty-three per cent of projects with FSA to pay.
components awarded a rating of “good • Some distribution sites were poorly
performance” and 37 per cent awarded selected and were far away from IDP
“underperforming but justified”. The sites, which resulted in beneficiaries
performance of monitored FSA projects in the incurring transport costs.
first half of 2020 was lower than in the second • Some food items, such as oil and wheat
half of 2019 when all FSA projects received flour, provided by contracted food
“good performance”. suppliers were of poor quality.
• Some beneficiaries received wheat flour,
which was damaged by moisture due to
poor storage facilities.
• Some beneficiaries were dissatisfied
because they had to wait a long time to
receive assistance and, at times, were
treated badly by the distribution staff.
NUTRITION
A total of 13 field visits were conducted to Summary of key findings associated with
9 projects with Nutrition components. The poor implementation performance
main activities monitored included: setup • In some facilities the Community Nutrition
of Outpatient Therapeutic Programme Volunteers (CNVs) did not receive proper
(OTP) points and provision of maternal and training on Mid-Upper Arm Circumference
child nutrition services; provision of cash/ (MUAC) screening and oedema checking.
voucher assistance to transport Severe • Inadequate tracking and documentation
Acute Malnutrition (SAM) referral cases systems in some facilities led to
to Therapeutic Treatment Centres (TTC); discrepancies in reporting project
establishment of Infant and Young Child achievements.
Feeding centres in nutrition service provision
• The coverage of malnutrition screening
sites; supplies and equipment support to was affected due to hiring fewer CNVs than
targeted facilities; incentive and operational planned.
support to targeted facilities.
• Nutrition supplies were stored in an unsafe
Fifty-four per cent of monitoring visits to and disorderly manner.
projects with Nutrition components awarded
a rating of “good performance” and 46
per cent awarded “underperforming but
justified”. The performance of monitored
Nutrition projects in the first half of 2020 was
lower than in the second half of 2019 when
63 per cent of nutrition projects received
“good performance”. On the other hand, the
proportion of projects rated “underperforming
and not justified” decreased from 25 per cent
in the second half of 2019 to zero per cent in
the first half of 2020.
EDUCATION
A total of 11 field visits were carried out Summary of key findings associated with
to 6 projects with Education components. poor implementation performance
The main activities monitored included: • Some local authority officers interfered
construction of Temporary Learning in the identification of target schools and
Spaces (TLCs); rehabilitation of schools; disrupted rehabilitation activities.
provision of cleaning materials; provision • There were delays in the construction of
and maintenance of school desks and other TLCs.
materials; provision of teacher kits and
• The support provided to schools did not
incentives for teachers in targeted schools;
match the needs.
provision of school supplies for students; and
community mobilization activities to promote • Rehabilitation activities were of poor
enrolment of children to schools. quality and incomplete.
• The quality of items in student kits was
Eighty-two per cent of the monitored project poor.
implementations received a rating of “good
• School WASH facilities were not used due
performance”. By comparison, in the second
to the lack of running water.
half of 2019, only one project with Education
component was monitored and was rated • Bags for students and teachers were
“good performance”. distributed at the end of the school year.
A total of 7 field visits were conducted to 3 Summary of key findings associated with
projects with Shelter/NFI/CCCM components. poor implementation performance
The main activities monitored included • Interference by local authorities resulted
distribution of in-kind NFI and emergency in IPs having limited or no control over
shelter kits; cash assistance for construction beneficiary registration and verification
and upgrading of emergency shelters; activities, which mainly affected targeting
construction and maintenance of emergency processes.
shelters and upgrading of family shelters. • Some registration committee members
Twenty-nine per cent of monitoring visits to requested money from beneficiaries for
projects with Shelter/NFIs/CCCM components registration and refused assistance to
awarded the rating of “good performance” those who refused to pay.
and 71 per cent rated “underperforming but • The quality of some items, such as
justified”. The performance of monitored blanket and mattresses, in NFI kits was
Shelter/NFIs/CCCM projects in the first half poor.
of 2020 was lower than in the second half of • Delays by Shelter and NFI Cluster
2019 when 75 per cent of Shelter/NFIs/CCCM in approving the transitional shelter
projects were awarded “good performance”. design resulted in a huge delay in the
construction of transitional shelters.
• Some items in the NFI kits were not used
by beneficiaries as they were not relevant
to their needs.
• Beneficiaries did not receive the full
contents of NFI kits.
PROTECTION
Four field visits were conducted to two Summary of key findings associated with
projects with Protection components. The poor implementation performance
main activities monitored included provision • Child Friendly Spaces (CFS) were set-up in
of legal assistance with civil documentation unsafe location that put children at risk of
and other legal matters; provision of car accidents.
protection cash assistance for targeted • Established CFS were found without
beneficiaries; mine risk awareness activities; playground materials installed.
establishing Community-Based Child
• The quality of mine-risk training was poor
Protection Committees and providing training;
and did not include visual materials.
protection case management and referral
services; and provision of Psychosocial • Legal assistance activities were
Support Services (PSS). inadequately implemented.
• The referral systems were weak and there
All monitoring visits to projects with was inadequate coordination with other
Protection components awarded the rating of sectors.
“underperforming but justified”.
• Some children with urgent protection needs
were left unsupported.
FEEDBACK AND
COMPLAINTS CATEGORIES
The person is calling to express gratitude for a specific activity being implemented under the
Positive feedback
YHF-funded projects.
The person is calling to request information on a specific YHF-funded project, or request assistance on
Request for information
how to receive goods/services provided by the YHF partners.
The person is calling to complain about minor issues on goods/services. This can include long queues,
Minor dissatisfaction
distance from distribution points, broken items within a kit, long waiting times, etc.
The person is calling to complain about major issues with goods/services. This can include being on a
Major dissatisfaction
beneficiary list but not receiving goods, items missing from kits etc.
The person is calling to report fraud, corruption, aid diversion, abuse or sexual harassment. This can
Major breaches including breach
include being asked for payment to be included on beneficiary lists, being asked to confirm receiving
of codes of conduct, mismanage-
more assistance than distributed, goods not going to the intended beneficiaries, being asked for favors in
ment, fraud etc.
exchange for goods/services etc.
Yemen
Humanitarian
Fund