MEAL WORKSHOP ON ETH1224

Discussion on MEAL practice on ETH1224

Photo: Welthungerhilfe
Dcember 6,2022
Abraham Lebeza
MEAL WORKSHOP ON ETH1161

# Topic Timing
MEAL Training Outline

 General MEAL Concepts  Data management , Data quality and

 Theory of change /Logframe
 Indicator (Outcome/output)
 Measuring success at WHH
 ETH1224 MEAL plan development -
Exercise
beneficiary counting
 Targeting (accountability to beneficiaries)
 CFRM and WHH code of conduct

2
MEAL WORKSHOP ON ETH1161

# Topic Timing

General MEAL Concepts

3
MEAL WORKSHOP ON ETH1161

# Topic Timing

What are these buzz words ?

Monitoirng ?

Evaluation?

4
MEAL WORKSHOP ON ETH1161

# Topic Timing

Are monitoring and evaluation similar or identical to each other?

How is monitoring and evaluation are reinforcing to each other?

1. Group exercise
 to differentiate monitoring and evaluation?
 To show how Monitoirng and evaluation are reinforcing to each other?
5
MEAL WORKSHOP ON ETH1224

Characteristics Monitoring Evaluation

# Topic
Time frame Continuous /regular
Timing
Periodic
Purpose Plan versus achievement, Judgmental of
track records effectiveness , what works
well and what doesn’t
Big question Are we doing what we are Are we doing the right things
expected to do
Staffing Internal Internal and external
Rigor Enough to drive continuous Systematic design that
improvement employs qualitative and
quantitative study

6
MEAL WORKSHOP ON ETH1224

# Topic Timing

The six main components of a project M&E system

1. Clear statements of measurable objectives for the project and its components.
2. A structured set of indicators covering: inputs, process, outputs, outcomes, impact,
and exogenous factors.
3. Data collection mechanisms capable of monitoring progress over time, including
baselines and a means to compare progress and achievements against targets.

7
MEAL WORKSHOP ON ETH1224

# Topic Timing

Contd..
4. Where applicable building on baselines and data collection with an evaluation
framework and methodology capable of establishing causation (ie capable of attributing
observed change to given interventions or other factors).
5. Clear mechanisms for reporting and use of M&E results in decision-making.
6. Sustainable organisational arrangements for data collection, management, analysis,
and reporting.

8
MEAL PURPOSES

# Topic Slide
2Group exercise
What is existing practice at HUNDEE in implementing the M&E system ?

What do the strategies HUNDEE employed to translate accountability to project

beneficiaries?
Bottlenecks –what should we overcome in the future

9
# Topic Slide

In their book on Reinventing Government (1992),

Osborne and Gaebler note that:
- What gets measured gets done.
- If you don’t measure results, you can’t tell success from failure.
- If you can’t see success, you can’t reward it.
- If you don’t recognize failure, you can’t correct it.

10
# Topic Slide

Failing to plan is Planning to fail

11
MEAL PURPOSES

# Topic Slide
1. Harnessing project management decisions through tracking project
progress/performance against budget and physical plan
1.1. Measurement –Result Based Management
2. Forward and backward accountability
3. Lessons learning so that we can build up to improve our programming

12
MEAL COMPONENTS OBJECTIVE

# Topic Slide
Discussions

 What good practices Hundee would replicate to the coming project

Hundee MEAL performance and constraining challenges
 What Hundee expect from WHH for further strengthening MEAL
 What was Hundee experience in M&E in general and in implementing ETH1205 in
particular
 MEAL practices Challenges and good practices

13
1. HARNESSING PROJECT MANAGEMENT
DECISIONS
Monitoring Exercice and review Meetings

MONITOIRNG ACTIVITIES
 Annual joint planning

 joint monitoring

 Revising plan

 Reflection workshop to share good practices /Review meetings

 Reporting (Quarter reporting of outcomes and outputs from partners and Interim report to the
donor/government sector office/ ACSI)

14
MEAL PURPOSES
What is existing practice at Hundee? With respect to evidence-based Strengths Weaknesses

project management ,accountability and continual improvement

Activity monitoring
# Topic Slide
Budget monitoring
]
Measuring results /outcomes
Redesign-mid-course adjustment
Compliance on project agreement /timely reporting to donors and
partners
Adaptability of project activities /external environment is changing

Quantitative survey and triangulation to substantiate results

Accountability and engagement of beneficiaries and government

Empower community ownership

15

Scale up good practices /Continual improvement

2. FACILITATE MANAGEMENT DECESIONS
Monitoring Exercice and review Meetings

MONITOIRNG ACTIVITIES
 Annual joint planning

 joint monitoring

 Revising plan

 Reflection workshop to share good practices

 Reporting (Quarter reporting of outcomes and outputs from partners and Interim report to the donor

16
2. FACILITATE MANAGEMENT DECESIONS
Monitoring Exercice and review Meetings

MONITOIRNG ACTIVITIES
 Data collection using quantitative and qualitative indicators

 Use triangulation method for complementarity

 Exercise

What do you think , qualitative methods would bring to a data collection to understand how food security and
nutrition project attains its objective ?

What are the tools for data collection ? Quantitative versus qualitative

17
2. FACILITATE MANAGEMENT DECESIONS
Monitoring Exercice and review Meetings

REPORTING
 Reporting on results (outcomes and immediate results)

 Reporting to inform the project management

 Compliance reporting (complaint response mechanisms ensured/accountability to the beneficiaries)

 Reporting of good practices for cross fertilization of knowledge

 Physical versus financial performance to learn about our efficiency

18
2. FACILITATE MANAGEMENT DECESIONS
Monitoring Exercice and review Meetings

REPORTING
 Quarterly reporting by partner

 Reporting challenges that needs management decisions

19
2. FACILITATE MANAGEMENT DECESIONS
Monitoring Exercice and review Meetings

REPORTING CHALLENGES
 What are the challenges in reporting ?

Discussion

Why not meeting deadlines ?

Why not reporting completed information?

Why not address all the results in the project logical framework

Aligning reportable data elements with government sector reporting data elements to avoid duplication of
effort (one plan one report)

Infact some data elements required to be reported might be the partner's interest

20
2.FORWARD AND BACK WARD ACCOUNTABILITY
Accountability and Quality of Programming

PILLARS OF CRM SYSTEM

1. Information sharing

2. Sensitizing the beneficiaries and staffs about the CRM system

3. Confidentiality of receiving complaints and feedback

4. Responsive action –program improvement

21
2.FORWARD AND BACK WARD ACCOUNTABILITY
Accountability and Quality of Programming

PROJECT DESIGN , IMPLEMENTAITON , MONITORING AND EVALAUTATION

 Participatory planning –integrating plan

 Integrating implementaiton

 Participatory targeting of beneficiaries

 Clear targeting criteria

 Intersectionality/Inclusiveness the most affected (PLW, aged people, vulnerable and women HH heads)

 Joint Monitoirng and evaluation

22
2.FORWARD AND BACK WARD ACCOUNTABILITY
Accountability and Quality of Programming

PROJECT DESIGN , IMPLEMENTAITON , MONITORING AND EVALAUTATION

 Exclusion and inclusion criteria

 Exercise

 What are inclusion criteria to target beneficiaries of a food security and nutrition program. What are the
rationality to select beneficiaries? List criteria for selection criteria

23
3. LESSONS LEARNING SO THAT WE CAN BUILD
UP TO IMPROVE OUR PROGRAMMING
Leesons learning

LEESONS LEARNING
 Benchmark meeting

 Quarterly review

 Joint evaluation

3. Group exercise

What lessons we have learned from ETH1205?

24
MEAL COMPONENTS OBJECTIVE

# Topic Slide

Theory of change /Logframe

25
MEAL COMPONENTS OBJECTIVE

# Topic Slide
What is theory of change ?

What is logical framework?

26
LOGIC OF PROJECT-THEORY OF CHANGE

# Topic Slide
 
Logic of project (theory of change) – pathways for achieving project objectives that
considers risks and assumptions
Logical framework- planning and designing tool to portray the project/program
progress from investment to achieving its intended objective-A four by four matrix
What risks are inevitable and what assumptions are holding

Understanding output indicators /quantitative and qualitative aspect

27
LOGIC OF PROJECT-THEORY OF CHANGE

# Topic Slide
The overall objective of the action is

to improve the food and nutrition security of coffee

farming communities in Manna, Seka Chekorsa,
Gomma, Shabe Sombo and Gera districts, in Jimma
Zone, Oromia region.

28
MEAL COMPONENTS OBJECTIVE

# Topic Slide
Log frame and MEAL plan are interrelated and the later is build up on the preceding
Objectively verifiable indicators, Means of verification/source of data ,
assumption and risks
data collection tools , frequency of data collection/reporting and for whom to be
reported)
Qualitative tools during measuring/ field Monitoirng
Exercise to entail the difference results of qualitative and quantitative undertakings
Participants can exercise
Why we use qualitative tools such as observation , KII , II and FGDs?
29
LOGFRAM- A FOUR BY FOUR MATRIX

# Topic Slide
Overall objective Objectively verifiable Sources of verification  Assumptions
indicators (OVIs) (MOVs)

Project purpose Objectively verifiable Sources of verification Assumptions

indicators

Results (intermediate results Objectively verifiable Sources of verification Assumptions

) indicators

Activities Means Costs Assumptions

30
MEAL COMPONENTS OBJECTIVE

# Topic Slide

Indicator (Outcome/output)

31
MEAL COMPONENTS OBJECTIVE

# Topic Slide

What are indicators ?

Baseline Targets
Milestones
Endline Targets
Indicator development
Direct versus indirect (proxy)targets
Qualitative versus quantitative INDICATORS
32
MEAL COMPONENTS OBJECTIVE

# Topic Slide

Indicator development/formulation :-Criteria for selection of indicators

 Pertinent (relevant)
 Sensitive
 Effective
 Technically valid
 Feasible to collect data
 Verifiable
33
MEAL COMPONENTS OBJECTIVE

# Topic Slide

Types of indicators
Input indicators – immunisation policies, resource inputs (human, material, financial). These are
pre-requisite indicators for implementation.
Process indicators – this area examine functionality and quality of immunization system and
include all activities: planning, financing, quality of service delivery, immunisation safety,
assessment of the programme and its efficiency, training, etc.
Output indicators – program’s immediate results, e.g. vaccination coverage and other results or
products contributing to the achievements of the programme objectives.

34
MEAL COMPONENTS OBJECTIVE

# Topic Slide

Types of indicators
Outcome indicators– relates to the objectives of the programme, i.e., achievement of final goal
of polio eradication, neonatal tetanus elimination, etc.
Impact indicators – relates to the goal of the programme, i.e. reduction of morbidity and
mortality of targeted diseases

35
MEAL COMPONENTS OBJECTIVE

# Topic Slide

Question:- Exercise to entail the difference results of qualitative and quantitative

undertakings
4. Group exercise
Why we use qualitative tools such as observation , KII , II and FGDs?
What are the pros of qualitative tools against quantitative tools?

36
TARGETING-ACCOUNTABILITY TO
BENEFICIARIES

# Topic Slide

Targeting-accountability to

beneficiaries

37
TARGETING ? BLANKET VERSUS
PRIORITIZATION
# Topic Slide
Targeting and accountability to beneficiaries
There is no blanket targeting always (resource is scarce)
Blanket targeting –livestock vaccination
 Criteria for inclusion and exclusion
5. Group exercise
What are the beneficiary targeting criteria for this particular project
(ETH1224)?
Target registration (Asset/ family size/family age band/PLW/benefit packages
eligible )?
38
TARGETING ? BLANKET VERSUS
PRIORITIZATION
# Topic Slide
What targeting strategies are better ?
 Self/
 Community based
 Proxy means test, categorical?
 Beneficiary master list- digital

39
TARGETING

# Topic Slide
SOPs and/or Steps in targeting process?
Step 1: Deciding whether targeting appropriate /blanket programming
Step 2: Selecting the targeting methodology
Step 3: Defining eligibility criteria
Step 4: Validating the targeting method and criteria
Step 5: Communication, appeals and feedback systems
Step 6: Identification of eligible individuals or households
Step 7: Monitoring
40
ETH1224 MEAL PLAN DEVELOPMENT EXERCISE?

# Topic Slide

ETH1224 MEAL Plan

development exercise?

41
ETH1224 MEAL PLAN DEVELOPMENT EXERCISE?

# Topic Slide

6 Group exercise MEAL plan exercise

and presentation

42
 DATA MANAGEMENT , DATA QUALITY AND
BENEFICIARY COUNTING

# Topic Slide

Data management ,
Data quality and
beneficiary counting

43
REPORTING FRAMEWORK

# Topic Slide
REPORTING FRAMEWORK
Frequency of reporting
Monthly update /Quarterly and annual reporting
Reporting on performance (physical activities and budget)
Reporting on outcomes (project objectives )
Reporting should focus on outcome level not only activity level
If the reporting is annual, it should address outcome level indicators

44
MULTI-STAKEHOLDER PARTNERSHIP

# Topic Slide
Multi-stakeholder partnership
WHH roles and responsibilities as partner
GIZ roles and responsibilities
Hundee roles and responsibilities
Compliance to partnership agreement
Forward and backward accountability
Reporting to partners
Monthly update, quarterly and annual reporting (Project based approach )
45
MULTI-STAKEHOLDER PARTNERSHIP

# Topic Slide
Reporting both physical and budget performance.
What are the challenges to incorporate budget section to a report?

46
COMPLAINT RESPONSE MECHANISM-CRM

# Topic Slide
Complaint response mechanism and accountability (Code of conduct)
 Community participation
 Information sharing
 Responsiveness to complaints
CFRM

47
MEASURING SUCCESS AT WHH

# Topic Slide

Measuring success at WHH

48
WHH ADHERE TO EIGHT INDICATORS
WHH zero hunger across the globe – how can we measure
this gaol?
THERE ARE EIGHT SUCCESS MEASUREMENT INDICATORS _#MS
# Topic/Sector Indicator
Please note: The square brackets […] indicate alternatives

#ms1 Food Access (MAHFP) Average months of food sufficiency (of targeted households) in the previous twelve months

#ms2 Nutrition Diversity (MDD-W) Number [or percentage] of targeted women aged 15–49 consuming a sufficiently diverse diet

#ms3 Drinking Water Number [or percentage] of households using safely managed drinking water services

#ms4 Sanitation Number [or percentage] of households using safely managed sanitation services

49
WHH ADHERE TO EIGHT INDICATORS

THERE ARE EIGHT SUCCESS MEASUREMENT INDICATORS 02_#MS.HANDBOOK.2019_EN.PDF

# Topic/Sector Indicator
Please note: The square brackets […] indicate alternatives
#ms4 Sanitation Number [or percentage] of households using safely managed sanitation services

#ms5 Income Number of households increasing their cash income

#ms6 Women in Decision-making Number [or percentage] of adult women being able to influence decision-making

#ms7 Skills Number of trainees successfully completing skills-development training

 

50
WHH ADHERE TO EIGHT INDICATORS
WHH zero hunger across the globe – how can we measure
this gaol?
THERE ARE EIGHT SUCCESS MEASUREMENT INDICATORS

WHH ADHERE TO EIGHT INDICATORS

51
MINIMUM DIET DIVERSITY- WOMEN

52
MINIMUM ACCEPTABLE DIET-CHILDREN

53
NUMBER [OR PERCENTAGE] OF ADULT WOMEN BEING
ABLE TO INFLUENCE DECISION-MAKING

54
Abraham Lebeza
MEAL
Abraham.Lebeza@welhungerhilfe.de
+251910818934

Photo: Haddad Toni / Welthungerhilfe