You are on page 1of 21

Evaluations Through NEDA Lens:

Challenges and Opportunities

Director Violeta S. Corpus


Monitoring and Evaluation Staff

6th M&E Network Forum


Quezon City, Philippines
6 December 2016
Outline of Presentation
I. Country Context

II. Typologies of Evaluation

III. Challenges and Opportunities


Country Context
Features of Results-
oriented Public Sector
Management (PSM)
Presence of core result
attributes
Focus on common
results
Interdependency among
the components
Effective vertical and
horizontal linkages

Source: Based on the results-based Public Sector Management (PSM) framework developed by the Asia-Pacific Community of Practice on Managing for
Development Results (APCoP-MfDR), Adopted in PDP Results Matrix 2011-2016
GPH Results Framework
Documents Societal Goal: M&E Reports
Foundation for
Inclusive Growth, A
• Socio-Economic
• Philippine
High Trust Society, Report
Development Plan • Regional
and Globally-
and-Results Matrices
Competitive Development Report
(RMs) Knowledge Economy c/o NEDA
• Regional
• SONA Technical
Development Plans
Report c/o OP-PMS
and Regional RMs
Sectoral Goals
• Budget/ Financial
Accountability Reports
• Program Expenditure c/o DBM
Organizational
Classification Outcomes/Major Final • Budget Execution
(PREXC) c/o DBM Outputs Document c/o DBM

• ODA Portfolio Review


• Project’s Logical • RPMES Reports
Framework c/o • Project-level Reports (c/o
Programs and Projects NEDA)
Implementing
• Project Evaluations
Agencies
Reports (c/o Agencies/
DPs)
Policy Context Relevant to M&E
EO 230 NEDA – DBM Sector PREXC - grouping of
AO 25 on
Reorganizing NB Resolution Effectiveness activities/ projects
RA 8182 (as unified
NEDA mandates No. 30 instructed under an assigned
amended by RA and Efficiency Results-Based
the agency to the ICC to review all program with the
8555) mandated Review assessed Performance targets clearly linked
monitor and ongoing ODA-funded NEDA to conduct an the responsiveness of Management to strategies, budgets,
evaluate the projects annual review of programs and projects System; 1st and intended results
implementation with the aim of to sector outcome
status of all ODA Results Matrix
of the PDP improving objectives
projects of PDP 2011-
absorptive capacity
2016

1987 1989 1992 1993 1996 1999 2001 2007 2011 2015 2016

EO 376 EO 93 further DBM adopted the NEDA – DBM JMC


NB Resolution No. 3
Established refined and Organizational No. 2015-01 on the
provides for
the Regional Project streamlined the Performance National Evaluation
reporting of project
Monitoring and roles and Indicator Policy Framework for
outcomes and
Evaluation System responsibilities and Framework (OPIF) the purposive conduct
impacts by ICC and
(RPMES) for M&E at operating which seeks to align of evaluations by all
Implementing
the sub-national procedures under good and services government agencies
Agencies
level the RPMES supported by the
budget with the
government’s desired
outcome objectives
Country Evaluation Systems
Paris Declaration
on Aid
Results Effectiveness,
orientation at and other High-
the project Level Fora
level

Prior to 1996 – 2000 – 2004 – 2008 –


1996 1999 2004 2008 Present

Results-based
M&E focus on selected Shift to sectoral
Management
major infrastructure and goals and tools and
ODA-assisted projects approaches , systems (Impact
(Input-Output; ODA MDGs Evaluation)
Portfolio Review)
Typologies of Evaluations (1)
Typology Supply Demand (Usefulness)
Country-Level Supported by providers of • Gauge country’s compliance with
development cooperation international commitments (e.g.,
and usually spearheaded by Paris Declaration on Aid
NEDA Effectiveness, Busan Partnership for
Effective Development Cooperation,
etc.)
• Document evaluation experiences
with development partners
(Collaborative Partner-Donor
Framework Study)
• Map-out financing for development
to guide future policies
(Development Finance and Aid in
the Philippines)
Country-Level Evaluations and Studies
Country Evaluations/ Studies Year Development Partners Involved
Country Level Evaluation, Phase 1 (CLE1) of the 2008 German Government through KfW- Interest
Implementation of the Paris Declaration (PD) Differential Fund
Country Level Evaluation, Phase 2 (CLE2) of the 2010 Danish Institute for International Studies
Implementation of the Paris Declaration (PD)
Global Partnership Monitoring Framework (GPMF) 2013- United Nations Development Programme
Round 1 2014 Country Office
Global Partnership Monitoring Framework (GPMF) 2015- United Nations Development Programme
Round 2 2016 Country Office
Development Finance and Aid in the Philippines: 2014 United Nations Development Programme
Policy, Institutional Arrangements and Flows Country Office and Asian Development Bank
Collaborative Partner-Donor Framework Study 2014 (commissioned by) Organisation for
(2 Case Studies: JICA- NEDA Joint Ex-Post Economic Co-operation and Development –
Evaluation and IFAD Joint Supervision Support Development Assistance Committee (OECD-
Missions) DAC) – EvalNet
International Initiative for Impact Evaluation: 2014 – Australian Government through Department
Philippine Policy Window present of Foreign Affairs and Trade
Typologies of Evaluations (2)
Typology Supply Demand (Usefulness)
Policy-Level Government- • For government
Sectoral Type commissioned/ led accountability on results
evaluations and findings
Assessment of
• To guide future policies
Development
Conducted by and programs in the
Plans (at
government think legislative and executive
National/
tank (PIDS), branches
Regional Levels)
academe, and • Inputs to Socio-economic
consultants. Reports, Philippine
Development Plan,
Legislative Notes, Policy
Notes, etc.
Typologies of Evaluations (3)
Types Supply Demand (Usefulness)
Program/ Project ODA. (i) Jointly conducted To (i) enhance/ improve
- Level by the Government and implementation of ODA and
providers of development ODA; (ii) future budget planning
cooperation; (ii) (LFPPPs) and future
Government-led (e.g., programming of assistance
NEDA, PIDS); (iii) provider (ODA)
of development
cooperation-led

LFPPs. Government-
commissioned/ led
evaluations (e.g., DBM-
commissioned studies)
Program/ Project Level Evaluations and Studies
Projects Year
JICA – NEDA Joint Ex-Post Evaluation
1. Philippine-Japan Friendship Highway Rehabilitation Project, Phases I and II
2. Maritime Safety Improvement Project 2006
3. Nationwide Air Navigation Facilities Modernization Project III
4. Metro Manila Interchange Construction Project, Phase IV
5. Pinatubo Hazard Urgent Mitigation Project 2007
6. Special Economic Zones Environment Management Project
7. Fisheries Resources Management Project
2008
8. Metro Manila Strategic Mass Rail Transit Development Project
9. Lower Agusan Development Project
2010
10. Rural Road Network Development Project Phase II
11. Cordillera Road Improvement Project
2011
12. Metro Manila Flood Control Project – West of Mangahan Floodway
13. Batangas Port Development Project II
2012
14. Pampanga Delta Development Project (Irrigation Component)
Program/ Project Level Evaluations and Studies
Projects Year Projects
1.Northern Mindanao Community Initiatives
IFAD – NEDA Joint Supervision and Implementation and Resource Management Project
Support Missions (NMCIRMP)
NMCIRMP, RuMEPP 2008 2.Rural Micro Enterprise Promotion
NMCIRMP, RuMEPP, CHARMP2 2008 Program (RuMEPP)
3.Cordillera Highland Agricultural Resource
NMCIRMP, RuMEPP, CHARMP2, Management Project (CHARMP2)
2009
RAFPEP, 4.Rapid Food Production Enhancement
NMCIRMP, RuMEPP, CHARMP2, Programme (RaFPEP)
2010
RAFPEP, 5.Rapid Food Production Enhancement
Programme (RaFPEP) - Irrigated Rice
RuMEPP, CHARMP2, RAFPEP 2011
Production Enhancement Project (IRPEP)
RuMEPP, CHARMP2, RAFPEP 2012 6.Haiyan Agriculture and Rehabilitation
RuMEPP, CHARMP2, RAFPEP 2013 Programme (HARP)
7.Integrated Natural Resources and
RuMEPP, CHARMP2, RAFPEP 2014
Environmental Management Project
CHARMP2, RAFPEP-IRPEP, HARP 2015 (INREMP)
CHARMP2, RAFPEP, INREMP 2016
Program/ Project Level Evaluations and Studies
NEDA-Led Studies Year
Impact Assessment
Agrarian Reform Communities Development Project 2 2015
(ARCDP 2)
Pilot Ex-Post Evaluation
1.Can-Asujan Small Reservoir Irrigation System (Southern
Philippines Irrigation Support Project) 2015
2.Arterial Road By-Pass Project
3.2nd Women’s Health and Safe Motherhood Project
Impact Evaluation Studies
1.Rural Road Network Development Project Ongoing
2.Technical Education and Skills Development Project procurement
3.National Shelter Program
Typologies of Evaluations (4)
Types Supply Demand (Usefulness)
Evaluations of Led by providers of Guide programming
Country development exercises
Assistance cooperation
Strategies

Evaluations of Country Assistance Strategies Studies


Studies/ Provider of Development Cooperation Year
Country Assistance Program Evaluation for the Philippines 2003 and
(2003 and 2008)/ ADB 2008
Philippines Country Partnership 2011-2016 Final Review/ ADB 2016
1st Country Strategy and Programme Evaluation (CSPE)/ IFAD 2016
Challenges and Opportunities
Factors Challenges Opportunities/ Next Steps
Policy-Support Operationalization of National Seek new champions for the
Evaluation Policy Framework (NEPF) NEPF IATF with the recent
change of administration
•Convening the NEPF Inter-agency
Task Force (IATF) with representatives
from NEDA, DBM, and OP – PMS

•Creation of a permanent NEPF


Secretariat

•Issuance of NEPF implementing


guidelines and subsequent policies
(e.g., use and dissemination protocols,
among others)
Challenges and Opportunities
Factors Challenges Opportunities/ Next Steps
Budget Provision of budget in • Reissuance of DBM Budget
the GAA for agencies to Memoranda allowing agencies to
conduct evaluations budget for M&E

• Agencies to conduct systematic


planning of evaluation activities
(evaluation plan) starting with new
projects to be included in annual
budget proposals
Challenges and Opportunities
Factors Challenges Opportunities/ Next Steps
Implementation Functional Strengthen/ establish (if none) evaluation
Arrangements evaluation units units of agencies
(Agency Level) of agencies
Challenges and Opportunities
Factors Challenges Opportunities/ Next Steps
Capacity Need to professionalize Certification Course on Evaluation (DBM)
Building evaluation practitioners
Conduct/ Outsource Impact Evaluation (IE) Studies
Need to provide incentives and IE Training (NEDA)
to evaluation practitioners
Partnerships with providers of development
Need to conduct cooperation or donor countries (e.g., JICA Joint Ex-
evaluations on priority Post Evaluations; Government of Japan – Joint
sectors/ programs and Evaluation; IFAD Joint Supervision Implementation
projects Support (SIS) Mission; DFAT – AusAID through the
3IE Impact Studies; UNDP Capacity Building activities,
TOR preparation for etc.)
Evaluation Studies,
Procurement for Continuing partnerships with providers of development
Consultancy Services, cooperation, CSOs, and private M&E practitioners
Managing Evaluation
Studies Capacitate agency M&E staffs
Challenges and Opportunities
Factors Challenges Opportunities/ Next Steps
Standardi- Need to Drafted Results-based Management
zation of harmonize Evaluation (RbME) and Ex-Post
Evaluation evaluation Evaluation Manuals (c/o NEDA)
Practices silos
(academe, Updated Regional Project Monitoring
development and Evaluation System (RPMES) (c/o
partners, NEDA)
government,
etc.) Other evaluation and RBM tools and
handbooks (c/o DBM)
Challenges and Opportunities
Factors Challenges Opportunities/ Next Steps
Management Need to collect Open-data platforms in the Government (i.e.,
Information baseline monitoring data to aid future conduct of
Systems information evaluations)
(MIS)
Need to build up Continuing developments of Government MIS
evaluation to include geo-tagging and analysis (e.g.,
database PPIES, AidDATA, etc.)

Need for a central


repository of
evaluation studies
Evaluations Through NEDA Lens:
Challenges and Opportunities

Director Violeta S. Corpus


Monitoring and Evaluation Staff

6th M&E Network Forum


Quezon City, Philippines
6 December 2016

You might also like