Professional Documents
Culture Documents
Veronica Gaffey, Kai Stryczynski, Adam Abdulwahab, Daniel Mouqu DG REGIO Evaluation Unit
What is proposed?
More Concentration A focus on results (not only spending) Programmes with clear articulation of what they aim to change and how Better gathering of basic data on outputs Performance Framework and Reserve to incentivise performance Evaluation more focused ex ante; evaluation plan obligatory, evaluation of the effects of each priority during the programming period; summary of evidence in 2020; ex post by Commission
II Result orientation
For each priority axis:
Quality criteria: robustness, clarity of normative interpretation, responsiveness, timely collection, public availability. Identification of sources, establishment of targets,
Select the factor(s) that the programme should influence what outputs will it produce?
Common Indicators
Objective: provide EU level (aggregated) information on achievements of Cohesion Policy Timing: information should be available at or shortly after finishing projects (selected and fully implemented) Simplicity: data from monitoring of implementation or operation Aggregation: outputs as much as possible
9
10
Performance framework
Aims to support the progressive achievement of programme objectives
Sets out milestones (interim steps) and targets for performance of programme priorities for 2016, 2018 and 2022 Milestones for 2016 to include financial indicators and output indicators Milestones for 2018 to include financial indicators, output indicators and where appropriate, result indicators (under the control of Managing Authorities possibly common indicators) Milestones also for key implementation steps
11
Ex ante evaluation appraises all indicators (logic of intervention and appropriateness of targets) and the suitability of milestones for performance framework Information also from current programmes (if reporting improved)
12
Performance review
Performance reviews in 2017 and 2019 and the disbursement of the performance reserve in 2019 based on Performance Framework Information for the performance review in the AIRs and progress reports of the Partnership Contract Member States are expected to react to significant shortfalls in the achievement of milestones (measures to improve performance, reprogramming) In the absence of sufficient action, Commission can suspend payments Significant failure (to be defined in implementing acts) to achieve the targets set for 2022 in the performance framework can lead to a financial correction at the end of the programming period
13
Performance reserve
5% of resources set aside at the beginning of the programming period (exception for ETC) The performance reserve is established per CSF Fund, per Member State and per category of region NB no competition between MS The 5% reserve is allocated to each Member State following the performance review in 2019 Allocation can only be used for priority axes where performance has been satisfactory (milestones have been achieved) based on Member State proposal
14
Priority axis Enhancing R&I infrastructure and capacities to develop R&I excellence and promoting centres of competence
Indicator and measurement unit, where appropriate Expenditure (EUR million) Size of developed infrastructure completed (m2) Researchers employed in enhanced infrastructure Expenditure (EUR million) Number of New Enterprises supported Gross jobs created in assisted SMEs
Promoting entrepreneurship, in particular by facilitating the economic exploitation of new ideas and fostering the creation of new firms
3 60
9 180 540
22 450 1400
Expenditure (EUR million) Feasibility studies completed and contracts for construction concluded Length of rail completed (km)
5 Yes
100
250
20
1550
Actions taken to fulfil ex ante conditionalities 2017 & 2019: performance framework and progress towards achieving objectives of the programme 2019 and FIR: contribution to EU2020 objectives
16
Evaluation: when?
MS MS
Ex post:
Commission
17
Evaluation: what?
Impact evaluations at least once during the period for each priority axis
Does the intervention work? Why and how does the intervention work (or not)?
Implementation evaluations (roughly what has been done so far) Guidance on methods: EVALSED
18
Next steps
Concepts and recommendations discussed with MS, later adaptation to agreed regulations. MS have asked for guidance on ex ante evaluation and performance framework Work with MS / geographic units in 2012 on result indicators.
19
20
Daniel Mouqu
Evaluation Unit, DG REGIO
21
and a solution
Grants to SMEs (capital equipment, modernisation, etc) Lets assume the project runs well, the money is absorbed, there are outputs (no. of firms, etc) Is this enough? Do we know it has worked?
23
In sum
Were asking regions to develop a clear causal chain:
Identify a problem Implement a possible solution Monitor an appropriate result indicator
Seems obvious, but new in practice Still need evaluation to assess policy contribution to the result (ie impact)
26
28
29
30