Thematic Working Group 8 - Ex post evaluation of RDPs 2014-2020: Learning from practice

 

In 2019, for the first time during the 2014-2020 programming period Member States had to report on their RDPs’ contributions to the achievement of the EU’s policy objectives by evaluating the policy’s impacts. The findings of these evaluations were reported  to the European Commission in the enhanced Annual Implementation Reports (AIRs) 2019.

The Evaluation Helpdesk has analysed the AIRs 2019 to identify major challenges and draw lessons for future learning. The main challenges identified through this assessment are related to:

  • The conceptual understanding of definitions of indicators and methodologies for the calculation of result and impact indicators;
  • The use of robust evaluation approaches and methods;
  • The collection and management of data for evaluations; 
  • The assessment of net contributions; 
  • The quantification of secondary contributions, synergies and LEADER contributions.

To address these challenges and to better prepare for the ex post evaluation in 2024 the Evaluation Helpdesk in collaboration with thematic experts and DG AGRI have launched the Thematic Working Group, ‘Ex post evaluation of RDPs 2014-2020: Learning from practice’ at the end of February 2020.
The objectives of the Thematic Working Group are to:

  • Address weaknesses in the assessment of RDP achievements and impacts;
  • Improve the calculation of result and impact indicators;
  • Tackle emerging issues in the assessment of priority areas (e.g. environment, climate, social indicators).

This Thematic Working Group will further serve as an important input into the future development of the monitoring and evaluation systems for the post-2020 period.

The Thematic Working Group will consist of three working packages each one related to one of the three CAP general objectives:

Each working package will encompass an overview of identified emerging issues and proposed recommendations for addressing those issues. These working packages will also be enriched with practical examples to illustrate how the identified issues have been addressed in different Member States.

To ensure that the Thematic Working Group meets the practical needs of the evaluation community ongoing consultations will take place with evaluation stakeholders through periodic Sounding Boards and other means of written feedback.
 

 

 

  • Topic 1 - Percentage/share of rural population benefiting from new or improved services/infrastructures (2014-2020): This document specifically highlights issues related to the use of the common result/target indicator ‘Percentage of rural population benefiting from new or improved services/infrastructures (ICT)’ to measure the achievements under the Focus Areas (FA) 6B (Result/Target Indicators R23/T22) and 6C (Result/Target Indicators R25/T24) in the 2014-2020 programming period. 

          PDF iconWorking Package 1: Topic 1 EN (717.65 KB)

  • Topic 2 - Jobs creation in rural areas (2014-2020): This document highlights issues related to the use of the common result/target indicator ‘Jobs created in supported projects’ to measure the achievements under the Focus Areas (FA) 6A (Result Indicator R21 and Target Indicator T20) and 6B (Result Indicator R24 and Target Indicator T23) in the 2014-2020 programming period. 

          PDF iconWorking Package 1: Topic 2 EN (853.84 KB)

  • Topic 3 - Reporting on net contributions of socio-economic impact indicators: This document examines issue related to reporting from the AIR 2019 on net contributions of socio-economic impact indicators.

          PDF iconWorking Package 1: Topic 3 EN (732.76 KB)

  • Topic 4 - Quantification of LEADER/CLLD contributions and measuring their secondary effects: This document specifically highlights issues related to the quantification of LEADER/CLLD contributions and measuring their secondary effects in the 2014-2020 programming period.

          PDF iconWorking Package 1: Topic 4 EN (837.49 KB)

 

  • Working Packge 3 coming in November 2020!

Centre for Strategy and Evaluation Services (2006): Study on Measuring Employment Effects. Brussels.

Ecorys (2019): The Evaluation of the results and impact of the RDP 2014-2020 in the years 2014-2018: Part 3 devoted to the issue of employment and local development. Warszawa.

ENRD Contact Point (2016): Rural Development Programmes 2014-2020: Key facts & figures. FOCUS AREA 6C: Access to and quality of ICT. Brussels.

ENRD Contact Point (2019): RDPs 2014-2020: Monitoring data Rural Development Priority 6 (P6): Promote social inclusion, poverty reduction and economic development in rural areas .Situation at the end of 2018. Brussels.

European Commission – Directorate-General for Agriculture and Rural Development – Unit C.4 (2019): Assessment of the progress in implementing the Evaluation Plans of RDPs 2014-2020. Chapter 2 of the AIRs submitted in 2019. Summary Report. Brussels.

European Commission – Directorate-General for Agriculture and Rural Development – Unit C.4   (2014): Capturing the success of your RDP: Guidelines for the ex post evaluation of 2007-2013 RDPs. Brussels.

European Commission – Directorate-General for Agriculture and Rural Development – Unit C.4 (2019): Evaluation-related queries. Working Document. Brussels.

European Commission – Directorate-General for Agriculture and Rural Development – Unit C.4 (2018): Guidelines. Assessing RDP achievements and impacts in 2019. Brussels.

European Commission – Directorate-General for Agriculture and Rural Development – Unit E.4 (2016): Guidelines. Assessment of RDP results: How to prepare for reporting on evaluation in 2017. Brussels.

European Commission – Directorate-General for Agriculture and Rural Development – Unit C.4 (2017): Guidelines. Evaluation of LEADER/CLLD. Brussels.

European Commission – Directorate-General for Agriculture and Rural Development – Unit C.4 (2019): Good Practice Workshop no 12. How to demonstrate RDP achievements and impacts: lessons learned from the evaluations reported in the AIR 2019. Seville.

European Commission – Directorate-General for Agriculture and Rural Development – Unit C.4 (2018): Good Practice Workshop no 7Showing the added value of LEADER/CLLD through evaluation. Helsinki.

European Commission – Directorate-General for Agriculture and Rural Development – Unit C.4 (2019): Interactive decision tools. Data for the assessment of RDP achievements and impacts. Brussels.

European Commission – Directorate-General for Agriculture and Rural Development – Unit C.4 (2019): Synthesis of the evaluation components of the enhanced AIRs 2019: Chapter 7. Summary Report. Brussels.

European Commission (2019): Commission Staff Working Document, Synthesis of the findings of the evaluations of European Structural and Investment Funds Programmes, SWD (2019) 445 final. Brussels.

European Commission / DG Regio (2013): Expert evaluation network (August 2013), Job creation as an indicator of outcomes in ERDF programmes. Brussels.

European Commission (2014/ rev. 2018): Guidance Document on Monitoring and Evaluation – ERDF and Cohesion Funds, Concepts and recommendations. Brussels.

European Commission (2018): Impact Indicator fiches. Brussels.

European Commission (2017): Technical Handbook On The Monitoring And Evaluation Framework Of The Common Agricultural Policy 2014 – 2020, Directorate-General For Agriculture And Rural Development. Brussels.

European Commission (2018): Working Document for the Rural Development Committee (August 2018), Rural Development Monitoring (2014-2020) – Implementation Report Tables. Brussels.

European Commission (2015): Working Document. Target indicator fiches for Pillar II (Priorities 1 to 6). Brussels.

European Court of Auditors (2018): Special report. EU support for productive investments in businesses - greater focus on durability needed. Brussels.

Fisheries and Aquaculture Monitoring and Evaluation Support Unit & FARNET Support Unit (2018): Evaluating CLLD: Handbook for LAGs and FLAGs. Brussels.

Forschungsgruppe Agrar- und Regionalentwicklung Triesdorf / ART (2019): Bewertung des Entwicklungsprogramms für den ländlichen Raum in Bayern 2014 – 2020 (EPLR Bayern 2020), Maßnahmenspezifische Bewertung. Triesdorf.

Other information sources

Complementary semi-structured interviews with evaluation stakeholders in Member States in March – April 2020

Evaluations in Member States (e.g. Austria)

Outcomes of the focus group discussion with selected participants representing Managing Authorities, evaluators, Paying Agencies, JRC and DG Agri organised on 28 April 2020.

Outcomes of the focus group discussion with selected participants representing Managing Authorities, evaluators, Paying Agencies, JRC and DG Agri organised on 23 April 2020.

Selected Rural Development Programmes (2014-2020) and Annual Implementation Reports submitted in 2019

Suggestions and comments of evaluation stakeholders from the Member States have been collected through a written Sounding Board consultation in May 2020

Survey on data sources conducted during the preparation of the Good Practice Workshop 13

Yearly Capacity Building Events in the Member States