Courses
AutumnAcademy
Monitoring, Evaluation and Indicators in ESI Funds:
Practitioner’s Toolbox
openregistration
-
Description
How to construct indicators in order to grasp the accomplishments that ESI Funds projects bring at the local and the national level? How to take care of targets at all programme stages to uphold the EU Commission demands and still keep them simple to understand? How to effectively monitor progress?
Monitoring and evaluation are integral elements of any ESI-funded activity, strongly reinforced by the Commission. So, when closing the Operational Programmes of the 2014- 2020 financial perspective, programming the new one, or working with the Resilience and Recovery Funds, we have to retain profound knowledge on the construction of targets and indicators, as well as the methods and tools to monitor and control them. Participation in this 2- day workshop will provide you with the understanding and skills necessary to collect valid data and select the right evaluation method necessary to assess the accomplishment of targets and results of Operational Programmes.
In ESIFA we know training needs to be practical and interactive to bring applicable results, so our experts in monitoring and evaluation will walk you through a series of interactive exercises and case study based in-depth discussions.
The Workshop will cover the following issues:
- The relation between evaluation purposes, criteria, questions, and stages of the intervention
- Evaluation approaches and strategies
- Exercise: assess terms of reference for coherence
- Counterfactual Impact Evaluation (CIE) strategies
- Theory-based impact evaluation approaches
- Monitoring and indicators systems in the ESI Funds (ESF perspective)
- Monitoring and evaluation: the role of indicators (ERDF perspective)
- Monitoring in practice
- Best practices
WHO IS THIS WORKSHOP FOR?
Experts from Managing Authorities, Audit Authorities, Intermediate Bodies, Regional and local authorities, Court of Auditors
External evaluators
Beneficiaries of EU funded projects -
Programme
Wednesday 25 October 2023
-
09.00
Welcome of the Participants
Welcome note by the ESI Funds Academy and Chair, Introduction Round
-
09.15
Monitoring and indicators systems in the ESI Funds (ESF perspective)
- Role and significance of monitoring for Operational Programmes and Projects;
- Legal framework of monitoring system in 2014-2020 and the information about the framework after 2020;
- Stakeholders involved and share of obligations;
- Relevant terminology: outputs, results, impact, participant;
- Performance Framework: expectations and consequences of performance review;
- Methods of target setting
Łukasz Mikulec, Expert on Expert on monitoring and indicators (tbc)
-
10.30
Coffee Break
Networking
-
11.00
ESI Funds - Monitoring & Evaluation: the role of indicators (ERDF perspective)
- Introduction to M&E;
- Basic concepts: outputs, outcomes, impacts;
- The role of indicators;
- Types of indicators;
- Selecting key indicators to measure achievements;
- Baseline data on indicators;
- Data sources and data collection
Łukasz Mikulec, Expert on Expert on monitoring and indicators (tbc)
-
10.30
Walking Tour in and a get together dinner in Lisbon
-
00.30
Lunch
-
14.00
Monitoring in practice
- Monitoring and IT systems;
- Collection and assessment of data;
- Establishing a clear intervention logic;
- Practical examples of designing the logic of intervention for a chosen specific objective will be discussed
Łukasz Mikulec, Expert on Expert on monitoring and indicators (tbc)
-
15.30
End of the Official Programm Day 1
-
18.00
Walking Tour and a get together dinner
After the completion of the first day of the Autumn Academy we are inviting the participants to a Walking Tour and a networking dinner in a restaurant in Lisbon
Our Guide will be an urban expert
Thursday 26 October 2023
-
09.00
MEETING EACH OTHER
- What are you responsible for in your organisation?
- Do you use monitoring and indicators in your day to day professional activity? But in your day to day life
Laura Bobarnac, Expert on Expert on monitoring and indicators
-
10.00
PART I: WHY do we need monitoring?
- Legal framework of monitoring system in 2021-2027;
- Role of monitoring for Operational Programmes and Projects;
- Stakeholders involved and share of obligations
Laura Bobarnac, Expert on Expert on monitoring and indicators
-
10.30
Coffee Break
Networking
-
11.00
PART II: WHAT shall we monitor and WHAT TOOLS do we need?
- Performance Framework: scope and challenges;
- Activities, Outputs, Results, (perspective for) Impact;
- Selecting the right indicators to measure achievements;
- Baseline and methods of target setting;
- Monitoring and IT systems;
- Collection and assessment of data;
- Q and A
Laura Bobarnac, Expert on Expert on monitoring and indicators
-
12.30
Lunch
-
13.45
PART III: HOW shall we do it? – programming and monitoring in practice - interactive session
- Practical exercise of designing the logic of intervention for a chosen specific objective;
- Practical exercise of selecting and formulating indicators
Laura Bobarnac, Expert on Expert on monitoring and indicators
-
15.30
End of the Official Program Day 2
Friday 27 October 2023
-
09.00
Part I: WHAT shall we evaluate?
- What do we evaluate: what is the relevant scope of the evaluation?
- How to think about “interventions” via theories of change and action?
Benedict Wauters, Director of European Programmes
-
10.00
Interactive session
- What interventions are you currently monitoring / evaluating? At what level?
- Is there a theory of change / action?
- Can you construct it?
- What would be your main evaluation question?
Benedict Wauters, Director of European Programmes
-
10.30
Coffee Break
Coffee Break and Networking
-
10.45
Part II: WHY shall we evaluate?
- Purpose of an evaluation
- Evaluation criteria
- Relation of purpose and criteria to the stages of an intervention
- Evaluation questions
- Relation of evaluation questions to criteria
Benedict Wauters, Director of European Programmes
-
12.00
Lunch
-
13.00
Part III: HOW shall we evaluate?
- Three overall evaluation approaches: merit, enlightenment, development
- Scientific versus ad hoc evaluation strategies: which research strategies to choose (selection framework) and refining evaluation questions accordingly
- The role of an evaluability assessment
- Ad hoc approaches (incl. Most Significant Change, Concept Mapping,…)
Benedict Wauters, Director of European Programmes
-
14.00
Coffee Break
-
14.15
Part III: HOW shall we evaluate?
- Scientific strategies:
- Quasi-experiments (incl. RCT’s, PSM, RDD,…)
- Surveys
- Case studies (incl. realist evaluations, QCA, process tracing, …)
Benedict Wauters, Director of European Programmes
-
15.45
Interactive session: assess a terms of reference
A sample ToR will be provided but you may also use your own
Benedict Wauters, Director of European Programmes
-
16.15
Creating your evaluation plan
- Generating criteria for prioritising evaluations
- How to deal with the requirement to evaluate all priorities in a programme for impact?
Benedict Wauters, Director of European Programmes
-
16.30
End of the Workshop and Distribution of Certificates
-
-
Experts
-
ProfileBenedict Wauters
Expert on organisational development and on the formulation, implementation, and evaluation of strategies, policies, programmes, and projects
-
ProfileJosé Eduardo Baptista
Event Manager
-
ProfileŁukasz Mikulec
Expert on monitoring and indicators
-
ProfileLaura Bobarnac
Expert in programming and monitoring the implementation of EU funds
-
-
Venue
4* Hotel in Lisbon
Hotel Açores Lisboa
Av. Columbano Bordalo Pinheiro 3, 1070-060 Lisboa, Portugal
https://www.bensaude.pt/hotelacoreslisboa/en/
Next to the training materials the training fee is covering:
a) the Catering during the training (Coffee Breaks and a Lunch every day);
b) the Walking Tour in Lisbon in the evening of the First Day of the Training;