Within the EU funded project ORGAP a toolbox for the evaluation of the European as well as national action plans for organic food and farming has been developed (www.orgap.org). This toolbox was based on a comparative analysis of national action plans in eight countries (CH, UK, DE, IT, DK, SI, CZ, NL, ES), a meta-evaluation of existing evaluations of national action plans, workshops with national stakeholders and a European Advisory Committee, interviews with experts. Furthermore synergies and conflicts between national and the European Action Plan were identified

Dabbert, St.

Eichert, Ch.

Gonzalvez, V.

Jeffreys, I.

Lampkin, N.

Michelsen, J.

Schmid, O.

Vairo, D.

Zanoli, R.

English

Organic Eprints

This presentation shall neither be binding nor construed as constituting a commitment by the European CommissionDevelopment of criteria und  Development of criteria und procedures for the evaluation  procedures for the evaluation of the European Action Plan  of the European Action Plan of Organic Food and Farming of Organic Food and FarmingResults from the ORGAP Project Results from the ORGAP Project( (No. CT No. CT- -2005 2005- -006591) 006591)Schmid O. , Lampkin, N. , Jeffreys, I.,  Dabbert, S., Eichert, C., Michelsen, J., Zanoli, R., Vairo, D. , Gonzalvez, V.IFOAM OWC 2008 in Modena, June 18th 2008  Archived at http://orgprints.org/12722/  This presentation shall neither be binding nor construed as constituting a commitment by the European CommissionIntroduction Introductionz The European Commission released in June 2004 the European Action Plan for Organic Food and Farming (EU-OAP)z Hearing 2004on the EU-OAPin Brusselsz In May 2005 the EU funded 3-year research project with the acronym ORGAP started. z In the project 10 partners from 9 countries (CH, UK, DE, IT, DK, SI, CZ, NL, ES) participated, as well as IFOAM EU Regional group. z The overall objective of this project was to give scientific support to the implementation of the EU-OAP by the development of an evaluation toolbox (ORGAPET).This presentation shall neither be binding nor construed as constituting a commitment by the European CommissionWhat What were were the the main main methods methodsand  and results results? ?z Comparison of national organic action plansz Meta-evaluation of evaluations of national organic action plans (DE, NL, UK DK)z ORGAPET development (Website and CD Rom)z Focus group discussions on the national implementation of the EUOAP – synergies and conflicts z Policy analysis of the European Action plan (including potential implementation problems) z Resource manual for development, implementation and evaluation of Organic Action Plansz Recommendations (including Golden Rules)z Project website, newsletter and forumAll reports can be downloaded from the Project website: www.orgap.ch . This presentation shall neither be binding nor construed as constituting a commitment by the European CommissionOverview Overview of national and  of national and regional  regional Organic Organic Action Plans Action PlansGeneral information AND CZ DK DE ENG IT NL SIStart of elaboration 2001 2002 1998 2001 2002 2001 2004 2004Implementation 2002 2004 1999 2001 2002 2005 2005 2005Bottom-up initiative 9 --- 999 -Top-down initiative - 999--- 9Stakeholder participationhigh high high high high high high highAP: evaluation and monitoring included9 - 99 (9)- 99AP has been evaluated  -- 999 - 9 -Targets: OF-area %Target year: --10%201012%200320%2010 -2010--10%201020%20159= yes, (9) = restricted, - = noThis presentation shall neither be binding nor construed as constituting a commitment by the European CommissionOrganic action plans  Organic action plans - - differences differencesz Variation with regard to elaboration process, targets, objectives and emphasis of measures on certain areas – due to national/regional context.z Large set of measures included in most action plans, however different levels and preciseness.z OAPs of Andalusia, Czech Republic, Slovenia and Denmark:  broad portfolio of areas and measures.z Dutch, Italian and English OAPs: main focus at market development and consumer information.z German Federal Organic Farming Scheme:  priority to consumer information/education as well as to the support of applied research for the organic sectorThis presentation shall neither be binding nor construed as constituting a commitment by the European CommissionORGAPET development ORGAPET developmentz A collection of evaluation tools and material (documents, methods, data sheets)z Divided into sections or compartmentsz Overview documents explaining key evaluation principles and issues that need to be addressed, including checklists, z Aimed at action plan administrators and engaged stakeholders z Linked to EU (MEANS, Evalsed, IRENA) and national evaluation frameworksz Annexes provide in-depth examples and information sources to give further background and support expert evaluatorsz Internet and CD-ROM accessibleThis presentation shall neither be binding nor construed as constituting a commitment by the European CommissionORGAPET  ORGAPET – – The The Organic Organic Action Plan  Action Plan Evaluation Toolbox Evaluation Toolbox on CD on CD- -Rom and   Rom and  website website www.orgap/orgapet www.orgap/orgapetThis presentation shall neither be binding nor construed as constituting a commitment by the European CommissionFocus group discussions  Focus group discussions – – perceptions  perceptions regarding the national implementation  regarding the national implementation of EU Organic Action Plan of EU Organic Action Planz Only the focus groups of CZ and SI found the EUOAP important and had positive expectations to it. z DK: EUOAP positive but EUOAP considered insignificant. z In DE, EN and IT: expectations were neutral (or partly negative)and the EUOAP considered insufficient; z In Spain (Andalusia) EUOAP was considered insufficient and expectations negative. z Only two problems appeared in most focus groups: Î the lack of sufficient statistical data as basis for market transparencyÎ and the GMO suggested threshold level in organic produce (commonagreement - threshold should be very low if it was to be allowed at all). z All other issues specific to the national context -implementation problems are specific to each EU member state. This presentation shall neither be binding nor construed as constituting a commitment by the European CommissionFocus group discussions  Focus group discussions – –conclusions regarding national  conclusions regarding national implementation of the EU implementation of the EU- -OAP OAPz Successful implementation in any member state depends strongly on the balance of 3 main factors: the willingness, capability and comprehension of the main actors (in a positive and negative sense);these balances are unique to each member state. z Importance how conflicts between the organic food and non-organic farming sector are handled; e.g. different goals, perceptions and impacts regarding the European Organic Action plans (e.g. new regulation)This presentation shall neither be binding nor construed as constituting a commitment by the European CommissionPotential  Potential implementation implementation problems problemsof EU of EU- -OAP  OAP - - Failure Failure mode  mode method methodCause  Effect Lack of stakeholder involvement  Lack of capacity building  Inadequate information and promotion campaigns Lack of knowledge/awareness on OF  Lack of information  Lack of political interest to support OF  Weak lobbying for OF   No mandatory implementation of AP  Research not developed enough Insufficient importance given to OF  Conventional interests against organic lobby  Lack of financial resources  Different priorities among MS  General implementation problems Different interests between EU and MS Inadequate rules/procedures OF = OF Farming  AP = Action Plan   Resultfromelec-tronicconsult-tationwithca. 30 expertsThis presentation shall neither be binding nor construed as constituting a commitment by the European CommissionDiscussion Discussion:  : the the challenge challenge to  to find  find appropriate appropriate indicators indicatorsz How to develop a core set of appropriate indicators for ORGAPET, which then can be adapted to specific action plan evaluations. ÎProcess/design indicators: scope OAP, stakeholder involvement. etc.ÎResource indicators: Budget, staffing, etc.ÎOutput indicators: action points completed, expenditure, etc.ÎResult indicators: see exampleÎImpact indicators: environment, animal welfare, social, etc.  ÎThe testing showed that major problems are the data availability and limited resources for data collection, which limits the number of indicators.This presentation shall neither be binding nor construed as constituting a commitment by the European CommissionExample: RESULT indicators for  Example: RESULT indicators for EUOAP EUOAPI.   Production (holdings, land area, new entrants, incomes, prices)II. Market (operators, retails sales, consumer trends)III.  Regulation(inspections/infringements, regulator burdens/changes)IV.  Capacity(number and size of support organisations, support levels)This presentation shall neither be binding nor construed as constituting a commitment by the European CommissionSynthesis/interpretation issues  Synthesis/interpretation issues regarding the EU regarding the EU- -OAP OAPz Trend on most indicators since 2004 is positiveÎ But can this be attributed to the action plan?Î As still the EU Organic Action Plan is in implementation phase, most effects may still be to comez Other causal factorsÎ Economic/market conditionsÎ National policy initiativesz Counterfactual analysisÎ what would have happened without the policy?This presentation shall neither be binding nor construed as constituting a commitment by the European CommissionThe Golden Rules for Organic Action Plan development I• Participatory stakeholder involvement –early & with resources, in all stages of OAP• Good communication during entire period• OAP as strategic instrument for achieving policy goals• Clear and operational objectives• Based on a status quo analysis• Review of policy areas related to the OAP and their impact• Actions tailored to the respective problems• Good implementation plan with sufficient financial and human resourcesThis presentation shall neither be binding nor construed as constituting a commitment by the European Commission• Relevant government departments must be involved• Balanced mix of ‘supply-push’ and ‘demand-pull’ policy measures• Countries with short tradition in OAP development need special measures• Monitoring and evaluation included from the outset• Action Plan evaluation = tool for further development of the plan• Successful evaluation with clearly purpose, scope and appropriate standardThe Golden Rules for Organic Action Plan development IIThis presentation shall neither be binding nor construed as constituting a commitment by the European CommissionFor further information:  For further information: www.orgap.org www.orgap.orgz A resource manual forthe organic food and farming sector is available.z This manual includes a CD Rom with ORGAPET –the evaluation toolboxwith checklistsand manybackgrounddocuments.ACKNOWLDEGEMENT FOR THE SUPPORT OF THE EU-COMMISSION FOR FUNDING THIS RESARCHThis presentation shall neither be binding nor construed as constituting a commitment by the European CommissionA: PROCESS/DESIGN indicators for  A: PROCESS/DESIGN indicators for EU Organic Action Plan EU Organic Action Planz Mainly qualitative, document based, linked to checklists:1 Prior policy initiatives2 Occasion/problem leading to policy initiative3 Nature of stakeholders involved in policy decision4 Scope of final planThis presentation shall neither be binding nor construed as constituting a commitment by the European CommissionB: RESOURCE indicators for EUOAP B: RESOURCE indicators for EUOAPz Budgetz Steering groups to involve stakeholdersz Staffingz Institutional changesz Legal basis for action planThis presentation shall neither be binding nor construed as constituting a commitment by the European CommissionC: OUTPUT indicators for EU OAP C: OUTPUT indicators for EU OAPz Action points completed/in progressz Actual expenditure/relation to budgetWith respect to each action point:z Uptake (number of projects/businesses)z Expenditure per project/businessThis presentation shall neither be binding nor construed as constituting a commitment by the European CommissionE: IMPACT indicators for EUOAP E: IMPACT indicators for EUOAPz Environment and resource sustainability(global warming potential, nutrient/energy balances, resource conservation, support, biodiversity)z Animal health and welfare(veterinary derogations, longevity of breeding stock, high welfare holdings, support)z Social (gender, age, occupational health, migrant labour)z Economic/rural  development (employment, labour incomes, risk)z Food security, safety, quality (productivity, residues, safety incidents, quality, self-sufficiency)

Development of criteria und procedures for the evaluation of the European Action Plan of Organic Food and Farming

Development of criteria und procedures for the evaluation of the European Action Plan of Organic Food and Farming

Abstract

Similar works

Full text

Available Versions

Organic Eprints