Utilization-focused evaluation for agricultural innovation

Utilization-focused evaluation (UFE) is based on the principle that an evaluation should be judged by its utility. So no matter how technically sound and methodologically elegant, an evaluation is not truly a good evaluation unless the findings are used. UFE is a framework for enhancing the likelihood that evaluation findings will be used and lessons will be learnt from the evaluation process. This Brief, based on the book Utilization-focused evaluation, introduces this approach to evaluation, outlines key steps in the evaluation process, identifies some of the main benefits of UFE, and provides two examples of UFE in the context of programmes aimed at promoting agricultural innovation

Program Evaluation in the Context of Debates in the Field: The Evaluation of PR-CETP

This paper rationalizes the selection of the concept of energy as the central theme of a new capstone course aimed at science education majors. It describes the goals of the course and the activities that preceded the course design and led to the selection of the topics, of the educational materials, and of the teaching methodologies. It presents a sequential description of the manner in which the conceptual knowledge of energy was to be developed. The specific experiments, interactive demonstrations and other educational materials utilized for the conceptual development of the concept of energy in context are described and referenced. The course objectives are described, as well as the instruments utilized to assess student learning. It also presents the activities utilized to assess the course, in addition to the modifications made to the course syllabus based on this assessment

La distinction entre le processus spécifique de l'évaluation de programme et l'application de son instrumentation : une étude de cas des modèles en évaluation de programme

Maintenant que le Programme de formation de l'école québécoise est implanté depuis plusieurs années au niveau primaire, il fait l'objet d'évaluation. Par contre, le domaine de l'évaluation de programme se fait souvent remettre en question par rapport à sa capacité de produire des recommandations pertinentes. Il existe donc un besoin de recherche fondamentale dans le domaine de l'évaluation de programme. Pour améliorer l'évaluation de programme dans le domaine de l'éducation, il est essentiel d'effectuer de la recherche fondamentale dans le domaine de l'évaluation de programme. Fournier (1995) et Hurteau et Houle (2006) ont effectué des recherches qui visaient la pratique en évaluation de programme. Leurs réflexions portaient sur la distinction entre ce qui constitue la pratique et ce qui a été élaboré pour la soutenir. Par contre, il existe une confusion dans la littérature à ce niveau car cette distinction n'a jamais fait l'objet d'une étude empirique. Notre recherche s'inscrit dans cette perspective afin d'établir un cadre de référence pertinent et d'examiner si le processus propre à l'évaluation de programme diffère de l'application de son instrumentation. Nous avons analysé des réponses à un scénario simulé. Ces réponses représentent trois orientations théoriques: méthodes, jugement de valeur et utilisation. Même si ces orientations ne sont pas nécessairement des catégories mutuellement exclusives, chacune s'attarde à une perspective distincte. L'orientation théorique associée aux méthodes utilise une approche expérimentale ou quasi-expérimentale où la rigueur est fondamentale. L'orientation du jugement de valeur souligne l'importance de porter un jugement sur la valeur du programme évalué afin d'offrir l'information nécessaire à une prise de décision. L'orientation théorique de l'utilisation s'attarde à l'utilisation des résultats de l'évaluation afin d'obtenir un changement au niveau organisationnel. Des grilles d'analyse sont utilisées pour identifier les éléments du processus de l'évaluation de programme et une analyse croisée des données quantitatives démontre le taux de présence de chaque élément dans chaque orientation théorique. Ces données sont ensuite appliquées à une analyse de contenue et font l'objet d'une analyse qualitative. Les composantes de l'instrumentation sont aussi appliquées à chaque orientation théorique. Les standards de pratique provenant du Joint Committee servent de cadre de référence pour identifier les variances et les choix méthodologiques sont étudiés à partir de critères prédéterminés. Les résultats démontrent qu'à un niveau global les trois orientations théoriques ont présenté les éléments du processus de l'évaluation de programme. Par contre, des différences ont été identifiées dans l'orientation de l'utilisation. C'est à souhaiter que la présente recherche éclaire notre sujet en stimulant la discussion et de futures études

Value-Added Model (VAM) Component of Teacher Evaluation and Job Satisfaction, Efficacy, and Retention: Perspectives of Secondary Teachers of Historically Low-Scoring Students and Recommendations for Alternative Student Performance Measurements

This qualitative study aimed to research the perspectives of four teachers who teach low-scoring populations of students traditionally. The research questions focused on job satisfaction, self-efficacy, and retention in education about Value-Added Model scores in their evaluations. The secondary purpose was for the teachers to recommend authentic assessment of student growth which is weighted 33% of teacher evaluations. I conducted a series of three open-ended interviews with each of the four participants. The interviews were designed to allow rich data to be collected. The significant findings have been discovered using the constant comparative method. The analysis revealed that the teacher’s perceptions of VAM scores were not in their control, nor did the teachers understand how the score is calculated; however, it was a stress point in the teaching environment. The recommendations for alternative measurement of student achievement had a common thread of a baseline assessment and a learning gain assessment of the students the teachers directly taught. The emerging themes concluded that the evaluating administrator had more impact on job satisfaction and self-efficacy than VAM scores. The research questions drove the study, and the analysis discovered trends and emerging themes

Research on Education in Developing Countries: an inventory of Dutch projects and programmes

SUMMARY The article surveys current Dutch research in the field, classifying it by theme, source of finance, and type of collaboration involved. Comment is then made on some of the concrete problems of research procedure. RESUMEN Investigación educacional en países en desarrollo: un inventarlo de los proyectos y programas holandeses El articulo analiza la investigación holandesa actual, clasificándola por tema, fuente financiera y tipo de colaboración involucrada. A continuación se hacen comentarios sobre los problemas concretos del procedimiento de investigación. SOMMAIRE Recherche sur l'éducation dans les pays en voie de développement: un inventaire des projets et des programmes hollandais L'article présente les recherches hollandaises dans ce domaine, en les classant par thème, source de financement et mode de collaboration pratiqué. Suit un commentaire concernant les problèmes concrets dans la procédure de recherche

Summary Report: National Evaluation of Learn and Serve America

In 1993, the Nalional and Community Service Trust Act (PL. 103-82) established the Learn and Serve America School and Community-Based Programs to support school and Community-Based efforts to involve school-aged youth in community service. The Learn and Serve program is administered by the Corporation for National Service and funded through grants to states and national organizations, and through them to individual school districts, schools, and community organizations. In 1994-95, the first year of the program, the Corporation awarded approximately $30 million in grants supporting over 2,000 local efforts involving over 750,000 school-aged youth

The makings of meanings: the evaluation of an employment programme for drug-using offenders

This thesis is based on a case study of the evaluation of an employment programme for drug-using offenders. Initially, my involvement was that of a studentship-funded research assistant, undertaking the associated duties and expectations of that role and working to an already agreed evaluation design. This design can be broadly categorised as quantitative, longitudinal, and summative. Subsequently, my role evolved, as did the evaluation methodology itself, becoming underpinned by Patton's notion of Utilisation Focus', and infused by the, what was initially unarticulated, constructivist hesitation I brought to the endeavour. The findings from the evaluation, which relate to direct Project outputs, staff and service user satisfaction, and service user motivation to participate in the evaluation, are presented. Primary intended user' response to these, as well as the evaluation itself, are gauged from interviews undertaken after a reading of the evaluation final report. I then consider what this case study of one evaluation might tell us about the art of evaluation itself. What might be the lessons for valuation which could be useful for others

The Effect That Project Management Certification Has on Employability: Agent's Perceptions from Spain

This study analyses the effects that the project management certification has on employability. This analysis started with a participative process in which various groups of experts who are involved in the certification of people were consulted. A personal interview was carried out amongst 106 professionals —certifying bodies, training institutions, the civil service, and international organisations— and amongst professional who are certified in project management by the International Project Management Association in Spain. The results show that the certification emerges as a powerful tool for improving employability. The effects are demonstrated across two complementary aspects: internal company aspects and external aspects relating to the labour market. Finally, by compiling the different agents’ opinions, a series of measures emerge for improving the accreditation processes as an employability tool and increasing the mutual learning between public and private actors