Evaluation of the NLP Components of the OVIS2 Spoken Dialogue System

The NWO Priority Programme Language and Speech Technology is a 5-year research programme aiming at the development of spoken language information systems. In the Programme, two alternative natural language processing (NLP) modules are developed in parallel: a grammar-based (conventional, rule-based) module and a data-oriented (memory-based, stochastic, DOP) module. In order to compare the NLP modules, a formal evaluation has been carried out three years after the start of the Programme. This paper describes the evaluation procedure and the evaluation results. The grammar-based component performs much better than the data-oriented one in this comparison.Comment: Proceedings of CLIN 9

Defining the gap between research and practice in public relations programme evaluation - towards a new research agenda

The current situation in public relations programme evaluation is neatly summarized by McCoy who commented that 'probably the most common buzzwords in public relations in the last ten years have been evaluation and accountability' (McCoy 2005, 3). This paper examines the academic and practitioner-based literature and research on programme evaluation and it detects different priorities and approaches that may partly explain why the debate on acceptable and agreed evaluation methods continues. It analyses those differences and proposes a research agenda to bridge the gap and move the debate forward

Silver Dreams Fund Learning and Evaluation Contract: Final report June 2014

This is a summary of the Final Report which presents the findings of the evaluation of the Big Lottery Fund's Silver Dreams Fund conducted by Ecorys.The Silver Dreams Fund was a £10 million programme which sought to address the gaps in provision by challenging organisations to come up with an innovative idea for a project that would "pioneer ways to help vulnerable older people deal more effectively with life-changing events".Our approach involved both formative and summative elements and was based upon a robust and evidence-based outcome evaluation framework. In addition, we have also undertaken an evaluation of the new programme management processes employed by the Big Lottery Fund which has been reported separately.In summary, the evaluation involved:- development of an evaluation framework and common indicators to measure outcomes;- provision of a package of self-evaluation support to projects;- programme level work to provide independent primary qualitative research and to validate findings from self-evaluations;- a range of learning activities; and- analysis and reporting

A follow-up evaluation of the business growth through skills development and knowledge transfer project

Builds on earlier (2008) evaluation of the Business Growth through Skills Development and Knowledge Transfer Programme, delivered through the New Technology Institute (NTI) in the East Midlands. This evaluation focuses on the programme's third and final phase from April 2009 to March 2010. The programme targeted Small and Medium Sized Enterprises (SMEs) and Higher Education Institutions (HEIs). Evaluation largely based on stakeholder and beneficiary surveys to ascertain Strategic Added Value (SAV)

Baseline report on the evaluation of Familias en Acción

This report describes the survey that was carried out in 122 communities in rural Colombia by the consortium formed by the Institute for Fiscal Studies, Econometria and SEI as the baseline for the impact evaluation of Familias en Acción, a programme to foster the accumulation of human capital in rural Colombia, run by the Colombian government. In this report, we will not describe in detail the programme or the methodology of the proposed evaluation, as this was done in IFS-Econometria-SEI (2003a). The main aim of the document is to discuss the first, baseline survey that was collected for this evaluation. While the baseline survey cannot, by definition, be used to perform impact evaluation, towards the end of the report we exploit the slightly peculiar way in which the programme was started and have a first very preliminary glance at some of the impacts that the programme might have. The methodological caveats on interpreting these results should be taken very seriously. This report does not contain an extensive ‘fieldwork’ report. This is included in SEI (2003). Analogously, we do not discuss extensively the operation of the programme and the evidence that emerged on related issues and on targeting. These issues are covered in IFS-Econometria- SEI (2003b, 2003c). We will be referring to some of the issues raised in those reports, however. This report is divided into five chapters. In Chapter 1, we briefly summarise the main features of the programme and its proposed evaluation. A more detailed description of both of these aspects is contained in IFS-Econometria-SEI (2003a). Here, however, we give some details on the expansion of the programme and on the features of this expansion that allow a first and preliminary analysis of the impact of the programme. In Chapter 2, we describe the statistical methodology that will be used in the report. This includes the methodology for the data description that constitutes the largest part of the report and for the preliminary impact evaluation. Chapter 3 describes the baseline survey. This chapter is divided into several sections, each referring to a particular module. In each section, we first describe the ‘treatment’ population – that is, the households eligible for the programme that were living in villages targeted by the programme. We then move on to the population living in ‘control’ villages – that is, in villages that were not targeted by the programme and yet are, nonetheless, reasonably similar to the treatment villages. Chapter 4 presents the preliminary impact evaluation

The development and evaluation of effective reading programmes : a thesis presented in partial fulfilment of the requirements for the degree of Master of Business Studies at Massey University

Theoretical constructs of reading and learner-controlled instruction were used to develop an Effective Reading Programme. Based on these concepts, instrument and non-instrument based techniques were applied to achieve its objectives. Evaluation of the Effective Reading Programme was conducted through an Evaluation model, comprised of Theoretical Constructs, Programme Design and Programme Results. The six stages of its development were individually described and evaluated, moving from courses conducted in South Africa, to those conducted in New Zealand. The conclusion at the end of its developmental stages, was a professional programme, which offered a guarantee within its results. Implications and recommendations were made for areas of further investigation

An evaluation of Te Rau Puawai workforce 100: Te Rau Puawai support team and staff perspectives

To evaluate the Te Rau Puawai programme, the Ministry of Health commissioned the Maori and Psychology Research Unit of the University of Waikato in July 2001. The overall aim of the evaluation was to provide the Ministry with a clearer understanding of the programme including: the perceived critical success factors, the barriers if any regarding Te Rau Puawai, the impact of the programme, the extent to which the programme may be transferable, gaps in the programme, and suggested improvements. The Te Rau Puawai support team were identified as an important source of support for bursars particularly the support provided by the coordinator and administrator. This report documents the perspectives of four members of the telephone support team (including the coordinator), and individual interviews held with the coordinator and the administrator in addressing the objectives of the evaluation

A qualitative evaluation of the Western Cheshire Community Weight Management Programme - Step by Step Healthy Weight and Lifestyle Programme - Interim Report

This report is an interim report for the evaluation of a community weight management programme, Step by Step. Western Cheshire PCT commissioned the University of Chester to evaluate the programme. The overall aim of the evaluation was to reveal the elements of the service that are most likely to increase the effectiveness and efficiency of the programme.Western Cheshire PC