133 research outputs found

    Evaluating the achievements and impacts of EC framework programme transport projects

    Get PDF
    Purpose The purpose of this paper is to present what kind of elements and evaluation methods should be included into a framework for evaluating the achievements and impacts of transport projects supported in EC Framework Programmes (FP). Further, the paper discusses the possibilities of such an evaluation framework in producing recommendations regarding future transport research and policy objectives as well as mutual learning for the basis of strategic long term planning. Methods The paper describes the two-dimensional evaluation methodology developed in the course of the FP7 METRONOME project. The dimensions are: (1) achievement of project objectives and targets in different levels and (2) research project impacts according to four impact groups. The methodology uses four complementary approaches in evaluation, namely evaluation matrices, coordinator questionnaires, lead user interviews and workshops. Results Based on the methodology testing, with a sample of FP5 and FP6 projects, the main results relating to the rationale, implementation and achievements of FP projects is presented. In general, achievement of objectives in both FPs was good. Strongest impacts were identified within the impact group of management and co-ordination. Also scientific and end-user impacts of the projects were adequate, but wider societal impacts quite modest. The paper concludes with a discussion both on the theoretical and practical implications of the proposed methodology and by presenting some relevant future research needs

    Not All Managers Are Managerial: A Self-Evaluation of Women Middle-Managers' Experiences in a UK University

    Get PDF
    The focus of this small-scale self-evaluation is the implementation of a new middle-management role in a post-92 UK university. A realist appreciative inquiry was undertaken with five women who had been promoted to a middle-management role 18 months prior to the inquiry. This evaluation for knowledge offered an opportunity to reflect on experiences in practice and sought to understand the experiences of the women in this role and how they cope with the challenges middle-management brings. Particular challenges (instability-generating) accorded with existing literature and included: lack of role clarity, lack of pre-preparation for management role, colleagues’ views of management, including perceptions of women in management roles and malicious intent of managed academics in rare cases. Supportive factors (provisional-stability-generating) included: personal resilience, informal peer support, external support and reflection. The co-evaluators offered reflections for the future from this co-evaluation. These suggest that training may contribute to provisional-stability in role and should be considered for new entrants to middle-management. The alternative construct of humanistic management is proposed as a way of understanding these women’s values-based decision-making practices in complex situations

    Evaluation for what purpose? Findings from two stakeholder groups

    Get PDF
    A host of reasons exist for the pursuit of evidence in the public sector, including to support good governance and policy development. As the expectations for program evaluation from policymakers have evolved, so too has evaluation practice and a great deal of experimentalism has ensued. There is a risk that these developments and the complexity inherent in them, may lead to conflicting expectations about why program evaluation is done, or even a loss of purpose. This prompts the meso-level analysis of two types of stakeholders in a governance network, explored in this chapter. This chapter presents the findings of an ongoing study which explores the perceptions of program evaluators and policy implementers towards the purpose of evidence. The findings suggest that program evaluators and policy implementers have divergent expectations of why and how evaluation data might be used. The findings suggest that program evaluators aspire to support change and enhance the policy domains they serve, whereas policy implementers perceive program evaluation as serving a more governance-/management-orientated role. The chapter demonstrates the complexity of both program evaluation and policy and may have implications for the twin pillars of governance and responsibility at the heart of the book. If governance and responsibility are the twin pillars of sustainability then the complex networks of relationships, expectations, values, and outcomes may need to be considered. The findings also have implications for evaluation commissioners and practitioners, demonstrating the need for the purpose and expectations of program evaluation to be agreed early. The use of program evaluation as a symbolic, aesthetic or structural mechanism also emerges, prompting opportunity for further research, for instance, to explore legitimacy and program evaluation.N/

    Quality versus Excellence: Introductory Remarks

    No full text

    Cross-national perspectives on the policy uses (and abuses) of evaluation

    No full text
    • …
    corecore