Closing the loop: assisting archival appraisal and information retrieval in one sweep

In this article, we examine the similarities between the concept of appraisal, a process that takes place within the archives, and the concept of relevance judgement, a process fundamental to the evaluation of information retrieval systems. More specifically, we revisit selection criteria proposed as result of archival research, and work within the digital curation communities, and, compare them to relevance criteria as discussed within information retrieval's literature based discovery. We illustrate how closely these criteria relate to each other and discuss how understanding the relationships between the these disciplines could form a basis for proposing automated selection for archival processes and initiating multi-objective learning with respect to information retrieval

Responsible research and innovation in science education: insights from evaluating the impact of using digital media and arts-based methods on RRI values

The European Commission policy approach of Responsible Research and Innovation (RRI) is gaining momentum in European research planning and development as a strategy to align scientific and technological progress with socially desirable and acceptable ends. One of the RRI agendas is science education, aiming to foster future generations' acquisition of skills and values needed to engage in society responsibly. To this end, it is argued that RRI-based science education can benefit from more interdisciplinary methods such as those based on arts and digital technologies. However, the evidence existing on the impact of science education activities using digital media and arts-based methods on RRI values remains underexplored. This article comparatively reviews previous evidence on the evaluation of these activities, from primary to higher education, to examine whether and how RRI-related learning outcomes are evaluated and how these activities impact on students' learning. Forty academic publications were selected and its content analysed according to five RRI values: creative and critical thinking, engagement, inclusiveness, gender equality and integration of ethical issues. When evaluating the impact of digital and arts-based methods in science education activities, creative and critical thinking, engagement and partly inclusiveness are the RRI values mainly addressed. In contrast, gender equality and ethics integration are neglected. Digital-based methods seem to be more focused on students' questioning and inquiry skills, whereas those using arts often examine imagination, curiosity and autonomy. Differences in the evaluation focus between studies on digital media and those on arts partly explain differences in their impact on RRI values, but also result in non-documented outcomes and undermine their potential. Further developments in interdisciplinary approaches to science education following the RRI policy agenda should reinforce the design of the activities as well as procedural aspects of the evaluation research

A Guide to Measuring Advocacy and Policy

The overall purpose of this guide is twofold. To help grantmakers think about and talk about measurement of advocacy and policy, this guide puts forth a framework for naming outcomes associated with advocacy and policy work as well as directions for evaluation design. The framework is intended to provide a common way to identify and talk about outcomes, providing philanthropic and non-profit audiences an opportunity to react to, refine and adopt the outcome categories presented. In addition, grantmakers can consider some key directions for evaluation design that include a broad range of methodologies, intensities, audiences, timeframes and purposes. Included in the guide are a tool to measure improved policies, a tool to measure a strengthened base of public support, and a survey to measure community members' perceptions about the prioritization of issues

Transitioning urban water systems

Water managers acknowledge on a global scale that current practices are no longer sustainable and have an adverse impact on ecology (disruptions to the water cycle and habitats), public health (water qualities, sanitation services) and the economy (flooding, drought and overuse of resources). The idea of applying transitioning approaches stems from growing recognition that changes in water management are urgently needed. The SWITCH transitioning approach was developed by consolidating the project’s existing stakeholder engagement approach with ideas on transition knowledge, an emerging new field of science

Agricultural Production and Externalities Simulator (APES) prototype to be used in Prototype 1 of SEAMLESS-IF

Production Economics,

Transfer as a reciprocal process: How to foster receptivity to results of transdisciplinary research

Transdisciplinary research (TDR) seeks to address real-world problems and aims to be socially transformative. This normative objective extends beyond particular TDR projects, as real-world problems are embedded in concrete contexts but, at the same time, are also related to wider societal challenges that are not restricted to one context. Therefore, TDR generally entails transfer of knowledge and results to other contexts. However, the TDR discourse has mainly treated transfer efforts from the perspective of scientific generalization, translation and packaging of knowledge. Within this understanding of transfer, little attention has been paid to interplay between contexts and the role of new contexts themselves. This article is based on qualitative explorative research on four TDR projects. Its results were iteratively derived through project analysis, reflection on insights from the literature and discussions with TDR experts. We propose that transfer is a complex reciprocal process in which different types of knowledge are provided and transferred to other contexts, where knowledge is adapted, enriched and modified. In addition to project researchers, actors in other (pick-up) contexts also play an important role for successful transfer and appropriation of TDR results. Generating transfer potential within the duration of a project depends on being aware of potential pick-up contexts. To address the interdependent aspects of transfer (results, mediation, and appropriation in other contexts), we present a comprehensive model outlining TDR transfer processes. To support projects seeking to raise their transfer potential in a more conscious manner, we also formulate three overarching recommendations: 1) process results for transfer adequately, 2) identify and support intermediaries and, 3) increase awareness of and address other contexts. Considering these recommendations while also being aware of their interdependence may increase potential for transfer of knowledge and results to other contexts. Our conceptual understanding acknowledges the complexity and non-linearity of endeavors to take advantage of case-specifically gained knowledge and results in other contexts or at other scales

The Australian Research Quality Framework: A live experiment in capturing the social, economic, environmental, and cultural returns of publicly funded research

Copyright @ 2008 Wiley Periodicals Inc. This is the accepted version of the following article: Donovan, C. (2008), The Australian Research Quality Framework: A live experiment in capturing the social, economic, environmental, and cultural returns of publicly funded research. New Directions for Evaluation, 2008: 47–60, which has been published in final form at http://onlinelibrary.wiley.com/doi/10.1002/ev.260/abstract.The author regards development of Australia's ill-fated Research Quality Framework (RQF) as a “live experiment” in determining the most appropriate approach to evaluating the extra-academic returns, or “impact,” of a nation's publicly funded research. The RQF was at the forefront of an international movement toward richer qualitative, contextual approaches that aimed to gauge the wider economic, social, environmental, and cultural benefits of research. Its construction and implementation sent mixed messages and created confusion about what impact is, and how it is best measured, to the extent that this bold live experiment did not come to fruition

Adaptation of WASH Services Delivery to Climate Change and Other Sources of Risk and Uncertainty

This report urges WASH sector practitioners to take more seriously the threat of climate change and the consequences it could have on their work. By considering climate change within a risk and uncertainty framework, the field can use the multitude of approaches laid out here to adequately protect itself against a range of direct and indirect impacts. Eleven methods and tools for this specific type of risk management are described, including practical advice on how to implement them successfully