On the Shapley value and its application to the Italian VQR research assessment exercise

Research assessment exercises have now become common evaluation tools in a number of countries. These exercises have the goal of guiding merit-based public funds allocation, stimulating improvement of research productivity through competition and assessing the impact of adopted research support policies. One case in point is Italy's most recent research assessment effort, VQR 2011–2014 (Research Quality Evaluation), which, in addition to research institutions, also evaluated university departments, and individuals in some cases (i.e., recently hired research staff and members of PhD committees). However, the way an institution's score was divided, according to VQR rules, between its constituent departments or its staff members does not enjoy many desirable properties well known from coalitional game theory (e.g., budget balance, fairness, marginality). We propose, instead, an alternative score division rule that is based on the notion of Shapley value, a well known solution concept in coalitional game theory, which enjoys the desirable properties mentioned above. For a significant test case (namely, Sapienza University of Rome, the largest university in Italy), we present a detailed comparison of the scores obtained, for substructures and individuals, by applying the official VQR rules, with those resulting from Shapley value computations. We show that there are significant differences in the resulting scores, making room for improvements in the allocation rules used in research assessment exercises

Applied Evaluative Informetrics: Part 1

This manuscript is a preprint version of Part 1 (General Introduction and Synopsis) of the book Applied Evaluative Informetrics, to be published by Springer in the summer of 2017. This book presents an introduction to the field of applied evaluative informetrics, and is written for interested scholars and students from all domains of science and scholarship. It sketches the field's history, recent achievements, and its potential and limits. It explains the notion of multi-dimensional research performance, and discusses the pros and cons of 28 citation-, patent-, reputation- and altmetrics-based indicators. In addition, it presents quantitative research assessment as an evaluation science, and focuses on the role of extra-informetric factors in the development of indicators, and on the policy context of their application. It also discusses the way forward, both for users and for developers of informetric tools.Comment: The posted version is a preprint (author copy) of Part 1 (General Introduction and Synopsis) of a book entitled Applied Evaluative Bibliometrics, to be published by Springer in the summer of 201

Effect of a science communication event on students’ attitudes towards science and technology

Peer ReviewedPostprint (author's final draft

Towards Principled Responsible Research and Innovation: Employing the Difference Principle in Funding Decisions

Responsible Research and Innovation (RRI) has emerged as a science policy framework that attempts to import broad social values into technological innovation processes whilst supporting institutional decision-making under conditions of uncertainty and ambiguity. When looking at RRI from a ‘principled’ perspective, we consider responsibility and justice to be important cornerstones of the framework. The main aim of this article is to suggest a method of realising these principles through the application of a limited Rawlsian Difference Principle in the distribution of public funds for research and innovation. There are reasons why the world's combined innovative capacity has spewed forth iPhones and space shuttles but not yet managed to produce clean energy or universal access to clean water. (Stilgoe 2013, xii) I derive great optimism from empathy's evolutionary antiquity. It makes it a robust trait that will develop in virtually every human being so that society can count on it and try to foster and grow it. It is a human universal. (de Waal 2009, 209) Responsible Research and Innovation (RRI) has emerged as a science policy framework that attempts to import broad social values into technological innovation processes whilst supporting institutional decision-making under conditions of uncertainty and ambiguity. In this respect, RRI re-focuses technological governance from standard debates on risks to discussions about the ethical stewardship of innovation. This is a radical step in Science & Technology (S&T) policy as it lifts the non-quantifiable concept of values into the driving seat of decision-making. The focus of innovation then goes beyond product considerations to include the processes and – importantly – the purposes of innovation (Owen et al. 2013, 34). Shared public values are seen as the cornerstone of the new RRI framework, while market mechanisms and risk-based regulations are of a secondary order. What are the values that could drive RRI? There are different approaches to the identification of public values. They can be located in democratically agreed processes and commitments (such as European Union treaties and policy statements) or they can be developed organically via public engagement processes. Both approaches have advantages and disadvantages. For instance, although constitutional values can be regarded as democratically legitimate, their application to specific technological fields can be difficult or ambiguous (Schroeder and Rerimassie 2015). On the other hand, public engagement can accurately reflect stakeholder values but is not necessarily free from bias and lobbyist agenda setting. We argue that if RRI is to be more successful in resolving policy dilemmas arising from poorly described and uncertain technological impacts, basic universal principles need to be evoked and applied. When looking at RRI from a ‘principled’ perspective, we consider responsibility and justice to be important cornerstones of the framework. One could describe them in the following manner: Research and innovation should be conducted responsibly. Publicly funded research and innovation should be focused fairly on socially beneficial targets. Research and innovation should promote and not hinder social justice. The main aim of this article is to suggest a method of realising these principles through the application of a limited Rawlsian Difference Principle in the distribution of public funds for research and innovation. This paper is in three parts. The first part discusses the above principles and introduces the Rawlsian Difference Principle. The second part identifies how RRI is currently applied by public funding bodies. The third part discusses the operationalisation of the Rawlsian Difference Principle in responsible funding decisions

EU Ecolabel for food and feed products – feasibility study

The environmental impacts of the production and processing of food, feed and drinks make up between 20% and 30% of the total environmental impacts of consumable goods in the EU. In the case of eutrophication (the accumulation of nutrients in water causing a reduction in oxygen availability) they account for as much as 58% of the total impacts. The EU Ecolabel is a voluntary scheme that forms part of overall EU policy to encourage more sustainable consumption and production. To date, the EU Ecolabel scheme has developed criteria for products in the non-food sector. The Regulation that governs the scheme (66/2010) aims to extend the EU Ecolabel into new product categories including food. However, the Regulation stipulates that before extending to the food sector, a feasibility study should be undertaken