Higher education reform: getting the incentives right

This study is a joint effort by the Netherlands Bureau for Economic Policy Analysis (CPB) and the Center for Higher Education Policy Studies. It analyses a number of `best practices¿ where the design of financial incentives working on the system level of higher education is concerned. In Chapter 1, an overview of some of the characteristics of the Dutch higher education sector is presented. Chapter 2 is a refresher on the economics of higher education. Chapter 3 is about the Australian Higher Education Contribution Scheme (HECS). Chapter 4 is about tuition fees and admission policies in US universities. Chapter 5 looks at the funding of Danish universities through the so-called taximeter-model, that links funding to student performance. Chapter 6 deals with research funding in the UK university system, where research assessments exercises underlie the funding decisions. In Chapter 7 we study the impact of university-industry ties on academic research by examining the US policies on increasing knowledge transfer between universities and the private sector. Finally, Chapter 8 presents food for thought for Dutch policymakers: what lessons can be learned from our international comparison

Citation gaming induced by bibliometric evaluation: a country-level comparative analysis

It is several years since national research evaluation systems around the globe started making use of quantitative indicators to measure the performance of researchers. Nevertheless, the effects on these systems on the behavior of the evaluated researchers are still largely unknown. We attempt to shed light on this topic by investigating how Italian researchers reacted to the introduction in 2011 of national regulations in which key passages of professional careers are governed by bibliometric indicators. A new inwardness measure, able to gauge the degree of scientific self-referentiality of a country, is defined as the proportion of citations coming from the country itself compared to the total number of citations gathered by the country. Compared to the trends of the other G10 countries in the period 2000-2016, Italy's inwardness shows a net increase after the introduction of the new evaluation rules. Indeed, globally and also for a large majority of the research fields, Italy became the European country with the highest inwardness. Possible explanations are proposed and discussed, concluding that the observed trends are strongly suggestive of a generalized strategic use of citations, both in the form of author self-citations and of citation clubs. We argue that the Italian case offers crucial insights on the constitutive effects of evaluation systems. As such, it could become a paradigmatic case in the debate about the use of indicators in science-policy contexts

Determinants of Renewable Energy Innovation: Environmental Policies vs. Market Regulation

This paper carries out a comprehensive analysis of renewable energy innovations considering four mechanisms suggested by innovation models: 1. policy-inducement; 2. market structure; 3. demand and social cohesion- mainly proxied by income inequality; 4. characteristics of country knowledge base. For OECD countries and years 1970-2005, we build a unique dataset containing time-varying information on quality-adjusted patent production in renewable energy, the latter being a function of environmental policies, green R&D, entry barriers, knowledge stock, knowledge diversity and income inequality. We develop count data models using the Generalized Method of Moments (GMM) to account for endogeneity of policy support. Our synthetic policy index positively affects innovations especially in countries with deregulated energy markets and low entry barriers. The effect of entry barriers and inequality is negative and of similar magnitude as that of policy. Product market liberalization positively affects green patent generation, especially so when ambitious policies are adopted, when the initial level of public R&D expenditures and when the initial share of distributed energy generation is high. Our results are robust to alternative specifications, to the inclusion of technology-specific effects and to the use of quality-adjusted patents as dependent variables. In the latter case, the estimated effect of lowering entry barriers and of knowledge diversity almost double on citation count relatively to patent count.renewable energy technology; patent; environmental policies; product market regulation; inequality

Determinants of Renewable Energy Innovation: environmental policies vs. market regulation

This paper carries out a comprehensive analysis of renewable energy innovations considering four mechanisms suggested by innovation models: 1. policy-inducement; 2. market structure; 3. demand and social cohesion- mainly proxied by income inequality; 4. characteristics of country knowledge base. For OECD countries and years 1970-2005, we build a unique dataset containing time-varying information on quality-adjusted patent production in renewable energy, the latter being a function of environmental policies, green R&D, entry barriers, knowledge stock, knowledge diversity and income inequality. We develop count data models using the Generalized Method of Moments (GMM) to account for endogeneity of policy support. Our synthetic policy index positively affects innovations especially in countries with deregulated energy markets and low entry barriers. The effect of entry barriers and inequality is negative and of similar magnitude as that of policy. Product market liberalization positively affects green patent generation, especially so when ambitious policies are adopted, when the initial level of public R&D expenditures and when the initial share of distributed energy generation is high. Our results are robust to alternative specifications, to the inclusion of technology-specific effects and to the use of quality-adjusted patents as dependent variables. In the latter case, the estimated effect of lowering entry barriers and of knowledge diversity almost double on citation count relatively to patent count.renewable energy technology, patent, environmental policies, product market regulation, inequality

Wage Dispersion and Firm Productivity in Different Working Environments

This paper investigates the impact of wage dispersion on firm productivity in different working environments. More precisely, it examines the interaction with: i) the skills of the workforce, using a more appropriate indicator than the standard distinction between white- and blue collar workers, and ii) the uncertainty of the firm economic environment, which has, to our knowledge, never been explored on an empirical basis. Using detailed LEED for Belgium, we find a hump-shaped relationship between (conditional) wage dispersion and firm productivity. This result suggests that up to (beyond) a certain level of wage dispersion, the incentive effects of “tournaments” dominate (are dominated by) “fairness” considerations. Findings also show that the intensity of the relationship is stronger for highly skilled workers and in more stable environments. This might be explained by the fact that monitoring costs and production-effort elasticity are greater for highly skilled workers and that in the presence of high uncertainty workers have less control over their effort-output relation and associate higher uncertainty with more unfair environments.linked employer-employee data, personnel economics, working environments, labour productivity, wage dispersion

Measuring the capability to raise revenue process and output dimensions and their application to the Zambia revenue authority

The worldwide diffusion of the good governance agenda and new public management has triggered a renewed focus on state capability and, more specifically, on the capability to raise revenue in developing countries. However, the analytical tools for a comprehensive understanding of the capability to raise revenue remain underdeveloped. This article aims at filling this gap and presents a model consisting of the three process dimensions ‘information collection and processing’, ‘merit orientation’ and ‘administrative accountability’. ‘Revenue performance’ constitutes the fourth capability dimension which assesses tax administration’s output. This model is applied to the case of the Zambia Revenue Authority. The dimensions prove to be valuable not only for assessing the how much but also the how of collecting taxes. They can be a useful tool for future comparative analyses of tax administrations’ capabilities in developing countries.Die weltweite Verbreitung der Good-Governance- und New-Public-Management-Konzepte hat zu einer zunehmenden Konzentration auf staatliche Leistungsfähigkeit und, im Besonderen, auf die Leistungsfähigkeit der Steuererhebung in Entwicklungsländern geführt. Allerdings bleiben die analytischen Werkzeuge für ein umfassendes Verständnis von Leistungsfähigkeit unterentwickelt. Dieser Artikel stellt hierfür ein Modell vor, das die drei Prozess-Dimensionen „Sammeln und Verarbeiten von Informationen“, „Leistungsorientierung der Mitarbeiter“ und „Verantwortlichkeit der Verwaltung“ beinhaltet. „Einnahmeperformanz“ ist die vierte Dimension und erfasst den Output der Steuerverwaltung. Das mehrdimensionale Modell wird für die Analyse der Leistungsfähigkeit der Steuerbehörde Zambias (Zambia Revenue Authority) genutzt. Es erweist sich nicht nur für die Untersuchung des Wieviel, sondern auch des Wie des Erhebens von Steuern als wertvoll. Die vier Dimensionen können in Zukunft zur umfassenden und vergleichenden Analyse der Leistungsfähigkeit verschiedener Steuerverwaltungen in Entwicklungsländern genutzt werden

The metric tide: report of the independent review of the role of metrics in research assessment and management

This report presents the findings and recommendations of the Independent Review of the Role of Metrics in Research Assessment and Management. The review was chaired by Professor James Wilsdon, supported by an independent and multidisciplinary group of experts in scientometrics, research funding, research policy, publishing, university management and administration. This review has gone beyond earlier studies to take a deeper look at potential uses and limitations of research metrics and indicators. It has explored the use of metrics across different disciplines, and assessed their potential contribution to the development of research excellence and impact. It has analysed their role in processes of research assessment, including the next cycle of the Research Excellence Framework (REF). It has considered the changing ways in which universities are using quantitative indicators in their management systems, and the growing power of league tables and rankings. And it has considered the negative or unintended effects of metrics on various aspects of research culture. The report starts by tracing the history of metrics in research management and assessment, in the UK and internationally. It looks at the applicability of metrics within different research cultures, compares the peer review system with metric-based alternatives, and considers what balance might be struck between the two. It charts the development of research management systems within institutions, and examines the effects of the growing use of quantitative indicators on different aspects of research culture, including performance management, equality, diversity, interdisciplinarity, and the ‘gaming’ of assessment systems. The review looks at how different funders are using quantitative indicators, and considers their potential role in research and innovation policy. Finally, it examines the role that metrics played in REF2014, and outlines scenarios for their contribution to future exercises

A review of the characteristics of 108 author-level bibliometric indicators

An increasing demand for bibliometric assessment of individuals has led to a growth of new bibliometric indicators as well as new variants or combinations of established ones. The aim of this review is to contribute with objective facts about the usefulness of bibliometric indicators of the effects of publication activity at the individual level. This paper reviews 108 indicators that can potentially be used to measure performance on the individual author level, and examines the complexity of their calculations in relation to what they are supposed to reflect and ease of end-user application.Comment: to be published in Scientometrics, 201