Measuring Time-Dynamics and Time-Stability of Journal Rankings in Mathematics and Physics by Means of Fractional p-Variations

[EN] Journal rankings of specific research fields are often used for evaluation purposes, both of authors and institutions. These rankings can be defined by means of several methods, as expert assessment, scholarly-based agreements, or by the ordering induced by a numeric index associated to the prestige of the journals. In order to be efficient and accepted by the research community, it must preserve the ordering over time, at least up to a point. Otherwise, the procedure for defining the ranking must be revised to assure that it reflects the presumably stable characteristic prestige that it claims to be quantifying. A mathematical model based on fractional p-variations of the values of the order number of each journal in a time series of journal rankings is explained, and its main properties are shown. As an example, we study the evolution of two given ordered lists of journals through an eleven-year series. These journal ranks are defined by using the 2-year Impact Factor of Thomson-Reuters (nowadays Clarivate Analytics) lists for MATHEMATICS and PHYSICS, APPLIED from 2002 to 2013. As an application of our model, we define an index that precludes the use of journal ranks for evaluation purposes when some minimal requirements on the associated fractional p-variations are not satisfied. The final conclusion is that the list of mathematics does not satisfy the requirements on the p-variations, while the list of applied physics does.The work of the first author was supported by Ministerio de Economi, Industria y Competitividad, Spain, under Research Grant CSO2015-65594-C2-1R Y 2R (MINECO/FEDER, UE). The work of the third author was supported by Ministerio de Economi, Industria y Competitividad, Spain, under Research Grant MTM2016-77054-C2-1-P. We did not receive any funds for covering the costs to publish in open access.Ferrer Sapena, A.; Díaz Novillo, S.; Sánchez Pérez, EA. (2017). Measuring Time-Dynamics and Time-Stability of Journal Rankings in Mathematics and Physics by Means of Fractional p-Variations. Publications. 5(3):1-14. https://doi.org/10.3390/publications5030021S1145

Impact of ERA research assessment on university behaviour and their staff

In early 2012, the National Tertiary Education Union (NTEU) undertook research into the effects of the ERA upon university staff involved in research. This was an exploratory, multi-method study conducted between April and September 2012 that included a national survey of 39 senior research administrators, eight focus groups at four institutions, eleven recorded and non-recorded interviews at five institutions, and a Workshop in Melbourne that involved 35 Early Career Researchers.The study acknowledges that institutional behaviour around research performance is changing, but in ways that take autonomy away from researchers, that rewards managerialism, and thus that undermines the public interest, on the basis that the public interest is understood as delivering Australian society public benefit through a world-class, sustainable and diverse research sector. In particular, the primary concern that the NTEU has with the ERA is its susceptibility to misuse by institutions through poor research management practices, and the risk posed to the intergity of the ‘research fabric’ through attacks on intellectual freedo

Examining how country-level science policy shapes publication patterns: The case of Poland

This work was supported by the DIALOG Programme [Grant name ‘Research into Excellence Patterns in Science and Art’].This country case study describes how science policy instruments are designed to shape publication patterns and identifies the changes in researchers’ productivity that can be observed over the period 2009–2016 in Poland by analysing data on 452,277 publications submitted to the country’s national research evaluation system. Our analysis reveals that policy instruments used in the country’s national research evaluation system, academic promotion procedures and competitive grants have increased the number of articles with an impact factor without compromising publication quality, as measured by a bibliometric indicator. Our findings highlight that only clear and stable incentives have influenced researchers’ publications. Therefore, patterns in scholarly book publications—for which regulations were not clear and stable—have not been significantly shaped by science policy

In Search of Excellent Research Assessment

This book provides analysis of current trends in research evaluation worldwide and compares the research assessment and innovation ecosystems in Austria, Bulgaria, the Czech Republic, Hungary, Lithuania, the Netherlands, Poland and Slovenia. It argues that in each country the research assessment system is interdependent with the national innovation system and the overall institutional governance/enforcement.Das Buch bietet eine Analyse aktueller Trends in der Forschungsbewertung weltweit und vergleicht die Forschungsbewertungs- und Innovationsökosysteme in Österreich, Bulgarien, der Tschechischen Republik, Ungarn, Litauen, den Niederlanden, Polen und Slowenien. Es wird argumentiert, dass das Forschungsbewertungssystem vom nationalen Innovationssystem und der gesamten institutionellen Governance/Durchsetzung abhängig ist

Analysis of Emerging Reputation and Funding Mechanisms in the Context of Open Science 2.0

This report covers the outcomes of two studies funded by JRC IPTS to explore emerging drivers for Open Science 2.0. In general, Open Science 2.0 is associated with themes such as open access to scientific outputs, open data, citizen science and open peer evaluation systems. This study, however, focused on less explored themes, namely on alternative funding mechanisms for scientific research and on emerging reputation mechanisms for scholars resulting from Web 2.0 platforms and applications. It has been demonstrated that both are providing significant new opportunities for researchers to disseminate, share, explore and collaborate with other researchers, but it remains to be seen whether they will be able to bring about more disruptive change in how science and research systems function in the future. They could well do so, especially if related changes being considered by the European Commission on ‘Science 2.0: Science in Transition’ are taken into account.JRC.J.3-Information Societ