Measurable utility for scientific influence

I give necessary and sufficient conditions for the existence of a cardinal utility function to represent, through summation, rankings of scientific units based on their journal articles and its citations. I discuss and interpret the meaning of those conditions, its connections with inequality theory and the theory of choice under uncertainty, and I connect the results of this approach to other performance measures provided by the literature on citation analysis.Scientific rankings, citations, impact, additive utility, stochastic dominance

On the additivity of preference aggregation methods

The paper reviews some axioms of additivity concerning ranking methods used for generalized tournaments with possible missing values and multiple comparisons. It is shown that one of the most natural properties, called consistency, has strong links to independence of irrelevant comparisons, an axiom judged unfavourable when players have different opponents. Therefore some directions of weakening consistency are suggested, and several ranking methods, the score, generalized row sum and least squares as well as fair bets and its two variants (one of them entirely new) are analysed whether they satisfy the properties discussed. It turns out that least squares and generalized row sum with an appropriate parameter choice preserve the relative ranking of two objects if the ranking problems added have the same comparison structure.Comment: 24 pages, 9 figure

Paired Comparisons Analysis: An Axiomatic Approach to Rankings in Tournaments

In this paper we present an axiomatic analysis of several ranking methods for tournaments. We find that two of them exhibit a very good behaviour with respect to the set of properties under consideration. One of them is the maximum likelihood ranking, the most common method in statistics and psychology. The other one is a new ranking method introduced in this paper: recursive Buchholz. One of the most widely studied methods in social choice, the fair bets ranking, also performs quite well, but fails to satisfy some arguably important properties.Tournament;ranking;paired comparisons;fair bets;maximum likelihood

Rangsorolás páros összehasonlításokkal. Kiegészítések a felvételizői preferencia-sorrendek módszertanához (Paired comparisons ranking. A supplement to the methodology of application-based preference ordering)

A Közgazdasági Szemle márciusi számában Telcs és szerzőtársai [2013] a felvételizők preferenciái alapján új megközelítést javasolt a felsőoktatási intézmények rangsorolására. Az alábbi írás új szempontokat biztosít ezen alapötlet gyakorlati megvalósításához. Megmutatja, hogy az alkalmazott modell ekvivalens az alternatívák egy aggregált páros összehasonlítási mátrix révén végzett rangsorolásával, ami rávilágít a szerzők kiinduló hipotéziseinek vitatható pontjaira. A szerző röviden áttekinti a hasonló feladatok megoldására javasolt módszereket, különös tekintettel azok axiomatikus megalapozására, majd megvizsgálja a Telcs és szerzőtársai [2013] által alkalmazott eljárásokat. Végül említést tesz egy hasonló megközelítéssel élő cikkről, és megfogalmaz néhány, a vizsgálat továbbfejlesztésére vonatkozó javaslatot. _____ In the March issue of Közgazdasági Szemle, Telcs et al. suggested a new approach to university ranking through preference ordering of applicants. The paper proposes new aspects to the implementation of this idea. It is shown that the model of these is equivalent to the ranking of alternatives based on paired comparisons, which reveals the debatable points in their hypotheses. The author reviews briefly the methods proposed in the literature, focusing on their axiomatic properties, and thoroughly examines the procedures of Telcs et al. [2013]. The paper presents an article which applied a similar approach and suggests some improvements to it

On the influence of rankings

Ranking systems are becoming increasingly important in many areas, in the Web environment and academic life for instance. In a world with a tremendous amount of choices, rankings play the crucial role of influencing which objects are 'tasted' or selected. This selection generates a feedback when the ranking is based on citations, as is the case for the widely used invariant method. The selection affects new stated opinions (citations), which will, in turn, affect next ranking. The purpose of this paper is to investigate this feedback in the context of journals by studying some simple but reasonable dynamics. Our main interest is on the long run behavior of the process and how it depends on the preferences, in particular on their diversity. We show that multiple long run behavior may arise due to strong self enforcing mechanisms at work with the invariant method. These effects are not present in a simple search model in which individuals are influenced by the cites of the papers they first read.ranking, scoring, invariant method, search

Ranking authors using fractional counting of citations : an axiomatic approach

This paper analyzes from an axiomatic point of view a recent proposal for counting citations: the value of a citation given by a paper is inversely proportional to the total number of papers it cites. This way of fractionally counting citations was suggested as a possible way to normalize citation counts between fields of research having different citation cultures. It belongs to the “citing-side” approach to normalization. We focus on the properties characterizing this way of counting citations when it comes to ranking authors. Our analysis is conducted within a formal framework that is more complex but also more realistic than the one usually adopted in most axiomatic analyses of this kind

Additive and multiplicative properties of scoring methods for preference aggregation

The paper reviews some additive and multiplicative properties of ranking procedures used for generalized tournaments with missing values and multiple comparisons. The methods analysed are the score, generalised row sum and least squares as well as fair bets and its variants. It is argued that generalised row sum should be applied not with a fixed parameter, but a variable one proportional to the number of known comparisons. It is shown that a natural additive property has strong links to independence of irrelevant matches, an axiom judged unfavourable when players have different opponents

Some impossibilities of ranking in generalized tournaments

In a generalized tournament, players may have an arbitrary number of matches against each other and the outcome of the games is measured on a cardinal scale with a lower and upper bound. An axiomatic approach is applied to the problem of ranking the competitors. Self-consistency requires assigning the same rank for players with equivalent results, while a player showing an obviously better performance than another should be ranked strictly higher. According to order preservation, if two players have the same pairwise ranking in two tournaments where the same players have played the same number of matches, then their pairwise ranking is not allowed to change in the aggregated tournament. We reveal that these two properties cannot be satisfied simultaneously on this universal domain.Comment: This article draws from arXiv:1612.00186 in model setting and axioms. 14 pages, 3 figure