Global Aggregated Ranking of HEIs: Russian Footprint

The paper suggests a new approach to performance evaluation of universities in Russia and worldwide based on aggregation of the results of ten global rankings and the Database of External Quality Assurance Results (DEQAR). The method of league analysis (MetALeague) allows the authors to integrate the diverse results of ranking and evaluation regardless of considerable variations in ranking methodology and indicators. As a result of MetALeague integration, the Global Aggregated Ranking of higher education institutions has been made. The paper analyses the global rankings and the position of Russian HEIs in these rankings. The authors have also analyzed the positions of countries based on the number of HEIs included in the Global Aggregated Ranking. The due consideration of research results, according to the authors, can propel the leading Russian universities to higher positions in the global educational environment

The Monitoring of Monitoring: What’s Wrong with the Ministry’s New Approach to Supervision of Effectiveness of Higher Education Institutions’ Performance?

The article discusses the Monitoring of higher education institutions’ (HEIs’) effectiveness, which has been conducted annually by the Ministry of Education and Science in the last five years. The method of the Monitoring is based on the technology of collecting and systematizing information used by the state accreditation in 1997–2010. The reasons for the introduction of the Monitoring by the Ministry are described; the features of the performance indicators are justified by the state educational policy. A model of presentation of the Monitoring results in the league table format is suggested, which makes it possible to use its results more flexibly for the management of the higher education system. It also allows higher education institutions to analyze their positions and to form their own ways of the development

FROM INSTITUTIONAL ACCREDITATION TO MONITORING OF EFFECTIVENESS

The article proposes a detailed analysis of the monitoring of higher education institutions effectiveness conducted annually by the Ministry of Education and Science for the last five years. The monitoring technique is based on collection and systematization of information used in state accreditation procedures in 1997–2010. The article also considers the reasons for implementing monitoring into the practice of governing body from the perspective of the state education policy. The list of HEIs’ performance indicators oriented mainly on social, economic and international policy, and the results of the follow-up procedures are criticized by the academic community. The authors propose a model of presentation the monitoring results in the League Tables format. It helps using the monitoring results in a flexible manner both by institutions of higher education management and by HEIs aimed at analyzing their policies and forming their development strategies. This paper is especially relevant in the framework of one more round of university effectiveness monitoring to be conducted in 2018. In conclusion, the conducted effectiveness monitoring can reflect the current situation of the education system on conditions of transparency of set goals and stability of “game rules”. But this instrument does not give universities the possibility of strategic and tactical vision of further development due to the limitation by the binary scale of decision-making. The given method of university clustering in league tables according to monitoring data may help universities develop a strategy of improving the quality of their activity

How to Design a National Aggregated Ranking?

The article presents a new method of designing a national ranking of higher education institutions on the basis of aggregating all existing public national rankings. The new aggregating method MetALeague (Method of Analysis of Leagues) can help to do away with monopoly in evaluation, thus, providing room for independent evaluation of HEIs. The analysis of the current state of procedures and methods of independent evaluation of Russian HEIs in the form of rankings and databases was carried out. The suggested MetALeague method is based on the mathematical tool of the voting theory in small groups and helps to combine different independent evaluations in a single format. A possible approach to creating such a unified national ranking in the form of 10 leagues is considered and the calculation results are presented. The developed ranking methods and the obtained results can be useful for self-diagnosis and promotion of research, organizational and methodological activities of HEIs, and also when introducing a risk-oriented approach in oversight activities