Evaluating a Department’s Research: Testing the Leiden Methodology in Business and Management

The Leiden methodology (LM), also sometimes called the “crown indicator”, is a quantitative method for evaluating the research quality of a research group or academic department based on the citations received by the group in comparison to averages for the field. There have been a number of applications but these have mainly been in the hard sciences where the data on citations, provided by the ISI Web of Science (WoS), is more reliable. In the social sciences, including business and management, many journals and books are not included within WoS and so the LM has not been tested here. In this research study the LM has been applied on a dataset of over 3000 research publications from three UK business schools. The results show that the LM does indeed discriminate between the schools, and has a degree of concordance with other forms of evaluation, but that there are significant limitations and problems within this discipline

A Review of Theory and Practice in Scientometrics

Scientometrics is the study of the quantitative aspects of the process of science as a communication system. It is centrally, but not only, concerned with the analysis of citations in the academic literature. In recent years it has come to play a major role in the measurement and evaluation of research performance. In this review we consider: the historical development of scientometrics, sources of citation data, citation metrics and the “laws" of scientometrics, normalisation, journal impact factors and other journal metrics, visualising and mapping science, evaluation and policy, and future developments

Ethics and OR: Operationalising Discourse Ethics

Operational researchers help managers decide what they ought to do and yet this is generally evaluated in terms of efficiency or effectiveness, not ethicality. However, the combination of the tremendous power of global corporations and the financial markets, and the problems the world faces in terms of economic and environmental sustainability, has led to a revival of interest in ethical approaches. This paper explores a relatively recent and innovative process called discourse ethics. This is very different from traditional ethical systems in taking ethical decisions away from individuals or committees and putting them in the hands of the actual people who are involved and affected through processes of debate and deliberation. The paper demonstrates that discourse ethics has strong connections to OR, especially in the areas of soft and critical systems, and that OR can actually contribute to the practical operationalisation of discourse ethics. At the same time, discourse ethics can provide a rigorous discursive framework for “ethics beyond the model"

Operational Research in Education

Operational Research (OR) techniques have been applied, from the early stages of the discipline, to a wide variety of issues in education. At the government level, these include questions of what resources should be allocated to education as a whole and how these should be divided amongst the individual sectors of education and the institutions within the sectors. Another pertinent issue concerns the efficient operation of institutions, how to measure it, and whether resource allocation can be used to incentivise efficiency savings. Local governments, as well as being concerned with issues of resource allocation, may also need to make decisions regarding, for example, the creation and location of new institutions or closure of existing ones, as well as the day-to-day logistics of getting pupils to schools. Issues of concern for managers within schools and colleges include allocating the budgets, scheduling lessons and the assignment of students to courses. This survey provides an overview of the diverse problems faced by government, managers and consumers of education, and the OR techniques which have typically been applied in an effort to improve operations and provide solutions

A review of the literature on citation impact indicators

Citation impact indicators nowadays play an important role in research evaluation, and consequently these indicators have received a lot of attention in the bibliometric and scientometric literature. This paper provides an in-depth review of the literature on citation impact indicators. First, an overview is given of the literature on bibliographic databases that can be used to calculate citation impact indicators (Web of Science, Scopus, and Google Scholar). Next, selected topics in the literature on citation impact indicators are reviewed in detail. The first topic is the selection of publications and citations to be included in the calculation of citation impact indicators. The second topic is the normalization of citation impact indicators, in particular normalization for field differences. Counting methods for dealing with co-authored publications are the third topic, and citation impact indicators for journals are the last topic. The paper concludes by offering some recommendations for future research

Networks of reader and country status: An analysis of Mendeley reader statistics

The number of papers published in journals indexed by the Web of Science core collection is steadily increasing. In recent years, nearly two million new papers were published each year; somewhat more than one million papers when primary research papers are considered only (articles and reviews are the document types where primary research is usually reported or reviewed). However, who reads these papers? More precisely, which groups of researchers from which (self-assigned) scientific disciplines and countries are reading these papers? Is it possible to visualize readership patterns for certain countries, scientific disciplines, or academic status groups? One popular method to answer these questions is a network analysis. In this study, we analyze Mendeley readership data of a set of 1,133,224 articles and 64,960 reviews with publication year 2012 to generate three different kinds of networks: (1) The network based on disciplinary affiliations of Mendeley readers contains four groups: (i) biology, (ii) social science and humanities (including relevant computer science), (iii) bio-medical sciences, and (iv) natural science and engineering. In all four groups, the category with the addition "miscellaneous" prevails. (2) The network of co-readers in terms of professional status shows that a common interest in papers is mainly shared among PhD students, Master's students, and postdocs. (3) The country network focusses on global readership patterns: a group of 53 nations is identified as core to the scientific enterprise, including Russia and China as well as two thirds of the OECD (Organisation for Economic Co-operation and Development) countries.Comment: 26 pages, 6 figures (also web-based startable), and 2 table

Sustainable development projects: explicit and acroamatic story telling as part of a new ‘project ethnography’

This paper constitutes an attempt to find a means to represent multiple stories in the strong narrative of conventional sustainable development (SD) projects. The author’s experience of such projects in various parts of the world indicates that they have a tendency to arise from and reflect a dominant mindset, placing the SD project in what can be a working environment which is inimical to the very ideals which SD is supposed to represent. Short termism and value for money drive project formats and objectives whilst counter narratives and alternative stories arising from stakeholders in such projects are often ignored. Yet these alternative threads often contain strong SD messages of their own and could, if effectively utilised, enhance the SD project process. This paper sets out the case for a new field – ‘project ethnography’ – allied with the growing use of meta analysis to compare project ‘stories’. The paper presents preliminary findings using an analytical framework to facilitate an ethnographic analysis and draw out the stories that those working in such projects can tell. The analysis focuses on some SD projects in the Mediterranean which reinforces the view of the authors that the conventional model of SD project organisation and delivery often contains within itself alternative understandings – understandings which the authors regard as stories in collision with the presenting and accepted project narrative, but at the same time valuable in richness of experience and perspective which can be drawn upon for informing SD project design and implementation