141 research outputs found

    Can we use altmetrics at the institutional level? A case study analysing the coverage by research areas of four Spanish universities

    Get PDF
    Proceedings of the 21st International Conference on Science and Technology Indicators (STI 2016). València (Spain), September 14-16, 2016.This paper aims at exploring the coverage of the Altmetric.com database and its potential use in order to show universities’ research profiles in relationship with other databases. Specifically, our objectives are the following:1. Analyse the coverage of Altmetric.com at the institutional level and verify its validity as a data source for obtaining alternative metrics derived from the research activity of universities in comparison with those from the Web of Science. For this, we will work with a small sample of four Spanish universities with different characteristics.2. Analyse coverage differences when obtaining bibliometric profiles from Altmetric.com and Web of Science. In some studies a higher coverage of the Social Sciences and Humanities has been reported, suggesting the potential of altmetric indicators in these areas (Costas, Zahedi, & Wouters, 2015b).Nicolás Robinson García is currently supported by a Juan de la Cierva-Formación Fellowship from the Spanish Ministry of Economy and Competitiveness

    The Many Publics of Science: Using Altmetrics to Identify Common Communication Channels by Scientific field

    Full text link
    Altmetrics have led to new quantitative studies of science through social media interactions. However, there are no models of science communication that respond to the multiplicity of non-academic channels. Using the 3653 authors with the highest volume of altmetrics mentions from the main channels (Twitter, News, Facebook, Wikipedia, Blog, Policy documents, and Peer reviews) to their publications (2016-2020), it has been analyzed where the audiences of each discipline are located. The results evidence the generalities and specificities of these new communication models and the differences between areas. These findings are useful for the development of science communication policies and strategies

    The metric tide: report of the independent review of the role of metrics in research assessment and management

    Get PDF
    This report presents the findings and recommendations of the Independent Review of the Role of Metrics in Research Assessment and Management. The review was chaired by Professor James Wilsdon, supported by an independent and multidisciplinary group of experts in scientometrics, research funding, research policy, publishing, university management and administration. This review has gone beyond earlier studies to take a deeper look at potential uses and limitations of research metrics and indicators. It has explored the use of metrics across different disciplines, and assessed their potential contribution to the development of research excellence and impact. It has analysed their role in processes of research assessment, including the next cycle of the Research Excellence Framework (REF). It has considered the changing ways in which universities are using quantitative indicators in their management systems, and the growing power of league tables and rankings. And it has considered the negative or unintended effects of metrics on various aspects of research culture. The report starts by tracing the history of metrics in research management and assessment, in the UK and internationally. It looks at the applicability of metrics within different research cultures, compares the peer review system with metric-based alternatives, and considers what balance might be struck between the two. It charts the development of research management systems within institutions, and examines the effects of the growing use of quantitative indicators on different aspects of research culture, including performance management, equality, diversity, interdisciplinarity, and the ‘gaming’ of assessment systems. The review looks at how different funders are using quantitative indicators, and considers their potential role in research and innovation policy. Finally, it examines the role that metrics played in REF2014, and outlines scenarios for their contribution to future exercises

    Altmetrics and societal impact measurements: Match or mismatch? A literature review

    Get PDF
    Can alternative metrics (altmetrics) data be used to measure societal impact? We wrote this literature overview of empirical studies in order to find an answer to this question. The overview includes two parts. The first part, “societal impact measurements”, explains possible methods and problems in measuring the societal impact of research, case studies for societal impact measurement, societal impact considerations at funding organizations, and the societal problems that should be solved by science. The second part of the review, “altmetrics”, addresses a major question in research evaluation, which is whether altmetrics are proper indicators for measuring the societal impact of research. In the second part we explain the data sources used for altmetrics studies and the importance of field-normalized indicators for impact measurements. This review indicates that it should be relevant for impact measurements to be oriented towards pressing societal problems. Case studies in which societal impact of certain pieces of research is explained seem to provide a legitimate method for measuring societal impact. In the use of altmetrics, field-specific differences should be considered by applying field normalization (in cross-field comparisons). Altmetrics data such as social media counts might mainly reflect the public interest and discussion of scholarly works rather than their societal impact. Altmetrics (Twitter data) might be especially fruitfully employed for research evaluation purposes, if they are used in the context of network approaches. Conclusions based on altmetrics data in research evaluation should be drawn with caution

    Unveiling the path towards sustainability: scientific interest at HEIs from a scientometric approach in the period 2008-2017

    Get PDF
    Mención Internacional en el título de doctorLa humanidad ha experimentado el impacto de un modelo económico insostenible a todos los niveles. Este tema se ha cristalizado en diferentes cumbres y conferencias durante el siglo XX. Como resultado de esta preocupación, surgió el concepto de Desarrollo Sostenible (DS). Sin embargo, este concepto ha recibido muchas críticas por ser altamente antropocéntrico y compartimentado, carente de coherencia conceptual o interconexión entre todos los aspectos involucrados. Más tarde, la aparición de los Objetivos de Desarrollo del Milenio (ODM) en 2000 y los recientes Objetivos de Desarrollo Sostenible (ODS) en 2015 constituyen una nueva era. Este es el plan para lograr un futuro mejor y más sostenible para todos, en el que todos los agentes involucrados deben participar. En este punto, las instituciones de educación superior (IES) tienen un papel central y la sostenibilidad se ha convertido en una prioridad política para la ciencia. El objetivo de este estudio es conocer los patrones de la investigación llevada a cabo en investigación de sostenibilidad, incluido el flujo de actividad científica, así como la colaboración o el impacto que genera dicha investigación. Este estudio de doctorado explora cómo se puede delinear este concepto desde un enfoque bibliométrico, lo cual conduce a la ‘ciencia de la sostenibilidad’. La producción científica de artículos fue identificada y analizada en el período 2008-2017 en la Web of Science (WoS). Además, este estudio explora las instituciones de educación superior (IES) y su papel en el fomento de la sostenibilidad, mediante la evaluación de su investigación y la implementación de prácticas de sostenibilidad en las IES españolas. Además, presenta una delineación de los Objetivos de Desarrollo Sostenible (ODS) y propone una metodología para clasificar la producción científica en cada uno e los objetivos. El análisis de esta producción se realiza a través de indicadores bibliométricos unidimensionales y multidimensionales. Estos indicadores se han dividido y analizado en diferentes niveles de agregación, desde el más general hasta el más específico, comenzando con las características generales de investigación y descendiendo al nivel de país, instituciones o temática, entre otros. Los resultados muestran un interés creciente en la investigación de sostenibilidad y se observa una fuerte influencia del pilar medioambiental. Además, hay países con una alta producción científica pero no tan especializados en el tema como otros con una menor producción. En cuanto a las instituciones, los resultados obtenidos muestran que las IES realizaron un importante esfuerzo de investigación para el desarrollo sostenible y son las que producen un mayor número de documentos. Además, se observa que las instituciones tienden a colaborar con centros geográficamente próximos. Al analizar las Prácticas de sostenibilidad en las IES españolas, se encuentran asociaciones altas entre variables como la presencia de un Plan de Sostenibilidad y de una Oficina Verde. Sin embargo, este estudio demuestra claramente que, aunque se reconoce que el desarrollo sostenible es muy importante para las IES y la sociedad, todavía no está integrado en las estrategias, actividades y políticas de todo el sistema. Como conclusión, se afirma que es esencial identificar estrategias de sostenibilidad e introducir desarrollo sostenible en todas las actividades en el entorno de las IES. Finalmente, esta tesis contribuye a la literatura sobre instituciones de educación superior sostenibles, así como al análisis y la mejora de educación superior para el desarrollo sostenible, especialmente en el sistema de educación superior español. Además, este estudio contribuye al análisis bibliométrico al ofrecer dos propuestas de delineación científica para la ciencia de la sostenibilidad y los objetivos de desarrollo sostenible, así como metodologías para clasificar la producción científica. Este análisis denota la importancia de los estudios bibliométricos para el estudio y la caracterización de la producción científica en un campo transdisciplinario que, además, se puede extrapolar a otros campos de estudio.Humanity has experienced the impact of an unsustainable economic model at all levels. This topic has crystallized in different summits and conferences during the 20th century. As a result of this concern, the concept of sustainable development (SD) emerged. However, it has received much criticism for being highly anthropocentric and compartmentalized, and lacking conceptual coherence or interconnectedness among all the aspects involved. The introduction of the Millennium Development Goals (MDGs) in 2000 and the recent Sustainable Development Goals (SDGs) in 2015 heralded a new era. They represent a blueprint to achieve a better and more sustainable future for all, in which all stakeholders need to be involved. At this point, higher education institutions (HEIs) have a central role to play and sustainability has emerged as a policy priority for science. The objective of this study is to investigate the patterns of sustainability research, including the flow of scientific activity, as well as the collaboration or impact that such research generates. This doctoral study explores how can sustainability can be delineated from a bibliometric approach, leading to a new approach of “sustainability science”. The scientific production of articles was identified and analysed for the period 2008–2017 using the Web of Science (WoS). Moreover, this research study explores HEIs and their role in fostering sustainability, by assessing their research and the implementation of sustainability practices in Spanish HEIs. As well, it presents a delineation of the Sustainable Development Goals (SDGs) and proposes a methodology for classifying the output on each SDG. This analysis is done through unidimensional and multidimensional bibliometric indicators. These indicators have been divided and analysed in different levels of aggregation, from the most general to the most specific, starting with general research features and progressing to country, institutional, and thematic levels, among others. The results indicate a growing interest in sustainability research and a strong influence on the environmental pillar. Moreover, some countries with the highest scientific output are not as specialized in terms of topics as others with a lower output. Regarding institutions, the results obtained indicate that HEIs made an important research contribution to SD and are the ones that produce a higher number of documents. It was found that institutions tend to collaborate with other institutions that are close. By analysing sustainability practices in Spanish HEIs, it was found that there are more associations between variables such as having a sustainability plan and having a green office. However, this study clearly demonstrates that although SD is recognized as being very important to HEIs and society, it is not yet embedded in the whole system’s strategies, activities, and policies. In conclusion, this research study reveals that it is essential to identify sustainability strategies and introduce SD in all activities in the HEI environment. Finally, this thesis contributes to the literature on sustainable HEIs, as well as to how higher education for SD is understood and can be improved, especially in the Spanish higher education system. Moreover, this contributes to bibliometric study by offering two delineation approach to sustainability science and sustainable development goals as well as methodologies for classifying scientific output. This denotes the importante of bibliometric studies for the study and characterization of scientific output in a transdisciplinary field that can be extrapolated to other fields of study.Programa de Doctorado en Documentación: Archivos y Bibliotecas en el Entorno Digital por la Universidad Carlos III de MadridPresidente: Carlos Balaguer Bernaldo de Quirós.- Secretario: Birger Larsen.- Vocal: Sandra Sofía Ferreira Da Silva C

    Study on open science: The general state of the play in Open Science principles and practices at European life sciences institutes

    Get PDF
    Nowadays, open science is a hot topic on all levels and also is one of the priorities of the European Research Area. Components that are commonly associated with open science are open access, open data, open methodology, open source, open peer review, open science policies and citizen science. Open science may a great potential to connect and influence the practices of researchers, funding institutions and the public. In this paper, we evaluate the level of openness based on public surveys at four European life sciences institute

    Philosophers’ appraisals of bibliometric indicators and their use in evaluation: from recognition to knee‑jerk rejection

    Get PDF
    Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. No funding was received for conducting this study.The authors would like to thank Daniel Pallarés-Domínguez for his help in the data collection process and Mark Andrews for the English translation. We would also like to thank the three main Spanish philosophy and ethics associations, Asociación Española de Ética y Filosofía Política (AEEFP), Sociedad Académica de Filosofía (SAF) and Red Española de Filosofía (REF), for their collaboration during the research process and their endorsement of the data collection report.The knowledge and stance of researchers regarding bibliometric indicators is a feld of study that has gained weight in recent decades. In this paper we address this issue for the little explored areas of philosophy and ethics, and applied to a context, in this case Spain, where bibliometric indicators are widely used in evaluation processes. The study combines data from a self-administered questionnaire completed by 201 researchers and from 14 in-depth interviews with researchers selected according to their afliation, professional category, gender and area of knowledge. The survey data suggest that researchers do not consider bibliometric indicators a preferred criterion of quality, while there is a fairly high self-perception of awareness of a number of indicators. The qualitative data points to a generalised perception of a certain rejection of the specifc use of indicators, with four main positions being observed: (1) disqualifcation of the logic of metrics, (2) scepticism about the possibility of assessing quality with quantitative methods, (3) complaints about the incorporation of methods that are considered to belong to other disciplines, and (4) criticism of the consequences that this generates in the discipline of philosophy.CRUE-CSI

    Congress UPV Proceedings of the 21ST International Conference on Science and Technology Indicators

    Get PDF
    This is the book of proceedings of the 21st Science and Technology Indicators Conference that took place in València (Spain) from 14th to 16th of September 2016. The conference theme for this year, ‘Peripheries, frontiers and beyond’ aimed to study the development and use of Science, Technology and Innovation indicators in spaces that have not been the focus of current indicator development, for example, in the Global South, or the Social Sciences and Humanities. The exploration to the margins and beyond proposed by the theme has brought to the STI Conference an interesting array of new contributors from a variety of fields and geographies. This year’s conference had a record 382 registered participants from 40 different countries, including 23 European, 9 American, 4 Asia-Pacific, 4 Africa and Near East. About 26% of participants came from outside of Europe. There were also many participants (17%) from organisations outside academia including governments (8%), businesses (5%), foundations (2%) and international organisations (2%). This is particularly important in a field that is practice-oriented. The chapters of the proceedings attest to the breadth of issues discussed. Infrastructure, benchmarking and use of innovation indicators, societal impact and mission oriented-research, mobility and careers, social sciences and the humanities, participation and culture, gender, and altmetrics, among others. We hope that the diversity of this Conference has fostered productive dialogues and synergistic ideas and made a contribution, small as it may be, to the development and use of indicators that, being more inclusive, will foster a more inclusive and fair world
    corecore