Measuring web connectivity between research organizations through ROR identifiers

Digital information needs to be accessed and used in a manageable and sustainable manner to facilitate the advancement of science and science management. Many types of Persistent Identifiers (PIDs) are already in use and well-established in support of the scholarly communication industry, mainly digital objects (e.g., DOIs) and person identifiers (e.g., ORCID). PIDs improve the interoperability of digital entities, make them reusable, and, at the same time, foster FAIR principles. The main objective of this exploratory work is to measure the degree and type of use of ROR identifiers by the online scientific and academic ecosystem through link-based indicators. The analysis yielded 149,851 links to ror.org webpages: 147,154 links to ROR-based URLs and 2,698 links to other informative webpages under the ror.org website. The results obtained evidence that the percentage of ROR identifiers linked is limited (51.6% of ROR identifiers have been linked at least once). These links come from a limited number of referring domains (242 unique domain names) and mainly from bibliographic records (51.4% of links) and organization cards (36% of links). While the distribution of ROR identifiers is biased towards Anglo-Saxon countries (mainly United States) and types (companies), the educational research organizations are the institutions most linked through their corresponding ROR-based URLs. The connectivity between DOIs, ORCIDs and RORs can be the spearhead to carry out new webometric and bibliometric studies, of interest to characterize the presence, impact, and interconnection of the global academic Web.Comment: Conference paper; 13 pages; 5 tables; 4 figure

Research assessment under debate: disentangling the interest around the DORA declaration on Twitter

Much debate has been around the misapplication of metrics in research assessment. As a result of this concern, the Declaration on Research Assessment (DORA) was launched, an initiative that caused opposing viewpoints. However, the discussion topics about DORA have not been formally identified, especially in participatory environments outside the scholarly communication process, such as social networks. This paper contributes to that end by analyzing 20,717 DORA-related tweets published from 2015 to 2022. The results show an increasing volume of tweets, mainly promotional and informative, but with limited participation of users, either commenting or engaging with the tweets, generating a scarcely polarized conversation driven primarily by a few DORA promoters. While a varied list of discussion topics is found (especially "Open science and research assessment," "Academics career assessment & innovation," and "Journal Impact Factor"), the DORA debate appears as part of broader conversations (research evaluation, open science). Further studies are needed to check whether these results are restricted to Twitter or reveal more general patterns. The findings might interest the different evaluators and evaluated agents regarding their interests and concerns around the reforms in the research evaluation

Low visibility of Latin American repositories in Google Scholar: technical incompatibility or lack of web strategy?

The content in many repositories in Latin America fail to come up in systematic searches largely due to the inadequate use of domain names and metadata schema, find Enrique Orduña-Malea and Emilio Delgado-López-Cózar. Institutional repositories are ultimately websites and concepts such as usability, information architecture, search engine optimization, among others, should be considered in their primary design. In a context like Latin America, in which scholarly production requires extra visibility because it lies outside the academic mainstream, repositories are essential vehicles, and their low visibility could significantly affect their real use by end users

Visibilidad de los repositorios institucionales argentinos en la web: Indicadores y buenas prácticas

Se aborda el estudio de la evaluación de los repositorios institucionales desde una perspectiva cibermétrica. En primer lugar se presenta la sede online universitaria como un sistema complejo y rico documentalmente, analizable desde un punto de vista tanto sistémico como cuantitativo. Tras ello, se sitúa el repositorio institucional como una sede independiente alojada dentro de la sede académica, con unos objetivos y características propios, y que pueden ser igualmente analizados desde un punto de vista cibermétrico. A continuación se exponen los indicadores cibermétricos más importantes utilizados en el análisis de repositorios institucionales (aplicando su uso a SEDICI, repositorio institucional de la Universidad Nacional de la Plata). Se finaliza con la presentación del Ranking Web de Repositorios del Mundo, en el que se aplican diversos indicadores cibermétricos, analizando la presencia de los repositorios institucionales argentinos en el mismo.The evaluation of institucional repositories is studied from a cibermetric point of view. First, the academic online seat is introduced as a complex and rich document system, approached both from systemic and quantitative perspectives. After that, the institutional repository is located as an independent online site, hosted inside the academic web domain, with some specific goals and characteristics, which can be analyzed under a cibermetric approach. Then, the main cibermetric indicators used to evaluate institutional repositories are showed (being applied at SeDICI, institutional repository from Universidad Nacional de la Plata). Finally, the Ranking Web of World Repositories is introduced, analysing the performance of Argentine institutional repositories therein.Conferencia plenariaFacultad de Humanidades y Ciencias de la Educació

Universities through the Eyes of Bibliographic Databases: A Retroactive Growth Comparison of Google Scholar, Scopus and Web of Science

The purpose of this study is to ascertain the suitability of GS's url-based method as a valid approximation of universities' academic output measures, taking into account three aspects (retroactive growth, correlation, and coverage). To do this, a set of 100 Turkish universities were selected as a case study. The productivity in Web of Science (WoS), Scopus and GS (2000 to 2013) were captured in two different measurement iterations (2014 and 2018). In addition, a total of 18,174 documents published by a subset of 14 research-focused universities were retrieved from WoS, verifying their presence in GS within the official university web domain. Findings suggest that the retroactive growth in GS is unpredictable and dependent on each university, making this parameter hard to evaluate at the institutional level. Otherwise, the correlation of productivity between GS (url-based method) and WoS and Scopus (selected sources) is moderately positive, even though it varies depending on the university, the year of publication, and the year of measurement. Finally, only 16% out of 18,174 articles analyzed were indexed in the official university website, although up to 84% were indexed in other GS sources. This work proves that the url-based method to calculate institutional productivity in GS is not a good proxy for the total number of publications indexed in WoS and Scopus, at least in the national context analyzed. However, the main reason is not directly related to the operation of GS, but with a lack of universities' commitment to open access.Comment: 19 pages, 3 figures and 7 table

Has Robert Parker lost his hegemony as a prescriptor in the wine World? A preliminar inquiry through Twitter

[EN] The aim of this work is to determine to what extent Robert Parker has lost his influence as a prescriber in the world of wine through a webometric analysis based on a comparative analysis of Parker’s web influence and that of a competitor who represents an anthitetical vision of the world of wine (Alice Feiring). To do this, we carried out a comparative analysis for Parker’s (@wine_advocate) and Alice Feiring’s (@alicefeiring) official Twitter accounts, including a broad set of metrics (productivity, age, Social Activity, number of followees, etc.), paying special attention to specific followers’ features (age, gender, location, and bios text). The results show that Parker’s twitter profile exhibits an overall higher impact, which denotes not only a different online strategy but also a high level of engagement and popularity. The low level of shared followers by Parker and Feiring (1,898 users) offer prima facie evidence of an online gap between these followers, which can indicate the existence of a divided group of supporters corresponding with the visions that Parker and Feiring represent. Finally, special features are notice for Feiring in gender (more women followers), language (more English-speaking followers) and country (more followers from the United States).Compés-López, R.; Font-Julian, C.; Orduna-Malea, E. (2018). Has Robert Parker lost his hegemony as a prescriptor in the wine World? A preliminar inquiry through Twitter. En 2nd International Conference on Advanced Reserach Methods and Analytics (CARMA 2018). Editorial Universitat Politècnica de València. 97-105. https://doi.org/10.4995/CARMA2018.2018.8320OCS9710

Link-based approach to study scientific software usage: the case of VOSviewer

Scientific software is a fundamental player in modern science, participating in all stages of scientific knowledge production. Software occasionally supports the development of trivial tasks, while at other instances it determines procedures, methods, protocols, results, or conclusions related with the scientific work. The growing relevance of scientific software as a research product with value of its own has triggered the development of quantitative science studies of scientific software. The main objective of this study is to illustrate a link-based webometric approach to characterize the online mentions to scientific software across different analytical frameworks. To do this, the bibliometric software VOSviewer is used as a case study. Considering VOSviewer's official website as a baseline, online mentions to this website were counted in three different analytical frameworks: academic literature via Google Scholar (988 mentioning publications), webpages via Majestic (1,330 mentioning websites), and tweets via Twitter (267 mentioning tweets). Google scholar mentions shows how VOSviewer is used as a research resource, whilst mentions in webpages and tweets show the interest on VOSviewer's website from an informational and a conversational point of view. Results evidence that URL mentions can be used to gather all sorts of online impacts related to non-traditional research objects, like software, thus expanding the analytical scientometric toolset by incorporating a novel digital dimension.Merit, Expertise and Measuremen