Conceptualising dimensions of bibliometric assessment: From resource allocation systems to evaluative landscapes

The purpose of this paper is to discuss the conceptualisation of bibliometric analyses in terms of the levels on which they are performed, adding contextual factors to the dimension where the size of the unit being analysed is considered. Based on empirical investigations of resource allocation systems and research evaluation practices, as well as the previous literature conceptualising bibliometric analyses, a framework based on Whitley’s (2000) notion of research fields as ‘reputational work organisations’, is discussed. The results suggest adding a contextual ‘reputational dimension’ to the size-based dimension distinguishing between micro-, meso- and macro-level analyses. Furthermore, we propose that ‘evaluative landscapes’ (Brandter, 2017) might be a fruitful approach for further analysing how complex and multifaceted landscapes of research assessment affects the individual researcher

Modelagem de um indicador bibliométrico para análise da dispersão de conhecimentos

Quando os suportes de uma informação encontram-se distribuídos por diferentes partes, diz-se que a informação sofreu dispersão. Se ela se encontra citada na literatura, isso configura impacto bibliográfico. Assim também, a dispersão geográfica das fontes citantes representa a extensão geográfica do impacto daquela informação. Dessa forma, um indicador de dispersão pode constituir ferramenta útil para avaliação desses fenômenos. O presente artigo demonstra a modelagem de um indicador relativo de dispersão (IDS – Índice de Dispersão Segmentar), que considera a ocorrência desta, segundo diferentes níveis de distribuição (macro, meso e/ou microdispersão) referentes a unidades de análise bibliométricas, cienciométricas, informétricas, tecnométricas ou similares. Exemplos que ilustram possibilidades de aplicação do IDS no estudo comparativo de obras, periódicos, autores, métodos, técnicas, assuntos, vocábulos etc. são também apresentados. Palavras-chave Informação. Comunicação científica. Dispersão. Difusão. Indicadores. Bibliometria. Cienciometria. Informetria. Índice de dispersão. Impacto bibliográfico. A bibliometric indicator modelling for analysis of knowledge dispersion Abstract When information channels are distributed by different parts, it means that the information is dispersed. If this information is cited in the literature it means bibliographic impact. Therefore, the geographical dispersion of the sources that cites the information represents an extension of geographical impact. Thus, a dispersion indicator could represent a practical tool for the assessment of these events. The present article shows the modeling of a relative dispersion indicator (Index of Segmental Dispersion – ISD) that considered its occurrence related to different distribution levels (macro, meso and/or microdispersion) in terms of bibliometric, scientometric, informetric, technometric or similar units of analysis. Examples that illustrates possible applications of ISD in comparative studies of literary works, journals, authors, methods, technique, themes or words and so forth are also introduced. Keywords Information. Scientific communication. Dispersion. Diffusion. Indicators. Bibliometrics. Scientometrics. Informetrics. Dispersion index. Bibliographic impact

Indicadores cienciometricos

Os indicadores científicos surgem da medição dos insumos e dos resultados da instituição científica. A cienciometria elabora metodologias para formular esses indicadores com técnicas interdisciplinares da economia, estatística, administração e documentação. As metodologias aceitas internacionalmente (Manual de Frascati, Manual de Oslo e Manual de Canberra) são as referências clássicas para medir os insumos e os resultados econômicos, bem como os resultados tecnológicos da pesquisa e desenvolvimento (P&D). Não existe consenso internacional sobre como medir e avaliar a produção intelectual e acadêmica tal como se manifesta no sistema editorial, nem na interpretação de seus impactos e influências. Definindo os termos bibliometria, cienciometria e informetria, seus alcances e aplicações, este trabalho apresenta visões alternativas para interpretar os indicadores cienciométricos existentes que, em sua maior parte, derivam das compilações do Citation Index do Institute for Scientific Information e de bases de dados similares. Em particular, apresenta-se uma hipótese para explicar o viés que o Citation Index manifesta em favor das publicações que fazem parte da corrente principal (mainstream) dos países desenvolvidos, em detrimento das publicações de qualidade similar provenientes de países do Terceiro Mundo

Development of Bridge Information Model (BrIM) for digital twinning and management using TLS technology

In the current modern era of information and technology, the concept of Building Information Model (BIM), has made revolutionary changes in different aspects of engineering design, construction, and management of infrastructure assets, especially bridges. In the field of bridge engineering, Bridge Information Model (BrIM), as a specific form of BIM, includes digital twining of the physical asset associated with geometrical inspections and non-geometrical data, which has eliminated the use of traditional paper-based documentation and hand-written reports, enabling professionals and managers to operate more efficiently and effectively. However, concerns remain about the quality of the acquired inspection data and utilizing BrIM information for remedial decisions in a reliable Bridge Management System (BMS) which are still reliant on the knowledge and experience of the involved inspectors, or asset manager, and are susceptible to a certain degree of subjectivity. Therefore, this research study aims not only to introduce the valuable benefits of Terrestrial Laser Scanning (TLS) as a precise, rapid, and qualitative inspection method, but also to serve a novel sliced-based approach for bridge geometric Computer-Aided Design (CAD) model extraction using TLS-based point cloud, and to contribute to BrIM development. Moreover, this study presents a comprehensive methodology for incorporating generated BrIM in a redeveloped element-based condition assessment model while integrating a Decision Support System (DSS) to propose an innovative BMS. This methodology was further implemented in a designed software plugin and validated by a real case study on the Werrington Bridge, a cable-stayed bridge in New South Wales, Australia. The finding of this research confirms the reliability of the TLS-derived 3D model in terms of quality of acquired data and accuracy of the proposed novel slice-based method, as well as BrIM implementation, and integration of the proposed BMS into the developed BrIM. Furthermore, the results of this study showed that the proposed integrated model addresses the subjective nature of decision-making by conducting a risk assessment and utilising structured decision-making tools for priority ranking of remedial actions. The findings demonstrated acceptable agreement in utilizing the proposed BMS for priority ranking of structural elements that require more attention, as well as efficient optimisation of remedial actions to preserve bridge health and safety

Unveiling the path towards sustainability: scientific interest at HEIs from a scientometric approach in the period 2008-2017

Mención Internacional en el título de doctorLa humanidad ha experimentado el impacto de un modelo económico insostenible a todos los niveles. Este tema se ha cristalizado en diferentes cumbres y conferencias durante el siglo XX. Como resultado de esta preocupación, surgió el concepto de Desarrollo Sostenible (DS). Sin embargo, este concepto ha recibido muchas críticas por ser altamente antropocéntrico y compartimentado, carente de coherencia conceptual o interconexión entre todos los aspectos involucrados. Más tarde, la aparición de los Objetivos de Desarrollo del Milenio (ODM) en 2000 y los recientes Objetivos de Desarrollo Sostenible (ODS) en 2015 constituyen una nueva era. Este es el plan para lograr un futuro mejor y más sostenible para todos, en el que todos los agentes involucrados deben participar. En este punto, las instituciones de educación superior (IES) tienen un papel central y la sostenibilidad se ha convertido en una prioridad política para la ciencia. El objetivo de este estudio es conocer los patrones de la investigación llevada a cabo en investigación de sostenibilidad, incluido el flujo de actividad científica, así como la colaboración o el impacto que genera dicha investigación. Este estudio de doctorado explora cómo se puede delinear este concepto desde un enfoque bibliométrico, lo cual conduce a la ‘ciencia de la sostenibilidad’. La producción científica de artículos fue identificada y analizada en el período 2008-2017 en la Web of Science (WoS). Además, este estudio explora las instituciones de educación superior (IES) y su papel en el fomento de la sostenibilidad, mediante la evaluación de su investigación y la implementación de prácticas de sostenibilidad en las IES españolas. Además, presenta una delineación de los Objetivos de Desarrollo Sostenible (ODS) y propone una metodología para clasificar la producción científica en cada uno e los objetivos. El análisis de esta producción se realiza a través de indicadores bibliométricos unidimensionales y multidimensionales. Estos indicadores se han dividido y analizado en diferentes niveles de agregación, desde el más general hasta el más específico, comenzando con las características generales de investigación y descendiendo al nivel de país, instituciones o temática, entre otros. Los resultados muestran un interés creciente en la investigación de sostenibilidad y se observa una fuerte influencia del pilar medioambiental. Además, hay países con una alta producción científica pero no tan especializados en el tema como otros con una menor producción. En cuanto a las instituciones, los resultados obtenidos muestran que las IES realizaron un importante esfuerzo de investigación para el desarrollo sostenible y son las que producen un mayor número de documentos. Además, se observa que las instituciones tienden a colaborar con centros geográficamente próximos. Al analizar las Prácticas de sostenibilidad en las IES españolas, se encuentran asociaciones altas entre variables como la presencia de un Plan de Sostenibilidad y de una Oficina Verde. Sin embargo, este estudio demuestra claramente que, aunque se reconoce que el desarrollo sostenible es muy importante para las IES y la sociedad, todavía no está integrado en las estrategias, actividades y políticas de todo el sistema. Como conclusión, se afirma que es esencial identificar estrategias de sostenibilidad e introducir desarrollo sostenible en todas las actividades en el entorno de las IES. Finalmente, esta tesis contribuye a la literatura sobre instituciones de educación superior sostenibles, así como al análisis y la mejora de educación superior para el desarrollo sostenible, especialmente en el sistema de educación superior español. Además, este estudio contribuye al análisis bibliométrico al ofrecer dos propuestas de delineación científica para la ciencia de la sostenibilidad y los objetivos de desarrollo sostenible, así como metodologías para clasificar la producción científica. Este análisis denota la importancia de los estudios bibliométricos para el estudio y la caracterización de la producción científica en un campo transdisciplinario que, además, se puede extrapolar a otros campos de estudio.Humanity has experienced the impact of an unsustainable economic model at all levels. This topic has crystallized in different summits and conferences during the 20th century. As a result of this concern, the concept of sustainable development (SD) emerged. However, it has received much criticism for being highly anthropocentric and compartmentalized, and lacking conceptual coherence or interconnectedness among all the aspects involved. The introduction of the Millennium Development Goals (MDGs) in 2000 and the recent Sustainable Development Goals (SDGs) in 2015 heralded a new era. They represent a blueprint to achieve a better and more sustainable future for all, in which all stakeholders need to be involved. At this point, higher education institutions (HEIs) have a central role to play and sustainability has emerged as a policy priority for science. The objective of this study is to investigate the patterns of sustainability research, including the flow of scientific activity, as well as the collaboration or impact that such research generates. This doctoral study explores how can sustainability can be delineated from a bibliometric approach, leading to a new approach of “sustainability science”. The scientific production of articles was identified and analysed for the period 2008–2017 using the Web of Science (WoS). Moreover, this research study explores HEIs and their role in fostering sustainability, by assessing their research and the implementation of sustainability practices in Spanish HEIs. As well, it presents a delineation of the Sustainable Development Goals (SDGs) and proposes a methodology for classifying the output on each SDG. This analysis is done through unidimensional and multidimensional bibliometric indicators. These indicators have been divided and analysed in different levels of aggregation, from the most general to the most specific, starting with general research features and progressing to country, institutional, and thematic levels, among others. The results indicate a growing interest in sustainability research and a strong influence on the environmental pillar. Moreover, some countries with the highest scientific output are not as specialized in terms of topics as others with a lower output. Regarding institutions, the results obtained indicate that HEIs made an important research contribution to SD and are the ones that produce a higher number of documents. It was found that institutions tend to collaborate with other institutions that are close. By analysing sustainability practices in Spanish HEIs, it was found that there are more associations between variables such as having a sustainability plan and having a green office. However, this study clearly demonstrates that although SD is recognized as being very important to HEIs and society, it is not yet embedded in the whole system’s strategies, activities, and policies. In conclusion, this research study reveals that it is essential to identify sustainability strategies and introduce SD in all activities in the HEI environment. Finally, this thesis contributes to the literature on sustainable HEIs, as well as to how higher education for SD is understood and can be improved, especially in the Spanish higher education system. Moreover, this contributes to bibliometric study by offering two delineation approach to sustainability science and sustainable development goals as well as methodologies for classifying scientific output. This denotes the importante of bibliometric studies for the study and characterization of scientific output in a transdisciplinary field that can be extrapolated to other fields of study.Programa de Doctorado en Documentación: Archivos y Bibliotecas en el Entorno Digital por la Universidad Carlos III de MadridPresidente: Carlos Balaguer Bernaldo de Quirós.- Secretario: Birger Larsen.- Vocal: Sandra Sofía Ferreira Da Silva C

Evaluación de la investigación científica. El caso de Andalucía

La evaluación de los resultados de la ciencia y la tecnología resulta esencial para el desarrollo científico, económico y social de cualquier país. En el presente artículo se realiza una revisión del estado del arte de los estudios de evaluación de la investigación científica bajo un enfoque teórico conceptual. Se identifican los principales tipos de indicadores y fuentes de información científica como herramientas fundamentales de la evaluación. Se describe el sistema de evaluación en el contexto andaluz del conocimiento.The evaluation of the results of science and technology is essential for scientific, economic and social development of any country. In this article we review the state of the art of evaluation studies of scientific research under a theoretical concept. It identifies the main types of indicators and sources of scientific information as a key evaluation tool. We describe the evaluation system in the Andalusian context of knowledge

A Bibliometric Analysis of the Use of Technical Report Literature: Pre- and Post- Internet Distribution

Technological advances have changed the way information is accessed, retrieved, and utilized. The Internet has contributed to greater accessibility of scientific and technical information (STI), particularly in the arena of technical report literature. Technical reports, which communicate the results of research and development activities, are significant indicators of scientific trends because they often represent public and governmental interest in emerging fields of study. Prior to the widespread use of the Internet, technical reports were disseminated in print format with the use of specific, and often limited, distribution lists. However, as technical report literature found a home on the Internet, it became more accessible to the public as a discoverable resource on par with journal literature. This study investigates the transition from the traditional paper distribution to the digital distribution of technical reports beginning in the mid-1990s. Reports produced and distributed by Oak Ridge National Laboratory (ORNL) are examined to determine trends over time and across disciplines. The scientific disciplines of chemistry and engineering are contrasted with respect to citation patterns. A quantitative analysis is used to determine whether citation patterns of technical report literature reflect the transition from print access to digital access. Publication and citation information was collected in 2009 from ISI’s Web of Science product as well as from databases maintained by the Department of Energy’s Office of Scientific and Technical Information (OSTI)

Congress UPV Proceedings of the 21ST International Conference on Science and Technology Indicators

This is the book of proceedings of the 21st Science and Technology Indicators Conference that took place in València (Spain) from 14th to 16th of September 2016. The conference theme for this year, ‘Peripheries, frontiers and beyond’ aimed to study the development and use of Science, Technology and Innovation indicators in spaces that have not been the focus of current indicator development, for example, in the Global South, or the Social Sciences and Humanities. The exploration to the margins and beyond proposed by the theme has brought to the STI Conference an interesting array of new contributors from a variety of fields and geographies. This year’s conference had a record 382 registered participants from 40 different countries, including 23 European, 9 American, 4 Asia-Pacific, 4 Africa and Near East. About 26% of participants came from outside of Europe. There were also many participants (17%) from organisations outside academia including governments (8%), businesses (5%), foundations (2%) and international organisations (2%). This is particularly important in a field that is practice-oriented. The chapters of the proceedings attest to the breadth of issues discussed. Infrastructure, benchmarking and use of innovation indicators, societal impact and mission oriented-research, mobility and careers, social sciences and the humanities, participation and culture, gender, and altmetrics, among others. We hope that the diversity of this Conference has fostered productive dialogues and synergistic ideas and made a contribution, small as it may be, to the development and use of indicators that, being more inclusive, will foster a more inclusive and fair world