Assessing impact and quality from local dynamics of citation networks

International audienceWe show that essentially local dynamics of citation networks bring special information about the relevance/quality of a paper. Up to some rescaling, they exhibit universal behavior in citation dynamics: temporal patterns are remarkably consistent across disciplines, and uncover a prediction method for citations based on the structure of references only, at publication time. Above-average cited papers universally focus extensively on their own recent subfield - as such, citation counts essentially select what may plausibly be considered as the most disciplinary and normal science; whereas papers which have a peculiar dynamics, such as re-birthing scientific works - 'rediscovered classics' or 'early birds' - are comparatively poorly cited, despite their plausible relevance for the underlying communities. The "rebirth index" that we propose to quantify this phenomenon may be used as a complementary quality-defining criterion, in addition to final citation counts

Determinants of the international influence of a R&D organisation: a bibliometric approach

Traditionally, studies on the influence and impact of knowledge-producing organisations have been addressed by means of strict economic analysis, stressing their economic impact to a local, regional or national extent. In the present study, an alternative methodology is put forward in order to evaluate the international scientific impact and influence of a knowledge-producing and -diffusing institution. We introduce a new methodology, based on scientometric and bibliometric tools, which complement traditional assessments by considering the influence of a R&D institution when looking at the scientific production undertaken and the recognition of its relevance by its international peer community. Focusing on the most prolific scientific areas of INESC Porto, and resorting to published scientific work recorded in the Science Citation Index (SCI), we show that INESC Porto has enlarged its international scientific network. The logit estimations demonstrate that the wide geographical influence of INESC Porto scientific research is a result not of its international positioning in terms of co-authorships, but rather a result of the quality of its scientific output.Impact and influence assessment methods; R&D Institutions; Bibliometrics, Scientometrics; knowledge network; INESC Porto

Determinants of the international influence of a R&D organisation: a bibliometric approach

Traditionally, studies on the influence and impact of knowledge-producing organisations have been addressed by means of strict economic analysis, stressing their economic impact to a local, regional or national extent. In the present study, an alternative methodology is put forward in order to evaluate the international scientific impact and influence of a knowledge-producing and -diffusing institution. We introduce a new methodology, based on scientometric and bibliometric tools, which complement traditional assessments by considering the influence of a R&D institution when looking at the scientific production undertaken and the recognition of its relevance by its international peer community. Focusing on the most prolific scientific areas of INESC Porto, and resorting to published scientific work recorded in the Science Citation Index (SCI), we show that INESC Porto has enlarged its international scientific network. The logit estimations demonstrate that the wide geographical influence of INESC Porto scientific research is a result not of its international positioning in terms of co-authorships, but rather a result of the quality of its scientific output.Impact and influence assessment methods; R&D Institutions; Bibliometrics, Scientometrics; knowledge network; INESC Porto

Assessing the influence of R&D institutions by mapping international scientific networks: the case of INESC Porto

Although scientometric and bibliometric studies embrace a much wider perspective of the linkages/networks of R&D institutions than standard economic studies, to the best of our knowledge, these studies have not yet made use of scientometric tools to analyse the influence and impact of R&D institutions. Moreover, the international perspective has so far been neglected both in standard and bibliometric studies. Based on networks of 1239 foreign co-authorships and 13035 foreign citation linkages, we demonstrate that INESC Porto international influence has considerably expanded since 2003, a year that coincided with the implementation of an internal policy of granting monetary prizes to publications in scientific international journals. In terms of co-authorship, the network of INESC Porto more than duplicated (13 countries in the initial period to 27 in 2004-07). In terms of citations, INESC Porto’s network encompassed almost 40 countries during the whole period (1996-2007). Its more prolific units (optoelectronics, energy and multimedia) presented a rather distinct pattern both in terms of size and evolution of the corresponding network boundaries. The network size of foreign co-authorships was not much different between the three units by the beginning of the 2000s (around 10 countries) but it evolved quite distinctly. The most remarkable pattern was registered by the multimedia (UTM) unit, whose network size rose exponentially to 21 countries in 2004-07. This contrasted with the decline (down to 8 countries) of the energy (USE) unit. The citation network of the optoelectronic unit (UOSE) was by far the largest, until 2003, involving 34 distinct countries, which contrasted with the size of USE (12 countries) and UTM (1 country). But again, after 2003, the size of the citation network of USE and UTM converged spectacularly to that of UOSE’s, reaching in the last period 21 and 16, respectively. The influence of INESC Porto reaches all five continents, especially when we consider citation networks. Indeed, excluding the citations from authors affiliated in Portuguese institutions, those that most cite INESC Porto’s (and UOSE’s) works are affiliated in institutions located in China, the UK and the US. The scientific works produced by USE influences mostly authors affiliated in institutions located in India, China and Spain, whereas for UTM the corresponding countries are the US, Germany and Italy. We infer from the evidence analysed that not only did the boundaries of INESC Porto’s scientific network substantially enlarge in the period of analysis (1996-2007) but its ‘quality’ also evidenced a positive evolution, with authors affiliated in institutions located in the scientific frontier countries citing works of INESC Porto (and its units).Bibliometrics, Knowledge networks; R&D Institutions

Assessing the influence of R&D institutions by mapping international scientific networks: the case of INESC Porto

Although scientometric and bibliometric studies embrace a much wider perspective of the linkages/networks of R&D institutions than standard economic studies, to the best of our knowledge, these studies have not yet made use of scientometric tools to analyse the influence and impact of R&D institutions. Moreover, the international perspective has so far been neglected both in standard and bibliometric studies. Based on networks of 1239 foreign co-authorships and 13035 foreign citation linkages, we demonstrate that INESC Porto international influence has considerably expanded since 2003, a year that coincided with the implementation of an internal policy of granting monetary prizes to publications in scientific international journals. In terms of co-authorship, the network of INESC Porto more than duplicated (13 countries in the initial period to 27 in 2004-07). In terms of citations, INESC Porto’s network encompassed almost 40 countries during the whole period (1996-2007). Its more prolific units (optoelectronics, energy and multimedia) presented a rather distinct pattern both in terms of size and evolution of the corresponding network boundaries. The network size of foreign co-authorships was not much different between the three units by the beginning of the 2000s (around 10 countries) but it evolved quite distinctly. The most remarkable pattern was registered by the multimedia (UTM) unit, whose network size rose exponentially to 21 countries in 2004-07. This contrasted with the decline (down to 8 countries) of the energy (USE) unit. The citation network of the optoelectronic unit (UOSE) was by far the largest, until 2003, involving 34 distinct countries, which contrasted with the size of USE (12 countries) and UTM (1 country). But again, after 2003, the size of the citation network of USE and UTM converged spectacularly to that of UOSE’s, reaching in the last period 21 and 16, respectively. The influence of INESC Porto reaches all five continents, especially when we consider citation networks. Indeed, excluding the citations from authors affiliated in Portuguese institutions, those that most cite INESC Porto’s (and UOSE’s) works are affiliated in institutions located in China, the UK and the US. The scientific works produced by USE influences mostly authors affiliated in institutions located in India, China and Spain, whereas for UTM the corresponding countries are the US, Germany and Italy. We infer from the evidence analysed that not only did the boundaries of INESC Porto’s scientific network substantially enlarge in the period of analysis (1996-2007) but its ‘quality’ also evidenced a positive evolution, with authors affiliated in institutions located in the scientific frontier countries citing works of INESC Porto (and its units). Length: 64 pagesBibliometrics, Knowledge networks; R&D Institutions

World caf\ue9 method to engage smart energy-district project partners in assessing urban co-benefits

Urban energy-district projects introduce outstanding technological innovation in buildings and energy systems increasing sustainability in city neighborhoods. Such projects generate additional co-benefits for the city beyond changes in physical elements and development of social and institutional relationships (e.g. local employment, environmental quality, public health, property values, innovation attitude, etc.). Since exceeding main declared goals or not always clearly foreseen in the early project phase, these co-benefits are often not properly understood and considered. However, only their explicit recognition will make possible their inclusion in the assessment of the whole project\u2019s performance. From these considerations, this study faces the issue of engaging project partners in assessing co-benefits in order to consider a broad spectrum of relevant, positive effects in the evaluation process. Group knowledge and group thinking of this complex topic are investigated through the world caf\ue9 method, providing an atmosphere of trust and open discussions among participants. This empirical work lays the foundations to go beyond the mere economic measure as the sole criterion for assessing project effects, also including changes in end-user behavior and intangible asset

Social networks : the future for health care delivery

With the rapid growth of online social networking for health, health care systems are experiencing an inescapable increase in complexity. This is not necessarily a drawback; self-organising, adaptive networks could become central to future health care delivery. This paper considers whether social networks composed of patients and their social circles can compete with, or complement, professional networks in assembling health-related information of value for improving health and health care. Using the framework of analysis of a two-sided network – patients and providers – with multiple platforms for interaction, we argue that the structure and dynamics of such a network has implications for future health care. Patients are using social networking to access and contribute health information. Among those living with chronic illness and disability and engaging with social networks, there is considerable expertise in assessing, combining and exploiting information. Social networking is providing a new landscape for patients to assemble health information, relatively free from the constraints of traditional health care. However, health information from social networks currently complements traditional sources rather than substituting for them. Networking among health care provider organisations is enabling greater exploitation of health information for health care planning. The platforms of interaction are also changing. Patient-doctor encounters are now more permeable to influence from social networks and professional networks. Diffuse and temporary platforms of interaction enable discourse between patients and professionals, and include platforms controlled by patients. We argue that social networking has the potential to change patterns of health inequalities and access to health care, alter the stability of health care provision and lead to a reformulation of the role of health professionals. Further research is needed to understand how network structure combined with its dynamics will affect the flow of information and potentially the allocation of health care resources

Three-feature model to reproduce the topology of citation networks and the effects from authors' visibility on their h-index

Various factors are believed to govern the selection of references in citation networks, but a precise, quantitative determination of their importance has remained elusive. In this paper, we show that three factors can account for the referencing pattern of citation networks for two topics, namely "graphenes" and "complex networks", thus allowing one to reproduce the topological features of the networks built with papers being the nodes and the edges established by citations. The most relevant factor was content similarity, while the other two - in-degree (i.e. citation counts) and {age of publication} had varying importance depending on the topic studied. This dependence indicates that additional factors could play a role. Indeed, by intuition one should expect the reputation (or visibility) of authors and/or institutions to affect the referencing pattern, and this is only indirectly considered via the in-degree that should correlate with such reputation. Because information on reputation is not readily available, we simulated its effect on artificial citation networks considering two communities with distinct fitness (visibility) parameters. One community was assumed to have twice the fitness value of the other, which amounts to a double probability for a paper being cited. While the h-index for authors in the community with larger fitness evolved with time with slightly higher values than for the control network (no fitness considered), a drastic effect was noted for the community with smaller fitness

A Review of Theory and Practice in Scientometrics

Scientometrics is the study of the quantitative aspects of the process of science as a communication system. It is centrally, but not only, concerned with the analysis of citations in the academic literature. In recent years it has come to play a major role in the measurement and evaluation of research performance. In this review we consider: the historical development of scientometrics, sources of citation data, citation metrics and the “laws" of scientometrics, normalisation, journal impact factors and other journal metrics, visualising and mapping science, evaluation and policy, and future developments