Universality of Performance Indicators based on Citation and Reference Counts

We find evidence for the universality of two relative bibliometric indicators of the quality of individual scientific publications taken from different data sets. One of these is a new index that considers both citation and reference counts. We demonstrate this universality for relatively well cited publications from a single institute, grouped by year of publication and by faculty or by department. We show similar behaviour in publications submitted to the arXiv e-print archive, grouped by year of submission and by sub-archive. We also find that for reasonably well cited papers this distribution is well fitted by a lognormal with a variance of around 1.3 which is consistent with the results of Radicchi, Fortunato, and Castellano (2008). Our work demonstrates that comparisons can be made between publications from different disciplines and publication dates, regardless of their citation count and without expensive access to the whole world-wide citation graph. Further, it shows that averages of the logarithm of such relative bibliometric indices deal with the issue of long tails and avoid the need for statistics based on lengthy ranking procedures.Comment: 15 pages, 14 figures, 11 pages of supplementary material. Submitted to Scientometric

Towards a new crown indicator: an empirical analysis

We present an empirical comparison between two normalization mechanisms for citation-based indicators of research performance. These mechanisms aim to normalize citation counts for the field and the year in which a publication was published. One mechanism is applied in the current so-called crown indicator of our institute. The other mechanism is applied in the new crown indicator that our institute is currently exploring. We find that at high aggregation levels, such as at the level of large research institutions or at the level of countries, the differences between the two mechanisms are very small. At lower aggregation levels, such as at the level of research groups or at the level of journals, the differences between the two mechanisms are somewhat larger. We pay special attention to the way in which recent publications are handled. These publications typically have very low citation counts and should therefore be handled with special care

Microwave studies of the fractional Josephson effect in HgTe-based Josephson junctions

The rise of topological phases of matter is strongly connected to their potential to host Majorana bound states, a powerful ingredient in the search for a robust, topologically protected, quantum information processing. In order to produce such states, a method of choice is to induce superconductivity in topological insulators. The engineering of the interplay between superconductivity and the electronic properties of a topological insulator is a challenging task and it is consequently very important to understand the physics of simple superconducting devices such as Josephson junctions, in which new topological properties are expected to emerge. In this article, we review recent experiments investigating topological superconductivity in topological insulators, using microwave excitation and detection techniques. More precisely, we have fabricated and studied topological Josephson junctions made of HgTe weak links in contact with two Al or Nb contacts. In such devices, we have observed two signatures of the fractional Josephson effect, which is expected to emerge from topologically-protected gapless Andreev bound states. We first recall the theoretical background on topological Josephson junctions, then move to the experimental observations. Then, we assess the topological origin of the observed features and conclude with an outlook towards more advanced microwave spectroscopy experiments, currently under development.Comment: Lectures given at the San Sebastian Topological Matter School 2017, published in "Topological Matter. Springer Series in Solid-State Sciences, vol 190. Springer

Contribution of Case Reports to Brain Metastases Research: Systematic Review and Analysis of Pattern of Citation

Research activity related to different aspects of prevention, prediction, diagnosis and treatment of brain metastases has increased during recent years. One of the major databases (Scopus) contains 942 scientific articles that were published during the 5-year time period 2006–2010. Of these, 195 (21%) reported on single patient cases and 12 (1%) were reports of 2 cases. Little is known about their influence on advancement of the field or scientific merits. Do brain metastases case reports attract attention and provide stimuli for further research or do they go largely unrecognized? Different measures of impact, visibility and quality of published research are available, each with its own pros and cons. For the present evaluation, article citation rate was chosen. The median number of citations overall and stratified by year of publication was 0, except for the year 2006 when it was 2. As compared to other articles, case reports remained more often without citation (p<0.05 except for 2006 data). All case reports with 10 or more citations (n = 6) reported on newly introduced anticancer drugs, which commonly are prescribed to treat extracranial metastases, and the responses observed in single patients with brain metastases. Average annual numbers of citations were also calculated. The articles with most citations per year were the same six case reports mentioned above (the only ones that obtained more than 2.0 citations per year). Citations appeared to gradually increase during the first two years after publication but remained on a generally low or modest level. It cannot be excluded that case reports without citation provide interesting information to some clinicians or researchers. Apparently, case reports describing unexpected therapeutic success gain more attention, at least in terms of citation, than others

Does the Committee Peer Review Select the Best Applicants for Funding? An Investigation of the Selection Process for Two European Molecular Biology Organization Programmes

Does peer review fulfill its declared objective of identifying the best science and the best scientists? In order to answer this question we analyzed the Long-Term Fellowship and the Young Investigator programmes of the European Molecular Biology Organization. Both programmes aim to identify and support the best post doctoral fellows and young group leaders in the life sciences. We checked the association between the selection decisions and the scientific performance of the applicants. Our study involved publication and citation data for 668 applicants to the Long-Term Fellowship programme from the year 1998 (130 approved, 538 rejected) and 297 applicants to the Young Investigator programme (39 approved and 258 rejected applicants) from the years 2001 and 2002. If quantity and impact of research publications are used as a criterion for scientific achievement, the results of (zero-truncated) negative binomial models show that the peer review process indeed selects scientists who perform on a higher level than the rejected ones subsequent to application. We determined the extent of errors due to over-estimation (type I errors) and under-estimation (type 2 errors) of future scientific performance. Our statistical analyses point out that between 26% and 48% of the decisions made to award or reject an application show one of both error types. Even though for a part of the applicants, the selection committee did not correctly estimate the applicant's future performance, the results show a statistically significant association between selection decisions and the applicants' scientific achievements, if quantity and impact of research publications are used as a criterion for scientific achievement

Effectiveness of Journal Ranking Schemes as a Tool for Locating Information

BACKGROUND: The rise of electronic publishing, preprint archives, blogs, and wikis is raising concerns among publishers, editors, and scientists about the present day relevance of academic journals and traditional peer review. These concerns are especially fuelled by the ability of search engines to automatically identify and sort information. It appears that academic journals can only remain relevant if acceptance of research for publication within a journal allows readers to infer immediate, reliable information on the value of that research. METHODOLOGY/PRINCIPAL FINDINGS: Here, we systematically evaluate the effectiveness of journals, through the work of editors and reviewers, at evaluating unpublished research. We find that the distribution of the number of citations to a paper published in a given journal in a specific year converges to a steady state after a journal-specific transient time, and demonstrate that in the steady state the logarithm of the number of citations has a journal-specific typical value. We then develop a model for the asymptotic number of citations accrued by papers published in a journal that closely matches the data. CONCLUSIONS/SIGNIFICANCE: Our model enables us to quantify both the typical impact and the range of impacts of papers published in a journal. Finally, we propose a journal-ranking scheme that maximizes the efficiency of locating high impact research

Excretion patterns of coccidian oocysts and nematode eggs during the reproductive season in Northern Bald Ibis (Geronticus eremita)

Individual reproductive success largely depends on the ability to optimize behaviour, immune function and the physiological stress response. We have investigated correlations between behaviour, faecal steroid metabolites, immune parameters, parasite excretion patterns and reproductive output in a critically endangered avian species, the Northern Bald Ibis (Geronticus eremita). In particular, we related haematocrit, heterophil/lymphocyte ratio, excreted immune-reactive corticosterone metabolites and social behaviour with parasite excretion and two individual fitness parameters, namely, number of eggs laid and number of fledglings. We found that the frequency of excretion of parasites’ oocysts and eggs tended to increase with ambient temperature. Paired individuals excreted significantly more samples containing nematode eggs than unpaired ones. The excretion of nematode eggs was also significantly more frequent in females than in males. Individuals with a high proportion of droppings containing coccidian oocysts were more often preened by their partners than individuals with lower excretion rates. We observed that the more eggs an individual incubated and the fewer offspring fledged, the higher the rates of excreted samples containing coccidian oocysts. Our results confirm that social behaviour, physiology and parasite burden are linked in a complex and context-dependent manner. They also contribute background information supporting future conservation programmes dealing with this critically endangered species

A bibliometric study of human–computer interaction research activity in the Nordic-Baltic Eight countries

Human–computer interaction (HCI) has become an important area for designers and developers worldwide, and research activities set in national cultural contexts addressing local challenges are often needed in industry and academia. This study explored HCI research in the Nordic-Baltic countries using bibliometric methods. The results show that the activity varies greatly across the region with activities dominated by Finland, Sweden, and Denmark, even when adjusting for differences in population size and GDP. Research output variations were larger for the top-tier conferences compared to entry-tier conferences and journals. Locally hosted conferences were associated with local increases in research activity. HCI research longevity appears to be an indicator of research maturity and quantity. HCI researchers typically collaborated either with colleagues within the same institution or with researchers from countries outside the Nordic-Baltic region such as US and the UK. There was less collaboration between national and Nordic-Baltic partners. Collaboration appeared especially prevalent for top-tier conference papers. Top-tier conference papers were also more frequently cited than regional-tier and entry-tier conferences, yet journal articles were cited the most. One implication of this study is that the HCI research activity gaps across the Nordic-Baltic countries should be narrowed by increasing the activity in countries with low research outputs. To achieve this, first-time authors could receive guidance through collaborations with experienced authors in the same institution or other labs around the world. More conferences could also be hosted locally. Furthermore, journals may be more effective than conferences if the goal is to accumulate citations.publishedVersio