Further clarifications about the success-index

The aim of this brief communication is to reply to a letter by Kosmulski (Journal of Informetrics 6(3):368-369, 2012), which criticizes a recent indicator called "success-index". The most interesting features of this indicator, presented in Franceschini et al. (Scientometrics, in press), are: (i) allowing the selection of an "elite" subset from a set of publications and (ii) implementing the field-normalization at the level of an individual publication. We show that the Kosmulski's criticism is unfair and inappropriate, as it is the result of a misinterpretation of the indicato

Participation bias assessment in three high-impact journals

Studies into participation bias have examined participation trends, where it occurs, the factors affecting it, and methods to try to reduce it. However, some authors only discuss participation bias at the end of the study, some acknowledge it and apply a method to try to reduce it, while others ignore it or dismiss it as negligible. Issues of three high-impact epidemiology journals were examined; 81 articles were read and reviewed for potential participation bias. Categories were used to classify the approach taken to participation bias and the results recorded. Of the 81 articles considered, 42 (51%) were eligible and could have suffered from participation bias. It was found that 57% of these articles ignored the effects of participation bias, while 17% only considered it briefly in the discussion. Few articles (22%) attempted to reduce the participation bias, with over half of these using unsuitable methods (55%). This review highlights how participation bias is often not considered and hence the conclusions drawn from these studies may not be correct

Searching biomedical databases on complementary medicine: the use of controlled vocabulary among authors, indexers and investigators

BACKGROUND: The optimal retrieval of a literature search in biomedicine depends on the appropriate use of Medical Subject Headings (MeSH), descriptors and keywords among authors and indexers. We hypothesized that authors, investigators and indexers in four biomedical databases are not consistent in their use of terminology in Complementary and Alternative Medicine (CAM). METHODS: Based on a research question addressing the validity of spinal palpation for the diagnosis of neuromuscular dysfunction, we developed four search concepts with their respective controlled vocabulary and key terms. We calculated the frequency of MeSH, descriptors, and keywords used by authors in titles and abstracts in comparison to standard practices in semantic and analytic indexing in MEDLINE, MANTIS, CINAHL, and Web of Science. RESULTS: Multiple searches resulted in the final selection of 38 relevant studies that were indexed at least in one of the four selected databases. Of the four search concepts, validity showed the greatest inconsistency in terminology among authors, indexers and investigators. The use of spinal terms showed the greatest consistency. Of the 22 neuromuscular dysfunction terms provided by the investigators, 11 were not contained in the controlled vocabulary and six were never used by authors or indexers. Most authors did not seem familiar with the controlled vocabulary for validity in the area of neuromuscular dysfunction. Recently, standard glossaries have been developed to assist in the research development of manual medicine. CONCLUSIONS: Searching biomedical databases for CAM is challenging due to inconsistent use of controlled vocabulary and indexing procedures in different databases. A standard terminology should be used by investigators in conducting their search strategies and authors when writing titles, abstracts and submitting keywords for publications

The governance and performance of universities: evidence from Europe and the US

"We test the hypothesis that universities are more productive when they are both more autonomous and face more competition. Using survey data, we construct indices of university autonomy and competition for both Europe and the United States. We show that there are strong positive correlations between these indices and multiple measures of university output. To obtain causal evidence, we investigate exogenous shocks to US universities' expenditures over three decades. These shocks arise through the political appointment process, which we use to generate instrumental variables. We find that an exogenous increase in a university's expenditure generates more output, measured by either patents or publications, if the university is more autonomous and faces more competition. Exploiting variation over time in the 'stakes' of competitions for US federal research grants, we also find that universities generate more output for a given expenditure when research competitions are high stakes. We draw lessons, arguing that European universities could benefit from a combination of greater autonomy and greater accountability. Greater accountability might come through increased reliance on competitive grants, enhanced competition for students and faculty (promoted by reforms that increase mobility), and yardstick competitions (which often take the form of assessment exercises)." Copyright (c) CEPR, CES, MSH, 2010.