Bibliometrics of systematic reviews : analysis of citation rates and journal impact factors

Background: Systematic reviews are important for informing clinical practice and health policy. The aim of this study was to examine the bibliometrics of systematic reviews and to determine the amount of variance in citations predicted by the journal impact factor (JIF) alone and combined with several other characteristics. Methods: We conducted a bibliometric analysis of 1,261 systematic reviews published in 2008 and the citations to them in the Scopus database from 2008 to June 2012. Potential predictors of the citation impact of the reviews were examined using descriptive, univariate and multiple regression analysis. Results: The mean number of citations per review over four years was 26.5 (SD +/-29.9) or 6.6 citations per review per year. The mean JIF of the journals in which the reviews were published was 4.3 (SD +/-4.2). We found that 17% of the reviews accounted for 50% of the total citations and 1.6% of the reviews were not cited. The number of authors was correlated with the number of citations (r = 0.215, P =5.16) received citations in the bottom quartile (eight or fewer), whereas 9% of reviews published in the lowest JIF quartile (<=2.06) received citations in the top quartile (34 or more). Six percent of reviews in journals with no JIF were also in the first quartile of citations. Conclusions: The JIF predicted over half of the variation in citations to the systematic reviews. However, the distribution of citations was markedly skewed. Some reviews in journals with low JIFs were well-cited and others in higher JIF journals received relatively few citations; hence the JIF did not accurately represent the number of citations to individual systematic reviews

Invasion of exotic earthworms into ecosystems inhabited by native earthworms

The most conspicuous biological invasions in terrestrial ecosystems have been by exotic plants, insects and vertebrates. Invasions by exotic earthworms, although not as well studied, may be increasing with global commerce in agriculture, waste management and bioremediation. A number of cases has documented where invasive earthworms have caused significant changes in soil profiles, nutrient and organic matter dynamics, other soil organisms or plant communities. Most of these cases are in areas that have been disturbed (e.g., agricultural systems) or were previously devoid of earthworms (e.g., north of Pleistocene glacial margins). It is not clear that such effects are common in ecosystems inhabited by native earthworms, especially where soils are undisturbed. We explore the idea that indigenous earthworm fauna and/or characteristics of their native habitats may resist invasion by exotic earthworms and thereby reduce the impact of exotic species on soil processes. We review data and case studies from temperate and tropical regions to test this idea. Specifically, we address the following questions: Is disturbance a prerequisite to invasion by exotic earthworms? What are the mechanisms by which exotic earthworms may succeed or fail to invade habitats occupied by native earthworms? Potential mechanisms could include (1) intensity of propagule pressure (how frequently and at what densities have exotic species been introduced and has there been adequate time for proliferation?); (2) degree of habitat matching (once introduced, are exotic species faced with unsuitable habitat conditions, unavailable resources, or unsuited feeding strategies?); and (3) degree of biotic resistance (after introduction into an otherwise suitable habitat, are exotic species exposed to biological barriers such as predation or parasitism, ‘‘unfamiliar’’ microflora, or competition by resident native species?). Once established, do exotic species coexist with native species, or are the natives eventually excluded? Do exotic species impact soil processes differently in the presence or absence of native species? We conclude that (1) exotic earthworms do invade ecosystems inhabited by indigenous earthworms, even in the absence of obvious disturbance; (2) competitive exclusion of native earthworms by exotic earthworms is not easily demonstrated and, in fact, co-existence of native and exotic species appears to be common, even if transient; and (3) resistance to exotic earthworm invasions, if it occurs, may be more a function of physical and chemical characteristics of a habitat than of biological interactions between native and exotic earthworms

Impact Factor: outdated artefact or stepping-stone to journal certification?

A review of Garfield's journal impact factor and its specific implementation as the Thomson Reuters Impact Factor reveals several weaknesses in this commonly-used indicator of journal standing. Key limitations include the mismatch between citing and cited documents, the deceptive display of three decimals that belies the real precision, and the absence of confidence intervals. These are minor issues that are easily amended and should be corrected, but more substantive improvements are needed. There are indications that the scientific community seeks and needs better certification of journal procedures to improve the quality of published science. Comprehensive certification of editorial and review procedures could help ensure adequate procedures to detect duplicate and fraudulent submissions.Comment: 25 pages, 12 figures, 6 table

Applications of Laboratory Technology in the Evaluation of the Risk of Rabies Transmissions by Biting Dogs and Cats

While rabies is not a common disease in domestic animal species of the United States, potential exposures to rabies in the form of bites are very common and increasing. A nationwide study conducted among general hospitals shows that 1 percent of emergency room visits are for animal bites, of which 80-90 percent are inflicted by the dog (Callaham 1980). This figure is conservative, as the study did not include pediatric hospitals, the bite of victims that progress only to a physician\u27s office, or those that receive no medical care at all. In Missouri alone, this study would infer about 1500 dog bites per year reaching only the general hospital. The number of dog and other animal bites across the country is unknown but may safely be assumed to be staggering in magnitude

Methodology for the development of a Canadian national EMS research agenda

<p>Abstract</p> <p>Background</p> <p>Many health care disciplines use evidence-based decision making to improve patient care and system performance. While the amount and quality of emergency medical services (EMS) research in Canada has increased over the past two decades, there has not been a unified national plan to enable research, ensure efficient use of research resources, guide funding decisions and build capacity in EMS research. Other countries have used research agendas to identify barriers and opportunities in EMS research and define national research priorities. The objective of this project is to develop a national EMS research agenda for Canada that will: 1) explore what barriers to EMS research currently exist, 2) identify current strengths and opportunities that may be of benefit to advancing EMS research, 3) make recommendations to overcome barriers and capitalize on opportunities, and 4) identify national EMS research priorities.</p> <p>Methods/Design</p> <p>Paramedics, educators, EMS managers, medical directors, researchers and other key stakeholders from across Canada will be purposefully recruited to participate in this mixed methods study, which consists of three phases: 1) qualitative interviews with a selection of the study participants, who will be asked about their experience and opinions about the four study objectives, 2) a facilitated roundtable discussion, in which all participants will explore and discuss the study objectives, and 3) an online Delphi consensus survey, in which all participants will be asked to score the importance of each topic discovered during the interviews and roundtable as they relate to the study objectives. Results will be analyzed to determine the level of consensus achieved for each topic.</p> <p>Discussion</p> <p>A mixed methods approach will be used to address the four study objectives. We anticipate that the keys to success will be: 1) ensuring a representative sample of EMS stakeholders, 2) fostering an open and collaborative roundtable discussion, and 3) adhering to a predefined approach to measure consensus on each topic. Steps have been taken in the methodology to address each of these <it>a priori </it>concerns.</p

Characteristics Associated with Citation Rate of the Medical Literature

BACKGROUND: The citation rate for articles is viewed as a measure of their importance and impact; however, little is known about what features of articles are associated with higher citation rate. METHODOLOGY/PRINCIPAL FINDINGS: We conducted a cohort study of all original articles, regardless of study methodology, published in the Lancet, JAMA, and New England Journal of Medicine, from October 1, 1999 to March 31, 2000. We identified 328 articles. Two blinded, independent reviewers extracted, in duplicate, nine variables from each article, which were analyzed in both univariable and multivariable linear least-squares regression models for their association with the annual rate of citations received by the article since publication. A two-way interaction between industry funding and an industry-favoring result was tested and found to be significant (p = 0.02). In our adjusted analysis, the presence of industry funding and an industry-favoring result was associated with an increase in annual citation rate of 25.7 (95% confidence interval, 8.5 to 42.8) compared to the absence of both industry funding and industry-favoring results. Higher annual rates of citation were also associated with articles dealing with cardiovascular medicine (13.3 more; 95% confidence interval, 3.9 to 22.3) and oncology (12.6 more; 95% confidence interval, 1.2 to 24.0), articles with group authorship (11.1 more; 95% confidence interval, 2.7 to 19.5), larger sample size and journal of publication. CONCLUSIONS/SIGNIFICANCE: Large trials, with group authorship, industry-funded, with industry-favoring results, in oncology or cardiology were associated with greater subsequent citations

Peer review quality and transparency of the peer-review process in open access and subscription journals

BACKGROUND:Recent controversies highlighting substandard peer review in Open Access (OA) and traditional (subscription) journals have increased the need for authors, funders, publishers, and institutions to assure quality of peer-review in academic journals. I propose that transparency of the peer-review process may be seen as an indicator of the quality of peer-review, and develop and validate a tool enabling different stakeholders to assess transparency of the peer-review process. METHODS AND FINDINGS:Based on editorial guidelines and best practices, I developed a 14-item tool to rate transparency of the peer-review process on the basis of journals' websites. In Study 1, a random sample of 231 authors of papers in 92 subscription journals in different fields rated transparency of the journals that published their work. Authors' ratings of the transparency were positively associated with quality of the peer-review process but unrelated to journal's impact factors. In Study 2, 20 experts on OA publishing assessed the transparency of established (non-OA) journals, OA journals categorized as being published by potential predatory publishers, and journals from the Directory of Open Access Journals (DOAJ). Results show high reliability across items (α = .91) and sufficient reliability across raters. Ratings differentiated the three types of journals well. In Study 3, academic librarians rated a random sample of 140 DOAJ journals and another 54 journals that had received a hoax paper written by Bohannon to test peer-review quality. Journals with higher transparency ratings were less likely to accept the flawed paper and showed higher impact as measured by the h5 index from Google Scholar. CONCLUSIONS:The tool to assess transparency of the peer-review process at academic journals shows promising reliability and validity. The transparency of the peer-review process can be seen as an indicator of peer-review quality allowing the tool to be used to predict academic quality in new journals

Cooperation between Referees and Authors Increases Peer Review Accuracy

Peer review is fundamentally a cooperative process between scientists in a community who agree to review each other's work in an unbiased fashion. Peer review is the foundation for decisions concerning publication in journals, awarding of grants, and academic promotion. Here we perform a laboratory study of open and closed peer review based on an online game. We show that when reviewer behavior was made public under open review, reviewers were rewarded for refereeing and formed significantly more cooperative interactions (13% increase in cooperation, P = 0.018). We also show that referees and authors who participated in cooperative interactions had an 11% higher reviewing accuracy rate (P = 0.016). Our results suggest that increasing cooperation in the peer review process can lead to a decreased risk of reviewing errors