Peer-review in a world with rational scientists: Toward selection of the average

One of the virtues of peer review is that it provides a self-regulating selection mechanism for scientific work, papers and projects. Peer review as a selection mechanism is hard to evaluate in terms of its efficiency. Serious efforts to understand its strengths and weaknesses have not yet lead to clear answers. In theory peer review works if the involved parties (editors and referees) conform to a set of requirements, such as love for high quality science, objectiveness, and absence of biases, nepotism, friend and clique networks, selfishness, etc. If these requirements are violated, what is the effect on the selection of high quality work? We study this question with a simple agent based model. In particular we are interested in the effects of rational referees, who might not have any incentive to see high quality work other than their own published or promoted. We find that a small fraction of incorrect (selfish or rational) referees can drastically reduce the quality of the published (accepted) scientific standard. We quantify the fraction for which peer review will no longer select better than pure chance. Decline of quality of accepted scientific work is shown as a function of the fraction of rational and unqualified referees. We show how a simple quality-increasing policy of e.g. a journal can lead to a loss in overall scientific quality, and how mutual support-networks of authors and referees deteriorate the system.Comment: 5 pages 4 figure

Natural IgM antibodies in the immune defence against neoehrlichiosis

Background: Neoehrlichiosis is an infectious disease caused by the tick-borne bacterium “Candidatus Neoehrlichia mikurensis”. Splenectomy and rituximab therapies are risk factors for severe neoehrlichiosis. Our aim was to examine if neoehrlichiosis patients had low levels of natural IgM antibodies and/or were hypogammaglobulinemic, and if such deficiencies were associated with asplenia and vascular complications. Methods: Neoehrlichiosis patients (n = 9) and control subjects (n = 10) were investigated for serum levels of IgG, IgA, and IgM, and for levels of natural IgM antibodies to pneumococcal polysaccharides (6B, 14), and to the malondialdehyde acetaldehyde epitope of oxidized LDL. The multivariate method Projection to Latent Structures was used to analyze the data. Results: The levels of natural IgM antibodies of various specificities were decreased or not measurable in half of the studied patients with neoehrlichiosis. Only one patient and one control subject were hypogammaglobulinemic. An inverse relationship was noted between the levels of natural IgM antibodies and the development of deep vein thrombosis. Unexpectedly, no association was seen between having or not having a spleen and the levels of natural IgM antibody levels in the circulation. Conclusions: Neither hypogammaglobulinemia nor lack of natural IgM antibodies alone predisposes for severe neoehrlichiosis. The importance of the spleen in the immune defence against Ca. N. mikurensis probably lies in its capacity to generate or maintain specific antibodies

From External Evaluation, to School Self-evaluation, to Peer Review

Most modern systems of school education around the world now have highly developed evaluation processes. Following quickly in the wake of external evaluation policies have followed calls for schools to develop their own capacities for self-review. An OECD report (2013) describes a number of ways in which developing school evaluation capacity should be a priority for school improvement. Among the report’s suggestions are promoting peer learning among schools (pp. 469–470). This chapter describes the research on external evaluation, internal evaluation and the relationship between these two. It then moves on to define and describes peer review and chart its growth. The accountability dimension of peer review is also explored. Finally the existing evidence on peer review is presented from the vocational and schools sectors to show key findings so far, and key conditions for effective peer review are described

Cooperation between Referees and Authors Increases Peer Review Accuracy

Peer review is fundamentally a cooperative process between scientists in a community who agree to review each other's work in an unbiased fashion. Peer review is the foundation for decisions concerning publication in journals, awarding of grants, and academic promotion. Here we perform a laboratory study of open and closed peer review based on an online game. We show that when reviewer behavior was made public under open review, reviewers were rewarded for refereeing and formed significantly more cooperative interactions (13% increase in cooperation, P = 0.018). We also show that referees and authors who participated in cooperative interactions had an 11% higher reviewing accuracy rate (P = 0.016). Our results suggest that increasing cooperation in the peer review process can lead to a decreased risk of reviewing errors

Characterizing a scientific elite: the social characteristics of the most highly cited scientists in environmental science and ecology

In science, a relatively small pool of researchers garners a disproportionally large number of citations. Still, very little is known about the social characteristics of highly cited scientists. This is unfortunate as these researchers wield a disproportional impact on their fields, and the study of highly cited scientists can enhance our understanding of the conditions which foster highly cited work, the systematic social inequalities which exist in science, and scientific careers more generally. This study provides information on this understudied subject by examining the social characteristics and opinions of the 0.1% most cited environmental scientists and ecologists. Overall, the social characteristics of these researchers tend to reflect broader patterns of inequality in the global scientific community. However, while the social characteristics of these researchers mirror those of other scientific elites in important ways, they differ in others, revealing findings which are both novel and surprising, perhaps indicating multiple pathways to becoming highly cited

Type II Heat-Labile Enterotoxins from 50 Diverse Escherichia coli Isolates Belong Almost Exclusively to the LT-IIc Family and May Be Prophage Encoded

Some enterotoxigenic Escherichia coli (ETEC) produce a type II heat-labile enterotoxin (LT-II) that activates adenylate cyclase in susceptible cells but is not neutralized by antisera against cholera toxin or type I heat-labile enterotoxin (LT-I). LT-I variants encoded by plasmids in ETEC from humans and pigs have amino acid sequences that are ≥95% identical. In contrast, LT-II toxins are chromosomally encoded and are much more diverse. Early studies characterized LT-IIa and LT-IIb variants, but a novel LT-IIc was reported recently. Here we characterized the LT-II encoding loci from 48 additional ETEC isolates. Two encoded LT-IIa, none encoded LT-IIb, and 46 encoded highly related variants of LT-IIc. Phylogenetic analysis indicated that the predicted LT-IIc toxins encoded by these loci could be assigned to 6 subgroups. The loci corresponding to individual toxins within each subgroup had DNA sequences that were more than 99% identical. The LT-IIc subgroups appear to have arisen by multiple recombinational events between progenitor loci encoding LT-IIc1- and LT-IIc3-like variants. All loci from representative isolates encoding the LT-IIa, LT-IIb, and each subgroup of LT-IIc enterotoxins are preceded by highly-related genes that are between 80 and 93% identical to predicted phage lysozyme genes. DNA sequences immediately following the B genes differ considerably between toxin subgroups, but all are most closely related to genomic sequences found in predicted prophages. Together these data suggest that the LT-II loci are inserted into lambdoid type prophages that may or may not be infectious. These findings raise the possibility that production of LT-II enterotoxins by ETEC may be determined by phage conversion and may be activated by induction of prophage, in a manner similar to control of production of Shiga-like toxins by converting phages in isolates of enterohemmorhagic E. coli