The Relationship of Previous Training and Experience of Journal Peer Reviewers to Subsequent Review Quality

BACKGROUND: Peer review is considered crucial to the selection and publication of quality science, but very little is known about the previous experiences and training that might identify high-quality peer reviewers. The reviewer selection processes of most journals, and thus the qualifications of their reviewers, are ill defined. More objective selection of peer reviewers might improve the journal peer review process and thus the quality of published science. METHODS AND FINDINGS: 306 experienced reviewers (71% of all those associated with a specialty journal) completed a survey of past training and experiences postulated to improve peer review skills. Reviewers performed 2,856 reviews of 1,484 separate manuscripts during a four-year study period, all prospectively rated on a standardized quality scale by editors. Multivariable analysis revealed that most variables, including academic rank, formal training in critical appraisal or statistics, or status as principal investigator of a grant, failed to predict performance of higher-quality reviews. The only significant predictors of quality were working in a university-operated hospital versus other teaching environment and relative youth (under ten years of experience after finishing training). Being on an editorial board and doing formal grant (study section) review were each predictors for only one of our two comparisons. However, the predictive power of all variables was weak. CONCLUSIONS: Our study confirms that there are no easily identifiable types of formal training or experience that predict reviewer performance. Skill in scientific peer review may be as ill defined and hard to impart as is “common sense.” Without a better understanding of those skills, it seems unlikely journals and editors will be successful in systematically improving their selection of reviewers. This inability to predict performance makes it imperative that all but the smallest journals implement routine review ratings systems to routinely monitor the quality of their reviews (and thus the quality of the science they publish)

Ion Exchange Technology Development in Support of the Urine Processor Assembly Precipitation Prevention Project for the International Space Station

In support of the Urine Processor Assembly Precipitation Prevention Project (UPA PPP), multiple technologies were explored to prevent CaSO4 dot 2H2O (gypsum) precipitation during the on-orbit distillation process. Gypsum precipitation currently limits the water recovery rate onboard the International Space Station (ISS) to 70% versus the planned 85% target water recovery rate. Due to its advanced performance in removing calcium cations in pretreated augmented urine (PTAU), ion exchange was selected as one of the technologies for further development by the PPP team. A total of 12 ion exchange resins were evaluated in various equilibrium and dynamic column tests with solutions of dissolved gypsum, urine ersatz, PTAU, and PTAU brine at 85% water recovery. While initial evaluations indicated that the Purolite SST60 resin had the highest calcium capacity in PTAU (0.30 meq/mL average), later tests showed that the Dowex G26 and Amberlite FPC12H resins had the highest capacity (0.5 meq/mL average). Further dynamic column testing proved that G26 performance is +/- 10% of that value at flow rates of 0.45 and 0.79 Lph under continuous flow, and 10.45 Lph under pulsed flow. Testing at the Marshall Spaceflight Center (MSFC) integrates the ion exchange technology with a UPA ground article under flight-like pulsed flow conditions with PTAU. To date, no gypsum precipitation has taken place in any of the initial evaluations

Maximal exercise testing and gas exchange in patients with chronic atrial fibrillation

AbstractTo evaluate the response of patients with chronic atrial fibrillation to exercise, 50 men (mean age 65 ± 8 years) with atrial fibrillation underwent a maximal exercise test using respiratory gas exchange techniques. Patients were classified by the presence (n = 29) or absence (“lone atrial fibrillation,” (n = 21) of underlying heart disease. Responses were evaluated at a standard submaximal work load (3.0 mph. [4.8 km/h] 0% grade), at the gas exchange anaerobic threshold and at maximal exercise. For all 50 patients, the mean maximal oxygen uptake was 20.6 ml/kg per min, which approximates 85% of the aerobic capacity predicted for age-matched normal individuals.Patients with lone atrial fibrillation demonstrated normal exercise capacity in contrast to patients with atrial fibrillation and known heart disease (22.7 ± 5 versus 19.1 ± 5.0 ml/kg per min, p < 0.05). The mean maximal heart rate (176 ± 30 beats/min) was approximately 20 beats/min higher than that expected for age, was extremely variable and accounted for only 8% of the variance in maximal oxygen uptake. Maximal heart rate in subjects with lone atrial fibrillation was higher than that of subjects with atrial fibrillation and known heart disease (189 ± 32 versus 166 ± 24 beats/min, p < 0.01). Stepwise regression analysis revealed that maximal systolic blood pressure accounted for 19% of the variance in maximal oxygen uptake (VO2max), suggesting that systolic function is an important determinant of exercise performance in atrial fibrillation.It is concluded that 1) the exercise response in patients with lone atrial fibrillation differs markedly from the typical heterogeneous group of patients with atrial fibrillation and underlying heart disease, 2) the higher maximal heart rate observed in patients with lone atrial fibrillation may be a compensation for the loss of atrial function, and 3) exercise impairment in patients with atrial fibrillation is due to underlying heart disease and not the arrhythmia itself

More insight into the fate of biomedical meeting abstracts: a systematic review

BACKGROUND: It has been estimated that about 45% of abstracts that are accepted for presentation at biomedical meetings will subsequently be published in full. The acceptance of abstracts at meetings and their fate after initial rejection are less well understood. We set out to estimate the proportion of abstracts submitted to meetings that are eventually published as full reports, and to explore factors that are associated with meeting acceptance and successful publication. METHODS: Studies analysing acceptance of abstracts at biomedical meetings or their subsequent full publication were searched in MEDLINE, OLDMEDLINE, EMBASE, Cochrane Library, CINAHL, BIOSIS, Science Citation Index Expanded, and by hand searching of bibliographies and proceedings. We estimated rates of abstract acceptance and of subsequent full publication, and identified abstract and meeting characteristics associated with acceptance and publication, using logistic regression analysis, survival-type analysis, and meta-analysis. RESULTS: Analysed meetings were held between 1957 and 1999. Of 14945 abstracts that were submitted to 43 meetings, 46% were accepted. The rate of full publication was studied with 19123 abstracts that were presented at 234 meetings. Using survival-type analysis, we estimated that 27% were published after two, 41% after four, and 44% after six years. Of 2412 abstracts that were rejected at 24 meetings, 27% were published despite rejection. Factors associated with both abstract acceptance and subsequent publication were basic science and positive study outcome. Large meetings and those held outside the US were more likely to accept abstracts. Abstracts were more likely to be published subsequently if presented either orally, at small meetings, or at a US meeting. Abstract acceptance itself was strongly associated with full publication. CONCLUSIONS: About one third of abstracts submitted to biomedical meetings were published as full reports. Acceptance at meetings and publication were associated with specific characteristics of abstracts and meetings

A call for transparent reporting to optimize the predictive value of preclinical research

The US National Institute of Neurological Disorders and Stroke convened major stakeholders in June 2012 to discuss how to improve the methodological reporting of animal studies in grant applications and publications. The main workshop recommendation is that at a minimum studies should report on sample-size estimation, whether and how animals were randomized, whether investigators were blind to the treatment, and the handling of data. We recognize that achieving a meaningful improvement in the quality of reporting will require a concerted effort by investigators, reviewers, funding agencies and journal editors. Requiring better reporting of animal studies will raise awareness of the importance of rigorous study design to accelerate scientific progress

Anesthesia advanced circulatory life support

The constellation of advanced cardiac life support (ACLS) events, such as gas embolism, local anesthetic overdose, and spinal bradycardia, in the perioperative setting differs from events in the pre-hospital arena. As a result, modification of traditional ACLS protocols allows for more specific etiology-based resuscitation. Perioperative arrests are both uncommon and heterogeneous and have not been described or studied to the same extent as cardiac arrest in the community. These crises are usually witnessed, frequently anticipated, and involve a rescuer physician with knowledge of the patient's comorbidities and coexisting anesthetic or surgically related pathophysiology. When the health care provider identifies the probable cause of arrest, the practitioner has the ability to initiate medical management rapidly. Recommendations for management must be predicated on expert opinion and physiological understanding rather than on the standards currently being used in the generation of ACLS protocols in the community. Adapting ACLS algorithms and considering the differential diagnoses of these perioperative events may prevent cardiac arrest