Examining the generalizability of research findings from archival data

This initiative examined systematically the extent to which a large set of archival research findings generalizes across contexts. We repeated the key analyses for 29 original strategic management effects in the same context (direct reproduction) as well as in 52 novel time periods and geographies; 45% of the reproductions returned results matching the original reports together with 55% of tests in different spans of years and 40% of tests in novel geographies. Some original findings were associated with multiple new tests. Reproducibility was the best predictor of generalizability-for the findings that proved directly reproducible, 84% emerged in other available time periods and 57% emerged in other geographies. Overall, only limited empirical evidence emerged for context sensitivity. In a forecasting survey, independent scientists were able to anticipate which effects would find support in tests in new samples.info:eu-repo/semantics/publishedVersio

Crowdsourcing hypothesis tests: making transparent how design choices shape research results

To what extent are research results influenced by subjective decisions that scientists make as they design studies? Fifteen research teams independently designed studies to answer five original research questions related to moral judgments, negotiations, and implicit cognition. Participants from 2 separate large samples (total N > 15,000) were then randomly assigned to complete 1 version of each study. Effect sizes varied dramatically across different sets of materials designed to test the same hypothesis: Materials from different teams rendered statistically significant effects in opposite directions for 4 of 5 hypotheses, with the narrowest range in estimates being d = -0.37 to + 0.26. Meta-analysis and a Bayesian perspective on the results revealed overall support for 2 hypotheses and a lack of support for 3 hypotheses. Overall, practically none of the variability in effect sizes was attributable to the skill of the research team in designing materials, whereas considerable variability was attributable to the hypothesis being tested. In a forecasting survey, predictions of other scientists were significantly correlated with study results, both across and within hypotheses. Crowdsourced testing of research hypotheses helps reveal the true consistency of empirical support for a scientific claim.info:eu-repo/semantics/submittedVersio

Publication Records of Faculty Promoted to Professor: Evidence from the UK Accounting and Finance Academic Community

This study investigates the publication profiles of 140 accounting and finance faculty promoted to the senior rank of professor at UK and Irish universities during the period 1992 to 2007. On average, approximately 9 papers in Association of Business Schools (ABS) (2008)-listed journals, with 5 at the highest 3*/4* quality levels in a portfolio of 20 outputs are required for promotion to professor. Multivariate analysis provides evidence that publication requirements in terms of ABS ranked journal papers have increased over time, an effect attributed to the government research assessment exercise. There is no evidence that requirements differ for: internal versus external promotion, male versus female candidates; accounting versus finance professors, research intensity of institution peer group; or government research ranking of unit. There is also no evidence of a substitution effect in relation to increased recent publication history, quantity of non-ABS outputs or sole-authorship, all of which show a significant complementary effect. It is noted that there is very limited overlap in the UK and US publication journal sets, suggesting underlying geographically-based paradigm differences. The benchmarks provided in this study are informative in a range of decision settings: recruitment; those considering making an application for promotion to a chair and those involved in promotion panels; cross-disciplinary comparisons; and resource allocation. The evidence presented also contributes to the emerging policy debates concerning the aging demographic profile of accounting faculty, the management of academic labour and the Research Excellence Framework

Masitinib (AB1010), a Potent and Selective Tyrosine Kinase Inhibitor Targeting KIT

International audienceBackground: The stem cell factor receptor, KIT, is a target for the treatment of cancer, mastocytosis, and inflammatory diseases. Here, we characterise the in vitro and in vivo profiles of masitinib (AB1010), a novel phenylaminothiazole-type tyrosine kinase inhibitor that targets KIT. Methodology/Principal Findings: In vitro, masitinib had greater activity and selectivity against KIT than imatinib, inhibiting recombinant human wild-type KIT with an half inhibitory concentration (IC50) of 200 ± 40 nM and blocking stem cell factor-induced proliferation and KIT tyrosine phosphorylation with an IC50 of 150 ± 80 nM in Ba/F3 cells expressing human or mouse wild-type KIT. Masitinib also potently inhibited recombinant PDGFR and the intracellular kinase Lyn, and to a lesser extent, fibroblast growth factor receptor 3. In contrast, masitinib demonstrated weak inhibition of ABL and c-Fms and was inactive against a variety of other tyrosine and serine/threonine kinases. This highly selective nature of masitinib suggests that it will exhibit a better safety profile than other tyrosine kinase inhibitors; indeed, masitinib-induced cardiotoxicity or genotoxicity has not been observed in animal studies. Molecular modelling and kinetic analysis suggest a different mode of binding than imatinib, and masitinib more strongly inhibited degranulation, cytokine production, and bone marrow mast cell migration than imatinib. Furthermore, masitinib potently inhibited human and murine KIT with activating mutations in the juxtamembrane domain. In vivo, masitinib blocked tumour growth in mice with subcutaneous grafts of Ba/F3 cells expressing a juxtamembrane KIT mutant. Conclusions: Masitinib is a potent and selective tyrosine kinase inhibitor targeting KIT that is active, orally bioavailable in vivo, and has low toxicit

Revisiting the Dexamethasone Suppression Test in unipolar major depression: an exploratory study

This is an Open Access article distributed under the terms of the Creative Commons Attribution Licens

Saint or Sinner?: A Reconsideration of the Career of Prince Alexandre de Merode, Chair of the International Olympic Committee’s Medical Commission, 1967-2002

This article explores the role of Prince Alexandre de Merode in heading the IOC’s fight against drugs from the 1960s to 2002. History has not served de Merode very well. He has been presented in simplistic ways that emerge from context rather than evidence – as either a saint or a sinner. IOC-sanctioned accounts cast him in the mould of the saint: a moral and intelligent man who saved sports from doping. In contrast, sports academics have tended to portray him as a sinner: an ineffectual leader who did not develop either the testing systems or the punishments required to prevent doping and who deliberately concealed evidence of high-profile doping cases. This article assesses both representations before presenting information to support a richer and more complicated interpretation

Nucleic acid amplification tests in the diagnosis of tuberculous pleuritis: a systematic review and meta-analysis

BACKGROUND: Conventional tests for tuberculous pleuritis have several limitations. A variety of new, rapid tests such as nucleic acid amplification tests – including polymerase chain reaction – have been evaluated in recent times. We conducted a systematic review to determine the accuracy of nucleic acid amplification (NAA) tests in the diagnosis of tuberculous pleuritis. METHODS: A systematic review and meta-analysis of 38 English and Spanish articles (with 40 studies), identified via searches of six electronic databases, hand searching of selected journals, and contact with authors, experts, and test manufacturers. Sensitivity, specificity, and other measures of accuracy were pooled using random effects models. Summary receiver operating characteristic curves were used to summarize overall test performance. Heterogeneity in study results was formally explored using subgroup analyses. RESULTS: Of the 40 studies included, 26 used in-house ("home-brew") tests, and 14 used commercial tests. Commercial tests had a low overall sensitivity (0.62; 95% confidence interval [CI] 0.43, 0.77), and high specificity (0.98; 95% CI 0.96, 0.98). The positive and negative likelihood ratios for commercial tests were 25.4 (95% CI 16.2, 40.0) and 0.40 (95% CI 0.24, 0.67), respectively. All commercial tests had consistently high specificity estimates; the sensitivity estimates, however, were heterogeneous across studies. With the in-house tests, both sensitivity and specificity estimates were significantly heterogeneous. Clinically meaningful summary estimates could not be determined for in-house tests. CONCLUSIONS: Our results suggest that commercial NAA tests may have a potential role in confirming (ruling in) tuberculous pleuritis. However, these tests have low and variable sensitivity and, therefore, may not be useful in excluding (ruling out) the disease. NAA test results, therefore, cannot replace conventional tests; they need to be interpreted in parallel with clinical findings and results of conventional tests. The accuracy of in-house nucleic acid amplification tests is poorly defined because of heterogeneity in study results. The clinical applicability of in-house NAA tests remains unclear

Serum screening with Down's syndrome markers to predict pre-eclampsia and small for gestational age: Systematic review and meta-analysis

<p>Abstract</p> <p>Background</p> <p>Reliable antenatal identification of pre-eclampsia and small for gestational age is crucial to judicious allocation of monitoring resources and use of preventative treatment with the prospect of improving maternal/perinatal outcome. The purpose of this systematic review was to determine the accuracy of five serum analytes used in Down's serum screening for prediction of pre-eclampsia and/or small for gestational age.</p> <p>Methods</p> <p>The data sources included Medline, Embase, Cochrane library, Medion (inception to February 2007), hand searching of relevant journals, reference list checking of included articles, contact with experts. Two reviewers independently selected the articles in which the accuracy of an analyte used in Downs's serum screening before the 25^thgestational week was associated with the occurrence of pre-eclampsia and/or small for gestational age without language restrictions. Two authors independently extracted data on study characteristics, quality and results.</p> <p>Results</p> <p>Five serum screening markers were evaluated. 44 studies, testing 169,637 pregnant women (4376 pre-eclampsia cases) and 86 studies, testing 382,005 women (20,339 fetal growth restriction cases) met the selection criteria. The results showed low predictive accuracy overall. For pre-eclampsia the best predictor was inhibin A>2.79MoM positive likelihood ratio 19.52 (8.33,45.79) and negative likelihood ratio 0.30 (0.13,0.68) (single study). For small for gestational age it was AFP>2.0MoM to predict birth weight < 10^thcentile with birth < 37 weeks positive likelihood ratio 27.96 (8.02,97.48) and negative likelihood ratio 0.78 (0.55,1.11) (single study). A potential clinical application using aspirin as a treatment is given as an example.</p> <p>There were methodological and reporting limitations in the included studies thus studies were heterogeneous giving pooled results with wide confidence intervals.</p> <p>Conclusion</p> <p>Down's serum screening analytes have low predictive accuracy for pre-eclampsia and small for gestational age. They may be a useful means of risk assessment or of use in prediction when combined with other tests.</p

Criteria for the use of omics-based predictors in clinical trials: Explanation and elaboration

High-throughput 'omics' technologies that generate molecular profiles for biospecimens have been extensively used in preclinical studies to reveal molecular subtypes and elucidate the biological mechanisms of disease, and in retrospective studies on clinical specimens to develop mathematical models to predict clinical endpoints. Nevertheless, the translation of these technologies into clinical tests that are useful for guiding management decisions for patients has been relatively slow. It can be difficult to determine when the body of evidence for an omics-based test is sufficiently comprehensive and reliable to support claims that it is ready for clinical use, or even that it is ready for definitive evaluation in a clinical trial in which it may be used to direct patient therapy. Reasons for this difficulty include the exploratory and retrospective nature of many of these studies, the complexity of these assays and their application to clinical specimens, and the many potential pitfalls inherent in the development of mathematical predictor models from the very high-dimensional data generated by these omics technologies. Here we present a checklist of criteria to consider when evaluating the body of evidence supporting the clinical use of a predictor to guide patient therapy. Included are issues pertaining to specimen and assay requirements, the soundness of the process for developing predictor models, expectations regarding clinical study design and conduct, and attention to regulatory, ethical, and legal issues. The proposed checklist should serve as a useful guide to investigators preparing proposals for studies involving the use of omics-based tests. The US National Cancer Institute plans to refer to these guidelines for review of proposals for studies involving omics tests, and it is hoped that other sponsors will adopt the checklist as well. © 2013 McShane et al.; licensee BioMed Central Ltd