Reducing the Probability of False Positive Research Findings by Pre-Publication Validation - Experience with a Large Multiple Sclerosis Database

*Objective*
We have assessed the utility of a pre-publication validation policy in reducing the probability of publishing false positive research findings. 
*Study design and setting*
The large database of the Sylvia Lawry Centre for Multiple Sclerosis Research was split in two parts: one for hypothesis generation and a validation part for confirmation of selected results. We present case studies from 5 finalized projects that have used the validation policy and results from a simulation study.
*Results*
In one project, the "relapse and disability" project as described in section II (example 3), findings could not be confirmed in the validation part of the database. The simulation study showed that the percentage of false positive findings can exceed 20% depending on variable selection. 
*Conclusion*
We conclude that the validation policy has prevented the publication of at least one research finding that could not be validated in an independent data set (and probably would have been a "true" false-positive finding) over the past three years, and has led to improved data analysis, statistical programming, and selection of hypotheses. The advantages outweigh the lost statistical power inherent in the process

Reducing the probability of false positive research findings by pre-publication validation – Experience with a large multiple sclerosis database

<p>Abstract</p> <p>Background</p> <p>Published false positive research findings are a major problem in the process of scientific discovery. There is a high rate of lack of replication of results in clinical research in general, multiple sclerosis research being no exception. Our aim was to develop and implement a policy that reduces the probability of publishing false positive research findings.</p> <p>We have assessed the utility to work with a pre-publication validation policy after several years of research in the context of a large multiple sclerosis database.</p> <p>Methods</p> <p>The large database of the Sylvia Lawry Centre for Multiple Sclerosis Research was split in two parts: one for hypothesis generation and a validation part for confirmation of selected results. We present case studies from 5 finalized projects that have used the validation policy and results from a simulation study.</p> <p>Results</p> <p>In one project, the "relapse and disability" project as described in section II (example 3), findings could not be confirmed in the validation part of the database. The simulation study showed that the percentage of false positive findings can exceed 20% depending on variable selection.</p> <p>Conclusion</p> <p>We conclude that the validation policy has prevented the publication of at least one research finding that could not be validated in an independent data set (and probably would have been a "true" false-positive finding) over the past three years, and has led to improved data analysis, statistical programming, and selection of hypotheses. The advantages outweigh the lost statistical power inherent in the process.</p

Recommendations for diagnosing and managing individuals with glutaric aciduria type 1: Third revision

Glutaric aciduria type 1 is a rare inherited neurometabolic disorder of lysine metabolism caused by pathogenic gene variations in GCDH (cytogenic location: 19p13.13), resulting in deficiency of mitochondrial glutaryl-CoA dehydrogenase (GCDH) and, consequently, accumulation of glutaric acid, 3-hydroxyglutaric acid, glutaconic acid and glutarylcarnitine detectable by gas chromatography/mass spectrometry (organic acids) and tandem mass spectrometry (acylcarnitines). Depending on residual GCDH activity, biochemical high and low excreting phenotypes have been defined. Most untreated individuals present with acute onset of striatal damage before age 3 (to 6) years, precipitated by infectious diseases, fever or surgery, resulting in irreversible, mostly dystonic movement disorder with limited life expectancy. In some patients, striatal damage develops insidiously. In recent years, the clinical phenotype has been extended by the finding of extrastriatal abnormalities and cognitive dysfunction, preferably in the high excreter group, as well as chronic kidney failure. Newborn screening is the prerequisite for pre-symptomatic start of metabolic treatment with low lysine diet, carnitine supplementation and intensified emergency treatment during catabolic episodes, which, in combination, have substantially improved neurologic outcome. In contrast, start of treatment after onset of symptoms cannot reverse existing motor dysfunction caused by striatal damage. Dietary treatment can be relaxed after the vulnerable period for striatal damage, that is, age 6 years. However, impact of dietary relaxation on long-term outcomes is still unclear. This third revision of evidence-based recommendations aims to re-evaluate previous recommendations (Boy et al., J Inherit Metab Dis, 2017;40(1):75-101; Kolker et al., J Inherit Metab Dis 2011;34(3):677-694; Kolker et al., J Inherit Metab Dis, 2007;30(1):5-22) and to implement new research findings on the evolving phenotypic diversity as well as the impact of non-interventional variables and treatment quality on clinical outcomes

The Renin-Angiotensin-Aldosterone system in patients with depression compared to controls – a sleep endocrine study

BACKGROUND: Hypercortisolism as a sign of hypothamamus-pituitary-adrenocortical (HPA) axis overactivity and sleep EEG changes are frequently observed in depression. Closely related to the HPA axis is the renin-angiotensin-aldosterone system (RAAS) as 1. adrenocorticotropic hormone (ACTH) is a common stimulus for cortisol and aldosterone, 2. cortisol release is suppressed by mineralocorticoid receptor (MR) agonists 3. angiotensin II (ATII) releases CRH and vasopressin from the hypothalamus. Furthermore renin and aldosterone secretion are synchronized to the rapid eyed movement (REM)-nonREM cycle. METHODS: Here we focus on the difference of sleep related activity of the RAAS between depressed patients and healthy controls. We studied the nocturnal plasma concentration of ACTH, cortisol, renin and aldosterone, and sleep EEG in 7 medication free patients with depression (1 male, 6 females, age: (mean +/-SD) 53.3 ± 14.4 yr.) and 7 age matched controls (2 males, 5 females, age: 54.7 ± 19.5 yr.). After one night of accommodation a polysomnography was performed between 23.00 h and 7.00 h. During examination nights blood samples were taken every 20 min between 23.00 h and 7.00 h. Area under the curve (AUC) for the hormones separated for the halves of the night (23.00 h to 3.00 h and 3.00 h to 7.00 h) were used for statistical analysis, with analysis of co variance being performed with age as a covariate. RESULTS: No differences in ACTH and renin concentrations were found. For cortisol, a trend to an increase was found in the first half of the night in patients compared to controls (p < 0.06). Aldosterone was largely increased in the first (p < 0.05) and second (p < 0.01) half of the night. Cross correlations between hormone concentrations revealed that in contrast to earlier findings, which included only male subjects, in our primarily female sample, renin and aldosterone secretion were not coupled and no difference between patients and controls could be found, suggesting a gender difference in RAAS regulation. No difference in conventional sleep EEG parameters were found in our sample. CONCLUSION: Hyperaldosteronism could be a sensitive marker for depression. Further our findings point to an altered renal mineralocorticoid sensitivity in patients with depression

Search for supersymmetry in events with b-quark jets and missing transverse energy in pp collisions at 7 TeV

Results are presented from a search for physics beyond the standard model based on events with large missing transverse energy, at least three jets, and at least one, two, or three b-quark jets. The study is performed using a sample of proton-proton collision data collected at sqrt(s) = 7 TeV with the CMS detector at the LHC in 2011. The integrated luminosity of the sample is 4.98 inverse femtobarns. The observed number of events is found to be consistent with the standard model expectation, which is evaluated using control samples in the data. The results are used to constrain cross sections for the production of supersymmetric particles decaying to b-quark-enriched final states in the context of simplified model spectra.Comment: Submitted to Physical Review

Crystal structure of nucleotide-free dynamin

Dynamin is a mechanochemical GTPase that oligomerizes around the neck of clathrin-coated pits and catalyses vesicle scission in a GTP-hydrolysis-dependent manner. The molecular details of oligomerization and the mechanism of the mechanochemical coupling are currently unknown. Here we present the crystal structure of human dynamin 1 in the nucleotide-free state with a four-domain architecture comprising the GTPase domain, the bundle signalling element, the stalk and the pleckstrin homology domain. Dynamin 1 oligomerized in the crystals via the stalks, which assemble in a criss-cross fashion. The stalks further interact via conserved surfaces with the pleckstrin homology domain and the bundle signalling element of the neighbouring dynamin molecule. This intricate domain interaction rationalizes a number of disease-related mutations in dynamin 2 and suggests a structural model for the mechanochemical coupling that reconciles previous models of dynamin function

MMP19 Is Essential for T Cell Development and T Cell-Mediated Cutaneous Immune Responses

Matrix metalloproteinase-19 (MMP19) affects cell proliferation, adhesion, and migration in vitro but its physiological role in vivo is poorly understood. To determine the function of MMP19, we generated mice deficient for MMP19 by disrupting the catalytic domain of mmp19 gene. Although MMP19-deficient mice do not show overt developmental and morphological abnormalities they display a distinct physiological phenotype. In a model of contact hypersensitivity (CHS) MMP19-deficient mice showed impaired T cell-mediated immune reaction that was characterized by limited influx of inflammatory cells, low proliferation of keratinocytes, and reduced number of activated CD8+ T cells in draining lymph nodes. In the inflamed tissue, the low number of CD8+ T cells in MMP19-deficient mice correlated with low amounts of proinflammatory cytokines, especially lymphotactin and interferon-inducible T cell α chemoattractant (I-TAC). Further analyses showed that T cell populations in the blood of immature, unsensitized mice were diminished and that this alteration originated from an altered maturation of thymocytes. In the thymus, thymocytes exhibited low proliferation rates and the number of CD4+CD8+ double-positive cells was remarkably augmented. Based on the phenotype of MMP19-deficient mice we propose that MMP19 is an important factor in cutaneous immune responses and influences the development of T cells

Measurement of the underlying event activity in pp collisions at √s = 0.9 and 7 TeV with the novel jet-area/median approach

Open Access: This article is distributed under the terms of the Creative Commons Attribution License.-- Chatrchyan, S. et al.The first measurement of the charged component of the underlying event using the novel >jet-area/median> approach is presented for proton-proton collisions at centre-of-mass energies of 0.9 and 7 TeV. The data were recorded in 2010 with the CMS experiment at the LHC. A new observable, sensitive to soft particle production, is introduced and investigated inclusively and as a function of the event scale defined by the transverse momentum of the leading jet. Various phenomenological models are compared to data, with and without corrections for detector effects. None of the examined models describe the data satisfactorily. © 2012 SISSA.Acknowledge support from BMWF and FWF (Austria); FNRS and FWO (Belgium); CNPq, CAPES, FAPERJ, and FAPESP (Brazil); MES (Bulgaria); CERN; CAS, MoST, and NSFC (China); COLCIENCIAS (Colombia); MSES (Croatia); RPF (Cyprus); MoER, SF0690030s09 and ERDF (Estonia); Academy of Finland, MEC, and HIP (Finland); CEA and CNRS/IN2P3 (France);BMBF, DFG, and HGF (Germany); GSRT (Greece); OTKA and NKTH (Hungary); DAE and DST (India); IPM (Iran); SFI (Ireland); INFN (Italy); NRF and WCU (Korea); LAS (Lithuania); CINVESTAV, CONACYT, SEP, and UASLP-FAI (Mexico); MSI (New Zealand); PAEC (Pakistan); MSHE and NSC (Poland); FCT (Portugal); JINR (Armenia, Belarus, Georgia, Ukraine, Uzbekistan); MON, RosAtom, RAS and RFBR (Russia); MSTD (Serbia); SEIDI and CPAN (Spain); Swiss Funding Agencies (Switzerland); NSC (Taipei); ThEP, IPST and NECTEC (Thailand); TUBITAK and TAEK (Turkey); NASU (Ukraine); STFC (United Kingdom); DOE and NSF (USA). Individuals have received support from the Marie-Curie program and the European Research Council (European Union); the Leventis Foundation; the A. P. Sloan Foundation; the Alexander von Humboldt Foundation; the Austrian Science Fund (FWF); the Belgian Federal Science Policy Office; the Fonds pour la Formation à la Recherche dans l’Industrie et dans l’Agriculture (FRIA-Belgium); the Agentschap voor Innovatie door Wetenschap en Technologie (IWTBelgium); the Ministry of Education, Youth and Sports (MEYS) of Czech Republic; the Council of Science and Industrial Research, India; the Compagnia di San Paolo (Torino); and the HOMING PLUS program of Foundation for Polish Science, cofinanced from European Union, Regional Development Fund.Peer Reviewe

Measurement of the prompt J/psi and psi(2S) polarizations in pp collisions at sqrt(s) = 7 TeV

The polarizations of prompt J/psi and psi(2S) mesons are measured in proton-proton collisions at sqrt(s) = 7 TeV, using a dimuon data sample collected by the CMS experiment at the LHC, corresponding to an integrated luminosity of 4.9 inverse femtobarns. The prompt J/psi and psi(2S) polarization parameters lambda[theta], lambda[phi], and lambda[theta, phi], as well as the frame-invariant quantity lambda(tilde), are measured from the dimuon decay angular distributions in three different polarization frames. The J/psi results are obtained in the transverse momentum range 14 &lt; pt &lt; 70 GeV, in the rapidity intervals abs(y) &lt; 0.6 and 0.6 &lt; abs(y) &lt; 1.2. The corresponding psi(2S) results cover 14 &lt; pt &lt; 50 GeV and include a third rapidity bin, 1.2 &lt; abs(y) &lt; 1.5. No evidence of large transverse or longitudinal polarizations is seen in these kinematic regions, which extend much beyond those previously explored