Reducing the Probability of False Positive Research Findings by Pre-Publication Validation - Experience with a Large Multiple Sclerosis Database

*Objective*
We have assessed the utility of a pre-publication validation policy in reducing the probability of publishing false positive research findings. 
*Study design and setting*
The large database of the Sylvia Lawry Centre for Multiple Sclerosis Research was split in two parts: one for hypothesis generation and a validation part for confirmation of selected results. We present case studies from 5 finalized projects that have used the validation policy and results from a simulation study.
*Results*
In one project, the "relapse and disability" project as described in section II (example 3), findings could not be confirmed in the validation part of the database. The simulation study showed that the percentage of false positive findings can exceed 20% depending on variable selection. 
*Conclusion*
We conclude that the validation policy has prevented the publication of at least one research finding that could not be validated in an independent data set (and probably would have been a "true" false-positive finding) over the past three years, and has led to improved data analysis, statistical programming, and selection of hypotheses. The advantages outweigh the lost statistical power inherent in the process

Treating Systematic Errors in Multiple Sclerosis Data

Multiple sclerosis (MS) is characterized by high variability between patients and, more importantly here, within an individual over time. This makes categorization and prognosis difficult. Moreover, it is unclear to what degree this intra-individual variation reflects the long-term course of irreversible disability and what is attributable to short-term processes such as relapses, to interrater variability and to measurement error. Any investigation and prediction of the medium or long term evolution of irreversible disability in individual patients is therefore confronted with the problem of systematic error in addition to random fluctuations. The approach described in this article aims to assist in detecting relapses in disease curves and in identifying the underlying disease course. To this end neurological knowledge was transformed into simple rules which were then implemented into computer algorithms for pre-editing disease curves. Based on simulations it is shown that pre-editing time series of disability measured with the Expanded Disability Status Scale (EDSS) can lead to more robust and less biased estimates for important disease characteristics, such as baseline EDSS and time to reach certain EDSS levels or sustained progression

The genetic basis of multiple sclerosis: a model for MS susceptibility

<p>Abstact</p> <p>Background</p> <p>MS-pathogenesis is known to involve both multiple environmental events, and several independent genetic risk-factors.</p> <p>Methods</p> <p>A model of susceptibility is developed and a mathematical analysis undertaken to elucidate the nature of genetic susceptibility to MS and to understand the constraints that are placed on the genetic basis of MS, both by the known epidemiological facts of this disease and by the known frequency of the HLA DRB1*1501 allele in the general populations of northern Europe and North America.</p> <p>Results</p> <p>For the large majority of cases (possibly all), MS develops, in part, because an individual is genetically susceptible. Nevertheless, 2.2% or less of the general population is genetically susceptible. Moreover, from the model, the number of susceptibility-loci that need to be in a "susceptible allelic state" to produce MS-susceptibility is small (11-18), whereas the total number of such susceptibility-loci is large (50-200), and their "frequency of susceptibility" is low (i.e., ≤ 0.12). The optimal solution to the model equations (which occurs when 80% of the loci are recessive) predicts the epidemiological data quite closely.</p> <p>Conclusions</p> <p>The model suggests that combinations of only a small number of genetic loci in a "susceptible allelic state" produce MS-susceptibility. Nevertheless, genome-wide associations studies with hundreds of thousands of SNPs, are plagued by both false-positive and false-negative identifications and, consequently, emphasis has been rightly placed on the replicability of findings. Nevertheless, because genome-wide screens don't distinguish between true susceptibility-loci and disease-modifying-loci, and because only true susceptibility-loci are constrained by the model, unraveling the two will not be possible using this approach.</p> <p>The model also suggests that HLA DRB1 may not be as uniquely important for MS-susceptibility as currently believed. Thus, this allele is only one among a hundred or more loci involved in MS susceptibility. Even though the "frequency of susceptibility" at the HLA DRB1 locus is four-fold that of other loci, the penetrance of those susceptible genotypes that include this allele is no different from those that don't. Also, almost 50% of genetically-susceptible individuals, lack this allele. Moreover, of those who have it, only a small fraction (≤ 5.2%) are even susceptible to getting MS.</p

The multiple sclerosis risk sharing scheme monitoring study - early results and lessons for the future

Background: Risk sharing schemes represent an innovative and important approach to the problems of rationing and achieving cost-effectiveness in high cost or controversial health interventions. This study aimed to assess the feasibility of risk sharing schemes, looking at long term clinical outcomes, to determine the price at which high cost treatments would be acceptable to the NHS. Methods: This case study of the first NHS risk sharing scheme, a long term prospective cohort study of beta interferon and glatiramer acetate in multiple sclerosis ( MS) patients in 71 specialist MS centres in UK NHS hospitals, recruited adults with relapsing forms of MS, meeting Association of British Neurologists (ABN) criteria for disease modifying therapy. Outcome measures were: success of recruitment and follow up over the first three years, analysis of baseline and initial follow up data and the prospect of estimating the long term cost-effectiveness of these treatments. Results: Centres consented 5560 patients. Of the 4240 patients who had been in the study for a least one year, annual review data were available for 3730 (88.0%). Of the patients who had been in the study for at least two years and three years, subsequent annual review data were available for 2055 (78.5%) and 265 (71.8%) patients respectively. Baseline characteristics and a small but statistically significant progression of disease were similar to those reported in previous pivotal studies. Conclusion: Successful recruitment, follow up and early data analysis suggest that risk sharing schemes should be able to deliver their objectives. However, important issues of analysis, and political and commercial conflicts of interest still need to be addressed

Pharmacoepidemiology and the Australian regional prevalence of multiple sclerosis

Background: Over some 50 years, field surveys have shown that the prevalence of multiple sclerosis (MS) increases with increasing distance from the equator in both the northern and the southern hemispheres. Such a latitudinal gradient has been found in field surveys of MS prevalence carried out at different times in various local regions of Australia

Vitamin D receptor ChIP-seq in primary CD4+ cells: relationship to serum 25-hydroxyvitamin D levels and autoimmune disease

PMCID: PMC3710212This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited

Prognosis of the individual course of disease - steps in developing a decision support tool for Multiple Sclerosis

<p>Abstract</p> <p>Background</p> <p>Multiple sclerosis is a chronic disease of uncertain aetiology. Variations in its disease course make it difficult to impossible to accurately determine the prognosis of individual patients. The Sylvia Lawry Centre for Multiple Sclerosis Research (SLCMSR) developed an "online analytical processing (OLAP)" tool that takes advantage of extant clinical trials data and allows one to model the near term future course of this chronic disease for an individual patient.</p> <p>Results</p> <p>For a given patient the most similar patients of the SLCMSR database are intelligently selected by a model-based matching algorithm integrated into an OLAP-tool to enable real time, web-based statistical analyses. The underlying database (last update April 2005) contains 1,059 patients derived from 30 placebo arms of controlled clinical trials. Demographic information on the entire database and the portion selected for comparison are displayed. The result of the statistical comparison is provided as a display of the course of Expanded Disability Status Scale (EDSS) for individuals in the database with regions of probable progression over time, along with their mean relapse rate. Kaplan-Meier curves for time to sustained progression in the EDSS and time to requirement of constant assistance to walk (EDSS 6) are also displayed. The software-application OLAP anticipates the input MS patient's course on the basis of baseline values and the known course of disease for similar patients who have been followed in clinical trials.</p> <p>Conclusion</p> <p>This simulation could be useful for physicians, researchers and other professionals who counsel patients on therapeutic options. The application can be modified for studying the natural history of other chronic diseases, if and when similar datasets on which the OLAP operates exist.</p

Expression of the Multiple Sclerosis-Associated MHC Class II Allele HLA-DRB1*1501 Is Regulated by Vitamin D

Multiple sclerosis (MS) is a complex trait in which allelic variation in the MHC class II region exerts the single strongest effect on genetic risk. Epidemiological data in MS provide strong evidence that environmental factors act at a population level to influence the unusual geographical distribution of this disease. Growing evidence implicates sunlight or vitamin D as a key environmental factor in aetiology. We hypothesised that this environmental candidate might interact with inherited factors and sought responsive regulatory elements in the MHC class II region. Sequence analysis localised a single MHC vitamin D response element (VDRE) to the promoter region of HLA-DRB1. Sequencing of this promoter in greater than 1,000 chromosomes from HLA-DRB1 homozygotes showed absolute conservation of this putative VDRE on HLA-DRB1*15 haplotypes. In contrast, there was striking variation among non–MS-associated haplotypes. Electrophoretic mobility shift assays showed specific recruitment of vitamin D receptor to the VDRE in the HLA-DRB1*15 promoter, confirmed by chromatin immunoprecipitation experiments using lymphoblastoid cells homozygous for HLA-DRB1*15. Transient transfection using a luciferase reporter assay showed a functional role for this VDRE. B cells transiently transfected with the HLA-DRB1*15 gene promoter showed increased expression on stimulation with 1,25-dihydroxyvitamin D3 (P = 0.002) that was lost both on deletion of the VDRE or with the homologous “VDRE” sequence found in non–MS-associated HLA-DRB1 haplotypes. Flow cytometric analysis showed a specific increase in the cell surface expression of HLA-DRB1 upon addition of vitamin D only in HLA-DRB1*15 bearing lymphoblastoid cells. This study further implicates vitamin D as a strong environmental candidate in MS by demonstrating direct functional interaction with the major locus determining genetic susceptibility. These findings support a connection between the main epidemiological and genetic features of this disease with major practical implications for studies of disease mechanism and prevention

Genetic, environmental and stochastic factors in monozygotic twin discordance with a focus on epigenetic differences

PMCID: PMC3566971This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited