Control procedures and estimators of the false discovery rate and their application in low-dimensional settings: an empirical investigation

Background: When many (up to millions) of statistical tests are conducted in discovery set analyses such as genome-wide association studies (GWAS), approaches controlling family-wise error rate (FWER) or false discovery rate (FDR) are required to reduce the number of false positive decisions. Some methods were specifically developed in the context of high-dimensional settings and partially rely on the estimation of the proportion of true null hypotheses. However, these approaches are also applied in low-dimensional settings such as replication set analyses that might be restricted to a small number of specific hypotheses. The aim of this study was to compare different approaches in low-dimensional settings using (a) real data from the CKDGen Consortium and (b) a simulation study. Results: In both application and simulation FWER approaches were less powerful compared to FDR control methods, whether a larger number of hypotheses were tested or not. Most powerful was the q-value method. However, the specificity of this method to maintain true null hypotheses was especially decreased when the number of tested hypotheses was small. In this low-dimensional situation, estimation of the proportion of true null hypotheses was biased. Conclusions: The results highlight the importance of a sizeable data set for a reliable estimation of the proportion of true null hypotheses. Consequently, methods relying on this estimation should only be applied in high-dimensional settings. Furthermore, if the focus lies on testing of a small number of hypotheses such as in replication settings, FWER methods rather than FDR methods should be preferred to maintain high specificity

Genome-wide association study of Stevens-Johnson Syndrome and Toxic Epidermal Necrolysis in Europe

<p>Abstract</p> <p>Background</p> <p>Stevens-Johnson syndrome (SJS) and Toxic Epidermal Necrolysis (TEN) are rare but extremely severe cutaneous adverse drug reactions in which drug-specific associations with HLA-B alleles were described.</p> <p>Objectives</p> <p>To investigate genetic association at a genome-wide level on a large sample of SJS/TEN patients.</p> <p>Methods</p> <p>We performed a genome wide association study on a sample of 424 European cases and 1,881 controls selected from a Reference Control Panel.</p> <p>Results</p> <p>Six SNPs located in the HLA region showed significant evidence for association (OR range: 1.53-1.74). The haplotype formed by their risk allele was more associated with the disease than any of the single SNPs and was even much stronger in patients exposed to allopurinol (OR_allopurinol= 7.77, 95%CI = [4.66; 12.98]). The associated haplotype is in linkage disequilibrium with the HLA-B*5801 allele known to be associated with allopurinol induced SJS/TEN in Asian populations.</p> <p>Conclusion</p> <p>The involvement of genetic variants located in the HLA region in SJS/TEN is confirmed in European samples, but no other locus reaches genome-wide statistical significance in this sample that is also the largest one collected so far. If some loci outside HLA play a role in SJS/TEN, their effect is thus likely to be very small.</p

Assessment of the extent of unpublished studies in prognostic factor research: a systematic review of p53 immunohistochemistry in bladder cancer as an example

Objectives When study groups fail to publish their results, a subsequent systematic review may come to incorrect conclusions when combining information only from published studies. p53 expression measured by immunohistochemistry is a potential prognostic factor in bladder cancer. Although numerous studies have been conducted, its role is still under debate. The assumption that unpublished studies too harbour evidence on this research topic leads to the question about the attributable effect when adding this information and comparing it with published data. Thus, the aim was to identify published and unpublished studies and to explore their differences potentially affecting the conclusion on its function as a prognostic biomarker. Design Systematic review of published and unpublished studies assessing p53 in bladder cancer in Germany between 1993 and 2007. Results The systematic search revealed 16 studies of which 11 (69%) have been published and 5 (31%) have not. Key reason for not publishing the results was a loss of interest of the investigators. There were no obviously larger differences between published and unpublished studies. However, a meaningful meta-analysis was not possible mainly due to the poor (ie, incomplete) reporting of study results. Conclusions Within this well-defined population of studies, we could provide empirical evidence for the failure of study groups to publish their results that was mainly caused by loss of interest. This fact may be coresponsible for the role of p53 as a prognostic factor still being unclear. We consider p53 and the restriction to studies in Germany as a specific example, but the critical issues are probably similar for other prognostic factors and other countries

Design choices for observational studies of the effect of exposure on disease incidence.

The purpose of this paper is to help readers choose an appropriate observational study design for measuring an association between an exposure and disease incidence. We discuss cohort studies, sub-samples from cohorts (case-cohort and nested case-control designs), and population-based or hospital-based case-control studies. Appropriate study design is the foundation of a scientifically valid observational study. Mistakes in design are often irremediable. Key steps are understanding the scientific aims of the study and what is required to achieve them. Some designs will not yield the information required to realise the aims. The choice of design also depends on the availability of source populations and resources. Choosing an appropriate design requires balancing the pros and cons of various designs in view of study aims and practical constraints. We compare various cohort and case-control designs to estimate the effect of an exposure on disease incidence and mention how certain design features can reduce threats to study validity

Genetics of osteopontin in patients with chronic kidney disease: The German chronic kidney disease study

Osteopontin (OPN), encoded by SPP1, is a phosphorylated glycoprotein predominantly synthesized in kidney tissue. Increased OPN mRNA and protein expression correlates with proteinuria, reduced creatinine clearance, and kidney fibrosis in animal models of kidney disease. But its genetic underpinnings are incompletely understood. We therefore conducted a genome-wide association study (GWAS) of OPN in a European chronic kidney disease (CKD) population. Using data from participants of the German Chronic Kidney Disease (GCKD) study (N = 4,897), a GWAS (minor allele frequency [MAF]>= 1%) and aggregated variant testing (AVT, MAFAuthor summaryOsteopontin (OPN) is involved in many (patho)physiological processes of the human body. Among others, it is known to be associated with adverse kidney outcomes. Since its genetic underpinnings are incompletely understood, we conducted a genome-wide association study of OPN in a European chronic kidney disease (CKD) population (N = 4,897). Of the three detected signals, two could be replicated within a population-based study of Finns. One locus is located upstream of SPP1 which encodes the OPN protein and is related to OPN production. This gene was also disclosed by an analysis of rare variants, all presumably effecting the gene product. Another locus maps into KLKB1 encoding prekallikrein (PK) that after processing to kallikrein (KAL) is implicated in blood pressure control and inflammation among others. Overall, our results highlight the multi-functional role of OPN and its possible pathological role in CKD. Further studies are needed to elucidate the complex role of OPN in humans.</p

Rare genetic variants affecting urine metabolite levels link population variation to inborn errors of metabolism

Metabolite levels in urine may provide insights into genetic mechanisms shaping their related pathways. We therefore investigate the cumulative contribution of rare, exonic genetic variants on urine levels of 1487 metabolites and 53,714 metabolite ratios among 4864 GCKD study participants. Here we report the detection of 128 significant associations involving 30 unique genes, 16 of which are known to underlie inborn errors of metabolism. The 30 genes are strongly enriched for shared expression in liver and kidney (odds ratio = 65, p-FDR = 3e-7), with hepatocytes and proximal tubule cells as driving cell types. Use of UK Biobank whole-exome sequencing data links genes to diseases connected to the identified metabolites. In silico constraint-based modeling of gene knockouts in a virtual whole-body, organ-resolved metabolic human correctly predicts the observed direction of metabolite changes, highlighting the potential of linking population genetics to modeling. Our study implicates candidate variants and genes for inborn errors of metabolis

Genetic studies of paired metabolomes reveal enzymatic and transport processes at the interface of plasma and urine.

The kidneys operate at the interface of plasma and urine by clearing molecular waste products while retaining valuable solutes. Genetic studies of paired plasma and urine metabolomes may identify underlying processes. We conducted genome-wide studies of 1,916 plasma and urine metabolites and detected 1,299 significant associations. Associations with 40% of implicated metabolites would have been missed by studying plasma alone. We detected urine-specific findings that provide information about metabolite reabsorption in the kidney, such as aquaporin (AQP)-7-mediated glycerol transport, and different metabolomic footprints of kidney-expressed proteins in plasma and urine that are consistent with their localization and function, including the transporters NaDC3 (SLC13A3) and ASBT (SLC10A2). Shared genetic determinants of 7,073 metabolite-disease combinations represent a resource to better understand metabolic diseases and revealed connections of dipeptidase 1 with circulating digestive enzymes and with hypertension. Extending genetic studies of the metabolome beyond plasma yields unique insights into processes at the interface of body compartments

Erratum to: Methods for evaluating medical tests and biomarkers

[This corrects the article DOI: 10.1186/s41512-016-0001-y.]

Evidence synthesis to inform model-based cost-effectiveness evaluations of diagnostic tests: a methodological systematic review of health technology assessments

Background: Evaluations of diagnostic tests are challenging because of the indirect nature of their impact on patient outcomes. Model-based health economic evaluations of tests allow different types of evidence from various sources to be incorporated and enable cost-effectiveness estimates to be made beyond the duration of available study data. To parameterize a health-economic model fully, all the ways a test impacts on patient health must be quantified, including but not limited to diagnostic test accuracy. Methods: We assessed all UK NIHR HTA reports published May 2009-July 2015. Reports were included if they evaluated a diagnostic test, included a model-based health economic evaluation and included a systematic review and meta-analysis of test accuracy. From each eligible report we extracted information on the following topics: 1) what evidence aside from test accuracy was searched for and synthesised, 2) which methods were used to synthesise test accuracy evidence and how did the results inform the economic model, 3) how/whether threshold effects were explored, 4) how the potential dependency between multiple tests in a pathway was accounted for, and 5) for evaluations of tests targeted at the primary care setting, how evidence from differing healthcare settings was incorporated. Results: The bivariate or HSROC model was implemented in 20/22 reports that met all inclusion criteria. Test accuracy data for health economic modelling was obtained from meta-analyses completely in four reports, partially in fourteen reports and not at all in four reports. Only 2/7 reports that used a quantitative test gave clear threshold recommendations. All 22 reports explored the effect of uncertainty in accuracy parameters but most of those that used multiple tests did not allow for dependence between test results. 7/22 tests were potentially suitable for primary care but the majority found limited evidence on test accuracy in primary care settings. Conclusions: The uptake of appropriate meta-analysis methods for synthesising evidence on diagnostic test accuracy in UK NIHR HTAs has improved in recent years. Future research should focus on other evidence requirements for cost-effectiveness assessment, threshold effects for quantitative tests and the impact of multiple diagnostic tests