The Reproducibility of Lists of Differentially Expressed Genes in Microarray Studies

Reproducibility is a fundamental requirement in scientific experiments and clinical contexts. Recent publications raise concerns about the reliability of microarray technology because of the apparent lack of agreement between lists of differentially expressed genes (DEGs). In this study we demonstrate that (1) such discordance may stem from ranking and selecting DEGs solely by statistical significance (P) derived from widely used simple t-tests; (2) when fold change (FC) is used as the ranking criterion, the lists become much more reproducible, especially when fewer genes are selected; and (3) the instability of short DEG lists based on P cutoffs is an expected mathematical consequence of the high variability of the t-values. We recommend the use of FC ranking plus a non-stringent P cutoff as a baseline practice in order to generate more reproducible DEG lists. The FC criterion enhances reproducibility while the P criterion balances sensitivity and specificity

Effect of various normalization methods on Applied Biosystems expression array system data

BACKGROUND: DNA microarray technology provides a powerful tool for characterizing gene expression on a genome scale. While the technology has been widely used in discovery-based medical and basic biological research, its direct application in clinical practice and regulatory decision-making has been questioned. A few key issues, including the reproducibility, reliability, compatibility and standardization of microarray analysis and results, must be critically addressed before any routine usage of microarrays in clinical laboratory and regulated areas can occur. In this study we investigate some of these issues for the Applied Biosystems Human Genome Survey Microarrays. RESULTS: We analyzed the gene expression profiles of two samples: brain and universal human reference (UHR), a mixture of RNAs from 10 cancer cell lines, using the Applied Biosystems Human Genome Survey Microarrays. Five technical replicates in three different sites were performed on the same total RNA samples according to manufacturer's standard protocols. Five different methods, quantile, median, scale, VSN and cyclic loess were used to normalize AB microarray data within each site. 1,000 genes spanning a wide dynamic range in gene expression levels were selected for real-time PCR validation. Using the TaqMan(® )assays data set as the reference set, the performance of the five normalization methods was evaluated focusing on the following criteria: (1) Sensitivity and reproducibility in detection of expression; (2) Fold change correlation with real-time PCR data; (3) Sensitivity and specificity in detection of differential expression; (4) Reproducibility of differentially expressed gene lists. CONCLUSION: Our results showed a high level of concordance between these normalization methods. This is true, regardless of whether signal, detection, variation, fold change measurements and reproducibility were interrogated. Furthermore, we used TaqMan(® )assays as a reference, to generate TPR and FDR plots for the various normalization methods across the assay range. Little impact is observed on the TP and FP rates in detection of differentially expressed genes. Additionally, little effect was observed by the various normalization methods on the statistical approaches analyzed which indicates a certain robustness of the analysis methods currently in use in the field, particularly when used in conjunction with the Applied Biosystems Gene Expression System

Upregulation of MMP-13 and TIMP-1 expression in response to mechanical strain in MC3T3-E1 osteoblastic cells

<p>Abstract</p> <p>Background</p> <p>Mechanical strain plays a significant role in the regulation of bone matrix turnover, which is mediated in part by matrix metalloproteinase (MMP)-13 and tissue inhibitors of matrix metalloproteinase (TIMP)-1. However, little is known about the correlation between mechanical strain and osteoblastic cell activities, including extracellular matrix (ECM) metabolism. Herein, we determined the effect of different magnitudes of cyclic tensile strain (0%, 6%, 12%, and 18%) on MMP-13 and TIMP-1 mRNA and protein expression in MC3T3-E1 osteoblasts. Furthermore, we employed specific inhibitors to examine the role of distinct signal transduction pathways known to mediate cellular responses to mechanical strain.</p> <p>Results</p> <p>We identified a magnitude-dependent increase in MMP-13 and TIMP-1 mRNA and protein levels in response to mechanical strains corresponding to 6%, 12%, and 18% elongation. The strain-induced increases in MMP-13 and TIMP-1 mRNA expression were inhibited by PD098059 and cycloheximide, respectively.</p> <p>Conclusions</p> <p>Our results suggest a mechanism for the regulation of bone matrix metabolism mediated by the differential expression of MMP-13 and TIMP-1 in response to increasing magnitudes of mechanical strain.</p

Impact of HIV on Cell Survival and Antiviral Activity of Plasmacytoid Dendritic Cells

Plasmacytoid dendritic cells (pDCs) are important mediators of innate immunity that act mainly through secretion of interferon (IFN)-α. Previous studies have found that these cells can suppress HIV in vitro; additionally, pDCs have been shown to be severely reduced in the peripheral blood of HIV-infected individuals. In the present study, we sought to determine the ability of pDCs to directly suppress viral replication ex vivo and to delineate the potential mechanisms whereby pDCs are depleted in HIV-infected individuals. We demonstrate that activated pDCs strongly suppress HIV replication in autologous CD4(+) T cells via a mechanism involving IFN-α as well as other antiviral factors. Of note, unstimulated pDCs from infected individuals who maintain low levels of plasma viremia without antiretroviral therapy were able to suppress HIV ex vivo via a mechanism requiring cell-to-cell contact. Our data also demonstrate that death of pDCs by both apoptosis and necrosis is induced by fusion of HIV with pDCs. Taken together, our data suggest that pDCs play an important role in the control of HIV replication and that high levels of viral replication in vivo are associated with pDC cell death via apoptosis and necrosis. Elucidation of the mechanism by which pDCs suppress HIV replication in vivo may have clinically relevant implications for future therapeutic strategies

Gene Expression Profiles Distinguish the Carcinogenic Effects of Aristolochic Acid in Target (Kidney) and Non-target (Liver) Tissues in Rats

BACKGROUND: Aristolochic acid (AA) is the active component of herbal drugs derived from Aristolochia species that have been used for medicinal purposes since antiquity. AA, however, induced nephropathy and urothelial cancer in people and malignant tumors in the kidney and urinary tract of rodents. Although AA is bioactivated in both kidney and liver, it only induces tumors in kidney. To evaluate whether microarray analysis can be used for distinguishing the tissue-specific carcinogenicity of AA, we examined gene expression profiles in kidney and liver of rats treated with carcinogenic doses of AA. RESULTS: Microarray analysis was performed using the Rat Genome Survey Microarray and data analysis was carried out within ArrayTrack software. Principal components analysis and hierarchical cluster analysis of the expression profiles showed that samples were grouped together according to the tissues and treatments. The gene expression profiles were significantly altered by AA treatment in both kidney and liver (p < 0.01; fold change > 1.5). Functional analysis with Ingenuity Pathways Analysis showed that there were many more significantly altered genes involved in cancer-related pathways in kidney than in liver. Also, analysis with Gene Ontology for Functional Analysis (GOFFA) software indicated that the biological processes related to defense response, apoptosis and immune response were significantly altered by AA exposure in kidney, but not in liver. CONCLUSION: Our results suggest that microarray analysis is a useful tool for detecting AA exposure; that analysis of the gene expression profiles can define the differential responses to toxicity and carcinogenicity of AA from kidney and liver; and that significant alteration of genes associated with defense response, apoptosis and immune response in kidney, but not in liver, may be responsible for the tissue-specific toxicity and carcinogenicity of AA

The balance of reproducibility, sensitivity, and specificity of lists of differentially expressed genes in microarray studies

<p>Abstract</p> <p>Background</p> <p>Reproducibility is a fundamental requirement in scientific experiments. Some recent publications have claimed that microarrays are unreliable because lists of differentially expressed genes (DEGs) are not reproducible in similar experiments. Meanwhile, new statistical methods for identifying DEGs continue to appear in the scientific literature. The resultant variety of existing and emerging methods exacerbates confusion and continuing debate in the microarray community on the appropriate choice of methods for identifying reliable DEG lists.</p> <p>Results</p> <p>Using the data sets generated by the MicroArray Quality Control (MAQC) project, we investigated the impact on the reproducibility of DEG lists of a few widely used gene selection procedures. We present comprehensive results from inter-site comparisons using the same microarray platform, cross-platform comparisons using multiple microarray platforms, and comparisons between microarray results and those from TaqMan – the widely regarded "standard" gene expression platform. Our results demonstrate that (1) previously reported discordance between DEG lists could simply result from ranking and selecting DEGs solely by statistical significance (<it>P</it>) derived from widely used simple <it>t</it>-tests; (2) when fold change (FC) is used as the ranking criterion with a non-stringent <it>P</it>-value cutoff filtering, the DEG lists become much more reproducible, especially when fewer genes are selected as differentially expressed, as is the case in most microarray studies; and (3) the instability of short DEG lists solely based on <it>P</it>-value ranking is an expected mathematical consequence of the high variability of the <it>t</it>-values; the more stringent the <it>P</it>-value threshold, the less reproducible the DEG list is. These observations are also consistent with results from extensive simulation calculations.</p> <p>Conclusion</p> <p>We recommend the use of FC-ranking plus a non-stringent <it>P </it>cutoff as a straightforward and baseline practice in order to generate more reproducible DEG lists. Specifically, the <it>P</it>-value cutoff should not be stringent (too small) and FC should be as large as possible. Our results provide practical guidance to choose the appropriate FC and <it>P</it>-value cutoffs when selecting a given number of DEGs. The FC criterion enhances reproducibility, whereas the <it>P </it>criterion balances sensitivity and specificity.</p

Tumor Transcriptome Sequencing Reveals Allelic Expression Imbalances Associated with Copy Number Alterations

Due to growing throughput and shrinking cost, massively parallel sequencing is rapidly becoming an attractive alternative to microarrays for the genome-wide study of gene expression and copy number alterations in primary tumors. The sequencing of transcripts (RNA-Seq) should offer several advantages over microarray-based methods, including the ability to detect somatic mutations and accurately measure allele-specific expression. To investigate these advantages we have applied a novel, strand-specific RNA-Seq method to tumors and matched normal tissue from three patients with oral squamous cell carcinomas. Additionally, to better understand the genomic determinants of the gene expression changes observed, we have sequenced the tumor and normal genomes of one of these patients. We demonstrate here that our RNA-Seq method accurately measures allelic imbalance and that measurement on the genome-wide scale yields novel insights into cancer etiology. As expected, the set of genes differentially expressed in the tumors is enriched for cell adhesion and differentiation functions, but, unexpectedly, the set of allelically imbalanced genes is also enriched for these same cancer-related functions. By comparing the transcriptomic perturbations observed in one patient to his underlying normal and tumor genomes, we find that allelic imbalance in the tumor is associated with copy number mutations and that copy number mutations are, in turn, strongly associated with changes in transcript abundance. These results support a model in which allele-specific deletions and duplications drive allele-specific changes in gene expression in the developing tumor

Genes related to mitochondrial functions are differentially expressed in phosphine-resistant and -susceptible Tribolium castaneum

Background: Phosphine is a valuable fumigant to control pest populations in stored grains and grain products. However, recent studies indicate a substantial increase in phosphine resistance in stored product pests worldwide.Results: To understand the molecular bases of phosphine resistance in insects, we used RNA-Seq to compare gene expression in phosphine-resistant and susceptible laboratory populations of the red flour beetle, Tribolium castaneum. Each population was evaluated as either phosphine-exposed or no phosphine (untreated controls) in triplicate biological replicates (12 samples total). Pairwise analysis indicated there were eight genes differentially expressed between susceptible and resistant insects not exposed to phosphine (i.e., basal expression) or those exposed to phopshine (>8-fold expression and 90 % C.I.). However, 214 genes were differentially expressed among all four treatment groups at a statistically significant level (ANOVA, p < 0.05). Increased expression of 44 cytochrome P450 genes was found in resistant vs. susceptible insects, and phosphine exposure resulted in additional increases of 21 of these genes, five of which were significant among all treatment groups (p < 0.05). Expression of two genes encoding anti-diruetic peptide was 2- to 8-fold reduced in phosphine-resistant insects, and when exposed to phosphine, expression was further reduced 36- to 500-fold compared to susceptible. Phosphine-resistant insects also displayed differential expression of cuticle, carbohydrate, protease, transporter, and many mitochondrial genes, among others. Gene ontology terms associated with mitochondrial functions (oxidation biological processes, monooxygenase and catalytic molecular functions, and iron, heme, and tetrapyyrole binding) were enriched in the significantly differentially expressed dataset. Sequence polymorphism was found in transcripts encoding a known phosphine resistance gene, dihydrolipoamide dehydrogenase, in both susceptible and resistant insects. Phosphine-resistant adults also were resistant to knockdown by the pyrethroid deltamethrin, likely due to the increased cytochrome P450 expression.Conclusions: Overall, genes associated with the mitochondria were differentially expressed in resistant insects, and these differences may contribute to a reduction in overall metabolism and energy production and/or compensation in resistant insects. These data provide the first gene expression data on the response of phosphine-resistant and -susceptible insects to phosphine exposure, and demonstrate that RNA-Seq is a valuable tool to examine differences in insects that respond differentially to environmental stimuli.Peer reviewedEntomology and Plant Patholog