MUX-PLMs: Data Multiplexing for High-throughput Language Models

The widespread adoption of large language models such as ChatGPT and Bard has led to unprecedented demand for these technologies. The burgeoning cost of inference for ever-increasing model sizes coupled with hardware shortages has limited affordable access and poses a pressing need for efficiency approaches geared towards high throughput and performance. Multi-input multi-output (MIMO) algorithms such as data multiplexing, offer a promising solution with a many-fold increase in throughput by performing inference for multiple inputs at the cost of a single input. Yet these approaches are not currently performant enough to be deployed in modern systems. We change that by developing MUX-PLMs, a class of high throughput pre-trained language models (PLMs) trained with data multiplexing, that can be fine-tuned for any downstream task to yield high-throughput high-performance. Our novel multiplexing and demultiplexing modules proficiently entangle and disentangle inputs, and enable high-performance high throughput \muxplms{} that are competitive with vanilla PLMs while achieving 2x/5x inference speedup with only a $1-4\%$ drop on a broad suite of tasks

Appraisal of progenitor markers in the context of molecular classification of breast cancers

Clinical management of breast cancer relies on case stratification, which increasingly employs molecular markers. The motivation behind delineating breast epithelial differentiation is to better target cancer cases through innate sensitivities bequeathed to the cancer from its normal progenitor state. A combination of histopathological and molecular classification of breast cancer cases suggests a role for progenitors in particular breast cancer cases. Although a remarkable fraction of the real tissue repertoire is maintained within a population of independent cell line cultures, some steps that are closer to the terminal differentiation state and that form a majority of primary human breast tissues are missing in the cell line cultures. This raises concerns about current breast cancer models

Littoral cell angioma of the spleen in a patient with previous pulmonary sarcoidosis: a TNF-α related pathogenesis?

<p>Abstract</p> <p>Background</p> <p>Littoral cell angioma (LCA) is a rare vascular tumor of the spleen. Generally thought to be benign, additional cases of LCA with malignant features have been described. Thus, its malignant potential seems to vary and must be considered uncertain. The etiology remains unclear, but an immune dysregulation for the apparent association with malignancies of visceral organs or immune-mediated diseases has been proposed.</p> <p>Case Presentation</p> <p>We report a case of LCA in a 43-year old male patient who presented with a loss of appetite and intermittent upper abdominal pain. Computed tomography showed multiple hypoattenuating splenic lesions which were hyperechogenic on abdominal ultrasound. Lymphoma was presumed and splenectomy was performed. Pathological evaluation revealed LCA.</p> <p>Conclusions</p> <p>LCA is a rare, primary vascular neoplasm of the spleen that might etiologically be associated with immune dysregulation. In addition, it shows a striking association with synchronous or prior malignancies. With about one-third of the reported cases to date being co-existent with malignancies of visceral organs or immune-mediated diseases, this advocates for close follow-ups in all patients diagnosed with LCA. To our knowledge, this report is the first one of LCA associated with previous pulmonary sarcoidosis and hypothesizes a TNF-α related pathogenesis of this splenic tumor.</p

Epithelioid Angiosarcoma of the Small Intestine After Occupational Exposure to Radiation and Polyvinyl Chloride: A case Report and Review of Literature

Angiosarcomas represent 1–2% of soft tissue sarcomas and most frequently occur in the subcutis. They may affect internal organs, such as the heart, liver, and spleen, and only rarely do they emerge in the gastrointestinal tract. The association between angiosarcomas and certain toxic chemical substances or previous external-beam radiation therapy is well documented

Meta-analysis of gene expression microarrays with missing replicates

<p>Abstract</p> <p>Background</p> <p>Many different microarray experiments are publicly available today. It is natural to ask whether different experiments for the same phenotypic conditions can be combined using meta-analysis, in order to increase the overall sample size. However, some genes are not measured in all experiments, hence they cannot be included or their statistical significance cannot be appropriately estimated in traditional meta-analysis. Nonetheless, these genes, which we refer to as <it>incomplete genes</it>, may also be informative and useful.</p> <p>Results</p> <p>We propose a meta-analysis framework, called "Incomplete Gene Meta-analysis", which can include incomplete genes by imputing the significance of missing replicates, and computing a meta-score for every gene across all datasets. We demonstrate that the incomplete genes are worthy of being included and our method is able to appropriately estimate their significance in two groups of experiments. We first apply the <it>Incomplete Gene Meta-analysis </it>and several comparable methods to five breast cancer datasets with an identical set of probes. We simulate incomplete genes by randomly removing a subset of probes from each dataset and demonstrate that our method consistently outperforms two other methods in terms of their false discovery rate. We also apply the methods to three gastric cancer datasets for the purpose of discriminating diffuse and intestinal subtypes.</p> <p>Conclusions</p> <p>Meta-analysis is an effective approach that identifies more robust sets of differentially expressed genes from multiple studies. The incomplete genes that mainly arise from the use of different platforms may also have statistical and biological importance but are ignored or are not appropriately involved by previous studies. Our Incomplete Gene Meta-analysis is able to incorporate the incomplete genes by estimating their significance. The results on both breast and gastric cancer datasets suggest that the highly ranked genes and associated GO terms produced by our method are more significant and biologically meaningful according to the previous literature.</p

Epigenetic Regulation of Cell Type–Specific Expression Patterns in the Human Mammary Epithelium

Differentiation is an epigenetic program that involves the gradual loss of pluripotency and acquisition of cell type–specific features. Understanding these processes requires genome-wide analysis of epigenetic and gene expression profiles, which have been challenging in primary tissue samples due to limited numbers of cells available. Here we describe the application of high-throughput sequencing technology for profiling histone and DNA methylation, as well as gene expression patterns of normal human mammary progenitor-enriched and luminal lineage-committed cells. We observed significant differences in histone H3 lysine 27 tri-methylation (H3K27me3) enrichment and DNA methylation of genes expressed in a cell type–specific manner, suggesting their regulation by epigenetic mechanisms and a dynamic interplay between the two processes that together define developmental potential. The technologies we developed and the epigenetically regulated genes we identified will accelerate the characterization of primary cell epigenomes and the dissection of human mammary epithelial lineage-commitment and luminal differentiation

Tailored design of NKT-stimulatory glycolipids for polarization of immune responses

Natural killer T (NKT) cell is a distinct population of T lymphocytes that can rapidly release massive amount of Th1 and Th2 cytokines upon the engagement of their T cell receptor with glycolipids presented by CD1d. The secreted cytokines can promote cell-mediated immunity to kill tumor cells and intracellular pathogens, or suppress autoreactive immune cells in autoimmune diseases. Thus, NKT cell is an attractive target for developing new therapeutics to manipulate immune system. The best-known glycolipid to activate NKT cells is α-galactosylceramide (α-GalCer), which has been used as a prototype for designing new NKT stimulatory glycolipids. Many analogues have been generated by modification of the galactosyl moiety, the acyl chain or the phytosphingosine chain of α-GalCer. Some of the analogues showed greater abilities than α-GalCer in polarizing immune responses toward Th1 or Th2 dominance. Among them, several analogues containing phenyl groups in the lipid tails were more potent in inducing Th1-skewed cytokines and exhibited greater anticancer efficacy than α-GalCer. Analyses of the correlation between structure and activity of various α-GalCer analogues on the activation of iNKT cell revealed that CD1d–glycolipid complexes interacted with the same population of iNKT cell expressing similar T-cell receptor Vβ as α-GalCer. On the other hand, those phenyl glycolipids with propensity for Th1 dominant responses showed greater binding avidity and stability than α-GalCer for iNKT T-cell receptor when complexed with CD1d. Thus, it is the avidity and stability of the ternary complexes of CD1d-glycolipid-iNKT TCR that dictate the polarity and potency of immune responses. These findings provide a key to the rationale design of immune modulating glycolipids with desirable Th1/Th2 polarity for clinical application. In addition, elucidation of α-GalCer-induced anergy, liver damage and accumulation of myeloid derived suppressor cells has offered explanation for its lacklustre anti-cancer activities in clinical trials. On other hand, the lack of such drawbacks in glycolipid analogues containing phenyl groups in the lipid tails of α-GalCer coupled with the greater binding avidity and stability of CD1d-glycolipid complex for iNKT T-cell receptor, account for their superior anti-cancer efficacy in tumor bearing mice. Further clinical development of these phenyl glycolipids is warranted

Evaluation of Candidate Stromal Epithelial Cross-Talk Genes Identifies Association between Risk of Serous Ovarian Cancer and TERT, a Cancer Susceptibility “Hot-Spot”

We hypothesized that variants in genes expressed as a consequence of interactions between ovarian cancer cells and the host micro-environment could contribute to cancer susceptibility. We therefore used a two-stage approach to evaluate common single nucleotide polymorphisms (SNPs) in 173 genes involved in stromal epithelial interactions in the Ovarian Cancer Association Consortium (OCAC). In the discovery stage, cases with epithelial ovarian cancer (n = 675) and controls (n = 1,162) were genotyped at 1,536 SNPs using an Illumina GoldenGate assay. Based on Positive Predictive Value estimates, three SNPs—PODXL rs1013368, ITGA6 rs13027811, and MMP3 rs522616—were selected for replication using TaqMan genotyping in up to 3,059 serous invasive cases and 8,905 controls from 16 OCAC case-control studies. An additional 18 SNPs with Pper-allele<0.05 in the discovery stage were selected for replication in a subset of five OCAC studies (n = 1,233 serous invasive cases; n = 3,364 controls). The discovery stage associations in PODXL, ITGA6, and MMP3 were attenuated in the larger replication set (adj. Pper-allele≥0.5). However genotypes at TERT rs7726159 were associated with ovarian cancer risk in the smaller, five-study replication study (Pper-allele = 0.03). Combined analysis of the discovery and replication sets for this TERT SNP showed an increased risk of serous ovarian cancer among non-Hispanic whites [adj. ORper-allele 1.14 (1.04–1.24) p = 0.003]. Our study adds to the growing evidence that, like the 8q24 locus, the telomerase reverse transcriptase locus at 5p15.33, is a general cancer susceptibility locus

Isolation, establishment, and characterization of ex vivo equine melanoma cell cultures

Gray horses spontaneously develop metastatic melanomas that resemble human disease, and this is often accompanied with metastasis to other organs. Unlike in other species, the establishment of primary equine melanoma cultures that could be used to develop new therapeutic approaches has remained a major challenge. The purpose of the study was to develop a protocol for routine isolation and cultivation of primary equine melanocytes. Melanoma tissues were excised from 13 horses under local anesthesia, mainly from the perianal area. The melanoma cells were isolated from the melanoma tissue by serial enzymatic digestion using dispase and collagenase. Out of the 13 excised melanomas, cell cultures from eight melanomas were established, which corresponded to a success rate 62%. These cells showed different degrees of melanin pigmentation. Characterization of these cells using confocal microscopy, FACs analysis and western blotting showed that they expressed melanoma-associated antigens; Melan-A, MAGE-1, and MAGE-3, and PCNA expression was higher in fast-proliferating isolates. The protocol we developed and established proved successful for routine isolation and cultivation of primary equine melanoma cells. This method provided a large number of primary equine melanoma cells that could be used to study new therapeutic approaches for treatment of equine melanomas