Spatio-Temporal Meta Contrastive Learning

Spatio-temporal prediction is crucial in numerous real-world applications, including traffic forecasting and crime prediction, which aim to improve public transportation and safety management. Many state-of-the-art models demonstrate the strong capability of spatio-temporal graph neural networks (STGNN) to capture complex spatio-temporal correlations. However, despite their effectiveness, existing approaches do not adequately address several key challenges. Data quality issues, such as data scarcity and sparsity, lead to data noise and a lack of supervised signals, which significantly limit the performance of STGNN. Although recent STGNN models with contrastive learning aim to address these challenges, most of them use pre-defined augmentation strategies that heavily depend on manual design and cannot be customized for different Spatio-Temporal Graph (STG) scenarios. To tackle these challenges, we propose a new spatio-temporal contrastive learning (CL4ST) framework to encode robust and generalizable STG representations via the STG augmentation paradigm. Specifically, we design the meta view generator to automatically construct node and edge augmentation views for each disentangled spatial and temporal graph in a data-driven manner. The meta view generator employs meta networks with parameterized generative model to customize the augmentations for each input. This personalizes the augmentation strategies for every STG and endows the learning framework with spatio-temporal-aware information. Additionally, we integrate a unified spatio-temporal graph attention network with the proposed meta view generator and two-branch graph contrastive learning paradigms. Extensive experiments demonstrate that our CL4ST significantly improves performance over various state-of-the-art baselines in traffic and crime prediction.Comment: 32nd ACM International Conference on Information and Knowledge Management (CIKM' 23

Void Fraction Measurement of Gas-Liquid Two-Phase Flow from Differential Pressure

Void fraction is an important process variable for the volume and mass computation required for transportation of gas–liquid mixture in pipelines, storage in tanks, metering and custody transfer. Inaccurate measurement would introduce errors in product measurement with potentials for loss of revenue. Accurate measurement is often constrained by invasive and expensive online measurement techniques. This work focuses on the use of cost effective and non-invasive pressure sensors to calculate the gas void fraction of gas–liquid flow. The differential pressure readings from the vertical upward bubbly and slug air–water flow are substituted into classical mathematical models based on energy conservation to derive the void fraction. Electrical Resistance Tomography (ERT) and Wire-mesh Sensor (WMS) are used as benchmark to validate the void fraction obtained from the differential pressure. Consequently the model is able to produce reasonable agreement with ERT and WMS on the void fraction measurement. The effect of the friction loss on the mathematical models is also investigated and discussed. It is concluded the friction loss cannot be neglected, particularly when gas void fraction is less than 0.2

Reducing the gap between streaming and non-streaming Transducer-based ASR by adaptive two-stage knowledge distillation

Transducer is one of the mainstream frameworks for streaming speech recognition. There is a performance gap between the streaming and non-streaming transducer models due to limited context. To reduce this gap, an effective way is to ensure that their hidden and output distributions are consistent, which can be achieved by hierarchical knowledge distillation. However, it is difficult to ensure the distribution consistency simultaneously because the learning of the output distribution depends on the hidden one. In this paper, we propose an adaptive two-stage knowledge distillation method consisting of hidden layer learning and output layer learning. In the former stage, we learn hidden representation with full context by applying mean square error loss function. In the latter stage, we design a power transformation based adaptive smoothness method to learn stable output distribution. It achieved 19\% relative reduction in word error rate, and a faster response for the first token compared with the original streaming model in LibriSpeech corpus

Identifying degradation patterns of lithium ion batteries from impedance spectroscopy using machine learning

Abstract: Forecasting the state of health and remaining useful life of Li-ion batteries is an unsolved challenge that limits technologies such as consumer electronics and electric vehicles. Here, we build an accurate battery forecasting system by combining electrochemical impedance spectroscopy (EIS)—a real-time, non-invasive and information-rich measurement that is hitherto underused in battery diagnosis—with Gaussian process machine learning. Over 20,000 EIS spectra of commercial Li-ion batteries are collected at different states of health, states of charge and temperatures—the largest dataset to our knowledge of its kind. Our Gaussian process model takes the entire spectrum as input, without further feature engineering, and automatically determines which spectral features predict degradation. Our model accurately predicts the remaining useful life, even without complete knowledge of past operating conditions of the battery. Our results demonstrate the value of EIS signals in battery management systems

Translocator protein is a marker of activated microglia in rodent models but not human neurodegenerative diseases

Microglial activation plays central roles in neuroinflammatory and neurodegenerative diseases. Positron emission tomography (PET) targeting 18 kDa Translocator Protein (TSPO) is widely used for localising inflammation in vivo, but its quantitative interpretation remains uncertain. We show that TSPO expression increases in activated microglia in mouse brain disease models but does not change in a non-human primate disease model or in common neurodegenerative and neuroinflammatory human diseases. We describe genetic divergence in the TSPO gene promoter, consistent with the hypothesis that the increase in TSPO expression in activated myeloid cells depends on the transcription factor AP1 and is unique to a subset of rodent species within the Muroidea superfamily. Finally, we identify LCP2 and TFEC as potential markers of microglial activation in humans. These data emphasise that TSPO expression in human myeloid cells is related to different phenomena than in mice, and that TSPO-PET signals in humans reflect the density of inflammatory cells rather than activation state.Published versionThe authors thank the UK MS Society for financial support (grant number: C008-16.1). DRO was funded by an MRC Clinician Scientist Award (MR/N008219/1). P.M.M. acknowledges generous support from Edmond J Safra Foundation and Lily Safra, the NIHR Senior Investigator programme and the UK Dementia Research Institute which receives its funding from DRI Ltd., funded by the UK Medical Research Council, Alzheimer’s Society, and Alzheimer’s Research UK. P.M.M. and D.R.O. thank the Imperial College Healthcare Trust-NIHR Biomedical Research Centre for infrastructure support and the Medical Research Council for support of TSPO studies (MR/N016343/1). E.A. was supported by the ALS Stichting (grant “The Dutch ALS Tissue Bank”). P.M. and B.B.T. are funded by the Swiss National Science Foundation (projects 320030_184713 and 310030_212322, respectively). S.T. was supported by an “Early Postdoc.Mobility” scholarship (P2GEP3_191446) from the Swiss National Science Foundation, a “Clinical Medicine Plus” scholarship from the Prof Dr. Max Cloëtta Foundation (Zurich, Switzerland), from the Jean et Madeleine Vachoux Foundation (Geneva, Switzerland) and from the University Hospitals of Geneva. This work was funded by NIH grants U01AG061356 (De Jager/Bennett), RF1AG057473 (De Jager/Bennett), and U01AG046152 (De Jager/Bennett) as part of the AMP-AD consortium, as well as NIH grants R01AG066831 (Menon) and U01AG072572 (De Jager/St George-Hyslop)

Comprehensive molecular characterization of gastric adenocarcinoma

Gastric cancer is a leading cause of cancer deaths, but analysis of its molecular and clinical characteristics has been complicated by histological and aetiological heterogeneity. Here we describe a comprehensive molecular evaluation of 295 primary gastric adenocarcinomas as part of The Cancer Genome Atlas (TCGA) project. We propose a molecular classification dividing gastric cancer into four subtypes: tumours positive for Epstein–Barr virus, which display recurrent PIK3CA mutations, extreme DNA hypermethylation, and amplification of JAK2, CD274 (also known as PD-L1) and PDCD1LG2 (also knownasPD-L2); microsatellite unstable tumours, which show elevated mutation rates, including mutations of genes encoding targetable oncogenic signalling proteins; genomically stable tumours, which are enriched for the diffuse histological variant and mutations of RHOA or fusions involving RHO-family GTPase-activating proteins; and tumours with chromosomal instability, which show marked aneuploidy and focal amplification of receptor tyrosine kinases. Identification of these subtypes provides a roadmap for patient stratification and trials of targeted therapies

Integrated genomic characterization of oesophageal carcinoma

Oesophageal cancers are prominent worldwide; however, there are few targeted therapies and survival rates for these cancers remain dismal. Here we performed a comprehensive molecular analysis of 164 carcinomas of the oesophagus derived from Western and Eastern populations. Beyond known histopathological and epidemiologic distinctions, molecular features differentiated oesophageal squamous cell carcinomas from oesophageal adenocarcinomas. Oesophageal squamous cell carcinomas resembled squamous carcinomas of other organs more than they did oesophageal adenocarcinomas. Our analyses identified three molecular subclasses of oesophageal squamous cell carcinomas, but none showed evidence for an aetiological role of human papillomavirus. Squamous cell carcinomas showed frequent genomic amplifications of CCND1 and SOX2 and/or TP63, whereas ERBB2, VEGFA and GATA4 and GATA6 were more commonly amplified in adenocarcinomas. Oesophageal adenocarcinomas strongly resembled the chromosomally unstable variant of gastric adenocarcinoma, suggesting that these cancers could be considered a single disease entity. However, some molecular features, including DNA hypermethylation, occurred disproportionally in oesophageal adenocarcinomas. These data provide a framework to facilitate more rational categorization of these tumours and a foundation for new therapies

A functional genomic approach to actionable gene fusions for precision oncology

Fusion genes represent a class of attractive therapeutic targets. Thousands of fusion genes have been identified in patients with cancer, but the functional consequences and therapeutic implications of most of these remain largely unknown. Here, we develop a functional genomic approach that consists of efficient fusion reconstruction and sensitive cell viability and drug response assays. Applying this approach, we characterize similar to 100 fusion genes detected in patient samples of The Cancer Genome Atlas, revealing a notable fraction of low-frequency fusions with activating effects on tumor growth. Focusing on those in the RTK-RAS pathway, we identify a number of activating fusions that can markedly affect sensitivity to relevant drugs. Last, we propose an integrated, level-of-evidence classification system to prioritize gene fusions systematically. Our study reiterates the urgent clinical need to incorporate similar functional genomic approaches to characterize gene fusions, thereby maximizing the utility of gene fusions for precision oncology

Global, regional, and national burden of disorders affecting the nervous system, 1990–2021: a systematic analysis for the Global Burden of Disease Study 2021

BackgroundDisorders affecting the nervous system are diverse and include neurodevelopmental disorders, late-life neurodegeneration, and newly emergent conditions, such as cognitive impairment following COVID-19. Previous publications from the Global Burden of Disease, Injuries, and Risk Factor Study estimated the burden of 15 neurological conditions in 2015 and 2016, but these analyses did not include neurodevelopmental disorders, as defined by the International Classification of Diseases (ICD)-11, or a subset of cases of congenital, neonatal, and infectious conditions that cause neurological damage. Here, we estimate nervous system health loss caused by 37 unique conditions and their associated risk factors globally, regionally, and nationally from 1990 to 2021.MethodsWe estimated mortality, prevalence, years lived with disability (YLDs), years of life lost (YLLs), and disability-adjusted life-years (DALYs), with corresponding 95% uncertainty intervals (UIs), by age and sex in 204 countries and territories, from 1990 to 2021. We included morbidity and deaths due to neurological conditions, for which health loss is directly due to damage to the CNS or peripheral nervous system. We also isolated neurological health loss from conditions for which nervous system morbidity is a consequence, but not the primary feature, including a subset of congenital conditions (ie, chromosomal anomalies and congenital birth defects), neonatal conditions (ie, jaundice, preterm birth, and sepsis), infectious diseases (ie, COVID-19, cystic echinococcosis, malaria, syphilis, and Zika virus disease), and diabetic neuropathy. By conducting a sequela-level analysis of the health outcomes for these conditions, only cases where nervous system damage occurred were included, and YLDs were recalculated to isolate the non-fatal burden directly attributable to nervous system health loss. A comorbidity correction was used to calculate total prevalence of all conditions that affect the nervous system combined.FindingsGlobally, the 37 conditions affecting the nervous system were collectively ranked as the leading group cause of DALYs in 2021 (443 million, 95% UI 378–521), affecting 3·40 billion (3·20–3·62) individuals (43·1%, 40·5–45·9 of the global population); global DALY counts attributed to these conditions increased by 18·2% (8·7–26·7) between 1990 and 2021. Age-standardised rates of deaths per 100 000 people attributed to these conditions decreased from 1990 to 2021 by 33·6% (27·6–38·8), and age-standardised rates of DALYs attributed to these conditions decreased by 27·0% (21·5–32·4). Age-standardised prevalence was almost stable, with a change of 1·5% (0·7–2·4). The ten conditions with the highest age-standardised DALYs in 2021 were stroke, neonatal encephalopathy, migraine, Alzheimer's disease and other dementias, diabetic neuropathy, meningitis, epilepsy, neurological complications due to preterm birth, autism spectrum disorder, and nervous system cancer.InterpretationAs the leading cause of overall disease burden in the world, with increasing global DALY counts, effective prevention, treatment, and rehabilitation strategies for disorders affecting the nervous system are needed