Transformer-based Acoustic Modeling for Hybrid Speech Recognition

We propose and evaluate transformer-based acoustic models (AMs) for hybrid speech recognition. Several modeling choices are discussed in this work, including various positional embedding methods and an iterated loss to enable training deep transformers. We also present a preliminary study of using limited right context in transformer models, which makes it possible for streaming applications. We demonstrate that on the widely used Librispeech benchmark, our transformer-based AM outperforms the best published hybrid result by 19% to 26% relative when the standard n-gram language model (LM) is used. Combined with neural network LM for rescoring, our proposed approach achieves state-of-the-art results on Librispeech. Our findings are also confirmed on a much larger internal dataset.Comment: to appear in ICASSP 202

High-Level Expression of Notch1 Increased the Risk of Metastasis in T1 Stage Clear Cell Renal Cell Carcinoma

Background: Although metastasis of clear cell renal cell carcinoma (ccRCC) is basically observed in late stage tumors, T1 stage metastasis of ccRCC can also be found with no definite molecular cause resulting inappropriate selection of surgery method and poor prognosis. Notch signaling is a conserved, widely expressed signal pathway that mediates various cellular processes in normal development and tumorigenesis. This study aims to explore the potential role and mechanism of Notch signaling in the metastasis of T1 stage ccRCC. Methodology/Principal Findings: The expression of Notch1 and Jagged1 were analyzed in tumor tissues and matched normal adjacent tissues obtained from 51 ccRCC patients. Compared to non-tumor tissues, Notch1 and Jagged1 expression was significantly elevated both in mRNA and protein levels in tumors. Tissue samples of localized and metastatic tumors were divided into three groups based on their tumor stages and the relative mRNA expression of Notch1 and Jagged1 were analyzed. Compared to localized tumors, Notch1 expression was significantly elevated in metastatic tumors in T1 stage while Jagged1 expression was not statistically different between localized and metastatic tumors of all stages. The average size of metastatic tumors was significantly larger than localized tumors in T1 stage ccRCC and the elevated expression of Notch1 was significantly positive correlated with the tumor diameter. The functional significance of Notch signaling was studied by transfection of 786-O, Caki-1 and HKC cell lines with full-length expression plasmids of Notch1 and Jagged1

Real-time Monitoring for the Next Core-Collapse Supernova in JUNO

Core-collapse supernova (CCSN) is one of the most energetic astrophysical events in the Universe. The early and prompt detection of neutrinos before (pre-SN) and during the SN burst is a unique opportunity to realize the multi-messenger observation of the CCSN events. In this work, we describe the monitoring concept and present the sensitivity of the system to the pre-SN and SN neutrinos at the Jiangmen Underground Neutrino Observatory (JUNO), which is a 20 kton liquid scintillator detector under construction in South China. The real-time monitoring system is designed with both the prompt monitors on the electronic board and online monitors at the data acquisition stage, in order to ensure both the alert speed and alert coverage of progenitor stars. By assuming a false alert rate of 1 per year, this monitoring system can be sensitive to the pre-SN neutrinos up to the distance of about 1.6 (0.9) kpc and SN neutrinos up to about 370 (360) kpc for a progenitor mass of 30$M_{\odot}$ for the case of normal (inverted) mass ordering. The pointing ability of the CCSN is evaluated by using the accumulated event anisotropy of the inverse beta decay interactions from pre-SN or SN neutrinos, which, along with the early alert, can play important roles for the followup multi-messenger observations of the next Galactic or nearby extragalactic CCSN.Comment: 24 pages, 9 figure

Potential of Core-Collapse Supernova Neutrino Detection at JUNO

JUNO is an underground neutrino observatory under construction in Jiangmen, China. It uses 20kton liquid scintillator as target, which enables it to detect supernova burst neutrinos of a large statistics for the next galactic core-collapse supernova (CCSN) and also pre-supernova neutrinos from the nearby CCSN progenitors. All flavors of supernova burst neutrinos can be detected by JUNO via several interaction channels, including inverse beta decay, elastic scattering on electron and proton, interactions on C12 nuclei, etc. This retains the possibility for JUNO to reconstruct the energy spectra of supernova burst neutrinos of all flavors. The real time monitoring systems based on FPGA and DAQ are under development in JUNO, which allow prompt alert and trigger-less data acquisition of CCSN events. The alert performances of both monitoring systems have been thoroughly studied using simulations. Moreover, once a CCSN is tagged, the system can give fast characterizations, such as directionality and light curve

Detection of the Diffuse Supernova Neutrino Background with JUNO

As an underground multi-purpose neutrino detector with 20 kton liquid scintillator, Jiangmen Underground Neutrino Observatory (JUNO) is competitive with and complementary to the water-Cherenkov detectors on the search for the diffuse supernova neutrino background (DSNB). Typical supernova models predict 2-4 events per year within the optimal observation window in the JUNO detector. The dominant background is from the neutral-current (NC) interaction of atmospheric neutrinos with 12C nuclei, which surpasses the DSNB by more than one order of magnitude. We evaluated the systematic uncertainty of NC background from the spread of a variety of data-driven models and further developed a method to determine NC background within 15\% with {\it{in}} {\it{situ}} measurements after ten years of running. Besides, the NC-like backgrounds can be effectively suppressed by the intrinsic pulse-shape discrimination (PSD) capabilities of liquid scintillators. In this talk, I will present in detail the improvements on NC background uncertainty evaluation, PSD discriminator development, and finally, the potential of DSNB sensitivity in JUNO

Spatial analysis of bus rapid transit actual operating conditions: the case of Hangzhou City, China

Bus rapid transit (BRT), as a modern mode of transportation, plays an increasingly important role in urban public transport. A real-time vehicle positioning and passenger flow sensing system is developed to collect and process the high-frequency data of the BRT operation status and passenger flow at BRT stations. Based on the established spatial analysis model, the intersection delay, running state, passenger flow and stranded passengers of BRT are analyzed. The experiment showed the outcome had a high accuracy and strong reference. It provided the transit agency with a timely, detailed and accurate decision-making basis to grasp the true operation situation of the BRT and carry out each BRT scheduling task scientifically, so as to improve the management efficiency and service level of BRT