Improving Textless Spoken Language Understanding with Discrete Units as Intermediate Target

Spoken Language Understanding (SLU) is a task that aims to extract semantic information from spoken utterances. Previous research has made progress in end-to-end SLU by using paired speech-text data, such as pre-trained Automatic Speech Recognition (ASR) models or paired text as intermediate targets. However, acquiring paired transcripts is expensive and impractical for unwritten languages. On the other hand, Textless SLU extracts semantic information from speech without utilizing paired transcripts. However, the absence of intermediate targets and training guidance for textless SLU often results in suboptimal performance. In this work, inspired by the content-disentangled discrete units from self-supervised speech models, we proposed to use discrete units as intermediate guidance to improve textless SLU performance. Our method surpasses the baseline method on five SLU benchmark corpora. Additionally, we find that unit guidance facilitates few-shot learning and enhances the model's ability to handle noise.Comment: Accepted by interspeech 202

Deriving inherent optical properties from classical water color measurements: Forel-ule index and secchi disk depth

Secchi disk depth (ZSD) and Forel-Ule index (FUI) are the two oldest and easiest measurements of water optical properties based on visual determination. With an overarching objective to obtain water inherent optical properties (IOPs) using these historical measurements, this study presents a model for associating remote-sensing reflectance (Rrs) with FUI and ZSD. Based upon this, a scheme (FZ2ab) for converting FUI and ZSD to absorption (a) and backscattering coefficients (bb) is developed and evaluated. For a data set from HydroLight simulations, the difference is < 11% between FZ2ab-derived a and known a, and < 28% between FZ2ab-derived bb and known bb. Further, for a data set from field measurements, the difference is < 30% between FZ2ab-derived a and measured a. These results indicate that FZ2ab can bridge the gap between historical measurements and the focus of IOP measurements in modern marine optics, and potentially extend our knowledge on the bio-optical properties of global seas to the past century through the historical measurements of FUI and ZSD

Neuron-Specific HuR-Deficient Mice Spontaneously Develop Motor Neuron Disease

Human Ag R (HuR) is an RNA binding protein in the ELAVL protein family. To study the neuron-specific function of HuR, we generated inducible, neuron-specific HuR-deficient mice of both sexes. After tamoxifen-induced deletion of HuR, these mice developed a phenotype consisting of poor balance, decreased movement, and decreased strength. They performed significantly worse on the rotarod test compared with littermate control mice, indicating coordination deficiency. Using the grip-strength test, it was also determined that the forelimbs of neuron-specific HuR-deficient mice were much weaker than littermate control mice. Immunostaining of the brain and cervical spinal cord showed that HuR-deficient neurons had increased levels of cleaved caspase-3, a hallmark of cell apoptosis. Caspase-3 cleavage was especially strong in pyramidal neurons and α motor neurons of HuR-deficient mice. Genome-wide microarray and real-time PCR analysis further indicated that HuR deficiency in neurons resulted in altered expression of genes in the brain involved in cell growth, including trichoplein keratin filament-binding protein, Cdkn2c, G-protein signaling modulator 2, immediate early response 2, superoxide dismutase 1, and Bcl2. The additional enriched Gene Ontology terms in the brain tissues of neuron-specific HuR-deficient mice were largely related to inflammation, including IFN-induced genes and complement components. Importantly, some of these HuR-regulated genes were also significantly altered in the brain and spinal cord of patients with amyotrophic lateral sclerosis. Additionally, neuronal HuR deficiency resulted in the redistribution of TDP43 to cytosolic granules, which has been linked to motor neuron disease. Taken together, we propose that this neuron-specific HuR-deficient mouse strain can potentially be used as a motor neuron disease model

Investigation of inversion, accumulation and junctionless mode bulk Germanium FinFETs

The characteristic performance of n-type and p-type inversion (IM) mode, accumulation (AC) mode and junctionless (JL) mode, bulk Germanium FinFET device with 3-nm gate length (LG) are demonstrated by using 3-D quantum transport device simulation. The simulated bulk Ge FinFET device exhibits favorable short channel characteristics, including drain-induced barrier lowering (DIBL&lt;10mV/V), sub threshold slope (SS∼64mV/dec.). Electron density distributions in ON-state and OFF-state also show that the simulated devices have large ION/IOFF ratios. Homogenous source/drain doping is maintained and only the channel doping is varied among different operating modes. Also, a constant threshold voltage |VTH|∼0.31V is maintained. Moreover, the calculated quantum capacitance (CQ) values of the Ge nanowire emphasizes the importance of quantum confinement effects (QCE) on the performance of the ultra-scaled devices