Analyzing Hidden Representations in End-to-End Automatic Speech Recognition Systems

Neural models have become ubiquitous in automatic speech recognition systems. While neural networks are typically used as acoustic models in more complex systems, recent studies have explored end-to-end speech recognition systems based on neural networks, which can be trained to directly predict text from input acoustic features. Although such systems are conceptually elegant and simpler than traditional systems, it is less obvious how to interpret the trained models. In this work, we analyze the speech representations learned by a deep end-to-end model that is based on convolutional and recurrent layers, and trained with a connectionist temporal classification (CTC) loss. We use a pre-trained model to generate frame-level features which are given to a classifier that is trained on frame classification into phones. We evaluate representations from different layers of the deep model and compare their quality for predicting phone labels. Our experiments shed light on important aspects of the end-to-end model such as layer depth, model complexity, and other design choices.Comment: NIPS 201

Soil pH, total phosphorus, climate and distance are the major factors influencing microbial activity at a regional spatial scale

Considering the extensive functional redundancy in microbial communities and great difficulty in elucidating it based on taxonomic structure, studies on the biogeography of soil microbial activity at large spatial scale are as important as microbial community structure. Eighty-four soil samples were collected across a region from south to north China (about 1,000 km) to address the questions if microbial activity displays biogeographic patterns and what are driving forces. These samples represented different soil types, land use and climate. Redundancy analysis and nonmetric multidimensional scaling clearly revealed that soil microbial activities showed distinct differentiation at different sites over a regional spatial scale, which were strongly affected by soil pH, total P, rainfall, temperature, soil type and location. In addition, microbial community structure was greatly influenced by rainfall, location, temperature, soil pH and soil type and was correlated with microbial activity to some extent. Our results suggest that microbial activities display a clear geographic pattern that is greatly altered by geographic distance and reflected by climate, soil pH and total P over large spatial scales. There are common (distance, climate, pH and soil type) but differentiated aspects (TP, SOC and N) in the biogeography of soil microbial community structure and activity

Wheel Running Improves Motor Function and Spinal Cord Plasticity in Mice With Genetic Absence of the Corticospinal Tract

Our previous studies showed that mutant mice with congenital absence of the corticospinal tract (CST) undergo spontaneous remodeling of motor networks to partially compensate for absent CST function. Here, we asked whether voluntary wheel running could further improve locomotor plasticity in CST-deficient mice. Adult mutant mice were randomly allocated to a “runners” group with free access to a wheel, or a “non-runners” group with no access to a wheel. In comparison with non-runners, there was a significant motor improvement including fine movement, grip strength, decreased footslip errors in runners after 8-week training, which was supported by the elevated amplitude of electromyography recording and increased neuromuscular junctions in the biceps. In runners, terminal ramifications of monoaminergic and rubrospinal descending axons were significantly increased in spinal segments after 12 weeks of exercise compared to non-runners. 5-ethynyl-2′-deoxyuridine (EDU) labeling showed that proliferating cells, 90% of which were Olig2-positive oligodendrocyte progenitors, were 4.8-fold more abundant in runners than in non-runners. In 8-week runners, RNAseq analysis of spinal samples identified 404 genes up-regulated and 398 genes down-regulated, and 69 differently expressed genes involved in signal transduction, among which the NF-κB, PI3K-Akt and cyclic AMP (cAMP) signaling were three top pathways. Twelve-week training induced a significant elevation of postsynaptic density protein 95 (PSD95), synaptophysin 38 and myelin basic protein (MBP), but not of brain derived neurotrophic factor (BDNF), glial cell line-derived neurotrophic factor (GDNF) and insulin like growth factor-1 (IGF-1). Thus, locomotor training activates multiple signaling pathways, contributes to neural plasticity and functional improvement, and might palliate locomotor deficits in patients

Molybdenum disulfide nanoflowers mediated anti-inflammation macrophage modulation for spinal cord injury treatment

Spinal cord injury (SCI) can cause locomotor dysfunctions and sensory deficits. Evidence shows that functional nanodrugs can regulate macrophage polarization and promote anti-inflammatory cytokine expression, which is feasible in SCI immunotherapeutic treatments. Molybdenum disulfide (MoS2) nanomaterials have garnered great attention as potential carriers for therapeutic payload. Herein, we synthesize MoS2@PEG (MoS2 = molybdenum disulfide, PEG = poly (ethylene glycol)) nanoflowers as an effective carrier for loading etanercept (ET) to treat SCI. We characterize drug loading and release properties of MoS2@PEG in vitro and demonstrate that ET-loading MoS2@PEG obviously inhibits the expression of M1-related pro-inflammatory markers (TNF-α, CD86 and iNOS), while promoting M2-related anti-inflammatory markers (Agr1, CD206 and IL-10) levels. In vivo, the mouse model of SCI shows that long-circulating ET-MoS2@PEG nanodrugs can effectively extravasate into the injured spinal cord up to 96 h after SCI, and promote macrophages towards M2 type polarization. As a result, the ET-loading MoS2@PEG administration in mice can protect survival motor neurons, thus, reducing injured areas at central lesion sites, and significantly improving locomotor recovery. This study demonstrates the anti-inflammatory and neuroprotective activities of ET-MoS2@PEG and promising utility of MoS2 nanomaterial-mediated drug delivery

Unregulated miR-96 Induces Cell Proliferation in Human Breast Cancer by Downregulating Transcriptional Factor FOXO3a

FOXO transcription factors are key tumor suppressors in mammalian cells. Until now, suppression of FOXOs in cancer cells was thought to be mainly due to activation of multiple onco-kinases by a phosphorylation-ubiquitylation-mediated cascade. Therefore, it was speculated that inhibition of FOXO proteins would naturally occur through a multiple step post-translational process. However, whether cancer cells may downregulate FOXO protein via an alternative regulatory mechanism is unclear. In the current study, we report that expression of miR-96 was markedly upregulated in breast cancer cells and breast cancer tissues compared with normal breast epithelial cells (NBEC) and normal breast tissues. Ectopic expression of miR-96 induced the proliferation and anchorage-independent growth of breast cancer cells, while inhibition of miR-96 reduced this effect. Furthermore, upregulation of miR-96 in breast cancer cells resulted in modulation of their entry into the G1/S transitional phase, which was caused by downregulation of cyclin-dependent kinase (CDK) inhibitors, p27Kip1 and p21Cip1, and upregulation of the cell-cycle regulator cyclin D1. Moreover, we demonstrated that miR-96 downregulated FOXO3a expression by directly targeting the FOXO3a 3′-untranslated region. Taken together, our results suggest that miR-96 may play an important role in promoting proliferation of human breast cancer cells and present a novel mechanism of miRNA-mediated direct suppression of FOXO3a expression in cancer cells

A Novel Peptide Derived from Human Pancreatitis-Associated Protein Inhibits Inflammation In Vivo and In Vitro and Blocks NF-Kappa B Signaling Pathway

BACKGROUND: Pancreatitis-associated protein (PAP) is a pancreatic secretory protein belongs to the group VII of C-type lectin family. Emerging evidence suggests that PAP plays a protective effect in inflammatory diseases. In the present study, we newly identified a 16-amino-acid peptide (named PAPep) derived from C-type lectin-like domain (CTLD) of human PAP with potent anti-inflammatory activity using both in vivo and in vitro assays. METHODOLOGY/PRINCIPAL FINDINGS: We assessed the anti-inflammatory effect of PAPep on endotoxin-induced uveitis (EIU) in rats and demonstrated that intravitreal pretreatment of PAPep concentration-dependently attenuated clinical manifestation of EIU rats, reduced protein leakage and cell infiltration into the aqueous humor (AqH), suppressed tumor necrosis factor (TNF)-α, interleukin (IL)-6, intercellular adhesion molecule-1 (ICAM-1) and monocyte chemoattractant protein (MCP)-1 production in ocular tissues, and improved histopathologic manifestation of EIU. Furthermore, PAPep suppressed the LPS-induced mRNA expression of TNF-α and IL-6 in RAW 264.7 cells, inhibited protein expression of ICAM-1 in TNF-α-stimulated human umbilical vein endothelial cells (HUVECs) as well as U937 cells adhesion to HUVECs. Western blot analysis in ocular tissues and different cell lines revealed that the possible mechanism for this anti-inflammatory effect of PAPep may depend on its ability to inhibit the activation of NF-kB signaling pathway. CONCLUSIONS/SIGNIFICANCE: Our studies provide the first evidence that the sequence of PAPep is within the critically active region for the anti-inflammatory function of PAP and the peptide may be a promising candidate for the management of ocular inflammatory diseases