Improved Noisy Student Training for Automatic Speech Recognition

Recently, a semi-supervised learning method known as "noisy student training" has been shown to improve image classification performance of deep networks significantly. Noisy student training is an iterative self-training method that leverages augmentation to improve network performance. In this work, we adapt and improve noisy student training for automatic speech recognition, employing (adaptive) SpecAugment as the augmentation method. We find effective methods to filter, balance and augment the data generated in between self-training iterations. By doing so, we are able to obtain word error rates (WERs) 4.2%/8.6% on the clean/noisy LibriSpeech test sets by only using the clean 100h subset of LibriSpeech as the supervised set and the rest (860h) as the unlabeled set. Furthermore, we are able to achieve WERs 1.7%/3.4% on the clean/noisy LibriSpeech test sets by using the unlab-60k subset of LibriLight as the unlabeled set for LibriSpeech 960h. We are thus able to improve upon the previous state-of-the-art clean/noisy test WERs achieved on LibriSpeech 100h (4.74%/12.20%) and LibriSpeech (1.9%/4.1%).Comment: 5 pages, 5 figures, 4 tables; v2: minor revisions, reference adde

Quenched chiral logarithms in lattice QCD with exact chiral symmetry

We examine quenched chiral logarithms in lattice QCD with overlap Dirac quark. For 100 gauge configurations generated with the Wilson gauge action at $\beta = 5.8$ on the $8^3 \times 24$ lattice, we compute quenched quark propagators for 12 bare quark masses. The pion decay constant is extracted from the pion propagator, and from which the lattice spacing is determined to be 0.147 fm. The presence of quenched chiral logarithm in the pion mass is confirmed, and its coefficient is determined to be $\delta = 0.203 \pm 0.014$, in agreement with the theoretical estimate in quenched chiral perturbation theory. Further, we obtain the topological susceptibility of these 100 gauge configurations by measuring the index of the overlap Dirac operator. Using a formula due to exact chiral symmetry, we obtain the $\eta'$ mass in quenched chiral perturbation theory, $m_{\eta'} = (901 \pm 64)$ Mev, and an estimate of $\delta = 0.197 \pm 0.027$, which is in good agreement with that determined from the pion mass.Comment: 24 pages, 6 EPS figures; v2: some clarifications added, to appear in Physical Review

Exploring deep neural networks for rumor detection

© 2019, Springer-Verlag GmbH Germany, part of Springer Nature. The widespread propagation of numerous rumors and fake news have seriously threatened the credibility of microblogs. Previous works often focused on maintaining the previous state without considering the subsequent context information. Furthermore, most of the early works have used classical feature representation schemes followed by a classifier. We investigate the rumor detection problem by exploring different Deep Learning models with emphasis on considering the contextual information in both directions: forward and backward, in a given text. The proposed system is based on Bidirectional Long Short-Term Memory with Convolutional Neural Network, effectively classifying the tweet into rumors and non-rumors. Experimental results show that the proposed method outperformed the baseline methods with 86.12% accuracy. Furthermore, the statistical analysis also shows the effectiveness of the proposed model than the comparing methods

Dynamic chromatin organization and regulatory interactions in human endothelial cell differentiation

Vascular endothelial cells are a mesoderm-derived lineage with many essential functions, including angiogenesis and coagulation. The gene-regulatory mechanisms underpinning endothelial specialization are largely unknown, as are the roles of chromatin organization in regulating endothelial cell transcription. To investigate the relationships between chromatin organization and gene expression, we induced endothelial cell differentiation from human pluripotent stem cells and performed Hi-C and RNA-sequencing assays at specific time points. Long-range intrachromosomal contacts increase over the course of differentiation, accompanied by widespread heteroeuchromatic compartment transitions that are tightly associated with transcription. Dynamic topologically associating domain boundaries strengthen and converge on an endothelial cell state, and function to regulate gene expression. Chromatin pairwise point interactions (DNA loops) increase in frequency during differentiation and are linked to the expression of genes essential to vascular biology. Chromatin dynamics guide transcription in endothelial cell development and promote the divergence of endothelial cells from cardiomyocytes

Janus monolayers of transition metal dichalcogenides.

Structural symmetry-breaking plays a crucial role in determining the electronic band structures of two-dimensional materials. Tremendous efforts have been devoted to breaking the in-plane symmetry of graphene with electric fields on AB-stacked bilayers or stacked van der Waals heterostructures. In contrast, transition metal dichalcogenide monolayers are semiconductors with intrinsic in-plane asymmetry, leading to direct electronic bandgaps, distinctive optical properties and great potential in optoelectronics. Apart from their in-plane inversion asymmetry, an additional degree of freedom allowing spin manipulation can be induced by breaking the out-of-plane mirror symmetry with external electric fields or, as theoretically proposed, with an asymmetric out-of-plane structural configuration. Here, we report a synthetic strategy to grow Janus monolayers of transition metal dichalcogenides breaking the out-of-plane structural symmetry. In particular, based on a MoS2 monolayer, we fully replace the top-layer S with Se atoms. We confirm the Janus structure of MoSSe directly by means of scanning transmission electron microscopy and energy-dependent X-ray photoelectron spectroscopy, and prove the existence of vertical dipoles by second harmonic generation and piezoresponse force microscopy measurements

Structure of the γ-D-glutamyl-L-diamino acid endopeptidase YkfC from Bacillus cereus in complex with L-Ala-γ-D-Glu: insights into substrate recognition by NlpC/P60 cysteine peptidases.

Dipeptidyl-peptidase VI from Bacillus sphaericus and YkfC from Bacillus subtilis have both previously been characterized as highly specific γ-D-glutamyl-L-diamino acid endopeptidases. The crystal structure of a YkfC ortholog from Bacillus cereus (BcYkfC) at 1.8 Å resolution revealed that it contains two N-terminal bacterial SH3 (SH3b) domains in addition to the C-terminal catalytic NlpC/P60 domain that is ubiquitous in the very large family of cell-wall-related cysteine peptidases. A bound reaction product (L-Ala-γ-D-Glu) enabled the identification of conserved sequence and structural signatures for recognition of L-Ala and γ-D-Glu and, therefore, provides a clear framework for understanding the substrate specificity observed in dipeptidyl-peptidase VI, YkfC and other NlpC/P60 domains in general. The first SH3b domain plays an important role in defining substrate specificity by contributing to the formation of the active site, such that only murein peptides with a free N-terminal alanine are allowed. A conserved tyrosine in the SH3b domain of the YkfC subfamily is correlated with the presence of a conserved acidic residue in the NlpC/P60 domain and both residues interact with the free amine group of the alanine. This structural feature allows the definition of a subfamily of NlpC/P60 enzymes with the same N-terminal substrate requirements, including a previously characterized cyanobacterial L-alanine-γ-D-glutamate endopeptidase that contains the two key components (an NlpC/P60 domain attached to an SH3b domain) for assembly of a YkfC-like active site

The structure of BVU2987 from Bacteroides vulgatus reveals a superfamily of bacterial periplasmic proteins with possible inhibitory function.

Proteins that contain the DUF2874 domain constitute a new Pfam family PF11396. Members of this family have predominantly been identified in microbes found in the human gut and oral cavity. The crystal structure of one member of this family, BVU2987 from Bacteroides vulgatus, has been determined, revealing a β-lactamase inhibitor protein-like structure with a tandem repeat of domains. Sequence analysis and structural comparisons reveal that BVU2987 and other DUF2874 proteins are related to β-lactamase inhibitor protein, PepSY and SmpA_OmlA proteins and hence are likely to function as inhibitory proteins

Structure of the first representative of Pfam family PF04016 (DUF364) reveals enolase and Rossmann-like folds that combine to form a unique active site with a possible role in heavy-metal chelation.

The crystal structure of Dhaf4260 from Desulfitobacterium hafniense DCB-2 was determined by single-wavelength anomalous diffraction (SAD) to a resolution of 2.01 Å using the semi-automated high-throughput pipeline of the Joint Center for Structural Genomics (JCSG) as part of the NIGMS Protein Structure Initiative (PSI). This protein structure is the first representative of the PF04016 (DUF364) Pfam family and reveals a novel combination of two well known domains (an enolase N-terminal-like fold followed by a Rossmann-like domain). Structural and bioinformatic analyses reveal partial similarities to Rossmann-like methyltransferases, with residues from the enolase-like fold combining to form a unique active site that is likely to be involved in the condensation or hydrolysis of molecules implicated in the synthesis of flavins, pterins or other siderophores. The genome context of Dhaf4260 and homologs additionally supports a role in heavy-metal chelation