Inter-KD: Intermediate Knowledge Distillation for CTC-Based Automatic Speech Recognition

Recently, the advance in deep learning has brought a considerable improvement in the end-to-end speech recognition field, simplifying the traditional pipeline while producing promising results. Among the end-to-end models, the connectionist temporal classification (CTC)-based model has attracted research interest due to its non-autoregressive nature. However, such CTC models require a heavy computational cost to achieve outstanding performance. To mitigate the computational burden, we propose a simple yet effective knowledge distillation (KD) for the CTC framework, namely Inter-KD, that additionally transfers the teacher's knowledge to the intermediate CTC layers of the student network. From the experimental results on the LibriSpeech, we verify that the Inter-KD shows better achievements compared to the conventional KD methods. Without using any language model (LM) and data augmentation, Inter-KD improves the word error rate (WER) performance from 8.85 % to 6.30 % on the test-clean.Comment: Accepted by 2022 SLT Worksho

Nasal Hemangiopericytoma Causing Oncogenic Osteomalacia

Oncogenic osteomalacia is a rare cause that makes abnormalities of bone metabolism. Our case arose in a 47-year-old woman presenting a nasal mass associated with osteomalacia. We excised the mass carefully. After surgery, it was diagnosed as hemangiopericytoma and her symptoms related with osteomalacia were relieved and biochemical abnormalities were restored to normal range. We report and review a rare case of nasal hemangiopericytoma that caused osteomalacia

PPM1A Controls Diabetic Gene Programming through Directly Dephosphorylating PPAR?? at Ser273

Peroxisome proliferator-activated receptor gamma (PPAR gamma) is a master regulator of adipose tissue biology. In obesity, phosphorylation of PPAR gamma at Ser273 (pSer273) by cyclin-dependent kinase 5 (CDK5)/extracellular signal-regulated kinase (ERK) orchestrates diabetic gene reprogramming via dysregulation of specific gene expression. Although many recent studies have focused on the development of non-classical agonist drugs that inhibit the phosphorylation of PPAR gamma at Ser273, the molecular mechanism of PPAR gamma dephosphorylation at Ser273 is not well characterized. Here, we report that protein phosphatase Mg2+/Mn2+-dependent 1A (PPM1A) is a novel PPAR gamma phosphatase that directly dephosphorylates Ser273 and restores diabetic gene expression which is dysregulated by pSer273. The expression of PPM1A significantly decreases in two models of insulin resistance: diet-induced obese (DIO) mice and db/db mice, in which it negatively correlates with pSer273. Transcriptomic analysis using microarray and genotype-tissue expression (GTEx) data in humans shows positive correlations between PPM1A and most of the genes that are dysregulated by pSer273. These findings suggest that PPM1A dephosphorylates PPAR gamma at Ser273 and represents a potential target for the treatment of obesity-linked metabolic disorders

Generation of Fibroblasts Lacking the Sal-like 1 Gene by Using Transcription Activator-like Effector Nuclease-mediated Homologous Recombination

The Sal-like 1 gene (Sall1) is essential for kidney development, and mutations in this gene result in abnormalities in the kidneys. Mice lacking Sall1 show agenesis or severe dysgenesis of the kidneys. In a recent study, blastocyst complementation was used to develop mice and pigs with exogenic organs. In the present study, transcription activator-like effector nuclease (TALEN)-mediated homologous recombination was used to produce Sall1-knockout porcine fibroblasts for developing knockout pigs. The vector targeting the Sall1 locus included a 5.5-kb 5′ arm, 1.8-kb 3′ arm, and a neomycin resistance gene as a positive selection marker. The knockout vector and TALEN were introduced into porcine fibroblasts by electroporation. Antibiotic selection was performed over 11 days by using 300 μg/mL G418. DNA of cells from G418-resistant colonies was amplified using polymerase chain reaction (PCR) to confirm the presence of fragments corresponding to the 3′ and 5′ arms of Sall1. Further, mono- and bi-allelic knockout cells were isolated and analyzed using PCR–restriction fragment length polymorphism. The results of our study indicated that TALEN-mediated homologous recombination induced bi-allelic knockout of the endogenous gene