Exploring the Encoding Layer and Loss Function in End-to-End Speaker and Language Recognition System

In this paper, we explore the encoding/pooling layer and loss function in the end-to-end speaker and language recognition system. First, a unified and interpretable end-to-end system for both speaker and language recognition is developed. It accepts variable-length input and produces an utterance level result. In the end-to-end system, the encoding layer plays a role in aggregating the variable-length input sequence into an utterance level representation. Besides the basic temporal average pooling, we introduce a self-attentive pooling layer and a learnable dictionary encoding layer to get the utterance level representation. In terms of loss function for open-set speaker verification, to get more discriminative speaker embedding, center loss and angular softmax loss is introduced in the end-to-end system. Experimental results on Voxceleb and NIST LRE 07 datasets show that the performance of end-to-end learning system could be significantly improved by the proposed encoding layer and loss function.Comment: Accepted for Speaker Odyssey 201

Setting behavior, apatite-forming ability, mechanical strength of polymethylmethacrylate bone cement through bioactivity modification of phosphate functional groups combined with Ca2+ ions

Bioactivity modification helps polymethylmethacrylate (PMMA) bone cement to reinforce its interfacial adhesion to bone tissues through the chemical bonding of apatite. Since Si-OH groups combined with Ca2+ ions have succeeded in inducing apatite formation, more combinations of functional groups and active ions are being explored. In this study, Bis[2-(methacryloyloxy)ethyl] phosphate (B2meP) containing phosphate (=PO4H) groups and Ca(CH3COO)2 supplying Ca2+ ion were adopted to investigate the feasibility of equipping PMMA bone cement with apatite-forming ability in vitro, more effects under designed contents on setting behavior, injectability, contact angle, cytotoxicity and mechanical strength were also investigated. Results showed B2meP copolymerized with MMA and became one section of PMMA chains, surface = PO4H groups and released Ca2+ ions pushed spherical apatite individuals nucleating and agglomerating into layer horizontally, Increasing B2meP content lowered the contact angle and the peak temperature, enhanced the cell viability of MC3T3-E1, but prolonged apatite forming period. Injectability rate performed a similar trend to setting time. Lower adding content and deposited apatite layer contributed to reduce the strength loss in soaking. Taking biological performance and other properties into balance, cement added with B2meP of 10 wt% in MMA and Ca(CH3COO)2 of 20 wt% in PMMA performed better