Multilingual Adaptation of RNN Based ASR Systems

In this work, we focus on multilingual systems based on recurrent neural networks (RNNs), trained using the Connectionist Temporal Classification (CTC) loss function. Using a multilingual set of acoustic units poses difficulties. To address this issue, we proposed Language Feature Vectors (LFVs) to train language adaptive multilingual systems. Language adaptation, in contrast to speaker adaptation, needs to be applied not only on the feature level, but also to deeper layers of the network. In this work, we therefore extended our previous approach by introducing a novel technique which we call "modulation". Based on this method, we modulated the hidden layers of RNNs using LFVs. We evaluated this approach in both full and low resource conditions, as well as for grapheme and phone based systems. Lower error rates throughout the different conditions could be achieved by the use of the modulation.Comment: 5 pages, 1 figure, to appear in 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2018

Spectral Attention-Driven Intelligent Target Signal Identification on a Wideband Spectrum

This paper presents a spectral attention-driven reinforcement learning based intelligent method for effective and efficient detection of important signals in a wideband spectrum. In the work presented in this paper, it is assumed that the modulation technique used is available as a priori knowledge of the targeted important signal. The proposed spectral attention-driven intelligent method is consists of two main components, a spectral correlation function (SCF) based spectral visualization scheme and a spectral attention-driven reinforcement learning mechanism that adaptively selects the spectrum range and implements the intelligent signal detection. Simulations illustrate that the proposed method can achieve high accuracy of signal detection while observation of spectrum is limited to few ranges via effectively selecting the spectrum ranges to be observed. Furthermore, the proposed spectral attention-driven machine learning method can lead to an efficient adaptive intelligent spectrum sensor designs in cognitive radio (CR) receivers.Comment: 6 pages, 11 figure