1 research outputs found
Thank you for Attention: A survey on Attention-based Artificial Neural Networks for Automatic Speech Recognition
Attention is a very popular and effective mechanism in artificial neural
network-based sequence-to-sequence models. In this survey paper, a
comprehensive review of the different attention models used in developing
automatic speech recognition systems is provided. The paper focuses on the
development and evolution of attention models for offline and streaming speech
recognition within recurrent neural network- and Transformer- based
architectures.Comment: Submitted to IEEE/ACM Trans. on Audio, Speech, and Language
Processin