2 research outputs found
Unsupervised Discovery of Structured Acoustic Tokens with Applications to Spoken Term Detection
In this paper, we compare two paradigms for unsupervised discovery of
structured acoustic tokens directly from speech corpora without any human
annotation. The Multigranular Paradigm seeks to capture all available
information in the corpora with multiple sets of tokens for different model
granularities. The Hierarchical Paradigm attempts to jointly learn several
levels of signal representations in a hierarchical structure. The two paradigms
are unified within a theoretical framework in this paper. Query-by-Example
Spoken Term Detection (QbE-STD) experiments on the QUESST dataset of MediaEval
2015 verifies the competitiveness of the acoustic tokens. The Enhanced
Relevance Score (ERS) proposed in this work improves both paradigms for the
task of QbE-STD. We also list results on the ABX evaluation task of the Zero
Resource Challenge 2015 for comparison of the Paradigms
Unsupervised Iterative Deep Learning of Speech Features and Acoustic Tokens with Applications to Spoken Term Detection
In this paper we aim to automatically discover high quality frame-level
speech features and acoustic tokens directly from unlabeled speech data. A
Multi-granular Acoustic Tokenizer (MAT) was proposed for automatic discovery of
multiple sets of acoustic tokens from the given corpus. Each acoustic token set
is specified by a set of hyperparameters describing the model configuration.
These different sets of acoustic tokens carry different characteristics for the
given corpus and the language behind, thus can be mutually reinforced. The
multiple sets of token labels are then used as the targets of a Multi-target
Deep Neural Network (MDNN) trained on frame-level acoustic features. Bottleneck
features extracted from the MDNN are then used as the feedback input to the MAT
and the MDNN itself in the next iteration. The multi-granular acoustic token
sets and the frame-level speech features can be iteratively optimized in the
iterative deep learning framework. We call this framework the Multi-granular
Acoustic Tokenizing Deep Neural Network (MATDNN). The results were evaluated
using the metrics and corpora defined in the Zero Resource Speech Challenge
organized at Interspeech 2015, and improved performance was obtained with a set
of experiments of query-by-example spoken term detection on the same corpora.
Visualization for the discovered tokens against the English phonemes was also
shown.Comment: Accepted by IEEE/ACM Transactions on Audio Speech and Language
Processing. arXiv admin note: text overlap with arXiv:1602.00426,
arXiv:1506.0232