This is an Open Access article distributed in accordance with the terms of the Creative Commons Attribution (CC BY 4.0) license, which permits others to distribute, remix, adapt and build upon this work, for commercial use, provided the original work is properly cited. See: http://creativecommons.org/ licenses/by/4.0

Plumbley, MD

Stowell, D

PeerJ

English

arXiv

Stowell, Dan

Plumbley, Mark D.

Tilburg University Repository

Automatic large-scale classification of bird sounds is strongly improved by unsupervised feature learning

Dan Stowell

Mark D. Plumbley

Crossref

Queen Mary Research Online

A practical comparison of manual and autonomous methods for acoustic monitoring.

A support vector method for optimizing average precision. In:

A syllable-level probabilistic framework for bird species identification. In:

Acoustic classification of multiple simultaneous bird species: a multi-instance multi-label approach.

An empirical comparison of supervised learning algorithms.

An introduction to ROC analysis.

Audio classification of bird species: a statistical manifold approach. In:

Auditory processing of vocal sounds in birds.

Automated classification of bird and amphibian calls using machine learning: a comparison of methods.

Automatic classification of a taxon-rich community recorded in the wild.

Automatic classification of bird species from their sounds using two-dimensional cepstral coefficients.

Bayesian classification of flight calls with a novel dynamic time warping kernel. In:

Birdsong and C4DM: a survey of UK birdsong and machine recognition for music researchers.

Birdsong recognition using backpropagation and multivariate statistics.

BTO Bird atlas 2007–11: the breeding and wintering birds of Britain and Ireland. Thetford: British Trust for Ornithology.

Call-independent identification in birds.

Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences.

Dynamic programming matching as a simulation of budgerigar contact-call discrimination.

Fast dictionary learning for sparse representations of speech signals.

Feature design for multilabel bird song classification in noise (nips4b challenge). In: Proceedings of NIPS4b: neural information processing scaled for bioacoustics, from neurons to big data.

In: CLEF Working Notes

K-SVD: an algorithm for designing overcomplete dictionaries for sparse representation.

Large-scale analysis of frequency modulation in birdsong databases.

Learning feature representations with k-means.

Least squares quantization in PCM.

LifeCLEF bird identification task

lme4: linear mixed-effects models using Eigen and S4, R package version 1.0-6.

Mining multi-label data. In: Data Mining and Knowledge Discovery Handbook.

More like this: machine learning approaches to music similarity.

Multiscale approaches to music audio feature learning.

Natural sound archives: past, present and future.

Neural information processing scaled for bioacoustics, from neurons to big data.

Neuronal bases of categorization in starling song.

R: a language and environment for statistical computing. Vienna: R Foundation for Statistical Computing.

Random forests.

Real-time bioacoustics monitoring and automated species identification.

Representation learning: a review and new perspectives.

Scikit-learn: machine learning in Python.

Sparse coding of sensory inputs.

Template-based automatic recognition of birdsong syllables from continuous recordings.

The emerging significance of bioacoustics in animal species conservation.

The ninth annual MLSP competition: first place. In:

Wavelets in recognition of bird sounds.

Why does unsupervised pre-training help deep learning?

Automatic species classification of birds from their sound is a computational tool of increasing importance in ecology, conservation monitoring and vocal communication studies. To make classification useful in practice, it is crucial to improve its accuracy while ensuring that it can run at big data scales. Many approaches use acoustic measures based on spectrogram-type data, such as the Mel-frequency cepstral coefficient (MFCC) features which represent a manually-designed summary of spectral information. However, recent work in machine learning has demonstrated that features learnt automatically from data can often outperform manually-designed feature transforms. Feature learning can be performed at large scale and “unsupervised”, meaning it requires no manual data labelling, yet it can improve performance on “supervised” tasks such as classification. In this work we introduce a technique for feature learning from large volumes of bird sound recordings, inspired by techniques that have proven useful in other domains. We experimentally compare twelve different feature representations derived from the Mel spectrum (of which six use this technique), using four large and diverse databases of bird vocalisations, classified using a random forest classifier. We demonstrate that in our classification tasks, MFCCs can often lead to worse performance than the raw Mel spectral data from which they are derived. Conversely, we demonstrate that unsupervised feature learning provides a substantial boost over MFCCs and Mel spectra without adding computational complexity after the model has been trained. The boost is particularly notable for single-label classification tasks at large scale. The spectro-temporal activations learned through our procedure resemble spectro-temporal receptive fields calculated from avian primary auditory forebrain. However, for one of our datasets, which contains substantial audio data but few annotations, increased performance is not discernible. We study the interaction between dataset characteristics and choice of feature representation through further empirical analysis

Directory of Open Access Journals

Automatic species classification of birds from their sound is a computational tool of increasing importance in ecology, conservation monitoring and vocal communication studies. To make classification useful in practice, it is crucial to improve its accuracy while ensuring that it can run at big data scales. Many approaches use acoustic measures based on spectrogram-type data, such as the Mel-frequency cepstral coefficient (MFCC) features which represent a manually-designed summary of spectral information. However, recent work in machine learning has demonstrated that features learnt automatically from data can often outperform manually-designed feature transforms. Feature learning can be performed at large scale and "unsupervised", meaning it requires no manual data labelling, yet it can improve performance on "supervised" tasks such as classification. In this work we introduce a technique for feature learning from large volumes of bird sound recordings, inspired by techniques that have proven useful in other domains. We experimentally compare twelve different feature representations derived from the Mel spectrum (of which six use this technique), using four large and diverse databases of bird vocalisations, classified using a random forest classifier. We demonstrate that in our classification tasks, MFCCs can often lead to worse performance than the raw Mel spectral data from which they are derived. Conversely, we demonstrate that unsupervised feature learning provides a substantial boost over MFCCs and Mel spectra without adding computational complexity after the model has been trained. The boost is particularly notable for single-label classification tasks at large scale. The spectro-temporal activations learned through our procedure resemble spectro-temporal receptive fields calculated from avian primary auditory forebrain. However, for one of our datasets, which contains substantial audio data but few annotations, increased performance is not discernible. We study the interaction between dataset characteristics and choice of feature representation through further empirical analysis

Surrey Research Insight

NARCIS 

Automatic large-scale classification of bird sounds is strongly improved by unsupervised feature learning

Abstract

Similar works

Full text

Available Versions

Tilburg University Repository

Crossref

Queen Mary Research Online

Directory of Open Access Journals

Tilburg University Repository

Surrey Research Insight

NARCIS