This is the author's accepted pre-print of the article, first published as G. Evangelista, S. Marchand, M. D. Plumbley and E. Vincent. Sound source separation. In U. Zölzer (ed.), DAFX: Digital Audio Effects, 2nd edition, Chapter 14, pp. 551-588. John Wiley & Sons, March 2011. ISBN 9781119991298. DOI: 10.1002/9781119991298.ch14file: Proof:e\EvangelistaMarchandPlumbleyV11-sound.pdf:PDF owner: markp timestamp: 2011.04.26file: Proof:e\EvangelistaMarchandPlumbleyV11-sound.pdf:PDF owner: markp timestamp: 2011.04.2

Evangelista, G

Marchand, S

Plumbley, MD

Vincent, E

English

International audienceWhen processing a sound recording, sound engineers often face the need to apply specific digital audio effects to certain sounds only. For instance, the remastering of a music recording may require to correct the tuning of a mistuned instrument or relocate that instrument in space without affecting the sound of other instruments. This operation is straightforward when these sounds are available as separate tracks but becomes quite difficult otherwise. Indeed, the digital audio effects reviewed in this book all apply to the recording as a whole. Source separation refers to the range of techniques aiming to extract the signals of individual sound sources from a given recording. The input recording is called mixture signal. The estimated source signals can then be separately processed and added back together for remastering purposes. In this scenario, the number of mixture channels is typically equal to one or two or more rarely up to five, while the number of sources ranges from two to ten or more. The need for source separation also arises in many other application scenarios, such as speech enhancement for hearing aids, high-quality upmixing of mono or stereo content to 3D sound formats and automatic speech and speaker recognition in multi-talker environments. Source separation is a recent field of research compared to the other audio effects reviewed in this book, so that most techniques are less mature and cannot address the above applications scenarios to date. Yet, some established techniques are gradually finding their way to the industry and will soon be part of professional or general consumer software. This chapter will provide an overview of these established techniques as well as more recent ones

Evangelista, Gianpaolo

Marchand, Sylvain

Plumbley, Mark, D.

Vincent, Emmanuel

HAL-CentraleSupelec

Sound source separation

INRIA a CCSD electronic archive server

Queen Mary Research Online

A Method for Separation of Overlapping Partials Based on Similarity of Temporal Envelopes in Multi-Channel Mixtures.

A New Dissimilarity Metric for the Clustering of Partials Using the Common Variation Cue.

A Tutorial on Onset Detection in Music Signals.

Audio source separation with a single sensor.

Auditory Function: Neurobiological Bases of Hearing, chapter Pitch Perception and the Segregation and Integration of Auditory Entities,

Auditory Scene Analysis: The Perceptual Organization of Sound.

Auditory Streaming and the Building of Timbre.

Binaural and Spatial Hearing in Real and Virtual Environments, Gilkey and Anderson (Eds.), chapter 24, Models of Binaural Perception, pages 499–531. Lawrence Erlbaum Associates,

Binaural Audio Signal Processing Using Interaural Coherence Matching.

Binaural Localization and Separation Techniques.

Binaural source localization by joint estimation of ILD and ITD.

Blind separation of speech mixtures via timefrequency masking.

Coincidence detection in the auditory system: 50 years after Jeffress.

Combined evaluation of interaural time and intensity differences: Psychoacoustic results and computer modeling.

Convolutive speech bases and their application to supervised speech separation.

Cumulative state coherence transform for a robust two-channel multiple source localization.

Extension of a binaural cross-correlation model by contralateral inhibition. i.simulation of lateralization for stationary signals.

Frequency-domain blind source separation.

Investigating single-channel audio source separation methods based on non-negative matrix factorization.

Learning the parts of objects by non-negative matrix factorization.

Minimum Prediction Residual Principle Applied to Speech Recognition.

Modlisation sinusodale des sons polyphoniques.

Multiple Fundamental Frequency Estimation Based on Harmonicity and Spectral Smoothness.

Non-negative matrix factor deconvolution: Extraction of multiple sound sources from monophonic inputs.

Non-negative matrix factorization for polyphonic music transcription.

Nonnegative matrix factor 2-D deconvolution for blind single channel source separation.

Perception of Attack Transients in Musical Tones.

Performance measurement in blind audio source separation.

Pitch Based Streaming in Auditory Perception.

Probabilistic modeling paradigms for audio source separation.

Segregation of Concurrrents Sounds: Effects of Frequency Modulation Coherence.

Separation of sound sources by convolutive sparse coding.

Source localization in complex listening situations: Selection of binaural cues based on interaural coherence.

Sound Source Separation

Abstract

Similar works

Full text

Available Versions

HAL-CentraleSupelec

INRIA a CCSD electronic archive server

Queen Mary Research Online

Surrey Research Insight

HAL-Rennes 1