Article thumbnail

Descriptor-based Sound Texture Sampling

By Diemo Schwarz and Norbert Schnell

Abstract

cote interne IRCAM: Schwarz10aNone / NoneNational audienceExisting methods for sound texture synthesis are often concerned with the extension of a given recording, while keeping its overall properties and avoiding artefacts. However, they generally lack controllability of the resulting sound texture. After a review and classification of existing approaches, we propose two methods of statistical modeling of the audio descriptors of texture recordings using histograms and Gaussian mixture models. The models can be interpolated to steer the evolution of the sound texture between different target recordings (e.g. from light to heavy rain). Target descriptor values are stochastically drawn from the statistic models by inverse transform sampling to control corpus-based concatenative synthesis for the final sound generation, that can also be controlled interactively by navigation through the descriptor space. To better cover the target descriptor space, we expand the corpus by automatically generating variants of the source sounds with transformations applied, and storing only the resulting descriptors and the transformation parameters in the corpus

Topics: audio descriptors, statistic modeling, sound textures, corpus-based synthesis, content-based retrieval, databases, Gaussian Mixture Models, concatenative synthesis, Informatique musicale, [INFO.INFO-SD]Computer Science [cs]/Sound [cs.SD], [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC], [SHS.MUSIQ]Humanities and Social Sciences/Musicology and performing arts, [INFO]Computer Science [cs], [INFO.INFO-TS]Computer Science [cs]/Signal and Image Processing, [INFO.INFO-LG]Computer Science [cs]/Machine Learning [cs.LG], [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI], [INFO.INFO-IA]Computer Science [cs]/Computer Aided Engineering, [INFO.INFO-MM]Computer Science [cs]/Multimedia [cs.MM], [INFO.INFO-CV]Computer Science [cs]/Computer Vision and Pattern Recognition [cs.CV], [INFO.INFO-OH]Computer Science [cs]/Other [cs.OH], [SPI.SIGNAL]Engineering Sciences [physics]/Signal and Image processing
Publisher: HAL CCSD
Year: 2010
OAI identifier: oai:HAL:hal-01161251v1
Download PDF:
Sorry, we are unable to provide the full text but you may find it at the following location(s):
  • https://hal.archives-ouvertes.... (external link)
  • https://hal.archives-ouvertes.... (external link)
  • https://hal.archives-ouvertes.... (external link)
  • https://hal.archives-ouvertes.... (external link)
  • https://hal.archives-ouvertes.... (external link)
  • Suggested articles


    To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.