An analysis of frequency recognition algorithms and implementation in realtime

Frequency recognition is an important task in many engineering fields, such as audio signal processing and telecommunications engineering. There are numerous applications where frequency recognition is absolutely necessary like in Dual-Tone Multi-Frequency (DTMF) detection or the recognition of the carrier frequency of a Global Positioning System (GPS) signal. Furthermore, frequency recognition has entered many other engineering disciplines such as sonar and radar technology, spectral analysis of astronomic data, seismography, acoustics and consumer electronics. Listening to electronic music and playing electronic musical instruments is becoming more and more popular, not only among young musicians. This dissertation details back groundinformation and a preliminary analysis of a musical system, the Generic Musical Instrument System (GMIS), which allows composers to experiment with electronic instruments without actually, learning how to play them.This dissertation gives background information about frequency recognition algorithms implemented in real time. It analyses state-of-the-art techniques, such as Dual- Tone Multiple Frequency (DTMF) implementations and MIDI-based musical systems, in order to work out their similarities. The key idea is to adapt well-proven frequency recognition algorithms of DTMF systems, which are successfully and widely used in telephony. The investigations will show to what extent these principles and algorithms can be applied to a musical system like the GMIS. This dissertation presents results of investigations into frequency recognition algorithms implemented on a Texas Instruments (TI) TMS320C6713 Digital Signal Processor (DSP) core, in order to estimate the frequency of an audio signal in real time. The algorithms are evaluated using selected criteria in terms of speed and accuracy with accomplishing over 9600 single measurements. The evaluations are made with simple sinusoids and musical notes played by instruments as input signals which allows a solid decision, which of these frequency recognition algorithms is appropriate for audio signal processing and for the constraints of the GMIS in real time

Synthesis and Analysis Tools with Physical Modeling : An Environment for Musical Sounds Production

International audienceWe first present some tools and methods for sound synthesis, based on the physical modeling, through a general representation formalism, of musical instruments and designed for the construction and the study of vibrating network-based objects. Then we present a second class of tools, based on the same principles and formalism of physical modeling, and designed for the analysis of sounds in term of vibrating phenomenon on a time/frequency domain

Score-Informed Source Separation for Musical Audio Recordings [An overview]

(c) 2014 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works

TimbreTron: A WaveNet(CycleGAN(CQT(Audio))) Pipeline for Musical Timbre Transfer

In this work, we address the problem of musical timbre transfer, where the goal is to manipulate the timbre of a sound sample from one instrument to match another instrument while preserving other musical content, such as pitch, rhythm, and loudness. In principle, one could apply image-based style transfer techniques to a time-frequency representation of an audio signal, but this depends on having a representation that allows independent manipulation of timbre as well as high-quality waveform generation. We introduce TimbreTron, a method for musical timbre transfer which applies "image" domain style transfer to a time-frequency representation of the audio signal, and then produces a high-quality waveform using a conditional WaveNet synthesizer. We show that the Constant Q Transform (CQT) representation is particularly well-suited to convolutional architectures due to its approximate pitch equivariance. Based on human perceptual evaluations, we confirmed that TimbreTron recognizably transferred the timbre while otherwise preserving the musical content, for both monophonic and polyphonic samples.Comment: 17 pages, published as a conference paper at ICLR 201

Systems control theory applied to natural and synthetic musical sounds

Systems control theory is a far developped field which helps to study stability, estimation and control of dynamical systems. The physical behaviour of musical instruments, once described by dynamical systems, can then be controlled and numerically simulated for many purposes. The aim of this paper is twofold: first, to provide the theoretical background on linear system theory, both in continuous and discrete time, mainly in the case of a finite number of degrees of freedom ; second, to give illustrative examples on wind instruments, such as the vocal tract represented as a waveguide, and a sliding flute