Deep Learning for Audio Signal Processing

Given the recent surge in developments of deep learning, this article provides a review of the state-of-the-art deep learning techniques for audio signal processing. Speech, music, and environmental sound processing are considered side-by-side, in order to point out similarities and differences between the domains, highlighting general methods, problems, key references, and potential for cross-fertilization between areas. The dominant feature representations (in particular, log-mel spectra and raw waveform) and deep learning models are reviewed, including convolutional neural networks, variants of the long short-term memory architecture, as well as more audio-specific neural network models. Subsequently, prominent deep learning application areas are covered, i.e. audio recognition (automatic speech recognition, music information retrieval, environmental sound detection, localization and tracking) and synthesis and transformation (source separation, audio enhancement, generative models for speech, sound, and music synthesis). Finally, key issues and future questions regarding deep learning applied to audio signal processing are identified.Comment: 15 pages, 2 pdf figure

Behavior of early warnings near the critical temperature in the two-dimensional Ising model

Among the properties that are common to complex systems, the presence of critical thresholds in the dynamics of the system is one of the most important. Recently, there has been interest in the universalities that occur in the behavior of systems near critical points. These universal properties make it possible to estimate how far a system is from a critical threshold. Several early-warning signals have been reported in time series representing systems near catastrophic shifts. The proper understanding of these early-warnings may allow the prediction and perhaps control of these dramatic shifts in a wide variety of systems. In this paper we analyze this universal behavior for a system that is a paradigm of phase transitions, the Ising model. We study the behavior of the early-warning signals and the way the temporal correlations of the system increase when the system is near the critical point.Comment: 20 pages, 8 figures, Submitted to PLOS ONE on Oct. 20th 2014. PONE-D-14-4718

Vortical control of forced two-dimensional turbulence

A new numerical technique for the simulation of forced two-dimensional turbulence (Dritschel and Fontane, 2010) is used to examine the validity of Kraichnan-Batchelor scaling laws at higher Reynolds number than previously accessible with classical pseudo-spectral methods,making use of large simulation ensembles to allow a detailed consideration of the inverse cascade in a quasi-steady state. Our results support the recent finding of Scott (2007), namely that when a direct enstrophy cascading range is well-represented numerically, a steeper energy spectrum proportional to k^(−2) is obtained in place of the classical k^(−5/3) prediction. It is further shown that this steep spectrum is associated with a faster growth of energy at large scales, scaling like t^(−1) rather than Kraichnan’s prediction of t^(−3/2). The deviation from Kraichnan’s theory is related to the emergence of a population of vortices that dominate the distribution of energy across scales, and whose number density and vorticity distribution with respect to vortex area are related to the shape of the enstrophy spectrum. An analytical model is proposed which closely matches the numerical spectra between the large scales and the forcing scale

Ideal evolution of MHD turbulence when imposing Taylor-Green symmetries

We investigate the ideal and incompressible magnetohydrodynamic (MHD) equations in three space dimensions for the development of potentially singular structures. The methodology consists in implementing the four-fold symmetries of the Taylor-Green vortex generalized to MHD, leading to substantial computer time and memory savings at a given resolution; we also use a re-gridding method that allows for lower-resolution runs at early times, with no loss of spectral accuracy. One magnetic configuration is examined at an equivalent resolution of $6144^3$ points, and three different configurations on grids of $4096^3$ points. At the highest resolution, two different current and vorticity sheet systems are found to collide, producing two successive accelerations in the development of small scales. At the latest time, a convergence of magnetic field lines to the location of maximum current is probably leading locally to a strong bending and directional variability of such lines. A novel analytical method, based on sharp analysis inequalities, is used to assess the validity of the finite-time singularity scenario. This method allows one to rule out spurious singularities by evaluating the rate at which the logarithmic decrement of the analyticity-strip method goes to zero. The result is that the finite-time singularity scenario cannot be ruled out, and the singularity time could be somewhere between $t=2.33$ and $t=2.70.$ More robust conclusions will require higher resolution runs and grid-point interpolation measurements of maximum current and vorticity.Comment: 18 pages, 13 figures, 2 tables; submitted to Physical Review