A Phase Vocoder based on Nonstationary Gabor Frames

We propose a new algorithm for time stretching music signals based on the theory of nonstationary Gabor frames (NSGFs). The algorithm extends the techniques of the classical phase vocoder (PV) by incorporating adaptive time-frequency (TF) representations and adaptive phase locking. The adaptive TF representations imply good time resolution for the onsets of attack transients and good frequency resolution for the sinusoidal components. We estimate the phase values only at peak channels and the remaining phases are then locked to the values of the peaks in an adaptive manner. During attack transients we keep the stretch factor equal to one and we propose a new strategy for determining which channels are relevant for reinitializing the corresponding phase values. In contrast to previously published algorithms we use a non-uniform NSGF to obtain a low redundancy of the corresponding TF representation. We show that with just three times as many TF coefficients as signal samples, artifacts such as phasiness and transient smearing can be greatly reduced compared to the classical PV. The proposed algorithm is tested on both synthetic and real world signals and compared with state of the art algorithms in a reproducible manner.Comment: 10 pages, 6 figure

Temporal album

Transient synchronization has been used as a mechanism of recognizing auditory patterns using integrate-and-fire neural networks. We first extend the mechanism to vision tasks and investigate the role of spike dependent learning. We show that such a temporal Hebbian learning rule significantly improves accuracy of detection. We demonstrate how multiple patterns can be identified by a single pattern selective neuron and how a temporal album can be constructed. This principle may lead to multidimensional memories, where the capacity per neuron is considerably increased with accurate detection of spike synchronization

A Comparative Study of Time-Frequency Representations for Fault Detection in Wind Turbine

To reduce the cost of wind energy, minimization and prediction of maintenance operations in wind turbine is of key importance. In variable speed turbine generator, advanced signal processing tools are required to detect and diagnose the generator faults from the stator current. To detect a fault in non-stationary conditions, previous studies have investigated the use of time-frequency techniques such as the Spectrogram, the Wavelet transform, the Wigner-Ville representation and the Hilbert-Huang transform. In this paper, these techniques are presented and compared for broken-rotor bar detection in squirrel-cage generators. The comparison is based on several criteria such as the computational complexity, the readability of the representation and the easiness of interpretatio

Idealized computational models for auditory receptive fields

This paper presents a theory by which idealized models of auditory receptive fields can be derived in a principled axiomatic manner, from a set of structural properties to enable invariance of receptive field responses under natural sound transformations and ensure internal consistency between spectro-temporal receptive fields at different temporal and spectral scales. For defining a time-frequency transformation of a purely temporal sound signal, it is shown that the framework allows for a new way of deriving the Gabor and Gammatone filters as well as a novel family of generalized Gammatone filters, with additional degrees of freedom to obtain different trade-offs between the spectral selectivity and the temporal delay of time-causal temporal window functions. When applied to the definition of a second-layer of receptive fields from a spectrogram, it is shown that the framework leads to two canonical families of spectro-temporal receptive fields, in terms of spectro-temporal derivatives of either spectro-temporal Gaussian kernels for non-causal time or the combination of a time-causal generalized Gammatone filter over the temporal domain and a Gaussian filter over the logspectral domain. For each filter family, the spectro-temporal receptive fields can be either separable over the time-frequency domain or be adapted to local glissando transformations that represent variations in logarithmic frequencies over time. Within each domain of either non-causal or time-causal time, these receptive field families are derived by uniqueness from the assumptions. It is demonstrated how the presented framework allows for computation of basic auditory features for audio processing and that it leads to predictions about auditory receptive fields with good qualitative similarity to biological receptive fields measured in the inferior colliculus (ICC) and primary auditory cortex (A1) of mammals.Comment: 55 pages, 22 figures, 3 table

Capacity limitations of visual memory in two-interval comparison of Gabor arrays

The capacity of short-term visual memory (VSTM) was assessed in a two-interval spatial frequency (SF) discrimination task. The cued Gabor target in a multi-element array either increased or decreased in SF across a 2s interstimulus interval (ISI). Distracters as well as target were made to change across ISI so that memory of the individual SF of Gabor elements was required to solve the discrimination. The dynamics of the information loss from visual memory were analysed by manipulating the timing of spatial cues and masks. Cueing the target position before the first display gave thresholds comparable with those for a single Gabor patch. Cues placed after the first display gave higher thresholds indicating some loss of information. Within the ISI there was little increase in threshold or set size effect with cue delay. However there was a sharp rise in thresholds for cue positions after the second display. Gabor masks placed before a mid-ISI cue were more effective than noise masks or Gabor masks placed after the cue. With a cue placed late in the ISI, preceded by a Gabor mask, the masking effect decreased with increasing delay of the mask after the first display. This suggests a selective, dynamic but increasingly durable representation of the initial stimulus is built up in memory, and there is a graded form of “overwriting” of this representation by new stimuli

Neural synchrony in cortical networks : history, concept and current status

Following the discovery of context-dependent synchronization of oscillatory neuronal responses in the visual system, the role of neural synchrony in cortical networks has been expanded to provide a general mechanism for the coordination of distributed neural activity patterns. In the current paper, we present an update of the status of this hypothesis through summarizing recent results from our laboratory that suggest important new insights regarding the mechanisms, function and relevance of this phenomenon. In the first part, we present recent results derived from animal experiments and mathematical simulations that provide novel explanations and mechanisms for zero and nero-zero phase lag synchronization. In the second part, we shall discuss the role of neural synchrony for expectancy during perceptual organization and its role in conscious experience. This will be followed by evidence that indicates that in addition to supporting conscious cognition, neural synchrony is abnormal in major brain disorders, such as schizophrenia and autism spectrum disorders. We conclude this paper with suggestions for further research as well as with critical issues that need to be addressed in future studies