Frame Theory for Signal Processing in Psychoacoustics

This review chapter aims to strengthen the link between frame theory and signal processing tasks in psychoacoustics. On the one side, the basic concepts of frame theory are presented and some proofs are provided to explain those concepts in some detail. The goal is to reveal to hearing scientists how this mathematical theory could be relevant for their research. In particular, we focus on frame theory in a filter bank approach, which is probably the most relevant view-point for audio signal processing. On the other side, basic psychoacoustic concepts are presented to stimulate mathematicians to apply their knowledge in this field

Additivity of auditory masking using Gaussian-shaped tones

International audienceBoth temporal and spectral masking have been studied extensively in the literature. Mostly, they have been regarded as separate phenomena. Very little is known about the interaction between these two effects, i.e. masking in the time-frequency domain. Data on the time-frequency spread of masking evoked by a single Gaussian-shaped tone pulse are presented in an accompanying study at the same conference (Necciari et al.). The current study gathers data on the additivity of masking by up to four, approximately equally effective Gaussian maskers (ERB=600 Hz, ERD=1.7 ms), separated either along the time or the frequency axis. For temporal shift, the amount of masking increases with the number of maskers, with excess masking (exceeding linear additivity) of up to 25 dB. For frequency separation excess masking amounts up to 15 dB, and the higher-frequency masker (relative to the target) contributes more to the additivity than the lower-frequency maskers. The data suggest strong basilar membrane compressivity even for such short stimuli. Combined with the single masker time-frequency spread data, these data may serve as a basis for modeling time-frequency masking effects in complex signals

Binaural jitter improves interaural time-difference sensitivity of cochlear implantees at high pulse rates

Interaural time difference (ITD) arises whenever a sound outside of the median plane arrives at the two ears. There is evidence that ITD in the rapidly varying fine structure of a sound is most important for sound localization and for understanding speech in noise. Cochlear implants (CIs), neural prosthetic devices that restore hearing in the profoundly deaf, are increasingly implanted to both ears to provide implantees with the advantages of binaural hearing. CI listeners have been shown to be sensitive to fine structure ITD at low pulse rates, but their sensitivity declines at higher pulse rates that are required for speech coding. We hypothesize that this limitation in electric stimulation is at least partially due to binaural adaptation associated with periodic stimulation. Here, we show that introducing binaurally synchronized jitter in the stimulation timing causes large improvements in ITD sensitivity at higher pulse rates. Our experimental results demonstrate that a purely temporal trigger can cause recovery from binaural adaptation. Thus, binaurally jittered stimulation may improve several aspects of binaural hearing in bilateral recipients of neural auditory prostheses

Sensitivity to Interaural Time Differences with Combined Cochlear Implant and Acoustic Stimulation

The interaural time difference (ITD) is an important cue to localize sound sources. Sensitivity to ITD was measured in eight users of a cochlear implant (CI) in the one ear and a hearing aid (HA) in the other severely impaired ear. The stimulus consisted of an electric pulse train of 100 pps and an acoustic filtered click train. Just-noticeable differences (JNDs) in ITD were measured using a lateralization paradigm. Four subjects exhibited median JNDs in ITD of 156, 341, 254, and 91 μs; the other subjects could not lateralize the stimuli consistently. Only the subjects who could lateralize had average acoustic hearing thresholds at 1,000 and 2,000 Hz better than 100-dB SPL. The electric signal had to be delayed by 1.5 ms to achieve synchronous stimulation at the auditory nerves