Virtual Audio - Three-Dimensional Audio in Virtual Environments

Three-dimensional interactive audio has a variety ofpotential uses in human-machine interfaces. After lagging seriously behind the visual components, the importance of sound is now becoming increas-ingly accepted. This paper mainly discusses background and techniques to implement three-dimensional audio in computer interfaces. A case study of a system for three-dimensional audio, implemented by the author, is described in great detail. The audio system was moreover integrated with a virtual reality system and conclusions on user tests and use of the audio system is presented along with proposals for future work at the end of the paper. The thesis begins with a definition of three-dimensional audio and a survey on the human auditory system to give the reader the needed knowledge of what three-dimensional audio is and how human auditory perception works

Relative Auditory Distance Discrimination With Virtual Nearby Sound Sources

In this paper a psychophysical experiment targeted at exploring relative distance discrimination thresholds with binaurally rendered virtual sound sources in the near field is described. Pairs of virtual sources are spatialized around 6 different spatial locations (2 directions 7 3 reference distances) through a set of generic far-field Head-Related Transfer Functions (HRTFs) coupled with a near-field correction model proposed in the literature, known as DVF (Distance Variation Function). Individual discrimination thresholds for each spatial location and for each of the two orders of presentation of stimuli (approaching or receding) are calculated on 20 subjects through an adaptive procedure. Results show that thresholds are higher than those reported in the literature for real sound sources, and that approaching and receding stimuli behave differently. In particular, when the virtual source is close (< 25 cm) thresholds for the approaching condition are significantly lower compared to thresholds for the receding condition, while the opposite behaviour appears for greater distances (~ 1 m). We hypothesize such an asymmetric bias to be due to variations in the absolute stimulus level

HRTF individualization using deep learning

The research presented in this paper focuses on Head-Related Transfer Function (HRTF) individualization using deep learning techniques. HRTF individualization is paramount for accurate binaural rendering, which is used in XR technologies, tools for the visually impaired, and many other applications. The rising availability of public HRTF data currently allows experimentation with different input data formats and various computational models. Accordingly, three research directions are investigated here: (1) extraction of predictors from user data; (2) unsupervised learning of HRTFs based on autoencoder networks; and (3) synthesis of HRTFs from anthropometric data using deep multilayer perceptrons and principal component analysis. While none of the aforementioned investigations has shown outstanding results to date, the knowledge acquired throughout the development and troubleshooting phases highlights areas of improvement which are expected to pave the way to more accurate models for HRTF individualization

Dominant Glint Based Prey Localization in Horseshoe Bats: A Possible Strategy for Noise Rejection

Rhinolophidae or Horseshoe bats emit long and narrowband calls. Fluttering insect prey generates echoes in which amplitude and frequency shifts are present, i.e. glints. These glints are reliable cues about the presence of prey and also encode certain properties of the prey. In this paper, we propose that these glints, i.e. the dominant glints, are also reliable signals upon which to base prey localization. In contrast to the spectral cues used by many other bats, the localization cues in Rhinolophidae are most likely provided by self-induced amplitude modulations generated by pinnae movement. Amplitude variations in the echo not introduced by the moving pinnae can be considered as noise interfering with the localization process. The amplitude of the dominant glints is very stable. Therefore, these parts of the echoes contain very little noise. However, using only the dominant glints potentially comes at a cost. Depending on the flutter rate of the insect, a limited number of dominant glints will be present in each echo giving the bat a limited number of sample points on which to base localization. We evaluate the feasibility of a strategy under which Rhinolophidae use only dominant glints. We use a computational model of the echolocation task faced by Rhinolophidae. Our model includes the spatial filtering of the echoes by the morphology of the sonar apparatus of Rhinolophus rouxii as well as the amplitude modulations introduced by pinnae movements. Using this model, we evaluate whether the dominant glints provide Rhinolophidae with enough information to perform localization. Our simulations show that Rhinolophidae can use dominant glints in the echoes as carriers for self-induced amplitude modulations serving as localization cues. In particular, it is shown that the reduction in noise achieved by using only the dominant glints outweighs the information loss that occurs by sampling the echo

Surround by Sound: A Review of Spatial Audio Recording and Reproduction

In this article, a systematic overview of various recording and reproduction techniques for spatial audio is presented. While binaural recording and rendering is designed to resemble the human two-ear auditory system and reproduce sounds specifically for a listener’s two ears, soundfield recording and reproduction using a large number of microphones and loudspeakers replicate an acoustic scene within a region. These two fundamentally different types of techniques are discussed in the paper. A recent popular area, multi-zone reproduction, is also briefly reviewed in the paper. The paper is concluded with a discussion of the current state of the field and open problemsThe authors acknowledge National Natural Science Foundation of China (NSFC) No. 61671380 and Australian Research Council Discovery Scheme DE 150100363

Acoustic modelling of bat pinnae utilising the TLM method

This thesis describes the numerical modelling of bioacoustic structures, the focus being the outer ear or pinnae of the Rufous Horseshoe bat (Rhinolophus rouxii). There have been several novel developments derived from this work including: • A method of calculating directionality based on the sphere with a distribution of measuring points such that each lies in an equal area segment. • Performance estimation of the pinna by considering the directionality of an equivalent radiating aperture. • A simple synthetic geometry that appears to give similar performance to a bat pinna. The outcome of applying the methods have yielded results that agree with measurements, indeed, this work is the first time TLM has been applied to a structure of this kind. It paves the way towards a greater understanding of bioacoustics and ultimately towards generating synthetic structures that can perform as well as those found in the natural world