Effect of Vertical Microphone Layer Spacing for a 3D Microphone Array

Subjective listening tests were conducted to investigate how the spacing between main (lower) and height (upper) microphone layers in a 3D main microphone array affects perceived spatial impression and overall preference. Four different layer spacings of 0m, 0.5m, 1m, and 1.5m were compared for the sound sources of trumpet, acoustic guitar, percussion quartet, and string quartet using a nine-channel loudspeaker setup. It was generally found that there was no significant difference between any of the spaced layer configurations, whereas the 0m layer had slightly higher ratings than the more spaced layers in both spatial impression and preference. Acoustical properties of the original microphone channel signals as well as those of the reproduced signals, which were binaurally recorded, were analyzed in order to find possible physical causes for the perceived results. It is suggested that the perceived results were mainly associated with vertical interchannel crosstalk in the signals of each height layer and the magnitude and pattern of spectral change at the listener’s ear caused by each layer

Predicting perceptual transparency of head-worn devices

| openaire: EC/H2020/812719/EU//VRACEAcoustically transparent head-worn devices are a key component of auditory augmented reality systems, in which both real and virtual sound sources are presented to a listener simultaneously. Head-worn devices can exhibit high transparency simply through their physical design but in practice will always obstruct the sound field to some extent. In this study, a method for predicting the perceptual transparency of head-worn devices is presented using numerical analysis of device measurements, testing both coloration and localization in the horizontal and median plane. Firstly, listening experiments are conducted to assess perceived coloration and localization impairments. Secondly, head-related transfer functions of a dummy head wearing the head-worn devices are measured, and auditory models are used to numerically quantify the introduced perceptual effects. The results show that the tested auditory models are capable of predicting perceptual transparency and are therefore robust in applications that they were not initially designed for.Peer reviewe

Psychoacoustic Considerations in Surround Sound with Height

This paper presents recent research findings in the psychoacoustics of 3D multichannel sound recording and rendering. The addition of height channels in new reproduction formats such as Auro-3D, Dolby Atmos and 22.2, etc. enhances the perceived spatial impression in reproduction. To achieve optimal acoustic recording and signal processing for such formats, it is first important to understand the fundamental principles of how we perceive sounds reproduced from vertically oriented stereophonic loudspeakers. Recent studies by the authors in this field provide insights into how such principles can be applied for practical 3D recording and upmixing. Topics that are discussed in this paper include the interchannel level and time difference relationships in terms of vertically induced interchannel crosstalk, the effectiveness of the precedence effect in the vertical plane, the aspect of tonal coloration resulting from vertical stereophonic reproduction, the effect of vertical microphone spacing on envelopment, the effect of interchannel decorrelation, and the use of spectral cues for extending vertical image spread

Optimization-based reproduction of diffuse audio objects

The creation of a diffuse sound event from a single audio signal is an important signal processing task, for instance in spatial audio reproduction or audio coding. Current algorithms based on decorrelation filters or frequency-dependent panning typically cause artifacts due to transients or time-domain aliasing. In this paper, we propose an optimization-based approach to diffusion that creates a set of filters to approximate a desired distribution of frequency-dependent propagation directions to create the perception of a diffuse sound field with a multi-channel audio system. Thus, the diffusion can be optimally adapted to a specific reproduction scenario. In addition, the transient response can be purposefully improved by imposing constraints on the time-domain filter coefficients

Sensitivity to Angular and Radial Source Movements as a Function of Acoustic Complexity in Normal and Impaired Hearing

In contrast to static sounds, spatially dynamic sounds have received little attention in psychoacoustic research so far. This holds true especially for acoustically complex (reverberant, multisource) conditions and impaired hearing. The current study therefore investigated the influence of reverberation and the number of concurrent sound sources on source movement detection in young normal-hearing (YNH) and elderly hearing-impaired (EHI) listeners. A listening environment based on natural environmental sounds was simulated using virtual acoustics and rendered over headphones. Both near-far (‘radial’) and left-right (‘angular’) movements of a frontal target source were considered. The acoustic complexity was varied by adding static lateral distractor sound sources as well as reverberation. Acoustic analyses confirmed the expected changes in stimulus features that are thought to underlie radial and angular source movements under anechoic conditions and suggested a special role of monaural spectral changes under reverberant conditions. Analyses of the detection thresholds showed that, with the exception of the single-source scenarios, the EHI group was less sensitive to source movements than the YNH group, despite adequate stimulus audibility. Adding static sound sources clearly impaired the detectability of angular source movements for the EHI (but not the YNH) group. Reverberation, on the other hand, clearly impaired radial source movement detection for the EHI (but not the YNH) listeners. These results illustrate the feasibility of studying factors related to auditory movement perception with the help of the developed test setup

How spatial constraints on efficacy and dynamic signaling alignment shape animal communication

Effective communication is important to the survival and reproduction of many organisms. Signal transmission and reception have spatial constraints that interact to determine effectiveness. Signals are often best perceived from specific angles, and sensory systems may be limited in their ability to detect or interpret incoming stimuli from certain directions. Alignment between these directional biases can be critical to effective communication. Misalignment of either signal or sensor may disrupt signal perception. Signals also degrade during the distance traveled from signaler to receiver. Thus, how animals position themselves during communication may be under selection. Despite this, we know little about the spatial arrangement of signalers and receivers, what behaviors influence positioning, or the causes and consequences of variation in positioning. To address this fundamental gap in knowledge, I developed a geometric framework for studying the spatial constraints of communication and how they shape positioning across visual, sound, and chemical signaling. To investigate respective roles of signaler and receiver in managing these spatial constraints, I then characterized the spatial dynamics of visual signaling in the jumping spider Habronattus pyrrithrix. Males perform an elaborate courtship dance which includes arm waves and colorful ornaments; the latter are not visible from the side. The female can only perceive colors of male displays when they are presented in her frontal field of view. I recorded relative positions and orientations of both actors throughout courtship and established the role of each sex in maintaining signaling alignment. Finally, I tested how males control female orientation, and respond to signaling challenges. Using video playback, I asked how males’ arm-waving display and the visual environment determine how effectively they attracted female attention, as well as how males respond to variation in their signaling environment. These studies reveal that signaling alignment is frequently disrupted by females turning away from males, but that male arm-waving effectively re-captures her attention. Males also modulate displays in response to changing spatial and environmental conditions. Overall, this dissertation reveals the widespread role of spatial constraints in driving signaling behavior, and demonstrates that the spatial arrangement of signaler and receiver must be managed dynamically through behavioral responses

Perceptual Organization

Perceiving the world of real objects seems so easy that it is difficult to grasp just how complicated it is. Not only do we need to construct the objects quickly, the objects keep changing even though we think of them as having a consistent, independent existence (Feldman, 2003). Yet, we usually get it right, there are few failures. We can perceive a tree in a blinding snowstorm, a deer bounding across a tree line, dodge a snowball, catch a baseball, detect the crack of a branch breaking in a strong windstorm amidst the rustling of trees, predict the sounds of a dripping faucet, or track a street musician strolling down the road