These are the echoes: Sound Proof 2008-2012

Article in peer-reviewed journal Culture/Kultura for their thematic issue, Art Media and Cultural Memory. Based on the conference talk given at CCCS Annual Conference on Cultural Memory 4-7 September 2013

The influence of auditory feedback on speed choice, violations and comfort in a driving simulation game

Two experiments are reported which explore the relationships between auditory feedback (engine noise), speed choice, driving violations and driver comfort. Participants played a driving simulation game with different levels of auditory feedback in the form of engine noise. In Experiment 1, a between-subjects design revealed that no noise and low levels of engine noise (65 dB(A)) resulted in participants driving at faster speeds than in the medium (75 dB(A)) and high (85 dB(A)) levels of engine noise conditions. The low noise feedback conditions were also associated with decreases in driver comfort. Experiment 2 also demonstrated that low levels of engine noise feedback (no feedback and 70 dB(A)) were associated with increases in driving speed, and driving violations relative to higher levels of feedback (75 dB(A) and 80 dB(A)). Implications exist for current car manufacturing trends which emphasise a growing increase in noise insulation for the driver. © 2011 Elsevier Ltd. All rights reserved

"Sitting too close to the screen can be bad for your ears": A study of audio-visual location discrepancy detection under different visual projections

In this work, we look at the perception of event locality under conditions of disparate audio and visual cues. We address an aspect of the so called “ventriloquism effect” relevant for multi-media designers; namely, how auditory perception of event locality is influenced by the size and scale of the accompanying visual projection of those events. We observed that recalibration of the visual axes of an audio-visual animation (by resizing and zooming) exerts a recalibrating influence on the auditory space perception. In particular, sensitivity to audio-visual discrepancies (between a centrally located visual stimuli and laterally displaced audio cue) increases near the edge of the screen on which the visual cue is displayed. In other words,discrepancy detection thresholds are not fixed for a particular pair of stimuli, but are influenced by the size of the display space. Moreover, the discrepancy thresholds are influenced by scale as well as size. That is, the boundary of auditory space perception is not rigidly fixed on the boundaries of the screen; it also depends on the spatial relationship depicted. For example,the ventriloquism effect will break down within the boundaries of a large screen if zooming is used to exaggerate the proximity of the audience to the events. The latter effect appears to be much weaker than the former

Fear and the musical avant-garde in games: Interviews with Jason Graves, Garry Schyman, Paul Gorman and Michael Kamper

© 2014 Intellect Ltd Article. If you have ever experienced the cold chill of fear when watching a film or playing a video or computer game, it is highly probable that your responses have been manipulated by composers exploiting the musical resources of modernism, experimental music and the avant-garde. Depictions of fear, horror, amorality, evil and so on, have come to be associated with these sound worlds, particularly within the realm of popular culture. A number of game titles and franchises have emerged in recent years, which exploit these musical associations, exploring their creative potential as vehicles of fear and horror within the context of interactive game-play. Two composers associated with this approach are Jason Graves (Dead Space franchise) and Garry Schyman (Bioshock franchise, Dante’s Inferno). This article explores perceived links between avant-garde music (as defined in ‘populist’ rather than musicological or historical terms, as a ‘catch-all’ phrase for twentieth-century music exploiting experimental techniques, modernism and atonality) and depictions of horror and fear through interviews with Graves and Schyman. Further questions are posed to Paul Gorman (audio director – Dante’s Inferno) and Michael Kamper (audio director – Bioshock 2) to contextualize the discussion by demonstrating the significant creative influence of audio directors in guiding the musical approach taken by game composers. The article would be of potential interest to anyone with an interest in game audio, commercial composition/composers, game development, creative collaboration, audio direction and the power of music to manipulate the emotions in association with visual media

Fast Modal Sounds with Scalable Frequency-Domain Synthesis

International audienceAudio rendering of impact sounds, such as those caused by falling objects or explosion debris, adds realism to interactive 3D audiovisual applications, and can be convincingly achieved using modal sound synthesis. Unfortunately, mode-based computations can become prohibitively expensive when many objects, each with many modes, are impacted simultaneously. We introduce a fast sound synthesis approach, based on short-time Fourier Tranforms, that exploits the inherent sparsity of modal sounds in the frequency domain. For our test scenes, this "fast mode summation" can give speedups of 5-8 times compared to a time-domain solution, with slight degradation in quality. We discuss different reconstruction windows, affecting the quality of impact sound "attacks". Our Fourier-domain processing method allows us to introduce a scalable, real-time, audio processing pipeline for both recorded and modal sounds, with auditory masking and sound source clustering. To avoid abrupt computation peaks, such as during the simultaneous impacts of an explosion, we use crossmodal perception results on audiovisual synchrony to effect temporal scheduling. We also conducted a pilot perceptual user evaluation of our method. Our implementation results show that we can treat complex audiovisual scenes in real time with high quality

BitBox!:A case study interface for teaching real-time adaptive music composition for video games

Real-time adaptive music is now well-established as a popular medium, largely through its use in video game soundtracks. Commercial packages, such as fmod, make freely available the underlying technical methods for use in educational contexts, making adaptive music technologies accessible to students. Writing adaptive music, however, presents a significant learning challenge, not least because it requires a different mode of thought, and tutor and learner may have few mutual points of connection in discovering and understanding the musical drivers, relationships and structures in these works. This article discusses the creation of ‘BitBox!’, a gestural music interface designed to deconstruct and explain the component elements of adaptive composition through interactive play. The interface was displayed at the Dare Protoplay games exposition in Dundee in August 2014. The initial proof-of- concept study proved successful, suggesting possible refinements in design and a broader range of applications

The Physio-Emotional Effects of Audio in the Global Christian Church

Audio, specifically as researched by the film industry specialists, has physical and emotional effects on those exposed to it. These effects follow from manipulation of sound’s characteristics in specific and measurable ways. The responsibility of the Christian is to share the gospel with others and support the kingdom of God with his or her skills. In light of these truths, Christian audio specialists should have a thorough knowledge of the physio-emotional effects of audio. Further, they should not shy away from applying strategies from secular audio research to benefit local churches across the globe