Sonic Interaction Design: New Applications and Challenges for Interactive Sonification

Hermann T. Sonic Interaction Design: New Applications and Challenges for Interactive Sonification. In: Alois S, Pomberger H, Zotter F, eds. Proceedings of the 13th International Conference on Digital Audio Effects (DAFx-10). Graz, Austria: IEM; 2010: 1-2.Sonic Interaction Design (SID) is the exploitation of sound as a principal channel to convey information, meaning as well as aesthetic and emotional qualities in interactive contexts [1]. SID is a new young research field that offers novel perspectives for interactive artefacts and multimodal user interfaces that use sound at the core of their designs as means to interact with the user or to communicate and express specific facets. The COST Action IC0601 SID investigates the various aspects of sonic interaction design with the focus on (a) perception, cognition and emotion, (b) product design, (c) interactive art and (d) sonification and information display. This talk will provide an overview of SID, present examples and design procedures that take sound, its synthesis and generation, as well as our modes of communication about sound serious. Sonification is the data-dependent, reproducible generation of sound using a systematic transformation, and it is a central component to shape the functional aspect of interactive artefacts [2]

Ambisonic Decoding with and without Mode-Matching: A Case Study Using the Hemisphere

cote interne IRCAM: Zotter10aNone / NoneNational audienceAccurate decoding and most notably mode-matching has always been a matter of concern within the Ambisonics community; it can be further expected to play a major role in future discussion and research. Specifically, ambisonic decoding by mode-matching attempts to perfectly reconstruct incident sound fields using a surrounding spherical arrangement of loudspeakers. This reproduction is valid locally within a bounded central area, the sweet-area. Surprisingly, many (experienced) listeners have reported good reproduction quality and fair localization accuracy of real-world Ambisonics systems even outside this sweet area. Hence in practice, mode-matching decoding performs better than expected from theory, but it frequently poses numerical problems for incomplete or non-uniform spherical loudspeaker arrangements. To cope with these issues, this article presents, discusses, and compares several alternative Ambisonics decoding strategies with and without mode-matching in terms of simple quality criteria

Sonic Interaction Design: New Applications and Challenges for Interactive Sonification

Hermann T. Sonic Interaction Design: New Applications and Challenges for Interactive Sonification. In: Alois S, Pomberger H, Zotter F, eds. Proceedings of the 13th International Conference on Digital Audio Effects (DAFx-10). Graz, Austria: IEM; 2010: 1-2.Sonic Interaction Design (SID) is the exploitation of sound as a principal channel to convey information, meaning as well as aesthetic and emotional qualities in interactive contexts [1]. SID is a new young research field that offers novel perspectives for interactive artefacts and multimodal user interfaces that use sound at the core of their designs as means to interact with the user or to communicate and express specific facets. The COST Action IC0601 SID investigates the various aspects of sonic interaction design with the focus on (a) perception, cognition and emotion, (b) product design, (c) interactive art and (d) sonification and information display. This talk will provide an overview of SID, present examples and design procedures that take sound, its synthesis and generation, as well as our modes of communication about sound serious. Sonification is the data-dependent, reproducible generation of sound using a systematic transformation, and it is a central component to shape the functional aspect of interactive artefacts [2]

Virtual Auditory Myography of Timpani-playing Avatars

Grond F, Bouenard A, Hermann T, Wanderley MM. Virtual Auditory Myography of Timpani-playing Avatars. In: Sontacchi A, Pomberger H, Zotter F, eds. Proceedings of the 13th Int. Conference on Digita Audio Effects. 2010: 135-142.Music performance is highly related to instrumentalists' movements and one of the biggest challenges is the identification and understanding of gesture strategies according to the plethora of musical nuances (dynamics, tempo, etc..) available to performers. During these past few years, a novel approach has been elaborated, consisting in studying movement strategies through auditory rendering. In this paper, we focus on the auditory analysis of timpani (percussion) gestures. We present a novel interface combining movement simulation and sonification as a means of enhancing the auditory analysis of timpani gestures. We further report the results from an evaluation of this interface, where we study the contributions of sonification to the multimodal display