Exploring Audiovisual Support Systems for In-Car Multiparty Conferencing

Calling while driving poses a severe safety risk. When more than two people are involved in a call - a conference call - this risk increases even more. Intelligent vehicles could offer support systems that ease the cognitive burden of such a multiparty calls. We explore the possibilities of such advanced driving assistant systems (ADAS) in two ways: first, we investigate object-based spatial audio where each remote caller is modeled as a distinct audio source. Second, we apply a non-intrusive ambient stereoscopic 3D (S3D) visualization that indicates the current speaker and its location. In a between-subject design driving simulator study (n=56), we assess workload, user experience and driving performance. Surprisingly, we found no positive effect of object-based audio. However, we present evidence how a supporting visualization might lower situational stress and increase the system’s dependability. We conclude that a supportive and intelligent stereoscopic visualization is a promising candidate for enhancing multiparty conference calls while driving

"Idle Flux": A Composer/Choreographer Collaboration

The following thesis documents the collaboration process behind Idle Flux, a collaboration between Samuel A. Montgomery, a graduate composer at University of North Texas, and Emily Jensen, a graduate choreographer at Texas Woman's University. Comprising an 18-minute stereo fixed media composition and choreography for seven dancers, Idle Flux seeks to challenge the traditional spatial relationship between audience members and performers through restructuring seating and stage arrangements while featuring immersive sound design in multiple venues. This thesis considers multiple sources of inspiration, including Immersive Van Gogh® Exhibit Dallas, John Jasperse's Canyon, Zoe | Juniper's BeginAgain, Francisco López's installations, Alexander Ekman's A Swan Lake, Imagine Dragons' "Enemy," Son Lux's "Dream State (Dark Day)," and Ryan Lott's dance compositions. This thesis also examines the interdependent collaborative relationship between composer and choreographer by considering the issues of autonomy and creative control, examining previous collaborative models proposed or implemented by Van Stiefel, José Limón and Norman Lloyd, John Cage and Merce Cunningham, Doris Humphrey and Norman Lloyd. In addition, this thesis discusses the creative process and foundational concepts behind the fixed media composition, including the use of sound samples, exploration of timbre through synthesizers, development of motives and musical language, and the spatialization of sound in multiple venues. This thesis further considers the advantages and challenges associated with creating an immersive experience at each venue as well as an interdependent collaborative process that facilitates the autonomy and creative independence for both the composer and choreographer

Sotto Voce: Exploring the Interplay of Conversation and Mobile Audio Spaces

In addition to providing information to individual visitors, electronic guidebooks have the potential to facilitate social interaction between visitors and their companions. However, many systems impede visitor interaction. By contrast, our electronic guidebook, Sotto Voce, has social interaction as a primary design goal. The system enables visitors to share audio information - specifically, they can hear each other's guidebook activity using a technologically mediated audio eavesdropping mechanism. We conducted a study of visitors using Sotto Voce while touring a historic house. The results indicate that visitors are able to use the system effectively, both as a conversational resource and as an information appliance. More surprisingly, our results suggest that the technologically mediated audio often cohered the visitors' conversation and activity to a far greater degree than audio delivered through the open air.Comment: 8 page

Spatialized data sonification in a 3D virtual environment

Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2013.Cataloged from PDF version of thesis.Includes bibliographical references (pages 67-69).This thesis explores new ways to communicate sensor data by combining spatialized sonification with data visualiation in a 3D virtual environment. A system for sonifying a space using spatialized recorded audio streams is designed, implemented, and integrated into an existing 3D graphical interface. Exploration of both real-time and archived data is enabled. In particular, algorithms for obfuscating audio to protect privacy, and for time-compressing audio to allow for exploration on diverse time scales are implemented. Synthesized data sonification in this context is also explored.by Nicholas D. Joliat.M. Eng

A New Medium for Remote Music Tuition

It is common to learn to play an orchestral musical instrument through regular one-to-one lessons with an experienced musician as a tutor. Students may work with the same tutor for many years, meeting regularly to receive real-time, iterative feedback on their performance. However, musicians travel regularly to audition, teach and perform and this can sometimes make it difficult to maintain regular contact. In addition, an experienced tutor for a specific instrument or musical style may not be available locally. General instrumental tuition may not be available at all in geographically distributed communities. One solution is to use technology such as videoconference to facilitate a remote lesson; however, this fundamentally changes the teaching interaction. For example, as a result of the change in communication medium, the availability of non-verbal cues and perception of relative spatiality is reduced. We describe a study using video-ethnography, qualitative video analysis and conversation analysis to make a fine-grained examination of student–tutor interaction during five co-present and one video-mediated woodwind lesson. Our findings are used to propose an alternative technological solution – an interactive digital score. Rather than the face-to-face configuration enforced by videoconference, interacting through a shared digital score, augmented by visual representation of the social cues found to be commonly used in co-present lessons, will better support naturalistic student–tutor interaction during the remote lesson experience. Our findings may also be applicable to other fields where knowledge and practice of a physical skill sometimes need to be taught remotely, such as surgery or dentistry