A perceptual sound space for auditory displays based on sung-vowel synthesis

When designing displays for the human senses, perceptual spaces are of great importance to give intuitive access to physical attributes. Similar to how perceptual spaces based on hue, saturation, and lightness were constructed for visual color, research has explored perceptual spaces for sounds of a given timbral family based on timbre, brightness, and pitch. To promote an embodied approach to the design of auditory displays, we introduce the Vowel-Type-Pitch (VTP) space, a cylindrical sound space based on human sung vowels, whose timbres can be synthesized by the composition of acoustic formants and can be categorically labeled. Vowels are arranged along the circular dimension, while voice type and pitch of the vowel correspond to the remaining two axes of the cylindrical VTP space. The decoupling and perceptual effectiveness of the three dimensions of the VTP space are tested through a vowel labeling experiment, whose results are visualized as maps on circular slices of the VTP cylinder. We discuss implications for the design of auditory and multi-sensory displays that account for human perceptual capabilities

Sonification as a reliable alternative to conventional visual surgical navigation

Despite the undeniable advantages of image-guided surgical assistance systems in terms of accuracy, such systems have not yet fully met surgeons' needs or expectations regarding usability, time efficiency, and their integration into the surgical workflow. On the other hand, perceptual studies have shown that presenting independent but causally correlated information via multimodal feedback involving different sensory modalities can improve task performance. This article investigates an alternative method for computer-assisted surgical navigation, introduces a novel four-DOF sonification methodology for navigated pedicle screw placement, and discusses advanced solutions based on multisensory feedback. The proposed method comprises a novel four-DOF sonification solution for alignment tasks in four degrees of freedom based on frequency modulation synthesis. We compared the resulting accuracy and execution time of the proposed sonification method with visual navigation, which is currently considered the state of the art. We conducted a phantom study in which 17 surgeons executed the pedicle screw placement task in the lumbar spine, guided by either the proposed sonification-based or the traditional visual navigation method. The results demonstrated that the proposed method is as accurate as the state of the art while decreasing the surgeon's need to focus on visual navigation displays instead of the natural focus on surgical tools and targeted anatomy during task execution

Musical Cities

Musical Cities represents an innovative approach to scholarly research and dissemination. A digital and interactive 'book', it explores the rhythms of our cities, and the role they play in our everyday urban lives, through the use of sound and music. Sara Adhitya first discusses why we should listen to urban rhythms in order to design more liveable and sustainable cities, before demonstrating how we can do so through various acoustic communication techniques. Using audio-visual examples, Musical Cities takes the ‘listener’ on an interactive journey, revealing how sound and music can be used to represent, compose, perform and interact with the city. Through case studies of urban projects developed in Paris, Perth, Venice and London, Adhitya demonstrates how the power of music, and the practice of listening, can help us to compose more accessible, inclusive, engaging, enjoyable, and ultimately more sustainable cities

Measuring the effects of display design and individual differences on the utilization of multi-stream sonifications

Previous work in the auditory display community has discussed the impact of both display design and individual listener differences on how successfully listeners can use a sonification. This dissertation extends past findings and explores the effects of display and individual differences on listeners’ ability to utilize a sonification for an analytical listening task when multiple variables are presented simultaneously. This is considered a more complicated task and pushes listeners’ perceptual abilities, but is necessary when wanting to use sonifications to display more detailed information about a dataset. The study used a two by two between- subjects approach to measure the effects of display design and domain mapping. Acoustic parameters were assigned to either the weather or the health domain, and these mappings were either created by an expert sound designer or arbitrarily assigned. The acoustic parameters were originally selected for the weather domain, so those display conditions were expected to result in higher listener accuracy. Results showed that the expert mapped weather sonification led to higher mean listener accuracy than the arbitrarily mapped health display when listeners did not have time to practice, however with less than an hour of practice the significant main effects of design and domain mapping went away and mean accuracy scores increased to a similar level. This dissertation introduces two models for predicting listener accuracy scores, the first model uses musical sophistication and self-reported motivation scores to predict listener accuracy on the task before practice. The second model uses musical sophistication, self-reported motivation, and listening discrimination scores to predict listener accuracy on the sonification task after practice.Ph.D

Musical Cities

Musical Cities represents an innovative approach to scholarly research and dissemination. A digital and interactive 'book', it explores the rhythms of our cities, and the role they play in our everyday urban lives, through the use of sound and music. Sara Adhitya first discusses why we should listen to urban rhythms in order to design more liveable and sustainable cities, before demonstrating how we can do so through various acoustic communication techniques. Using audio-visual examples, Musical Cities takes the ‘listener’ on an interactive journey, revealing how sound and music can be used to represent, compose, perform and interact with the city. Through case studies of urban projects developed in Paris, Perth, Venice and London, Adhitya demonstrates how the power of music, and the practice of listening, can help us to compose more accessible, inclusive, engaging, enjoyable, and ultimately more sustainable cities

Sonifying Urban Rhythms: Towards the spatio-temporal composition of the urban environment

This thesis is concerned with the composition of the urban rhythms generated by urban design and planning. It recognises the temporal limitations of the graphic urban masterplan, with its tendency of being static and singular in the composition of urban experience. Thus it proposes the integration of rhythm into the urban design and planning process, with the aim to improve the temporal quality of urban design. In order to represent these urban rhythms, as designed in the graphic masterplan, we propose their sonification. A Sonified Urban Masterplan (SUM) tool was developed, allowing the sonification of multiple layers of maps (raster or vector images) along a number of paths of interest. An urban sonic code was then developed in order to map the relevant graphic urban parameters into sound parameters. This sonification strategy was applied to the city of Paris as a case study, producing a sonified set of maps whose composition could be ‘listened’ to over time. Temporal issues concerning human movement, transport infrastructure, activity distribution, and the structuring of urban form and design elements could be represented and heard. We then investigated the potential of the SUM tool as a design and planning tool. We explored how sound could be used to inform the composition of urban form in both time and space, in order to generate the urban rhythms we may desire to experience. Thus through the integration of sonification in urban design and planning, this thesis permits the spatio-­‐temporal representation and composition of urban form. It allows urban designers and planners to compose future urban rhythms and improve the temporal quality of our urban environments. Furthermore, the potential of this tool in other fields has also be recognized, for example in music and the composition of multi-­‐layered open graphic scores

Musical Cities

Musical Cities represents an innovative approach to scholarly research and dissemination. A digital and interactive 'book', it explores the rhythms of our cities, and the role they play in our everyday urban lives, through the use of sound and music. Sara Adhitya first discusses why we should listen to urban rhythms in order to design more liveable and sustainable cities, before demonstrating how we can do so through various acoustic communication techniques. Using audio-visual examples, Musical Cities takes the ‘listener’ on an interactive journey, revealing how sound and music can be used to represent, compose, perform and interact with the city. Through case studies of urban projects developed in Paris, Perth, Venice and London, Adhitya demonstrates how the power of music, and the practice of listening, can help us to compose more accessible, inclusive, engaging, enjoyable, and ultimately more sustainable cities

A perceptual framework for the auditory display of scientific data

Presented at 2nd International Conference on Auditory Display (ICAD), Santa Fe, New Mexico, November 7-9, 1994.A principal requirement of the auditory display of scientsc data is an accurate portrayal of the information contained in the data. The characteristics of the display device can significantly affect the faithfulness of the data presentation. Human hearing is a complex nonlinear process and the intuitive comprehension of the display requires consideration of perceptual interactions and the natural connection between the data and the perception of the dat