The role of participatory workshops in investigating narrative and sound ecologies in the design of an ambient intelligence audio display

We describe two participatory workshops conducted to support design decisions in the making of the audio display for an ambient intelligent game platform. The workshops discussed here explore specific issues of players’ interactions with sound and auditory display design. The workshops helped move our design process forward by specifying the role of narrative and sound ecologies in our design. They clarified the role of sound in creating narrative coherence, guiding player actions, and supporting group interaction. We describe the workshops, the auditory display issues we addressed, discuss how the workshops helped inform our subsequent design, and extend recommendations on how participatory workshops can be used by other designers of auditory displays

Ecological IVIS design : using EID to develop a novel in-vehicle information system

New in-vehicle information systems (IVIS) are emerging which purport to encourage more environment friendly or ‘green’ driving. Meanwhile, wider concerns about road safety and in-car distractions remain. The ‘Foot-LITE’ project is an effort to balance these issues, aimed at achieving safer and greener driving through real-time driving information, presented via an in-vehicle interface which facilitates the desired behaviours while avoiding negative consequences. One way of achieving this is to use ecological interface design (EID) techniques. This article presents part of the formative human-centred design process for developing the in-car display through a series of rapid prototyping studies comparing EID against conventional interface design principles. We focus primarily on the visual display, although some development of an ecological auditory display is also presented. The results of feedback from potential users as well as subject matter experts are discussed with respect to implications for future interface design in this field

Lexical semantics and auditory presentation in virtual storytelling

Presented at the 11th International Conference on Auditory Display (ICAD2005)Audio presentation is an important modality in virtual storytelling. In this paper we present our work on audio presentation in our intelligent multimodal storytelling system, CONFUCIUS, which automatically generates 3D animation speech, and non-speech audio from natural language sentences. We provide an overview of the system and describe speech and non-speech audio in virtual storytelling by using linguistic approaches. We discuss several issues in auditory display, such as its relation to verb and adjective ontology, concepts and modalities, and media allocation. Finally we conclude that introducing linguistic knowledge provides more intelligent virtual storytelling, especially in audio presentation

DOLPHIN: the design and initial evaluation of multimodal focus and context

In this paper we describe a new focus and context visualisation technique called multimodal focus and context. This technique uses a hybrid visual and spatialised audio display space to overcome the limited visual displays of mobile devices. We demonstrate this technique by applying it to maps of theme parks. We present the results of an experiment comparing multimodal focus and context to a purely visual display technique. The results showed that neither system was significantly better than the other. We believe that this is due to issues involving the perception of multiple structured audio sources

The Use of Audio in Minimal Access Surgery

In minimal access surgery (MAS) (also known as minimally invasive surgery), operations are carried out by making small incisions in the skin and inserting special apparatus into potential body cavities through those incisions. Laparoscopic MAS procedures are conducted in the patient’s abdomen. The aim of MAS is faster recovery, shorter hospitalisation and fewer major post-operative complications; all resulting in lower societal cost with better patient acceptability. The technique is markedly dependent on supporting technologies for vision, instrumentation, energy delivery, anaesthesia, and monitoring. However, in practice, much MAS continues to take longer and be associated with an undesirable frequency of unwanted minor (or occasionally major) mishaps. Many of these difficulties result precisely from the complexity and mal-adaptation of the additional technology and from lack of familiarity with it. A survey of South East England surgeons showed the two main stress factors on surgeons to be the technical difficulty of the procedure and time pressures placed on the surgeon by third parties. Many of the problems associated with MAS operations are linked to the control and monitoring of the equipment. This paper describes work begun to explore ergonomic enhancements to laparoscopic operating technology that could result in faster and safer laparoscopic operations, less surgeon stress and reduce dependence on ancillary staff. Auditory displays have been used to communicate complex information to users in a modality that is complementary to the visual channel. This paper proposes the development of a control and feedback system that will make use of auditory displays to improve the amount of information that can be communicated to the surgeon and his assistant without overloading the visual channel. Control of the system would be enhanced by the addition of voice input to allow the surgeon direct control

Ars Informatica -- Ars Electronica: Improving Sonification Aesthetics

In this paper we discuss æsthetic issues of sonifications. We posit that many sonifications have suffered from poor acoustic ecology which makes listening more difficult, thereby resulting in poorer data extraction and inference on the part of the listener. Lessons are drawn from the electro acoustic music community as we argue that it is not instructive to distinguish between sonifications and music/sound art. Edgar Var`ese defined music as organised sound and sonifications organise sound to reflect some aspect of the thing being sonified. Therefore, we propose that sonification designers can improve the communicative ability of their auditory displays by paying attention to the æsthetic issues that are well known to composers, orchestrators, sound designers & artists, and recording engineers