Gestural control of sonic swarms: Composing with grouped sound objects

This paper outlines an alternative controller designed to diffuse and manipulate a swarm of sounds in 3- dimensional space and discusses the compositional issues that emerge from its use. The system uses an algorithm from a nature-derived model describing the spatial behavior of a swarm. The movement of the swarm is mapped in the 3- dimensional space and a series of sound transformation functions for the sonic agents are implemented. The notion of causal relationships is explored regarding the spatial movement of the swarm and sound transformation of the agents by employing the physical controller as a performance, compositional and diffusion tool

A toolkit for interactive exhibitions for the partially sighted and blind

Exhibitions in museums, art galleries and other cultural centres are generally designed for normally sighted visitors and are therefore not easily accessible for partially sighted or blind persons. To make exhibitions more suitable for the visually impaired, interactive installations should be offered which take the special human factors requirements of the visually impaired into consideration and enable them to examine exhibits without assistance. To keep installation costs low, it is desirable to have a single system that can be used for different exhibitions. The project described here aimed to address and solve these problems, firstly through the design of various interactivity scenarios, which take into account the capabilities and disabilities of visually impaired people, and secondly through the development of a flexible and reusable installation kit for providing the interactivities. The functionality of the tool-kit prototype was proven by successfully testing an exemplary installation for a photographer who was looking for new ways of presenting his documentary photographs about blindness to partially sighted and sighted audiences. The installation kit has the advantage of being made up of commercially available components and therefore low-cost; it can be used for any kind of interactive installation and is beneficial for visually impaired as well as normally sighted people

Tangible user interfaces : past, present and future directions

In the last two decades, Tangible User Interfaces (TUIs) have emerged as a new interface type that interlinks the digital and physical worlds. Drawing upon users' knowledge and skills of interaction with the real non-digital world, TUIs show a potential to enhance the way in which people interact with and leverage digital information. However, TUI research is still in its infancy and extensive research is required in or- der to fully understand the implications of tangible user interfaces, to develop technologies that further bridge the digital and the physical, and to guide TUI design with empirical knowledge. This paper examines the existing body of work on Tangible User In- terfaces. We start by sketching the history of tangible user interfaces, examining the intellectual origins of this field. We then present TUIs in a broader context, survey application domains, and review frame- works and taxonomies. We also discuss conceptual foundations of TUIs including perspectives from cognitive sciences, phycology, and philoso- phy. Methods and technologies for designing, building, and evaluating TUIs are also addressed. Finally, we discuss the strengths and limita- tions of TUIs and chart directions for future research

Musical Gesture through the Human Computer Interface: An Investigation using Information Theory

This study applies information theory to investigate human ability to communicate using continuous control sensors with a particular focus on informing the design of digital musical instruments. There is an active practice of building and evaluating such instruments, for instance, in the New Interfaces for Musical Expression (NIME) conference community. The fidelity of the instruments can depend on the included sensors, and although much anecdotal evidence and craft experience informs the use of these sensors, relatively little is known about the ability of humans to control them accurately. This dissertation addresses this issue and related concerns, including continuous control performance in increasing degrees-of-freedom, pursuit tracking in comparison with pointing, and the estimations of musical interface designers and researchers of human performance with continuous control sensors. The methodology used models the human-computer system as an information channel while applying concepts from information theory to performance data collected in studies of human subjects using sensing devices. These studies not only add to knowledge about human abilities, but they also inform on issues in musical mappings, ergonomics, and usability