Exploring ambient sound techniques in the design of responsive environments for children

This paper describes the theoretical framework, design, implementation and results from an exploratory informant workshop that examines an alternative approach to sound feedback in the design of responsive environments for children. This workshop offers preliminary directions and models for using intensity-based ambient sound display in the design of interactive learning environments for children that offer assistance in task-oriented activities. We see the value of this research in developing a more cohesive and ecological model for use of audio feedback in the design of embedded interactions for children. The approach presented here takes the design of multi-modal feedback beyond being experiential, to one that supports learning and problem solving

Sonic souvenirs: exploring the paradoxes of recorded sound for family remembering

Many studies have explored social processes and technologies associated with sharing photos. In contrast, we explore the role of sound as a medium for social reminiscing. We involved 10 families in recording 'sonic souvenirs' of their holidays. They shared and discussed their collections on their return. We compared these sounds with their photo taking activities and reminiscences. Both sounds and pictures triggered active collaborative reminiscing, and attempts to capture iconic representations of events. However sounds differed from photos in that they were more varied, familial and creative. Further, they often expressed the negative or mundane in order to be 'true to life', and were harder to interpret than photos. Finally we saw little use of pure explanatory narrative. We reflect on the relations between sound and family memory and propose new designs on the basis of our findings, to better support the sharing and manipulation of social sounds

Investigating sound intensity gradients as feedback for embodied learning

This paper explores an intensity-based approach to sound feedback in systems for embodied learning. We describe a theoretical framework, design guidelines, and the implementation of and results from an informant workshop. The specific context of embodied activity is considered in light of the challenges of designing meaningful sound feedback, and a design approach is shown to be a generative way of uncovering significant sound design patterns. The exploratory workshop offers preliminary directions and design guidelines for using intensity-based ambient sound display in interactive learning environments. The value of this research is in its contribution towards the development of a cohesive and ecologically valid model for using audio feedback in systems, which can guide embodied interaction. The approach presented here suggests ways that multi-modal auditory feedback can support interactive collaborative learning and problem solving

An aesthetics of touch: investigating the language of design relating to form

How well can designers communicate qualities of touch? This paper presents evidence that they have some capability to do so, much of which appears to have been learned, but at present make limited use of such language. Interviews with graduate designer-makers suggest that they are aware of and value the importance of touch and materiality in their work, but lack a vocabulary to fully relate to their detailed explanations of other aspects such as their intent or selection of materials. We believe that more attention should be paid to the verbal dialogue that happens in the design process, particularly as other researchers show that even making-based learning also has a strong verbal element to it. However, verbal language alone does not appear to be adequate for a comprehensive language of touch. Graduate designers-makers’ descriptive practices combined non-verbal manipulation within verbal accounts. We thus argue that haptic vocabularies do not simply describe material qualities, but rather are situated competences that physically demonstrate the presence of haptic qualities. Such competencies are more important than groups of verbal vocabularies in isolation. Design support for developing and extending haptic competences must take this wide range of considerations into account to comprehensively improve designers’ capabilities

FM radio: family interplay with sonic mementos

Digital mementos are increasingly problematic, as people acquire large amounts of digital belongings that are hard to access and often forgotten. Based on fieldwork with 10 families, we designed a new type of embodied digital memento, the FM Radio. It allows families to access and play sonic mementos of their previous holidays. We describe our underlying design motivation where recordings are presented as a series of channels on an old fashioned radio. User feedback suggests that the device met our design goals: being playful and intriguing, easy to use and social. It facilitated family interaction, and allowed ready access to mementos, thus sharing many of the properties of physical mementos that we intended to trigger

Socio-ec(h)o: Ambient intelligence and gameplay

This paper describes the preliminary research of an ambient intelligent system known as socioec(h)o. socio-ec(h)o explores the design and implementation of an ambient intelligent system for sensing and display, user modeling, and interaction models based on game structures. Our interaction model is based on a game structure including levels, body states, goals and game skills. Body states are the body movements and positions that players must discover in order to complete a level and in turn represent a learned game skill. The paper provides an overview of background concepts and related research. We describe the game structure and prototype of our environment. We discuss games research concepts we utilized and our approach to group user models based on Richard Bartle’s game types. We explain the role of embodied cognition within our design and elaborate on what we chose to encode as embodied actions, cognition and communication. We describe how we utilized selective responses that were real-time, gradient, provided rewards and were unique to different group user models. We introduce our approach to designing ambient intelligent systems that is ecologically inspired. We stress the empirical nature of the design work and the role of participatory design in developing our system

Design and semantics of form and movement (DeSForM 2006)

Design and Semantics of Form and Movement (DeSForM) grew from applied research exploring emerging design methods and practices to support new generation product and interface design. The products and interfaces are concerned with: the context of ubiquitous computing and ambient technologies and the need for greater empathy in the pre-programmed behaviour of the ‘machines’ that populate our lives. Such explorative research in the CfDR has been led by Young, supported by Kyffin, Visiting Professor from Philips Design and sponsored by Philips Design over a period of four years (research funding £87k). DeSForM1 was the first of a series of three conferences that enable the presentation and debate of international work within this field: • 1st European conference on Design and Semantics of Form and Movement (DeSForM1), Baltic, Gateshead, 2005, Feijs L., Kyffin S. & Young R.A. eds. • 2nd European conference on Design and Semantics of Form and Movement (DeSForM2), Evoluon, Eindhoven, 2006, Feijs L., Kyffin S. & Young R.A. eds. • 3rd European conference on Design and Semantics of Form and Movement (DeSForM3), New Design School Building, Newcastle, 2007, Feijs L., Kyffin S. & Young R.A. eds. Philips sponsorship of practice-based enquiry led to research by three teams of research students over three years and on-going sponsorship of research through the Northumbria University Design and Innovation Laboratory (nuDIL). Young has been invited on the steering panel of the UK Thinking Digital Conference concerning the latest developments in digital and media technologies. Informed by this research is the work of PhD student Yukie Nakano who examines new technologies in relation to eco-design textiles

Responsive environments: Participants and protagonists

This PhD research project builds on thirteen years of enquiries as an academic practitioner, developing/critiquing interactive audio-visuals. This approach interweaves theory and practice so that both build on each other. It responds to the need for principles that inter-relate people, digital technologies and environments. The concept of “responsive environments” (RE) is offered as a starting point for the development of principles focusing on people within these environments. A responsive environment is “responsive” in the sense that some form of computer technologies are present and sensing/recording/reacting to people, and an “environment” in the sense that these activities are located in a place and that that place matters in terms of setting the scene, housing the technology and providing a context for the users/visitors. Common themes were extracted from the literature review to draw together previous and, for the most part, separate attempts at theory/practice relating to RE. These themes were complemented by research into contemporaneous activities in the areas of Augmented Reality, Mixed Reality and Locative Media to provided enhancements to the development of three practice projects. These enhancements together with the incorporation of Moore and Anderson’s concepts of “patient”, “actor”, “reciprocator” and “referee” as roles available to those encountering REs led to specific research questions regarding roles, positions, opportunities for repurposing content, learning experiences, the use of sound, visuals and presence, and the assessment of values represented in and through a responsive environment. In each case these questions shift the emphasis of the research towards the experiencing of REs and what they enable rather than the technologies used only. The use of Schwartz and Halegoua’s concept of the “spatial self” further focuses attention of the value in connecting digital expression with real spaces through an RE. This has led to a proposed conceptual framework and principles of practice that can be applied in the area of study of RE to nurture opportunities for participants and protagonists. The latter term is proposed as a means of acknowledging opportunities to make content/concepts in an RE as well as obtain and use them by participation. These opportunities are supported by both synchronous and asynchronous interactions through digital layers using online social media platforms. These platforms enable the archiving of content in a digital layer and/or possibilities for continued social interaction through a digital social layer in relation to the responsive environment. The incorporation of synchronous and asynchronous interactions through digital layers is a major contribution to the concept of REs. A further contribution is the use of the pioneering work of Gordon Pask in both the practice and theory of cybernetics as informing the concept of REs. Pask provided a formulation that expressed how content/concepts could be produced through relationships between people, computers and environments. This approach has been mirrored in other disciplines thus giving additional credence to its value. This discovery provides the impetus for further research, by academic practitioners and others, in this developing area of study

Making sense of group interaction in an ambient intelligent environment for physical play

This paper presents the results of a study on group interaction with a prototype known as socio-ec(h)o. socioec(h)o explores the design of sensing and display, user modeling, and interaction in an embedded interaction system utilizing a game structure. Our study involved the playing of our prototype system by thirty-six (36) participants grouped into teams of four (4). Our aim was to determine heuristics that we could use to further design the interaction and user model approaches for group and embodied interaction systems. We analyzed group interaction and performance based on factors of team cohesion and goal focus. We found that with our system, these factors alone could not explain performance. However, when transitions in the degrees of each factor, i.e. high, medium or low are considered, a clearer picture for performance emerges. The significance of the results is that they describe recognizable factors for positive group interaction

Design Strategies for Adaptive Social Composition: Collaborative Sound Environments

In order to develop successful collaborative music systems a variety of subtle interactions need to be identified and integrated. Gesture capture, motion tracking, real-time synthesis, environmental parameters and ubiquitous technologies can each be effectively used for developing innovative approaches to instrument design, sound installations, interactive music and generative systems. Current solutions tend to prioritise one or more of these approaches, refining a particular interface technology, software design or compositional approach developed for a specific composition, performer or installation environment. Within this diverse field a group of novel controllers, described as ‘Tangible Interfaces’ have been developed. These are intended for use by novices and in many cases follow a simple model of interaction controlling synthesis parameters through simple user actions. Other approaches offer sophisticated compositional frameworks, but many of these are idiosyncratic and highly personalised. As such they are difficult to engage with and ineffective for groups of novices. The objective of this research is to develop effective design strategies for implementing collaborative sound environments using key terms and vocabulary drawn from the available literature. This is articulated by combining an empathic design process with controlled sound perception and interaction experiments. The identified design strategies have been applied to the development of a new collaborative digital instrument. A range of technical and compositional approaches was considered to define this process, which can be described as Adaptive Social Composition. Dan Livingston