Whole body interaction

In this workshop we explore the notation of whole body interaction. We bring together different disciplines to create a new research direction for study of this emerging form of interaction

Whole body interaction in abstract domains

Whole Body Interaction appears to be a good fit of interaction style for some categories of application domain, such as the motion capture of gestures for computer games and virtual physical sports. However, the suitability of whole body interaction for more abstract application domains is less apparent, and the creation of appropriate whole body interaction designs for complex abstract areas such as mathematics, programming and musical harmony remains challenging. We argue, illustrated by a detailed case study, that conceptual metaphor theory and sensory motor contingency theory offer analytic and synthetic tools whereby whole body interaction can in principle be applied usefully to arbitrary abstract application domains. We present the case study of a whole body interaction system for a highly abstract application area, tonal harmony in music. We demonstrate ways in which whole body interaction offers strong affordances for action and insight in this domain when appropriate conceptual metaphors are harnessed in the design. We outline how this approach can be applied to abstract domains in general, and discuss its limitations.Published versio

Running up Blueberry Hill: Prototyping whole body interaction in harmony space

Musical harmony is considered to be one of the most abstract and technically difficult parts of music. It is generally taught formally via abstract, domain-specific concepts, principles, rules and heuristics. By contrast, when harmony is represented using an existing interactive desktop tool, Harmony Space, a new, parsimonious, but equivalently expressive, unified level of description emerges. This focuses not on abstract concepts, but on concrete locations, objects, areas and trajectories. This paper presents a design study of a prototype version of Harmony Space driven by whole body navigation, and characterizes the new opportunities presented for the principled manipulation of chord sequences and bass lines. These include: deeper engagement and directness; rich physical cues for memory and reflection, embodied engagement with rhythmic time constraints; hands which are free for other simultaneous activities (such as playing a traditional instrument); and qualitatively new possibilities for collaborative use

Whole body interaction in abstract domains

Whole Body Interaction appears to be a good fit of interaction style for some categories of application domain, such as the motion capture of gestures for computer games and virtual physical sports. However, the suitability of whole body interaction for more abstract application domains is less apparent, and the creation of appropriate whole body interaction designs for complex abstract areas such as mathematics, programming and musical harmony remains challenging. We argue, illustrated by a detailed case study, that conceptual metaphor theory and sensory motor contingency theory offer analytic and synthetic tools whereby whole body interaction can in principle be applied usefully to arbitrary abstract application domains. We present the case study of a whole body interaction system for a highly abstract application area, tonal harmony in music. We demonstrate ways in which whole body interaction offers strong affordances for action and insight in this domain when appropriate conceptual metaphors are harnessed in the design. We outline how this approach can be applied to abstract domains in general, and discuss its limitations

Exploring whole body interaction and design for museums

Museums increasingly use digital technology to enhance exhibition experiences for families, notably in relation to physically mediated installations for young children through natural user interfaces. Yet little is known about how families and children engage with such installations and the kinds of interactive experiences they engender in museum spaces. This paper addresses a pressing need for research to adopt an analytical focus on the body during such digitally mediated interactions in order to understand how bodily interaction contributes to meaning making in the museum context. It reports an observation study of families and children interacting with a whole-body interface (using Kinect) in the context of an installation in a museum exhibit on rare Chinese paintings. The study shows how the installation design engenders particular forms of bodily interaction, collaboration and meaning making. It also contributes design insights into whole-body interaction installations in museums and public spaces

Exploring whole body interaction and design for museums

Museums increasingly use digital technology to enhance exhibition experiences for families, notably in relation to physically mediated installations for young children through natural user interfaces. Yet little is known about how families and children engage with such installations and the kinds of interactive experiences they engender in museum spaces. This paper addresses a pressing need for research to adopt an analytical focus on the body during such digitally mediated interactions in order to understand how bodily interaction contributes to meaning making in the museum context. It reports an observation study of families and children interacting with a whole-body interface (using Kinect) in the context of an installation in a museum exhibit on rare Chinese paintings. The study shows how the installation design engenders particular forms of bodily interaction, collaboration and meaning making. It also contributes design insights into whole-body interaction installations in museums and public spaces

Developing Ideas and Methods for Supporting Whole Body Interaction in Remote Co-Design with Children

Drawing from a present need as well as a growing interest towards developing methods to engage participants in research remotely [1,2], this workshop focuses on identifying opportunities and challenges around designing with children from an embodiment perspective [3,4,5,6,10,11,12,13,15]. Themed around whole body interaction and digital technologies [3,7,8,9,10,11,14,15,16,17,18,20,21] the aim of this workshop is to gain methodological insights for the remote participation of children in design, and arrive at design insights addressing the question how we can design remote, inclusive whole body interactions for and with children while attending to child participants’ multimodal communication and bodily engagement [19,21] in a physically dislocated setting [1,2]. The workshop will involve discussions around data gathering from different angles, including relational, ethical, safety and practical perspectives, to create a comprehensive picture of what it entails to orchestrate embodied co-design workshops with children virtually. Outputs from the workshop will contribute to the IDC community by offering methodological insights from attendees’ own experience and presented case studies from researchers and practitioners from both non-academic and academic settings to support children's embodied engagement in remote workshop situations and beyond