Wireless inertial sensor system for the interactive dance and collective motion analysis

Thesis (S.M.)--Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 2006.Includes bibliographical references (p. 251-256).The motivation for this project is the recent opportunity to leverage low-power, high-bandwidth RF devices and compact inertial sensors to create a wearable, wireless, motion analysis system meeting the demands of many points of measurement and high data rates. This thesis outlines the implementation of such a system intended for interactive dance, in which sensor nodes are worn on the wrists and ankles of dancers in an ensemble. Interactive dance is in some ways an ideal situation for pushing high performance requirements. Collecting data in a highly active environment of human motion demands a comfortable yet sturdy wearable design. Obtaining detailed information about the movement of the human body and the interaction of multiple human bodies demands many points of measurement and high resolution. Most importantly, using this information as a vehicle for interactive performance demands the real-time translation of data into an efficient feature set that a composer, designer, or choreographer can interpret. Now that it is possible to extend expressive motion sensing to multiple points on multiple dancers, an interactive system is capable of responding not only to individual motions, but also to how an ensemble is working together.(cont.) The primary goal in this work is to demonstrate that simple features describing this type of collective activity can be extracted from the system and interpreted real-time, in order to generate responsive music or other immediate feedback. To this end, relevant strategies for feature extraction and music generation were implemented and tested, using data from a small dance ensemble. The results presented in this thesis show promising opportunities for future development in the areas of dance and interactive performance. In the broader scope, the hope is to expand this system to other applications, such as analyzing the dynamics of team sports, physical therapy, biomotion measurement and analysis, or personal physical training. Preliminary testing in these areas is also discussed.by Ryan P. Aylward.S.M

Interaction design for live performance

PhD Thesis Multimedia item accompanying this thesis to be consulted at Robinson LibraryThe role of interactive technology in live performance has increased substantially in recent years. Practices and experiences of existing forms of live performance have been transformed and new genres of technology-­‐mediated live performance have emerged in response to novel technological opportunities. Consequently, designing for live performance is set to become an increasingly important concern for interaction design researchers and practitioners. However, designing interactive technology for live performance is a challenging activity, as the experiences of both performers and their audiences are shaped and influenced by a number of delicate and interconnected issues, which relate to different forms and individual practices of live performance in varied and often conflicting ways. The research presented in this thesis explores how interaction designers might be better supported in engaging with this intricate and multifaceted design space. This is achieved using a practice-­‐led methodology, which involves the researcher’s participation in both the investigation of, and design response to, issues of live performance as they are embodied in the lived and felt experiences of individual live performers’ practices during three interaction design case studies. This research contributes to the field of interaction design for live performance in three core areas. Understandings of the relationships between key issues of live performance and individual performers’ lived and felt experiences are developed, approaches to support interaction designers in engaging individual live performers’ lived and felt experiences in design are proposed and innovative interfaces and interaction techniques for live performance are designed. It is anticipated that these research outcomes will prove directly applicable or inspiring to the practices of interaction designers wishing to address live performance and will contribute to the ongoing academic discourse around the experience of, and design for, live performance.Engineering and Physical Sciences Research Council