Developing the Dance Jockey system for musical interaction with the Xsens MVN suit

In this paper we present the Dance Jockey System, a system developed for using a full body inertial motion capture suit (Xsens MVN) in music/dance performances. We present different strategies for extracting relevant postures and actions from the continuous data, and how these postures and actions can be used to control sonic and musical features. The system has been used in several public performances, and we believe it has great potential for further exploration. However, to overcome the current practical and technical challenges when working with the system, it is important to further refine tools and software in order to facilitate making of new performance pieces. Proceedings of the 12th International Conference on New Interfaces for Musical Expression. University of Michigan Press 2012 ISBN 978-0-9855720-1-3

The development and experience of gesture and brainwave interaction in audiovisual performances

Software and hardware developments in the 21st century have greatly expanded the realm of possibilities for interactive media. These developments have fueled an increased interest in using unconventional methods to translate a performer’s intentions to music and visuals. And at the heart of every computer mediated performance is the question of what human action causes what audiovisual effect. This research explores this question and others by examining two performances that I created; performances featuring audiovisual media that respond to a performer’s gestures and brainwaves. The aim is to improve our understanding of what factors influence interaction design within and across the performing arts. I argue that technology, collaborators and transparency have a decisive impact on a performer’s actions and interactive media. Furthermore, my findings suggest that synchronicity, elegance and visual feedback are important characteristics that can enhance the bond between the performer and audiovisual content. Lastly, I explain how universities and companies can improve research and development by together creating a live show.Communication Studie

OSC Implementation and Evaluation of the Xsens MVN suit

The paper presents research about implementing a full body inertial motion capture system, the Xsens MVN suit, for musical interaction. Three di erent approaches for streaming real time and prerecorded motion capture data with Open Sound Control have been implemented. Furthermore, we present technical performance details and our experience with the motion capture system in realistic practice. Part of Proceedings of the International Conference on New Interfaces for Musical Expression 2011 http://urn.nb.no/URN:NBN:no-2936

Dance Jockey: Performing Electronic Music by Dancing

The authors present an experimental musical performance called Dance Jockey, wherein sounds are controlled by sensors on the dancer's body. These sensors manipulate music in real time by acquiring data about body actions and transmitting the information to a control unit that makes decisions and gives instructions to audio software. The system triggers a broad range of music events and maps them to sound effects and musical parameters such as pitch, loudness and rhythm. Copyright 2011 ISAS