A Motion Recognition Method for a Wearable Dancing Musical Instrument

Abstract In this paper, we constructed a system for realizing a new style of dance performance that dancers play music by dancing. From pilot study, we have found that the motion recognition for dance performance needed the synchronism to back ground music (BGM). Therefore, we propose a new motion recognition method specialized to dance performances. The key techniques of the proposed method are (1) adaptive decision of the size of recognition window to recognize a motion in sync with BGM, and (2) motion recognition in two-phase (rough and detailed) to fulfill the accuracy in high speed recognition. Data was recorded using a 3-axis wireless accelerometers mounted on both shoes. We evaluated the method on a dataset of 5 different dance steps (each repeated 100 times). The results show that this method is capable of improving recognition for all steps (in one case improving recognition from 62% to 99%) while retaining a feeling of seamless connection between movement and sound

Machine Learning of Musical Gestures: Principles and Review

We present an overview of machine learning (ML) techniques and their application in interactive music and new digital instrument design. We first provide the non-specialist reader an introduction to two ML tasks, classification and regression, that are particularly relevant for gestural interaction. We then present a review of the literature in current NIME research that uses ML in musical gesture analysis and gestural sound control. We describe the ways in which machine learning is useful for creating expressive musical interaction, and in turn why live music performance presents a pertinent and challenging use case for machine learning

Dance training and feedback system using wearable wireless sensors.

Teaching and learning the art of human body motion practices such as dance are interesting activities and they are usually performed at traditional training centres. Nowadays, learning the art of dance is becoming challenging proposition with a huge time and energy commitment. In recent times, there has been a vast advancement in computing and sensing technologies, and they are easily accessible. Based on these observations, we proposed a wireless sensor-based dance training and feedback system, which is convenient, flexible, and portable. This system is unique in terms of providing prompt feedback with various teaching and learning flexibilities to both trainees and trainers. In this thesis, an architectural framework of generic body movement training system, proposed in [1], is tuned and expanded to develop a dance training and feedback system. The proposed feedback system and its prototype implementation is the main contributions of this thesis. The proposed teaching and learning tool presents a method for generating meaningful feedback by capturing and analyzing the motion data in real time. The usage of the proposed system is demonstrated using Tap dance. Performance metrics are devised to evaluate the performance and a weighted scoring scheme is applied to compute the performance. The functionalities of the feedback system are illustrated using suitable scenarios. A combination of quantitative and qualitative feedbacks can be generated and presented to the trainees in three different forms: textual, graphical, and audio. The system also accommodates varying teaching styles and preferences of different trainers. We believe that such a two-end customization is a unique feature of the proposed system. With further tunning, we expect it will be a useful tool for teaching and learning of dance at the beginner's level.The original print copy of this thesis may be available here: http://wizard.unbc.ca/record=b180584

Interactive Tango Milonga: An Interactive Dance System for Argentine Tango Social Dance

abstract: When dancers are granted agency over music, as in interactive dance systems, the actors are most often concerned with the problem of creating a staged performance for an audience. However, as is reflected by the above quote, the practice of Argentine tango social dance is most concerned with participants internal experience and their relationship to the broader tango community. In this dissertation I explore creative approaches to enrich the sense of connection, that is, the experience of oneness with a partner and complete immersion in music and dance for Argentine tango dancers by providing agency over musical activities through the use of interactive technology. Specifically, I create an interactive dance system that allows tango dancers to affect and create music via their movements in the context of social dance. The motivations for this work are multifold: 1) to intensify embodied experience of the interplay between dance and music, individual and partner, couple and community, 2) to create shared experience of the conventions of tango dance, and 3) to innovate Argentine tango social dance practice for the purposes of education and increasing musicality in dancers.Dissertation/ThesisDoctoral Dissertation Music 201