Assistive Technology and Performance Behaviours in Music Improvisation.

The findings from three trial workshops with a group of music-learners with physical disabilities have culminated in an initial design for a novel interactive music-generation system. Using a variety of commercially available music-technologies in a synchronised set-up, the target group identified those aspects of both music production and accessible interaction that were most appealing and productive. The proposed design places equal emphasis on improvisation and accessibility, generating rhythmic, harmonic and melodic patterns that an individual can trigger and manipulate. The system will also allow a group of improvisers to work together offering variable levels of synchronization based on individual need or preference. A prototype system is currently under development

User modelling for robotic companions using stochastic context-free grammars

Creating models about others is a sophisticated human ability that robotic companions need to develop in order to have successful interactions. This thesis proposes user modelling frameworks to personalise the interaction between a robot and its user and devises novel scenarios where robotic companions may apply these user modelling techniques. We tackle the creation of user models in a hierarchical manner, using a streamlined version of the Hierarchical Attentive Multiple-Models for Execution and Recognition (HAMMER) architecture to detect low-level user actions and taking advantage of Stochastic Context-Free Grammars (SCFGs) to instantiate higher-level models which recognise uncertain and recursive sequences of low-level actions. We discuss a couple of distinct scenarios for robotic companions: a humanoid sidekick for power-wheelchair users and a companion of hospital patients. Next, we address the limitations of the previous scenarios by applying our user modelling techniques and designing two further scenarios that fully take advantage of the user model. These scenarios are: a wheelchair driving tutor which models the user abilities, and the musical collaborator which learns the preferences of its users. The methodology produced interesting results in all scenarios: users preferred the actual robot over a simulator as a wheelchair sidekick. Hospital patients rated positively their interactions with the companion independently of their age. Moreover, most users agreed that the music collaborator had become a better accompanist with our framework. Finally, we observed that users' driving performance improved when the robotic tutor instructed them to repeat a task. As our workforce ages and the care requirements in our society grow, robots will need to play a role in helping us lead better lives. This thesis shows that, through the use of SCFGs, adaptive user models may be generated which then can be used by robots to assist their users.Open Acces

Designing for Musical Play

Though sensory spaces are a common feature within many special needs schools, the way in which they are designed and resourced varies greatly between provisions as do the types of activities that take place within them. A short series of case studies has been carried out across a cross section of UK special needs schools to demonstrate this contrast whilst also attempting to better understand the reasoning and motivation behind their design and usage. In 2012, eight schools were visited in England and Wales with the aim of documenting the types of sensory space that were available, the resources that were featured within each space and the types of sensory activities that were being used. The key themes that emerged during the case studies are discussed alongside an historical overview of the conception and evolution of the multisensory environment

A Practice-Based Study into the Composition and Performance of Polytemporal Music

This practice-based research explores the composition and performance of polytemporal music, culminating in ten new works in audio/visual format with accompanying commentaries and notation. Research is undertaken into concepts of rhythm and pulse in order to develop new techniques for composing music in multiple simultaneous tempi, particularly methods for managing rhythmic consonance and dissonance in the compositional process. Attention is also given to the practicalities and implications of performance, investigating issues of accessibility and ensemble in reference to the use of click tracks and headphones, as well as the form and function of notation. The approaches within this research stem from my experience as a commercial rock/studio musician fused with contemporary classical influences. As well as these musical influences, a background in visual art and design also contributes to the visual presentation of works and scores; musical works are presented in video format which is shown to enhance temporal perception, and a new form of rhythmically accurate western notation for polytemporal music is developed. Composing and performing in a strictly polytemporal setting has at the time of writing not been widely researched, and it is hoped this work displays new knowledge and approaches important for the development of composition in this area

Music Technology and Alternate Controllers for Clients with Complex Needs

ABSTRACT: Music technology can provide unique opportunities to allow access to music-making for clients with complex needs. While there is a growing trend of research in this area, technology has been shown to face a variety of issues leading to underuse in this context. This literature review is a collation of information from peer-reviewed publications, gray literature, and practice. Focusing on active music-making using new types of alternate controllers, this re- view aims to bring together information regarding the types of tech- nology available, categorizes music technology and its use within the music therapy setting for clients with complex needs, catalogues work occurring within the eld, and explores the issues and poten- tials surrounding music technology and its use in practice

Improvising through the senses: a performance approach with the indirect use of technology

This article explores and proposes new ways of performing in a technology-mediated environment. We present a case study that examines feedback loop relationships between a dancer and a pianist. Rather than using data from sensor technologies to directly control and affect musical parameters, we captured data from a dancer's arm movements and mapped them onto a bespoke device that stimulates the pianist's tactile sense through vibrations. The pianist identifies and interprets the tactile sensory experience, with his improvised performance responding to the changes in haptic information received. Our system presents a new way of technology-mediated performer interaction through tactile feedback channels, enabling the user to establish new creative pathways. We present a classification of vibrotactile interaction as means of communication, and we conclude how users experience multi-point vibrotactile feedback as one holistic experience rather than a collection of discrete feedback points

AXMEDIS 2007 Conference Proceedings

The AXMEDIS International Conference series has been established since 2005 and is focused on the research, developments and applications in the cross-media domain, exploring innovative technologies to meet the challenges of the sector. AXMEDIS2007 deals with all subjects and topics related to cross-media and digital-media content production, processing, management, standards, representation, sharing, interoperability, protection and rights management. It addresses the latest developments and future trends of the technologies and their applications, their impact and exploitation within academic, business and industrial communities