A Conceptual Framework for Motion Based Music Applications

Imaginary projections are the core of the framework for motion based music applications presented in this paper. Their design depends on the space covered by the motion tracking device, but also on the musical feature involved in the application. They can be considered a very powerful tool because they allow not only to project in the virtual environment the image of a traditional acoustic instrument, but also to express any spatially defined abstract concept. The system pipeline starts from the musical content and, through a geometrical interpretation, arrives to its projection in the physical space. Three case studies involving different motion tracking devices and different musical concepts will be analyzed. The three examined applications have been programmed and already tested by the authors. They aim respectively at musical expressive interaction (Disembodied Voices), tonal music knowledge (Harmonic Walk) and XX century music composition (Hand Composer)

Herding cats: observing live coding in the wild

After a momentous decade of live coding activities, this paper seeks to explore the practice with the aim of situating it in the history of contemporary arts and music. The article introduces several key points of investigation in live coding research and discusses some examples of how live coding practitioners engage with these points in their system design and performances. In the light of the extremely diverse manifestations of live coding activities, the problem of defining the practice is discussed, and the question raised whether live coding will actually be necessary as an independent category

Testing Schenkerian theory: an experiment on the perception of key distances

The lack of attention given to Schenkerian theory by empirical research in music is striking when compared to its status in music theory as a standard account of tonality. In this paper I advocate a different way of thinking of Schenkerian theory that can lead to empirically testable claims, and report on an experiment that shows how hypotheses derived from Schenker’s theories explain features of listener’s perception of key relationships. To be relevant to empirical research, Schenker’s theory must be treated as a collection of interrelated but independent theoretical claims rather than a comprehensive analytical method. These discrete theoretical claims can then lead to hypotheses that we can test through empirical methods. This makes it possible for Schenkerian theory improve our scientific understanding of how listeners understand tonal music. At the same time, it opens the possibility of challenging the usefulness of certain aspects of the theory. This paper exemplifies the empirical project with an experiment on the perception of key distance. The results show that two features of Schenkerian theory predict how listeners rate stimuli in terms of key distance. The first is the Schenkerian principle of “composing out” a harmony, and the second is the theory of “voice-leading prolongations.” In a regression analysis, both of these principles significantly improve upon a model of distance ratings based on change of scalar collection alone.Accepted manuscrip

BitBox!:A case study interface for teaching real-time adaptive music composition for video games

Real-time adaptive music is now well-established as a popular medium, largely through its use in video game soundtracks. Commercial packages, such as fmod, make freely available the underlying technical methods for use in educational contexts, making adaptive music technologies accessible to students. Writing adaptive music, however, presents a significant learning challenge, not least because it requires a different mode of thought, and tutor and learner may have few mutual points of connection in discovering and understanding the musical drivers, relationships and structures in these works. This article discusses the creation of ‘BitBox!’, a gestural music interface designed to deconstruct and explain the component elements of adaptive composition through interactive play. The interface was displayed at the Dare Protoplay games exposition in Dundee in August 2014. The initial proof-of- concept study proved successful, suggesting possible refinements in design and a broader range of applications

Experimental Approaches to the Composition of Interactive Video Game Music

This project explores experimental approaches and strategies to the composition of interactive music for the medium of video games. Whilst music in video games has not enjoyed the technological progress that other aspects of the software have received, budgets expand and incomes from releases grow. Music is now arguably less interactive than it was in the 1990’s, and whilst graphics occupy large amounts of resources and development time, audio does not garner the same attention. This portfolio develops strategies and audio engines, creating music using the techniques of aleatoric composition, real-time remixing of existing work, and generative synthesisers. The project created music for three ‘open-form’ games : an example of the racing genre (Kart Racing Pro); an arena-based first-person shooter (Counter-Strike : Source); and a real-time strategy title (0 A.D.). These games represent a cross-section of ‘sandbox’- type games on the market, as well as all being examples of games with open-ended or open-source code

‘It’s a-me, Mario!’ Exploring dynamic changes and similarities in the composition of early Nintendo video game music

As with films, a thoughtfully composed video game soundtrack has the ability to dramatically enhance and elevate the experience for the audience or player. This article explores the potential issues and difficulties of composing for video game systems by studying the sound-producing hardware and music for two popular systems from one manufacturer. By comparing two of Nintendo’s Super Mario titles, which appeared on both 8-bit and 16-bit systems, through an analysis of the technology, audio, visual (audiovisual), music, and gameplay elements, it is shown that the musical composition was affected by the limitations of processing power. The discussion shows how the composer, Koji Kondo, overcame the issues of limited computing power by using layers of repetition while applying various functions of music for film to enhance player immersion. Kondo composed theme music that has become engrained in popular culture and is synonymous with one of Nintendo’s flagship franchises (Greening, 2014). By attempting to understand the method or approach behind the composition for earlier systems, it is possible to investigate and discuss the evolution of video game music while acknowledging and contributing to the study of music for games. A musical analysis of the Castle and Underwater themes on each system allows for a direct comparison of the compositional approach, while an audiovisual analysis reveals the presence of existing cinematic tropes and identifies potential influences on the creation of effective musical soundtracks for video games. Applying audiovisual theory to games will require the use of existing literature from Lissa (1965), Gorbman (1987), Chion (1994) and Tagg (2004), along with the work of Collins (2005; 2007a; 2007b; 2008a; 2008b), which adapts and applies audiovisual analysis to video games