Interfacing Jazz: A Study in Computer-Mediated Jazz Music Creation And Performance

O objetivo central desta dissertação é o estudo e desenvolvimento de algoritmos e interfaces mediados por computador para performance e criação musical. É sobretudo centrado em acompanhamentos em Jazz clássico e explora um meta-controlo dos parâmetros musicais como forma de potenciar a experiência de tocar Jazz por músicos e não-músicos, quer individual quer coletivamente. Pretende contribuir para a pesquisa existente nas áreas de geração automática de música e de interfaces para expressão musical, apresentando um conjunto de algoritmos e interfaces de controlo especialmente criados para esta dissertação. Estes algoritmos e interfaces implementam processos inteligentes e musicalmente informados, para gerar eventos musicais sofisticados e corretos musical estilisticamente, de forma automática, a partir de um input simplificado e intuitivo do utilizador, e de forma coerente gerir a experiência de grupo, estabelecendo um controlo integrado sobre os parâmetros globais. A partir destes algoritmos são apresentadas propostas para diferentes aplicações dos conceitos e técnicas, de forma a ilustrar os benefícios e potencial da utilização de um meta-controlo como extensão dos paradigmas existentes para aplicações musicais, assim como potenciar a criação de novos. Estas aplicações abordam principalmente três áreas onde a música mediada por computador pode trazer grandes benefícios, nomeadamente a performance, a criação e a educação. Uma aplicação, PocketBand, implementada no ambiente de programação Max, permite a um grupo de utilizadores tocarem em grupo como uma banda de jazz, quer sejam ou não treinados musicalmente, cada um utilizando um teclado de computador ou um dispositivo iOS multitoque. O segundo protótipo visa a utilização em contextos coletivos e participativos. Trata-se de uma instalação para vários utilizadores, para ecrã multitoque, intitulada MyJazzBand, que permite até quatro utilizadores tocarem juntos como membros de uma banda de jazz virtual. Ambas as aplicações permitem que os utilizadores experienciem e participem de forma eficaz como músicos de jazz, quer sejam ou não músicos profissionais. As aplicações podem ser utilizadas para fins educativos, seja como um sistema de acompanhamento automático em tempo real para qualquer instrumentista ou cantor, seja como uma fonte de informação para procedimentos harmónicos, ou como uma ferramenta prática para criar esboços ou conteúdos para aulas. Irei também demonstrar que esta abordagem reflete uma tendência crescente entre as empresas de software musical comercial, que já começaram a explorar a mediação por computador e algoritmos musicais inteligentes.Abstract : This dissertation focuses on the study and development of computer-mediated interfaces and algorithms for music performance and creation. It is mainly centered on traditional Jazz music accompaniment and explores the meta-control over musical events to potentiate the rich experience of playing jazz by musicians and non-musicians alike, both individually and collectively. It aims to complement existing research on automatic generation of jazz music and new interfaces for musical expression, by presenting a group of specially designed algorithms and control interfaces that implement intelligent, musically informed processes to automatically produce sophisticated and stylistically correct musical events. These algorithms and control interfaces are designed to have a simplified and intuitive input from the user, and to coherently manage group playing by establishing an integrated control over global common parameters. Using these algorithms, two proposals for different applications are presented, in order to illustrate the benefits and potential of this meta-control approach to extend existing paradigms for musical applications, as well as to create new ones. These proposals focus on two main perspectives where computer-mediated music can benefit by using this approach, namely in musical performance and creation, both of which can also be observed from an educational perspective. A core framework, implemented in the Max programming environment, integrates all the functionalities of the instrument algorithms and control strategies, as well as global control, synchronization and communication between all the components. This platform acts as a base, from which different applications can be created. For this dissertation, two main application concepts were developed. The first, PocketBand, has a single-user, one-man-band approach, where a single interface allows a single user to play up to three instruments. This prototype application, for a multi- touch tablet, was the test bed for several experiments with the user interface and playability issues that helped define and improve the mediated interface concept and the instrument algorithms. The second prototype aims the creation of a collective experience. It is a multi-user installation for a multi-touch table, called MyJazzBand, that allows up to four users to play together as members of a virtual jazz band. Both applications allow the users to experience and effectively participate as jazz band musicians, whether they are musically trained or not. The applications can be used for educational purposes, whether as a real-time accompaniment system for any jazz instrument practitioner or singer, as a source of information for harmonic procedures, or as a practical tool for creating quick arrangement drafts or music lesson contents. I will also demonstrate that this approach reflects a growing trend on commercial music software that has already begun to explore and implement mediated interfaces and intelligent music algorithms

Pushing the boundaries : digital impacts upon jazz

The rapid development of audio technology, particularly in the last fifty years, has changed the way music is composed, produced, consumed and received. The domination of the traditional meta-genres, classical, jazz and folk, is increasingly challenged by postmodern thinking and new methodologies. Centuries of development in techniques, education, culture and practice are in danger of being rendered obsolete. Changing practices for musicians raise philosophical arguments touching on the meaning of the musical work, authenticity and genre itself. This research project is a creative practice-led exercise in applying digital audio technology within the restraints of jazz as a genre. Recordings of works including harmonic, rhythmic and timbral characteristics typical to a broad definition of jazz, have been manipulated digitally with synthesis, looping and sampling. Results have indicated the importance of the timbral voice in signifying genre but the creative application of harmonic and rhythmic factors can allow new timbres to express generically. The success of the hybrid approach to the music also lies in the definitions used to describe the basic comparative criteria, which are themselves contestable. Philosophical considerations can open space for new timbres, new ways to contextualise, and new ways for musicians to interact and improvise against the language of genre

Inside England’s Tap Jams: Improvisation, Identity, and Community

This thesis examines tap dance practice and performance in England. The study is based on a multi-sited ethnography of two tap dance communities in Manchester and London. Participants in the communities ranged in ages from eighteen to eighty and were from a variety of social backgrounds. The investigation focusses on the tap jam, an informal performance event that showcases improvised tap dance to live music. Many individuals disclosed that they joined the tap communities despite possessing limited knowledge and experience of tap improvisation. Improvisation in tap dance is traditionally studied within the context of performance technique and the historical evolution of tap practice in the United States. American tap practitioners and historians such as Hill (2010), Knowles (2002), Frank (1994), and Stearns and Stearns (1968) state that tap improvisation contributes to unique performance styles but do not clarify how these identities are achieved by tap dancers. In order to understand how performance styles are generated, a symbolic interactionist approach is applied to the act of tap improvisation in the two communities. Viewing tap improvisation through a symbolic interactionist framework revealed that the tap jams are a shared social process that does not limit participation based on dance training or socio-cultural background. The improvised performances at the tap jam created performance identities that focussed on the individual rather than on an English interpretation of tap dance. The thesis delivers an analysis and discussion of how the tap community members cultivate these identities within a social context, exploring how tap dance is evolving beyond American identity and practice

The Arpeggiator: A Compositional tool for Performance and Production

The properties of the arpeggiator bring forth a creative process that marries production, composition, improvisation and performance in a manner that inspires the musician/producer, helped define the aesthetics, creative process, and social function of electronic music as a whole, while grounding that music in an association with traditional African-American music and notions of futurism simultaneously. The arpeggiators impact on aesthetics is explored, demonstrating how automation and repetition combine to inject mechanical aesthetics into music, reflecting societys immersion and fascination with automation and futuristic technology while redefining the creative process of the musician. This paper establishes that the arpeggiator is more than just a series of knobs on a synthesizer that manipulate sound or act as a facilitator for performance. Rather, by referencing my creative process and compositions within the context of belonging to the lineage of African-American music, this paper will demonstrate how the arpeggiator is representational of electronic dance musics overall essential qualities

"Being" a Stickist: A Phenomenological Consideration of "Dwelling" in a Virtual Music Scene

Musical instruments are not static, unchanging objects. They are, instead, things that materially evolve in symmetry with human practices. Alterations to an instrument's design often attend to its ergonomic or expressive capacity, but sometimes an innovator causes an entirely new instrument to arise. One such instrument is the Chapman Stick. This instrument's history is closely intertwined with global currents that have evolved into virtual, online scenes. Virtuality obfuscates embodiment, but the Stick's world, like any instrument's, is optimally related in intercorporeal exchanges. Stickists circumvent real and virtual obstacles to engage the Stick world. Using an organology informed by the work of Heidegger and Merleau-Ponty, this study examines how the Chapman Stick, as a material "thing," speaks in and through a virtual, representational environment

Actions towards freedom: Theoretical and practical perspectives on improvisation and composition

This thesis was submitted for the degree of Doctor of Philosophy and was awarded by Brunel University London.This thesis, and the accompanying portfolio of pieces, is concerned with investigating practical and theoretical meeting points between improvisation and composition. Such meeting points are evaluated alongside a consideration of ‘freedom’ in improvised music, for which a frame is drawn from George Lewis’s concepts of the ‘Afrological’ (placing emphasis on expression of the ‘self’) and ‘Eurological’ (in which the ‘self’ is explicitly avoided). It is suggested that a reconciliation of these two extremes might be found in a compositional ‘creative displacement’, which might change an improviser’s environment in unforeseen ways and thus stimulate explorations of expressive novelty. Three different compositional approaches to ‘creative displacement’ are investigated: through fixed notation, through electronic real-time notation, and through leadership in a workshop setting. In each case compositional experiments will be undertaken and documented, detailing the creation and realisation of the pieces included in the accompanying portfolio. A terminology for the theoretical consideration of these approaches will draw on theories of complex systems, the philosophy of Gilles Deleuze, and various socio-musicological models such as those of Steven Feld and Charles Keil. Through an evaluation of the portfolio compositions in rehearsal and performance, this thesis will conclude that a reconciliation of Lewis’s ‘Afro’ and ‘Eurological’ can be found through the external application of limitations to improvisational creativity. Such constraints will be described as ‘creatively displacing’ if they provoke a performer towards an exploration of novel expressive approaches. In order to achieve this in practice, limitations must be carefully judged with regard to their degree of abstraction, the manner of their presentation and the nature of their notation; it will be suggested that the presence of a leader is vital in achieving this. These conclusions will lead to a questioning of conventional ideas of improvisation and leadership, and suggest a re-evaluation of indeterminacy within notation

Tony Williams' drumset ideology to 1969: Synergistic emergence from an adaptive modeling of feel, technique and creativity as an archetype for cultivating originality in jazz drumset performance studies

I identify Tony Williams’ formative drumset ideology as being emergent from his adaptive modeling of the feel, technique and creativity identified in the drumming of Art Blakey, Max Roach and Philly Joe Jones respectively and present the results of extensive textual and musicological research on Williams’ formative practices between 1945 and 1969 as an archetype for cultivating originality in jazz drumset performance studies. I examine patterns of creative thought in the New York jazz community as they developed from the relative heteronomy of modernist bebop improvisation to the postmodernist aesthetic of jazz-rock fusion resulting in the emergence of collective autonomy in musical interaction and improvisation. My research reveals Willams’ possession of autotelic personality and utilisation of learning techniques associated with heutagogy. Also identified is the prevalence of entrainment in the social and musical interactions of the New York jazz community and I interpret these qualities through the lens of the theory of complex adaptive systems as a model for learning in jazz drumset performance studies. I analyse Williams’ ensemble and solo drumming in comparison to that of Blakey, Roach and Jones in addition to Roy Haynes by using an analytic schema designed specifically for identification of contrasting qualities in the voicing of rhythm and expression as revealed in the grouping and ordering of limbs in drumset performance. I present a complete stylistic overview of Williams’ recorded output until 1969 including swing, avant garde, ballad, straight eighth-note and sixteenth-note oriented styles as well as complex temporal events such as polymetric superimposition, rubato, polytempo, superimposed metric modulation, metric modulation and tempo fluctuation

Making in the moment: The dynamic cognition of musicians-in-action

Watching highly-skilled experts in the midst of improvised performance can be a source of mystification and wonder. Understanding this mystery in more detail, especially for music, is a major motivation for my dissertation. Moreover, while there are multiple avenues through which one could explore improvisation, I will primarily utilize the tools of embodied cognitive science to help better understand it in general and bebop jazz improvisation in particular. I furthermore consider possible ways to define improvisation as an essential precondition of my project.In what follows, I will not defend one type of embodied approach over all alternatives. Instead, I will consider improvisation in light of three different strands of research: shared intentions, ecological psychology (especially in regards to a theory of affordances), and predictive processing. The focus on these strands, taken both as individual research programs and a single unit of analysis, closely mirrors the essential core commitment of embodiment by providing a dynamic account that spans brain, body, and world. It likewise does so in ways that reject any neat partition of inputs, cognition, and output.For shared intentions, the main issue I will explore concerns how to best account for the dynamic moment-to-moment engagement of musicians with each other, especially in light of improvisation as an intentional activity, and covering the differences from novices to experts in bebop performance. For a theory of affordances, the focus will be on the interplay between a skilled agent and a structured environment as an essential part of musical perception and action. Finally, for predictive processing, a picture of the brain as a predictive, anticipatory engine takes center stage to explain how musicians can respond to the extremely fast time constraints that are part of musical performance. I will also consider how novelty can be accounted for on predictive processing accounts. Through considerations of these different areas, the impacts of embodied approaches will be further clarified and help us to better model, understand, and appreciate the cognition of musicians-in-action

THE PHILOSOPHY OF ACTION IN LIVE PERFORMANCE INTERACTION DESIGN: ALIGNING FLOWS OF INTENTIONALITY

In recent years, ubiquitous computing has altered traditional performance spaces. Arts organizations have notably tested various strategies to either accommodate or eliminate the persistent and disruptive “glowing screen” of smartphones. While theatre and performance artists and scholars correctly identify many problems created by this influx of new technology, this dissertation argues that the rise of ubiquitous computing presents immense potential for theatre and performance studies to begin solving the design problems faced by computer scientists and user experience designers. Theatre and performance scholars hold a crucial role in ubiquitous technology design for live performance, and we have key knowledge of action that user experience designers seek now more than ever. I propose that human action is the basis for a common nomenclature and theoretical bridge between user experience design and theatre and performance studies. I extend Aristotle’s intentionalist mimetic theory using current philosophy of action and cognitive science, and argue that performance artists and designers select and align flows of intentionality in action that immerse spectators in the intentional presentation of an action. Furthermore, I follow Elizabeth Anscombe’s theory of action to argue for the incommensurability of propositionally articulated theoretical knowledge and non-propositional practical knowledge. Audiences experience the flow of a performance as they ascertain the interweaving of these incommensurable yet complimentary articulations of intentionality through a reciprocal feedback loop of active perception. Both performers and audiences derive the meaning of a performance from an “expanded description” of the teleological structure of actions that comprise it. This action-centric analysis of performance provides the basis for dialogue with human experience designers through an ecologically balanced mapping of the four Aristotelian causes of a performance onto the design of new technology. As a practical application of this theoretical framework, the dissertation also proposes a new platform for smartphone-based audience interactivity at live Jazz concerts. Applying the theoretical argument to the intentional flows of action in live jazz, the Nymbus system seeks to align the material, formal, and efficient causality of smartphones at concerts with the intentional flows in jazz performance in order to heighten and compliment audience immersion in jazz performance flow

A study, exploration and development of the interaction of music production techniques in a contemporary desktop setting

As with all computer-based technologies, music production is advancing at a rate comparable to ‘Moore’s law’. Developments within the discipline are gathering momentum exponentially; stretching the boundaries of the field, deepening the levels to which mediation can be applied, concatenating previously discrete hardware technologies into the desktop domain, demanding greater insight from practitioners to master these technologies and even defining new genres of music through the increasing potential for sonic creativity to evolve. This DMus project will draw from the implications of the above developments and study the application of technologies currently available in the desktop environment, from emulations of that which was traditionally hardware to the latest spectrally based audio-manipulation tools. It will investigate the interaction of these technologies, and explore creative possibilities that were unattainable only a few years ago – all as exemplified through the production of two contrasting albums of music. In addition, new software will be developed to actively contribute to the evolution of music production as we know it. The focus will be on extended production technique and innovation, through both development and context. The commentary will frame the practical work. It will offer a research context with a number of foci in preference to literal questions, it will qualify the methodology and then form a literature & practice review. It will then present a series of frameworks that analyse music production contexts and technologies in a historical perspective. By setting such a trajectory, the current state-of-the-art can be best placed, and a number of the progressive production techniques associated with the submitted artefacts can then by contextualised. It will terminate with a discussion of the work that moves from the specific to the general