Software agents in music and sound art research/creative work: Current state and a possible direction

Composers, musicians and computer scientists have begun to use software-based agents to create music and sound art in both linear and non-linear (non-predetermined form and/or content) idioms, with some robust approaches now drawing on various disciplines. This paper surveys recent work: agent technology is first introduced, a theoretical framework for its use in creating music/sound art works put forward, and an overview of common approaches then given. Identifying areas of neglect in recent research, a possible direction for further work is then briefly explored. Finally, a vision for a new hybrid model that integrates non-linear, generative, conversational and affective perspectives on interactivity is proposed

Clap-along: A negotiation strategy for creative musical interaction with computational systems

This paper describes Clap-along, an interactive system for theorising about creativity in improvised musical performance. It ex- plores the potential for negotiation between human and computer par- ticipants in a cyclical rhythmic duet. Negotiation is seen as one of a set of potential interactive strategies, but one that ensures the most equitable correspondence between human and machine. Through mutual negotia- tion (involving listening/feature extraction and adaptation) the two par- ticipants attempt to satisfy their own and each other’s target outcome, without knowing the other’s goal. Each iteration is evaluated by both participants and compared to their target. In this model of negotiation, we query the notion of ‘flow’ as an objective of creative human-computer collaboration. This investigation suggests the potential for sophisticated applications for real-time creative computational systems

Networks of Liveness in Singer-Songwriting: A practice-based enquiry into developing audio-visual interactive systems and creative strategies for composition and performance.

This enquiry explores the creation and use of computer-based, real-time interactive audio-visual systems for the composition and performance of popular music by solo artists. Using a practice-based methodology, research questions are identified that relate to the impact of incorporating interactive systems into the songwriting process and the liveness of the performances with them. Four approaches to the creation of interactive systems are identified: creating explorative-generative tools, multiple tools for guitar/vocal pieces, typing systems and audio-visual metaphors. A portfolio of ten pieces that use these approaches was developed for live performance. A model of the songwriting process is presented that incorporates system-building and strategies are identified for reconciling the indeterminate, electronic audio output of the system with composed popular music features and instrumental/vocal output. The four system approaches and ten pieces are compared in terms of four aspects of liveness, derived from current theories. It was found that, in terms of overall liveness, a unity to system design facilitated both technological and aesthetic connections between the composition, the system processes and the audio and visual outputs. However, there was considerable variation between the four system approaches in terms of the different aspects of liveness. The enquiry concludes by identifying strategies for maximising liveness in the different system approaches and discussing the connections between liveness and the songwriting process

The Translocal Event and the Polyrhythmic Diagram

This thesis identifies and analyses the key creative protocols in translocal performance practice, and ends with suggestions for new forms of transversal live and mediated performance practice, informed by theory. It argues that ontologies of emergence in dynamic systems nourish contemporary practice in the digital arts. Feedback in self-organised, recursive systems and organisms elicit change, and change transforms. The arguments trace concepts from chaos and complexity theory to virtual multiplicity, relationality, intuition and individuation (in the work of Bergson, Deleuze, Guattari, Simondon, Massumi, and other process theorists). It then examines the intersection of methodologies in philosophy, science and art and the radical contingencies implicit in the technicity of real-time, collaborative composition. Simultaneous forces or tendencies such as perception/memory, content/ expression and instinct/intellect produce composites (experience, meaning, and intuition- respectively) that affect the sensation of interplay. The translocal event is itself a diagram - an interstice between the forces of the local and the global, between the tendencies of the individual and the collective. The translocal is a point of reference for exploring the distribution of affect, parameters of control and emergent aesthetics. Translocal interplay, enabled by digital technologies and network protocols, is ontogenetic and autopoietic; diagrammatic and synaesthetic; intuitive and transductive. KeyWorx is a software application developed for realtime, distributed, multimodal media processing. As a technological tool created by artists, KeyWorx supports this intuitive type of creative experience: a real-time, translocal “jamming” that transduces the lived experience of a “biogram,” a synaesthetic hinge-dimension. The emerging aesthetics are processual – intuitive, diagrammatic and transversal

Bodies and labour: industrialisation, dance and performance

This thesis was submitted for the degree of Master of Philosophy and was awarded by Brunel UniversityThis thesis presents an interdisciplinary analysis of ideas regarding the introduction of technologies in the field of dance and performance since the industrial era. The first two chapters analyse different historical periods, thus creating a parallel between the establishment of work-science, and emerging methods and styles within performing arts that utilise technology as a core element for its creation. The historical examination of the field of work-science studies allows the sketching of a variety of relationships between labour and technical developments, focusing especially on the systematisation of productive processes, the integration of new technical developments and the measurements of body’s rhythms and capacities. Therefore, rather than presenting a full historical study of industrialisation and technological performance, this research proposes a segmented analysis of two different periods: firstly, a parallel between Taylorism and Electric Dance since the late nineteenth century; and secondly, some relevant notions of Fordism, Mass Ornament and film studies from the 1920s. In the last part of this thesis, I present some general ideas on post-Fordism and digital performance that will serve as a base for future research development. This investigation is rooted in the field of performing arts, introducing ideas and concepts from labour studies and generating a critical approach to the integration of technologies within performing arts and its aesthetical, methodological and creative outcomes. The research encompasses a wide range of perspectives, from early photographic experiments, film studies, entertainment culture, video games, and digital technologies, formulating a general approach to technological transformations since the late nineteenth century. The key question throughout this research is precisely a double-sided adaptation between movement style and technical development: a process of intermedial configurations based on technological progress, analysed from a labour-science perspective, and then applied to performance art and entertainment culture

Unification, Agency, Systemization, Intuition: My Art Making Process and Ideas

This essay is an attempt to describe my ideas about my work, my process, and my philosophy of art by examining five of the major pieces I created during the pursuit of a Master of Fine Arts degree at Virginia Commonwealth University. I will discuss the pieces in chronological order, first providing a description of the works’ salient characteristics, then delving into both my specific thoughts about the work as well as the background ideas that were pertinent to me during my process of creation

Forming a Sonic Identity through the Integration of Transculturality and Technology

This paper investigates the ways in which new sonic identities begin to emerge through a dialogue between cultures, artistic disciplines and technology. Musicians worldwide commonly shape their identity and forms of musical expression through the lens of the environment they grow up in. Ideas about desirable sonic aesthetics vary drastically across musical traditions and cultures globally. Whilst one musician may strive for a sound that is clear, pure and unaltered, another may strive for a distorted, inharmonic sound, for example. The article examines what happens when a musician from a given sonic tradition is exposed to and interacts with a diversely different approach to producing sound. It puts forward the case of an Australian double bass player with a long immersion into Tanzanian musical culture, carving out a personal approach to double bass playing via a synthesis of traditional western techniques, extended techniques influenced by Tanzanian sonic aesthetics, as well as mechanical preparations and electronic augmentation of the instrument. The combination of these diverse elements allows for the emergence of a distinctive sonic identity, illustrated by excerpts from three pieces composed and performed within this specific aesthetic framework. The article’s discussion on sonic identity formation holds relevance as an example case of artistic creation within the current globalised context, where finding the distinct quality of one’s expression needs to be negotiated through layers of transcultural and technological elements

Amergent Music: behavior and becoming in technoetic & media arts

Merged with duplicate records 10026.1/1082 and 10026.1/2612 on 15.02.2017 by CS (TIS)Technoetic and media arts are environments of mediated interaction and emergence, where meaning is negotiated by individuals through a personal examination and experience—or becoming—within the mediated space. This thesis examines these environments from a musical perspective and considers how sound functions as an analog to this becoming. Five distinct, original musical works explore the possibilities as to how the emergent dynamics of mediated, interactive exchange can be leveraged towards the construction of musical sound. In the context of this research, becoming can be understood relative to Henri Bergson’s description of the appearance of reality—something that is making or unmaking but is never made. Music conceived of a linear model is essentially fixed in time. It is unable to recognize or respond to the becoming of interactive exchange, which is marked by frequent and unpredictable transformation. This research abandons linear musical approaches and looks to generative music as a way to reconcile the dynamics of mediated interaction with a musical listening experience. The specifics of this relationship are conceptualized in the structaural coupling model, which borrows from Maturana & Varela’s “structural coupling.” The person interacting and the generative musical system are compared to autopoietic unities, with each responding to mutual perturbations while maintaining independence and autonomy. Musical autonomy is sustained through generative techniques and organized within a psychogeographical framework. In the way that cities invite use and communicate boundaries, the individual sounds of a musical work create an aural context that is legible to the listener, rendering the consequences or implications of any choice audible. This arrangement of sound, as it relates to human presence in a technoetic environment, challenges many existing assumptions, including the idea “the sound changes.” Change can be viewed as a movement predicated by behavior. Amergent music is brought forth through kinds of change or sonic movement more robustly explored as a dimension of musical behavior. Listeners hear change, but it is the result of behavior that arises from within an autonomous musical system relative to the perturbations sensed within its environment. Amergence propagates through the effects of emergent dynamics coupled to the affective experience of continuous sonic transformation.Rutland Port Authoritie

Deep Flow: a tentacular worlding of dance, biosensor technology, lived experience and embodied materials of the human and non-humankind

How to find relations between lived experience and biosensor technology in dance practice? This PaR presents a novel methodology, tentacular worlding, to explore Embodied Dance practice as lived experience, using phenomenological methods and biosensor technologies to better understand experiential aspects of dance more fully, by looking inwardly. It challenges dance practice intersecting with biosensors that visualise invisible physiological events such as heart rate, in external mediated environments, to which dancer’s respond. These ocularcentric practices illustrate only certain aspects of a dancer’s bodily engagement with technology thereby privileging vision over bodily experience. Looking outwardly neglects the vast storehouse of lived experiences that technologies used instrumentally, cannot capture. To explore the strategy of looking inwardly, a relational methodological approach tentacular worlding is applied. This inspires an interdisciplinary study of the human body in dance practice, phenomenology, technology, and ecofeminist posthumanism. Phenomenological dance methods are used to; explore whole bodily experiences; investigate bodily interactions with differing environments; and discover human relations with biosensor technologies and differing materials. It challenges ocularcentrism by blindfolding the practitioner to augment bodily sensing in the absence of visual information. Multimodal qualitative and quantitative methods are used to interpret these experiences and methods of analysis emphasise tentacular relations between lived experience, the heart, and biometric data. Tentacular worlding gave birth to the Embodied Dance practice Deep Flow, to foreground relations between lived and bodily experiencing, meditation, fascia release and heart rate variability. By looking inwardly, within an ecology of embodied experience, visible and invisible, tangible, and intangible materials, Deep Flow collapses binary notions of inside and outside, subject and object, an embodied materiality. It proposes; a return to bodily experience and embodied states of flow, to construct knowledge from a first-person perspective and to explore the complexity of relations between the heart, the human and nonhuman

Deep Flow: a tentacular worlding of dance, biosensor technology, lived experience and embodied materials of the human and non-humankind

How to find relations between lived experience and biosensor technology in dance practice? To do this, current dance practices using biosensor and interactive technologies are studied. These practices visualise invisible bodily events such as heart rate, in external media environments, illustrating certain aspects of a dancer’s experience, to which they respond. This neglects the storehouse of felt experience that technologies, used instrumentally, cannot capture. The research challenges these strategies of looking outwardly to looking inwardly (Höök, 2018), to understand dance as experience (Fraleigh, 2018) more fully. It explores phenomenological methods of dance practice and biosensor technology to; explore the felt senses (Gendlin, 2003) through whole body experiences; investigate experiential interactions in differing environments; and explore human relations with technologies and materials that are both human and non-human. A practice as research methodology is used to explore this strategy. It uses a relational theoretical approach, an interdisciplinary study of the human body in dance practice, phenomenology, technology and feminist posthumanism. Phenomenological methods are explored in methods of dance practice using biosensor technologies. Multimodal qualitative and quantitative methods of data collection are used to interpret the experiences of these practices. Methods of analysis generate an understanding of the relations between these experiences, the body and biometric data. The methods and research methodology have given birth to the practice of Deep Flow, that reveals relations between states of flow (Csikszentmihalyi, 1990; 2004), movement meditation, fascia release and heart rate variability. This replaces practices with biosensor technologies that quantifies and visualises human experience. By looking inwardly, within an ecology of lived experience, biometric data, tangible and intangible materials, Deep Flow collapses notions of inside and outside. It proposes a return to subjective experience, to understand our relations with our bodies, the world and technology, through states of flow and well-being