Voicing Kinship with Machines: Diffractive Empathetic Listening to Synthetic Voices in Performance.

This thesis contributes to the field of voice studies by analyzing the design and production of synthetic voices in performance. The work explores six case studies, consisting of different performative experiences of the last decade (2010- 2020) that featured synthetic voice design. It focusses on the political and social impact of synthetic voices, starting from yet challenging the concepts of voice in the machine and voice of the machine. The synthetic voices explored are often playing the role of simulated artificial intelligences, therefore this thesis expands its questions towards technology at large. The analysis of the case studies follows new materialist and posthumanist premises, yet it tries to confute the patriarchal and neoliberal approach towards technological development through feminist and de-colonial approaches, developing a taxonomy for synthetic voices in performance. Chapter 1 introduces terms and explains the taxonomy. Chapter 2 looks at familiar representations of fictional AI. Chapter 3 introduces headphone theatre exploring immersive practices. Chapters 4 and 5 engage with chatbots. Chapter 6 goes in depth exploring Human and Artificial Intelligence interaction, whereas chapter 7 moves slightly towards music production and live art. The body of the thesis includes the work of Pipeline Theatre, Rimini Protokoll, Annie Dorsen, Begüm Erciyas, and Holly Herndon. The analysis is informed by posthumanism, feminism, and performance studies, starting from my own practice as sound designer and singer, looking at aesthetics of reproduction, audience engagement, and voice composition. This thesis has been designed to inspire and provoke practitioners and scholars to explore synthetic voices further, question predominant biases of binarism and acknowledge their importance in redefining technology

Immersive Participation:Futuring, Training Simulation and Dance and Virtual Reality

Dance knowledge can inform the development of scenario design in immersive digital simulation environments by strengthening a participant’s capacity to learn through the body. This study engages with processes of participatory practice that question how the transmission and transfer of dance knowledge/embodied knowledge in immersive digital environments is activated and applied in new contexts. These questions are relevant in both arts and industry and have the potential to add value and knowledge through crossdisciplinary collaboration and exchange. This thesis consists of three different research projects all focused on observation, participation, and interviews with experts on embodiment in digital simulation. The projects were chosen to provide a range of perspectives across dance, industry and futures studies. Theories of embodied cognition, in particular the notions of the extended body, distributed cognition, enactment and mindfulness, offer critical lenses through which to explore the relationship of embodied integration and participation within immersive digital environments. These areas of inquiry lead to the consideration of how language from the field of computer science can assist in describing somatic experience in digital worlds through a discussion of the emerging concepts of mindfulness, wayfinding, guided movement and digital kinship. These terms serve as an example of how the mutability of language became part of the process as terms applied in disparate disciplines were understood within varying contexts. The analytic tools focus on applying a posthuman view, speculation through a futures ethnography, and a cognitive ethnographical approach to my research project. These approaches allowed me to examine an ecology of practices in order to identify methods and processes that can facilitate the transmission and transfer of embodied knowledge within a community of practice. The ecological components include dance, healthcare, transport, education and human/computer interaction. These fields drove the data collection from a range of sources including academic papers, texts, specialists’ reports, scientific papers, interviews and conversations with experts and artists.The aim of my research is to contribute both a theoretical and a speculative understanding of processes, as well as tools applicable in the transmission of embodied knowledge in virtual dance and arts environments as well as digital simulation across industry. Processes were understood theoretically through established studies in embodied cognition applied to workbased training, reinterpreted through my own movement study. Futures methodologies paved the way for speculative processes and analysis. Tools to choreograph scenario design in immersive digital environments were identified through the recognition of cross purpose language such as mindfulness, wayfinding, guided movement and digital kinship. Put together, the major contribution of this research is a greater understanding of the value of dance knowledge applied to simulation developed through theoretical and transformational processes and creative tools

Haptic Media Scenes

The aim of this thesis is to apply new media phenomenological and enactive embodied cognition approaches to explain the role of haptic sensitivity and communication in personal computer environments for productivity. Prior theory has given little attention to the role of haptic senses in influencing cognitive processes, and do not frame the richness of haptic communication in interaction design—as haptic interactivity in HCI has historically tended to be designed and analyzed from a perspective on communication as transmissions, sending and receiving haptic signals. The haptic sense may not only mediate contact confirmation and affirmation, but also rich semiotic and affective messages—yet this is a strong contrast between this inherent ability of haptic perception, and current day support for such haptic communication interfaces. I therefore ask: How do the haptic senses (touch and proprioception) impact our cognitive faculty when mediated through digital and sensor technologies? How may these insights be employed in interface design to facilitate rich haptic communication? To answer these questions, I use theoretical close readings that embrace two research fields, new media phenomenology and enactive embodied cognition. The theoretical discussion is supported by neuroscientific evidence, and tested empirically through case studies centered on digital art. I use these insights to develop the concept of the haptic figura, an analytical tool to frame the communicative qualities of haptic media. The concept gauges rich machine- mediated haptic interactivity and communication in systems with a material solution supporting active haptic perception, and the mediation of semiotic and affective messages that are understood and felt. As such the concept may function as a design tool for developers, but also for media critics evaluating haptic media. The tool is used to frame a discussion on opportunities and shortcomings of haptic interfaces for productivity, differentiating between media systems for the hand and the full body. The significance of this investigation is demonstrating that haptic communication is an underutilized element in personal computer environments for productivity and providing an analytical framework for a more nuanced understanding of haptic communication as enabling the mediation of a range of semiotic and affective messages, beyond notification and confirmation interactivity

Cyborg Art: An Explorative and Critical Inquiry into Corporeal Human-Technology Convergence

This thesis introduces and examines the undervalued concept of corporeal human-technology interface art, or 'cyborg art', which describes literal, figural and metaphorical representations of increasing body and technology integration. The transforming (post)human being is therefore the focus; who we are today, and who or what we may become as humanity increasingly interfaces with technology. Theoretical analysis of cyborg imagery centres on the science fiction domain, in particular film and television, as opposed to art. Yet a profusion of cyborg art and art practices abound within contemporary society; each differing art form (for example, performance, interactive, digital, sculpture or painting), offering possible 'symbolic function' and 'critical potential' concerning increasing cyborgisation. I therefore argue in this thesis that cyborg art has social value, and reveal throughout the way this artistic focus depicts key ontological and sociological themes of body-technology merger. Seventy-two artworks are examined in total, each demonstrating relevant concerns and aspirations regarding present and envisioned impacts of technoscience. The cyborg-inspired artworks included in this study are primarily situated within four fundamental dimensions of humanity: birth, death, gender and ethnicity; and within three main spheres of corporeal-technological developments: prosthetics, telematics and genetics. Key concepts and themes explored within these realms include ectogenesis, post-genderism, necrotic and ethno-cyborgs, augmentation and reconstruction, tele-erotics and tele-puppets, and transgenics. In addition, three new cyborgian concepts are introduced: the udopian cyborg, which is an aesthetic representing technology's paradoxical dimension - technology as evoking fear and yearning, and having the potential to benefit and harm humanity; the permeative gaze of technoscience, which is a new technologised gaze focusing on how human skin no longer serves as a boundary and barrier to the inner corporeal realm; and lastly, triadic convergence, which denotes the way artists are increasingly creating entities which are a melding of animal, technological and human components. Multimethod research serves as the methodological base for this thesis, as both qualitative and quantitative methods are incorporated into the research design. Hermeneutics is adopted as the analytical/interpretive perspective and approach. The empirical research includes semi-structured in-depth interviews, qualitative (artists') email questionnaires, and structured quantitative questionnaires. Triangulation is employed in order to obtain varied responses to, and perspectives on, technology and the technological epoch, art and cyborg art, and the cyborg. A theory of cyborg art is constructed by interweaving the collated findings with interview participants' responses to a selection of cyborg artworks, and theorists' perspectives on the aforementioned concepts, derived from visual culture, cyborg theory, and critical postmodern theory. The ultimate goal of this thesis is to present the underlying theoretical breadth and creative depth of cyborg art, and to demonstrate that cyborg art can act as a catalyst for increasing societal awareness of, and interest in, corporeal human-technology merger. I analyse the critical relevance of this under-examined artistic focus, and address why cyborg art should be recognised as a new postmodern art genre, and complementary to theoretical discussions of cyborgisation. I argue overall that cyborg art is a valid and critical sphere of inquiry into the increasing integration which exists between humanity and technology

Digital Theatre: A "Live" and Mediated Art Form Expanding Perceptions of Body, Place, and Community

This work discusses Digital Theatre, a type of performance which utilizes both "live" actors and co-present audiences along with digital media to create a hybrid art form revitalizing theatre for contemporary audiences. This work surveys a wide range of digital performances (with "live" and digital elements, limited interactivity/participation and spoken words) and identifies the group collectively as Digital Theatre, an art form with the flexibility and reach of digital data and the sense of community found in "live" theatre. I offer performance examples from Mark Reaney, David Saltz, Troika Ranch, Gertrude Stein Repertory Theatre, Flying Karamazov Brothers, Talking Birds, Yacov Sharir, Studio Z, George Coates Performance Group, and ArtGrid. (The technologies utilized in performances include: video-conferencing, media projection, MIDI control, motion capture, VR animation, and AI). Rather than looking at these productions as isolated events, I identify them as a movement and link the use of digital techniques to continuing theatrical tradition of utilizing new technologies on the stage. The work ties many of the aesthetic choices explored in theatrical past by the likes of Piscator, Svoboda, Craig, and in Bauhaus and Futurist movements. While it retains the essential qualities of public human connection and imaginative thought central to theatre, Digital Theatre can cause theatrical roles to merge as it extends the performer's body, expands our concept of place, and creates new models of global community

From corporeality to virtual reality: theorizing literacy, bodies, and technology in the emerging media of virtual, augmented, and mixed realities

This dissertation explores the relationships between literacy, technology, and bodies in the emerging media of Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR). In response to the recent, rapid emergence of new media forms, questions arise as to how and why we should prepare to compose in new digital media. To interrogate the newness accorded to new media composing, I historicize the literacy practices demanded by new media by examining digital texts, such as video games and software applications, alongside analogous “antiquated” media, such as dioramas and museum exhibits. Comparative textual analysis of analogous digital and non-digital VR, AR, and MR texts reveals new media and “antiquated” media utilize common characteristics of dimensionality, layering, and absence/presence, respectively. The establishment of shared traits demonstrates how media operate on a continuum of mutually held textual practices; despite their distinctive forms, new media texts do not represent either a hierarchical or linear progression of maturing development. Such an understanding aids composing in new VR, AR, and MR media by enabling composers to make fuller use of prior knowledge in a rapidly evolving new media environment, a finding significant both for educators and communicators. As these technologies mature, we will continue to compose both traditional and new forms of texts. As such, we need literacy theory that attends to both the traditional and the new and also is comprehensive enough to encompass future acts of composing in media yet to emerge