Quo vadimus? The 21st Century and multimedia

The concept is related of computer driven multimedia to the NASA Scientific and Technical Information Program (STIP). Multimedia is defined here as computer integration and output of text, animation, audio, video, and graphics. Multimedia is the stage of computer based information that allows access to experience. The concepts are also drawn in of hypermedia, intermedia, interactive multimedia, hypertext, imaging, cyberspace, and virtual reality. Examples of these technology developments are given for NASA, private industry, and academia. Examples of concurrent technology developments and implementations are given to show how these technologies, along with multimedia, have put us at the threshold of the 21st century. The STI Program sees multimedia as an opportunity for revolutionizing the way STI is managed

Drones, Signals, and the Techno-Colonisation of Landscape

This research project is a cross-disciplinary, creative practice-led investigation that interrogates increasing military interest in the electromagnetic spectrum (EMS). The project’s central argument is that painted visualisations of normally invisible aspects of contemporary EMS-enabled warfare can reveal useful, novel, and speculative but informed perspectives that contribute to debates about war and technology. It pays particular attention to how visualising normally invisible signals reveals an insidious techno-colonisation of our extended environment from Earth to orbiting satellites

Sonified freaks and sounding prostheses: sonic representation of bodies in performance art

This study is concerned with the role of sound in the presentation and representation of bodies in performance art that incorporates digital technologies. It consists of a written thesis accompanied by a portfolio with documentation of original artwork. Since the 1960s, performance artists have explored the use of sensor technologies to register signals generated by the body and synthesize or control sound. However, both practical and theoretical approaches to biosignal sonification in this field have almost entirely focused on musical (formalist) perspectives, technological innovation, or heightening the performer’s and spectator’s awareness of their body’s physiology. Little attention has been paid to the usually conspicuous interaction between body and technological equipment and the role of the generated sound in the context of cultural critical debates regarding the performing body. The present study responds to this observation in two ways: Firstly, the written part of the study examines existing biosignal performance practices. It seeks to demonstrate that artists’ decisions on the design of sensor technology and sound synthesis or manipulation methods are often complicit in the representation of normative body types and behaviour. Drawing from a concept of the sonified body as a transgressive or ‘freak’ body, three critical perspectives on biosignal sonification in digital performance are proposed: A reading of body sonification methods from a gender-critical perspective, an inquiry in the context of Mikhail Bakhtin’s concepts of the grotesque and the classical body, and a conceptualization of the sonified body as a posthuman prosthetisized body. This part of the study serves as a framework for its second objective: the development of practical performance strategies to address and challenge cultural conventions concerning ‘the’ body’s form and role in society. This aspect of the thesis is developed in conjunction with, and further explored in, the artwork documented in the portfolio. The practical part of the study consists of three digital performance works. ELECTRODE (2011) involves an anal electrode that registers the activity of my sphincter muscle and uses this data to synthesize sound. For this work, I modified a commercially available muscle tension sensor device designed for people with faecal incontinence problems. Feedback (2010) encompasses components of a commercially available fetal Doppler sensor intended to listen to the heartbeat of unborn babies. SUIT (2009-2010) encompasses several performances that feature a PVC overall equipped with a loudspeaker, sensor interface and Doppler and humidity sensors

DIGITIZING THE CORPOREAL: THE AFFECT OF MEDIATIZED ELEMENTS IN THEATRICAL PERFORMANCE

This paper explores the affect of digital media in live performance. The research is generated from work with integrated digital media in Carol Ann Duffy\u27s 2015 adaptation of Everyman as well as Samuel Beckett\u27s radio play Cascando. Through experimentation and implementation of motion tracking digital elements and actor-manipulated sonic and visual digital media achieved with MIDI and OSC mapping, I explore the embodiment of performances by actors when their various characters are represented on the physical as well as the digital stage simultaneously. The research interrogates digital media in storytelling when actors can manipulate imagery and language in real time on stage and what that means for character and plot in live theatre, the embodiment of physical and virtual representation of character, and evolving storytelling through digital means

Playformance: The Virtual Amplification of Spontaneous Hand Gestures in Performance Art

Playformance (an originally-coined term) offers the space for performance artists to rethink their art practice in new ways through the incorporation of augmentative technology. In this line of research, spontaneous hand gestures (in addition to other forms of movement) serve as a kinetic form of creative articulation, and are translated to affect projected graphics rendered live. By situating interactive technology as an extension of the artist’s expression, playformance posits that this user-authored virtual output has the potential to convey the user’s inner thoughts and/ or motives through ludic performativity. In-depth contextual inquiry and user-experience-enhancing compliance design, inform the creative and technical process of five diverse, original and custom-made networked-performances: Dissolving Self, Blendism, Havabazi Tuno, Jadoo Bänoo, and Havabazi Avesta. Findings conclude that the director must design a visceral experience for the user, which, in turn subsequently felt and understood by the audience as well. With staged performances, come a divide between the passive audience and active performer. Inspired from this, playformance also includes the conceptual development and production of Mirada, an interactive installation, in which users collaboratively engage with sensor-embedded abstract instruments through playful haptic exploration to serendipitously affect both visual and acoustic feedback in real-time

Proof of Concept For the Use of Motion Capture Technology In Athletic Pedagogy

Visualization has long been an important method for conveying complex information. Where information transfer using written and spoken means might amount to 200-250 words per minute, visual media can often convey information at many times this rate. This makes visualization a potentially important tool for education. Athletic instruction, particularly, can involve communication about complex human movement that is not easily conveyed with written or spoken descriptions. Video based instruction can be problematic since video data can contain too much information, thereby making it more difficult for a student to absorb what is cognitively necessary. The lesson is to present the learner what is needed and not more. We present a novel use of motion capture animation as an educational tool for teaching athletic movements. The advantage of motion capture is its ability to accurately represent real human motion in a minimalist context which removes extraneous information normally found in video. Motion capture animation only displays motion information, not additional information regarding the motion context. Producing an “automated coach” would be too large and difficult a problem to solve within the scope of a Master's thesis but we can perform initial steps including producing a useful software tool which performs data analysis on two motion datasets. We believe such a tool would be beneficial to a human coach as an analysis tool and the work would provide some useful understanding of next important steps towards perhaps someday producing an automated coach

Storytelling with salient stills

Thesis (M.S.)--Massachusetts Institute of Technology, Program in Media Arts & Sciences, 1996.Includes bibliographical references (p. 59-63).Michale J. Massey.M.S

Immersive Participation:Futuring, Training Simulation and Dance and Virtual Reality

Dance knowledge can inform the development of scenario design in immersive digital simulation environments by strengthening a participant’s capacity to learn through the body. This study engages with processes of participatory practice that question how the transmission and transfer of dance knowledge/embodied knowledge in immersive digital environments is activated and applied in new contexts. These questions are relevant in both arts and industry and have the potential to add value and knowledge through crossdisciplinary collaboration and exchange. This thesis consists of three different research projects all focused on observation, participation, and interviews with experts on embodiment in digital simulation. The projects were chosen to provide a range of perspectives across dance, industry and futures studies. Theories of embodied cognition, in particular the notions of the extended body, distributed cognition, enactment and mindfulness, offer critical lenses through which to explore the relationship of embodied integration and participation within immersive digital environments. These areas of inquiry lead to the consideration of how language from the field of computer science can assist in describing somatic experience in digital worlds through a discussion of the emerging concepts of mindfulness, wayfinding, guided movement and digital kinship. These terms serve as an example of how the mutability of language became part of the process as terms applied in disparate disciplines were understood within varying contexts. The analytic tools focus on applying a posthuman view, speculation through a futures ethnography, and a cognitive ethnographical approach to my research project. These approaches allowed me to examine an ecology of practices in order to identify methods and processes that can facilitate the transmission and transfer of embodied knowledge within a community of practice. The ecological components include dance, healthcare, transport, education and human/computer interaction. These fields drove the data collection from a range of sources including academic papers, texts, specialists’ reports, scientific papers, interviews and conversations with experts and artists.The aim of my research is to contribute both a theoretical and a speculative understanding of processes, as well as tools applicable in the transmission of embodied knowledge in virtual dance and arts environments as well as digital simulation across industry. Processes were understood theoretically through established studies in embodied cognition applied to workbased training, reinterpreted through my own movement study. Futures methodologies paved the way for speculative processes and analysis. Tools to choreograph scenario design in immersive digital environments were identified through the recognition of cross purpose language such as mindfulness, wayfinding, guided movement and digital kinship. Put together, the major contribution of this research is a greater understanding of the value of dance knowledge applied to simulation developed through theoretical and transformational processes and creative tools