Design-led approach for transferring the embodied skills of puppet stop-motion animators into haptic workspaces

This design-led research investigates the transfer of puppet stop-motion animators’ embodied skills from the physical workspace into a digital environment. The approach is to create a digital workspace that evokes an embodied animating experience and allows puppet stop-motion animators to work in it unencumbered. The insights and outcomes of the practical explorations are discussed from the perspective of embodied cognition. The digital workspace employs haptic technology, an advanced multi-modal interface technology capable of invoking the tactile, kinaesthetic and proprioceptive senses. The overall aim of this research is to contribute, to the Human-Computer Interaction design community, design considerations and strategies for developing haptic workspaces that can seamlessly transfer and accommodate the rich embodied knowledge of non-digital skillful practitioners. Following an experiential design methodology, a series of design studies in collaboration with puppet stop-motion animators led to the development of a haptic workspace prototype for producing stop-motion animations. Each design study practically explored the transfer of different aspects of the puppet stop-motion animation practice into the haptic workspace. Beginning with an initial haptic workspace prototype, its design was refined in each study with the addition of new functionalities and new interaction metaphors which were always developed with the aim to create and maintain an embodied animating experience. The method of multiple streams of reflection was proposed as an important design tool for identifying, understanding and articulating design insights, empirical results and contextual considerations throughout the design studies. This thesis documents the development of the haptic workspace prototype and discusses the collected design insights and empirical results from the perspective of embodied cognition. In addition, it describes and reviews the design methodology that was adopted as an appropriate approach towards the design of the haptic workspace prototype

An aesthetics of touch: investigating the language of design relating to form

How well can designers communicate qualities of touch? This paper presents evidence that they have some capability to do so, much of which appears to have been learned, but at present make limited use of such language. Interviews with graduate designer-makers suggest that they are aware of and value the importance of touch and materiality in their work, but lack a vocabulary to fully relate to their detailed explanations of other aspects such as their intent or selection of materials. We believe that more attention should be paid to the verbal dialogue that happens in the design process, particularly as other researchers show that even making-based learning also has a strong verbal element to it. However, verbal language alone does not appear to be adequate for a comprehensive language of touch. Graduate designers-makers’ descriptive practices combined non-verbal manipulation within verbal accounts. We thus argue that haptic vocabularies do not simply describe material qualities, but rather are situated competences that physically demonstrate the presence of haptic qualities. Such competencies are more important than groups of verbal vocabularies in isolation. Design support for developing and extending haptic competences must take this wide range of considerations into account to comprehensively improve designers’ capabilities

Literacy for digital futures : Mind, body, text

The unprecedented rate of global, technological, and societal change calls for a radical, new understanding of literacy. This book offers a nuanced framework for making sense of literacy by addressing knowledge as contextualised, embodied, multimodal, and digitally mediated. In today’s world of technological breakthroughs, social shifts, and rapid changes to the educational landscape, literacy can no longer be understood through established curriculum and static text structures. To prepare teachers, scholars, and researchers for the digital future, the book is organised around three themes – Mind and Materiality; Body and Senses; and Texts and Digital Semiotics – to shape readers’ understanding of literacy. Opening up new interdisciplinary themes, Mills, Unsworth, and Scholes confront emerging issues for next-generation digital literacy practices. The volume helps new and established researchers rethink dynamic changes in the materiality of texts and their implications for the mind and body, and features recommendations for educational and professional practice

Walking away from VR as ‘empathy-machine’: peripatetic animations with 360-photogrammetry

My research partakes in an expanded documentary practice that weaves together walking, immersive technologies, and moving image. Two lines of enquiry motivate the research journey: the first responds to the trope of VR as 'empathy-machine' (Milk, 2015), often accompanied by the expression 'walking in someone else's shoes'. Within a research project that begins on foot, the idiom’s significance demands investigation. The second line of enquiry pursues a collaborative artistic practice informed by dialogue and poetry, where the bipedals of walking and the binaries of the digital are entwined by phenomenology, hauntology, performance, and the in-betweens of animation. My practice-as-research methodology involves desk study, experimentation with VR, AR, digital photogrammetry, and CGI animation. Central to my approach is the multifaceted notion of Peripatos ̶ as a school of philosophy, a stroll-like walk, and the path where the stroll takes place ̶ manifested both corporeally and as 'playful curiosity'. The thread that interweaves practice and theory has my body-moving in the centre; I call it the ‘camera-walk’: a processional shoot that documents a real place and the bodies that make it, while my hand holds high a camera-on-a-stick shooting 360-video. The resulting spherical video feeds into photogrammetric digital processing, and reassembles into digital 3D models that form the starting ground for still images, a site-specific installation, augmented reality (AR) exchanges, and short films. Because 360-video includes the body that carries the camera, the digital meshes produced by the ‘camera-walk’ also reveal the documentarian during the act of documenting. Departing from the pursuit of perfect replicas, my research articulates the iconic lineage of photogrammetry, embracing imperfections as integral. Despite the planned obsolescence of my digital instruments, I treat my 360-camera as a ‘dangerous tool’, uncovering (and inventing) its hidden virtualities, via Vilém Flusser. Against its formative intentions as an accessory for extreme sports, I focus on everyday life, and become inspired by Harun Farocki’s ‘another kind of empathy’. Within the collaborative projects presented within my thesis, I move away from the colonialist-inspired ideal of ‘walking in someone else’s shoes’, and ‘tread softly’ along the footsteps of my co-walkers

Association of Architecture Schools in Australasia

"Techniques and Technologies: Transfer and Transformation", proceedings of the 2007 AASA Conference held September 27-29, 2007, at the School of Architecture, UTS

Reinventing bodies and practice in medical education

Thesis (Ph. D. in History and Social Study of Science and Technology (HASTS))--Massachusetts Institute of Technology, Program in Science, Technology and Society, June 2004."May 2004."Includes bibliographical references (p. 247-253).This dissertation recounts the development of graphic models of human bodies and virtual reality simulators for teaching anatomy and surgery to medical students, residents, and physicians. It considers how researchers from disciplinary cultures in medicine, engineering, and computer programming come together to build these technologies, bringing with them values and assumptions about bodies from each of their disciplines, values and assumptions that must be negotiated and that often are made material and embedded in these new technologies. It discusses how the technological objects being created privilege the body as a dynamic and interactive system, in contrast to the description and taxonomic body of traditional anatomy and medicine. It describes the ways that these technologies create new sensory means of knowing bodies. And it discusses the larger cultural values that these technologies reify or challenge. The methodology of this dissertation is ethnography. I consider in-depth one laboratory at a major medical school, as well as other laboratories and researchers in the field of virtual medicine. I study actors in the emerging field of virtual medicine as they work in laboratories, at conferences, and in collaborations with one another. I consider the social formations that are developing with this new discipline. Methods include participant observation of laboratory activities, teaching, surgery, and conferences and extensive, in-depth interviewing of actors in the field. I draw on the literatures in the anthropology of science, technology, and medicine, the sociology of science, technology, and medicine, and the history of science and technology to argue that "bodies of information" are part of a bio-engineering revolution.(Cont.) that is making human bodies more easily viewed and manipulated. Science studies theorists have revealed the constructed, situated, and contingent nature of technoscientific communities and the objects they work with. They also have discussed how technoscientific objects help create their subjects and vice versa. This dissertation considers these phenomena within the arena of virtual medicine to intervene in debates about the body, about simulation, and about scientific cultures.by Rachel Prentice.Ph.D.in History and Social Study of Science and Technology (HAST