Actors, Avatars and Agents: Potentials and Implications of Natural Face Technology for the Creation of Realistic Visual Presence

We are on the cusp of creating realistic, interactive, fully rendered human faces on computers that transcend the “uncanny valley,” widely known for capturing the phenomenon of “eeriness” in faces that are almost, but not fully realistic. Because humans are hardwired to respond to faces in uniquely positive ways, artificial realistic faces hold great promise for advancing human interaction with machines. For example, realistic avatars will enable presentation of human actors in virtual collaboration settings with new levels of realism; artificial natural faces will allow the embodiment of cognitive agents, such as Amazon’s Alexa or Apple’s Siri, putting us on a path to create “artificial human” entities in the near future. In this conceptual paper, we introduce natural face technology (NFT) and its potential for creating realistic visual presence (RVP), a sensation of presence in interaction with a digital actor, as if present with another human. We contribute a forward-looking research agenda to information systems (IS) research, comprising terminology, early conceptual work, concrete ideas for research projects, and a broad range of research questions for engaging with this emerging, transformative technology as it becomes available for application. By doing so, we respond to calls for “blue ocean research” that explores unchartered territory and makes a novel technology accessible to IS early in its application. We outline promising areas of application and foreshadow philosophical, ethical, and conceptual questions for IS research pertaining to the more speculative phenomena of “living with artificial humans.

Immersive Kansei Engineering : A New Method and its Potentials

Product development becomes more and more complex. Products obtain more and more functions and at the same time they must be still attractive for the customers to ensure a successful product launch. To predict their acceptance and to gain knowledge on how to design attractive products new methods are developed in the field of the emotional design. Such a method is the Kansei Engineering, which collects the customers hidden subjective needs and their translation into concrete products. We present and validate a new form of the Kansei Engineering method for emotional assessment by the customers during the product development, based on an interactive product experience in Virtual Reality. The major novelty of our kind of method is the use of immersive representations which focuses on both, the product itself and its environmental context, too. Customers experience these virtual representations quite dynamically and with this freely describe their emotional influence on them. We come to the conclusion that more reliable emotional customer feedback can be acquired through the implementation of the proposed context paradigm shift. The fusion of product and environmental context enables the simultaneous role of the customer as a subject (actor) and an object (observer) in the virtual world, thus promoting reliable emotional reactions. Despite of some disadvantages, we propose Immersive Kansei Engineering as a reliable method for emotional product assessment by the customer

Best Practice for Casualty Simulation - Role-playing Actor, High Fidelity Mannequin Simulation, or Virtual Reality?

Objective: The purpose of this systemic review of the literature is to determine the best practice with regards to simulating casualties during a disaster response exercise. Methods: MEDLINE was searched from 1950 till present for the key terms of disaster, simulation, and emergency preparedness. Articles were included which met the following criteria: English language, human subjects, original research using any research design (with or without intervention), and primary focus of disaster preparedness using simulation, virtual reality, or role playing actors. Results: Of the 386 articles reviewed only 18 met inclusion criteria. The literature is primarily descriptive in nature with regards to simulation in disaster preparedness. Seven articles (38%) were analytical in study design with the rest being observational or descriptive. The populations varied widely among the included articles ranging from participants at a formal training class to medical students to residents and finally nurses and full trained physicians. The majority of studies including the analytical ones used convenience sampling. These articles were assigned a level of evidence and best practice recommendations and conclusions were then determined. Conclusions: The results show that virtual reality and high-fidelity mannequin based simulation are at least equivalent to the traditional full scale exercise. In addition, both modalities have the advantage of allowing invasive procedures to be performed as well as giving a more realistic time frame experience for the participant. These modalities can be incorporated into future disaster response drills in order to complement each individual modalities strengths and weaknesses

Organizational Ethnography and the Art of Judgment in-the-Moment

This paper responds to the conveners’ call on exploring and advancing Organizational Ethnography (OE) as a paradigm for the organizational sciences. This sub-theme is linked through my empirical study of senior managers in international development organizations and how they make sense of using their judgment ‘in-the-moment’ in the context of their leadership roles and work environments. I adopt an “ethnographic orientation” (Watson, 2011, p.216) and emphasize the need for a highly reflexive approach in an ethnographer’s role as making judgments throughout the challenging processes of doing “fieldwork, headwork and textwork” (Van Maanen, 2011, p.218). Theoretically, this study contributes to the existing judgment and decision making literature from a social constructionist perspective by drawing linkages to judgment as a co-constructed phenomenon. How senior managers understand their judgment-making in situations ‘in-the-moment’ is an understudied area thus far and even scarcer in the context of international development organizations. Methodologically, the ethnographic and radically reflexive approach taken addresses a gap in the literature, builds awareness and raises in importance examining the ‘multiple selves’ (Reinharz, 1997) of the ethnographer. How I influenced my research and was influenced by it as both subject and object were key to my findings. In addition to the sub-theme call, this paper also links to the overarching Colloquium theme, ‘Bridging Continents, Cultures and Worldviews’, by connecting the cultures and co- constructed views of the researcher and practitioners. The collaborative, ethnographic approach taken was a unique way to get ‘up close and personal’ in understanding what judgment meant to senior leaders in the two participating UK-headquartered organizations. With international development missions in African nations, the senior leaders continuously constructed their own bridges across borders in their financing, operations and communications between their team members and external stakeholders located in multiple countries, reliant on virtual offices and mobile and Internet technology to stay connected. My judgment as an ethnographer was necessary to determine how to best embrace this way of ‘working’ during fieldwork and become another type of stakeholder to them. I will begin with a brief theoretical and methodological background of my exploratory study, identifying the gap in the literature and how my study fills it. Then I will outline the methodology, methods, data collection and analysis and findings. Finally, I will conclude with the challenges of ‘doing organizational ethnography’ inside small international development organizations and the contributions made to advance OE as a unique way to study the social phenomenon of judgment ‘in-the moment’

Science Fictioning Singularities: The Diagrammatic Imaginaries of Physics

Data Loam focuses on the future of knowledge systems in texts about artificial intelligence, cybernetics, and cryptoeconomics – as a means of counteracting end-of-the-world fears

Self-induced Footsteps Sounds in Virtual Reality: Latency, Recognition, Quality and Presence

In this paper we describe the results of experiments whose goal is to investigate the effect of enhancing a virtual reality experience with the sound of synthetic footsteps. Results show that the sense of presence is enhanced when the sound of one’s own motion is added. Furthermore, the experiments show that the threshold for detection of latency between motion and sound is raised when visual stimuli is introduced. 1

Face It, Users Don’t Care: Affinity and Trustworthiness of Imperfect Digital Humans

Digital humans are growing in application and popularity, both as avatars for people and as standalone artificial intelligence-controlled agents. While the technology to make a digital human look more realistic is improving, we know little about how realistic they need to be. Humans are exceptionally good at identifying imperfect digital reproductions of human faces, so it has been reasoned that the slightest imperfections in the visual design of digital humans may translate into reduced acceptance and effectiveness. The broadly held wisdom is that digital humans should be photorealistic and indistinguishable from real people. To examine this common belief we collected data on individuals’ affinity and trustworthiness in photorealistic digital humans when engaged in a product bidding situation, along with a human presenter with varying degrees of video imperfections. The results reveal that participants noticed some of the video imperfections, but this did not adversely affect their willingness to pay, affinity, or trust. We found that once digital humans become close to realistic, users simply do not care about visual imperfection

A Seeing Place – Connecting Physical and Virtual Spaces

In the experience and design of spaces today, we meet both reality and virtuality. But how is the relation between real and virtual construed? How can we as researchers and designers contribute to resolving the physical-virtual divide regarding spaces? This thesis explores the relations between the physical and the virtual and investigates ways of connecting physical and virtual space, both in theory and practice.\ua0The basic concepts of the thesis are Space, Place, and Stage. The central idea is that the stage is a strong conceptual metaphor that has the capacity to work as a unifying concept relating physical and virtual spaces and forming a place for attention, agreements, and experience – A Seeing Place. The concept of seeing place comes from the Greek word theatre, meaning a “place for seeing”, both in the sense of looking at and understanding.\ua0In certain situations, the relations between physical and virtual spaces become important for users’ experience and understanding of these situations. This thesis presents seven cases of physical-virtual spaces, in the field of architectural and exhibition design. The method of these studies is research by design. The discussion then focuses on how each setting works as a stage, and how conceptual metaphors can contribute to the connection between physical and virtual spaces.\ua0Building upon the explorations and experiments in different domains, the thesis contains a collection of seven papers concerning the relations between physical and virtual space in different contexts outside the world of theatre. These papers range from more technical about Virtual Reality (design of networked collaborative spaces) to more conceptual about staging (methods in interaction design) and virtual space (using a transdisciplinary approach).\ua0The results of those studies suggest that the Stage metaphor of a physical-virtual space can contribute to the elucidating of relations between physical and virtual spaces in number of ways. Conceptually, the stage metaphor links together the semiotic and the hermeneutic views of space and place. And, from a practice-based perspective, A Seeing Place view opens up the way to creating contemporary spaces and resolving the physical-virtual divide

Inside International Development Organisations: Socially Constructing Judgement in-the-Moment

This exploratory study aimed, first, to build new knowledge on how senior managers of international development organisations defined judgement and how they made sense of it in the context of their leadership roles and work environments. A secondary aim was to explore methodologies and methods, specifically unstructured interviews and observations, to be used in the PhD phase to study the social phenomenon of judgement. Using an ethnographic and reflexive approach, this study addressed the question: How do managers understand their use of judgement ‘in-the-moment’ in practice? Results from the two participating organisations suggest that there are diverse interpretations of the meaning of ‘judgement’; it is a socially constructed process; used in uncertain situations; and influenced by time and space. These findings contribute to our understanding of how judgement in-the-moment is perceived inside an understudied area: the everyday context of small international development organisations. Theoretically, this study complements the existing literature with a social constructionist perspective and draws linkages to judgement as a constitutive element of sensemaking. Methodologically, the reflexive approach taken builds awareness of examining the ‘multiple selves’ and how researchers influence their research and are influenced by it as subject and object. The validity, methodological issues, limitations and implications for future research are also discussed