Animating Truth

Animating Truth examines the rise of animated documentary in the 21st century, and addresses how non-photorealistic animation is increasingly used to depict and shape reality

Actors, Avatars and Agents: Potentials and Implications of Natural Face Technology for the Creation of Realistic Visual Presence

We are on the cusp of creating realistic, interactive, fully rendered human faces on computers that transcend the “uncanny valley,” widely known for capturing the phenomenon of “eeriness” in faces that are almost, but not fully realistic. Because humans are hardwired to respond to faces in uniquely positive ways, artificial realistic faces hold great promise for advancing human interaction with machines. For example, realistic avatars will enable presentation of human actors in virtual collaboration settings with new levels of realism; artificial natural faces will allow the embodiment of cognitive agents, such as Amazon’s Alexa or Apple’s Siri, putting us on a path to create “artificial human” entities in the near future. In this conceptual paper, we introduce natural face technology (NFT) and its potential for creating realistic visual presence (RVP), a sensation of presence in interaction with a digital actor, as if present with another human. We contribute a forward-looking research agenda to information systems (IS) research, comprising terminology, early conceptual work, concrete ideas for research projects, and a broad range of research questions for engaging with this emerging, transformative technology as it becomes available for application. By doing so, we respond to calls for “blue ocean research” that explores unchartered territory and makes a novel technology accessible to IS early in its application. We outline promising areas of application and foreshadow philosophical, ethical, and conceptual questions for IS research pertaining to the more speculative phenomena of “living with artificial humans.

3D Virtual Worlds and the Metaverse: Current Status and Future Possibilities

Moving from a set of independent virtual worlds to an integrated network of 3D virtual worlds or Metaverse rests on progress in four areas: immersive realism, ubiquity of access and identity, interoperability, and scalability. For each area, the current status and needed developments in order to achieve a functional Metaverse are described. Factors that support the formation of a viable Metaverse, such as institutional and popular interest and ongoing improvements in hardware performance, and factors that constrain the achievement of this goal, including limits in computational methods and unrealized collaboration among virtual world stakeholders and developers, are also considered

To Affinity and Beyond: Interactive Digital Humans as a Human Computer Interface

The field of human computer interaction is increasingly exploring the use of more natural, human-like user interfaces to build intelligent agents to aid in everyday life. This is coupled with a move to people using ever more realistic avatars to represent themselves in their digital lives. As the ability to produce emotionally engaging digital human representations is only just now becoming technically possible, there is little research into how to approach such tasks. This is due to both technical complexity and operational implementation cost. This is now changing as we are at a nexus point with new approaches, faster graphics processing and enabling new technologies in machine learning and computer vision becoming available. I articulate the issues required for such digital humans to be considered successfully located on the other side of the phenomenon known as the Uncanny Valley. My results show that a complex mix of perceived and contextual aspects affect the sense making on digital humans and highlights previously undocumented effects of interactivity on the affinity. Users are willing to accept digital humans as a new form of user interface and they react to them emotionally in previously unanticipated ways. My research shows that it is possible to build an effective interactive digital human that crosses the Uncanny Valley. I directly explore what is required to build a visually realistic digital human as a primary research question and I explore if such a realistic face provides sufficient benefit to justify the challenges involved in building it. I conducted a Delphi study to inform the research approaches and then produced a complex digital human character based on these insights. This interactive and realistic digital human avatar represents a major technical undertaking involving multiple teams around the world. Finally, I explored a framework for examining the ethical implications and signpost future research areas

What aspects of realism and faithfulness are relevant to supporting non-verbal communication through 3D mediums

This thesis investigates what aspects of realism and faithfulness are relevant to supporting non-verbal communication through visual mediums. The mediums examined are 2D video, 3D computer graphics and video based 3D reconstruction. The latter is 3D CGI derived from multiple streams of 2D video. People’s ability to identify behaviour of primates through gross non-verbal communication is compared across 2D video and 3D CGI. Findings suggest 3D CGI performs equally well to 2D video for the identification of gross non-verbal behaviour, however user feedback points to a lack of understanding of intent. Secondly, ability to detect truthfulness in humans across 2D video and video based 3D reconstruction mediums is examined. Effort of doing this is measured by studying changes in level of oxygenation to the prefrontal cortex. Discussion links to the literature to propose that tendency to over trust is inversely proportional to the range of non-verbal resources communicated through a medium. It is suggested that perhaps this is because “tells” are hidden. The third study identifies that video based 3D reconstruction can successfully illustrate subtle facial muscle movements on a par with 2D video, but does identify issues with the display of lower facial detail, due to a reconstruction error called droop. It is hoped that the combination of these strands of research will help users, and application developers, make more informed decisions when selecting which type of virtual character to implement for a particular application therefore contributing to the fields of virtual characters and virtual environments/serious gaming, by giving readers a greater understanding of virtual characters ability to convey non-verbal behaviour

Neural Radiance Fields: Past, Present, and Future

The various aspects like modeling and interpreting 3D environments and surroundings have enticed humans to progress their research in 3D Computer Vision, Computer Graphics, and Machine Learning. An attempt made by Mildenhall et al in their paper about NeRFs (Neural Radiance Fields) led to a boom in Computer Graphics, Robotics, Computer Vision, and the possible scope of High-Resolution Low Storage Augmented Reality and Virtual Reality-based 3D models have gained traction from res with more than 1000 preprints related to NeRFs published. This paper serves as a bridge for people starting to study these fields by building on the basics of Mathematics, Geometry, Computer Vision, and Computer Graphics to the difficulties encountered in Implicit Representations at the intersection of all these disciplines. This survey provides the history of rendering, Implicit Learning, and NeRFs, the progression of research on NeRFs, and the potential applications and implications of NeRFs in today's world. In doing so, this survey categorizes all the NeRF-related research in terms of the datasets used, objective functions, applications solved, and evaluation criteria for these applications.Comment: 413 pages, 9 figures, 277 citation

The Strange Case of the Animated Jekyll and the Online Hyde : a documentary study of Korean youth culture and identity

Robert Louis Stevenson s The Strange Case of Dr Jekyll and Mr Hyde (1886) is the starting point for my practice-led research project. Stevenson's Victorian novella enables me to identify core themes which are pertinent to a discussion of the construction of contemporary identities in Korean youth culture. These identities are exemplified in the creation of avatars the virtual characters of animated online games such as massively multiplayer online role-playing games (MMORPGs). My animation practice is developed by addressing how Jekyll and Hyde provides useful critical and creative tools, such as gothic imagery and detective thrillers, for looking at the double . This concept is used to investigate the case of a young Korean boy, addicted to online gaming, who committed violent acts. My animated drama-documentary draws on research into the real and virtual Korean worlds and employs a visual ethnographic methodology to test my research question: in what ways can the construction of 'identity' (based on concepts drawn from 'Jekyll and Hyde') be identified in contemporary 'virtual' media (i.e. 'MMORPGs'/the 'animated' documentary), and how does this facilitate an address of the specific case of 'Korea' and 'Korean-ness'? The thesis is structured into five chapters: The Idea of Dr Jekyll and Mr Hyde, Theorising Identities in a Korean Context, Theorising Visual Ethnography, Theorising Animated Drama-Documentary, and A Film Practice as Animated Drama-Documentary in Visual Ethnography. Evidence of the research process and findings is located in a series of appendices. Theories about the construction of identity are discussed from three different perspectives: sociology, psychoanalysis and bio-culturalism. In my film practice, I look for the connection between the anxious self and Korean social issues, such as modernisation and the 1997 IMF economic crisis, to account for Korean youth s identity formation through online gaming. My research shows that many South Korean MMORPG users construct identity within contemporary virtual media and that this contributes to a very complex Korean-ness amongst Korean youth. Online gaming has both positive and negative consequences. Immersion in the virtual world can lead to addiction and to the violence which is at the core of my film narrative. It can also result in close online friendships, offering kinship not available in many broken families, or families inhibited in their communication by social roles and expectations, or the effect of economic failure and loss. My practice criticises young Korean people's narrow and limited social environment and proves that they desire liberal expression and decision-making for themselves, which can be experienced through the embodiment of animated avatars in MMORPGs. Hence, the online Hyde , though assumed to be a negative or destructive force, is actually a vehicle for varied and numerous social identities for youth culture preferable to those available in real Korean society. The research mounts a critique of the meaning of the online Hyde , not as a misrepresentative and negative representation of Korean-ness, but as a revelation of its contemporary meaning which can be articulated though animation, a tool which has applications within visual ethnography

Diversity and the Virtual Workplace: Performance Identity and Shifting Boundaries of Workplace Engagement

This article explores the meaning of workplace discrimination where reality meets the imaginary world in virtual work settings. Using a more recent development in the realm of virtual work--workplace avatars--the article considers the impact on law of virtual performance identity by workers where appearances can be altered in virtual reality. Current protected-class approaches to antidiscrimination law have not served as the antidote to workplace bias and exclusion. Thus, the article investigates whether avatar technology holds promise for facilitating greater inclusion of marginalized workers in the contemporary workplace. Does this mode of virtual work serve as a platform for diversity or simply create more confusion regarding our fundamental understandings of discrimination? The author\u27s premise is that the mechanics of online identity and the social and behavioral dynamics of virtual engagement produce a new locus for bias to flourish. While the virtual workplace holds some appeal for promoting broader acceptance within organizations, the article claims that avatar-based virtual work environments do not constitute unconditional and neutral spaces. Overall, the article takes an optimistic stance toward immersive environments in the employment context. However, it cautions that avatars create interpersonal dynamics that are just as dangerous to notions of belonging in the contemporary workplace as their physical counterparts. The author posits that the multidimensionality of identity in this context illuminates the limitations of the categorical approach to antidiscrimination law and concludes that the avatar makes the case for intersectionality theory in workplace law

Diversity and the Virtual Workplace: Performance Identity and Shifting Boundaries of Workplace Engagement

This article explores the meaning of workplace discrimination where reality meets the imaginary world in virtual work settings. Using a more recent development in the realm of virtual work--workplace avatars--the article considers the impact on law of virtual performance identity by workers where appearances can be altered in virtual reality. Current protected-class approaches to antidiscrimination law have not served as the antidote to workplace bias and exclusion. Thus, the article investigates whether avatar technology holds promise for facilitating greater inclusion of marginalized workers in the contemporary workplace. Does this mode of virtual work serve as a platform for diversity or simply create more confusion regarding our fundamental understandings of discrimination? The author\u27s premise is that the mechanics of online identity and the social and behavioral dynamics of virtual engagement produce a new locus for bias to flourish. While the virtual workplace holds some appeal for promoting broader acceptance within organizations, the article claims that avatar-based virtual work environments do not constitute unconditional and neutral spaces. Overall, the article takes an optimistic stance toward immersive environments in the employment context. However, it cautions that avatars create interpersonal dynamics that are just as dangerous to notions of belonging in the contemporary workplace as their physical counterparts. The author posits that the multidimensionality of identity in this context illuminates the limitations of the categorical approach to antidiscrimination law and concludes that the avatar makes the case for intersectionality theory in workplace law