In dialogue with an avatar, language behaviour is identical compared to dialogue with a human partner.

The use of virtual reality (VR) as a methodological tool is becoming increasingly popular in behavioral research as its flexibility allows for a wide range of applications. This new method has not been as widely accepted in the field of psycholinguistics, however, possibly due to the assumption that language processing during human-computer interactions does not accurately reflect human-human interactions. Yet at the same time there is a growing need to study human-human language interactions in a tightly controlled context, which has not been possible using existing methods. VR, however, offers experimental control over parameters that cannot be (as finely) controlled in the real world. As such, in this study we aim to show that human-computer language interaction is comparable to human-human language interaction in virtual reality. In the current study we compare participants’ language behavior in a syntactic priming task with human versus computer partners: we used a human partner, a human-like avatar with human-like facial expressions and verbal behavior, and a computer-like avatar which had this humanness removed. As predicted, our study shows comparable priming effects between the human and human-like avatar suggesting that participants attributed human-like agency to the human-like avatar. Indeed, when interacting with the computer-like avatar, the priming effect was significantly decreased. This suggests that when interacting with a human-like avatar, sentence processing is comparable to interacting with a human partner. Our study therefore shows that VR is a valid platform for conducting language research and studying dialogue interactions in an ecologically valid manner

Open Medical Gesture: An Open-Source Experiment in Naturalistic Physical Interactions for Mixed and Virtual Reality Simulations

Mixed Reality (MR) and Virtual Reality (VR) simulations are hampered by requirements for hand controllers or attempts to perseverate in use of two-dimensional computer interface paradigms from the 1980s. From our efforts to produce more naturalistic interactions for combat medic training for the military, USC has developed an open-source toolkit that enables direct hand controlled responsive interactions that is sensor independent and can function with depth sensing cameras, webcams or sensory gloves. Natural approaches we have examined include the ability to manipulate virtual smart objects in a similar manner to how they are used in the real world. From this research and review of current literature, we have discerned several best approaches for hand-based human computer interactions which provide intuitive, responsive, useful, and low frustration experiences for VR users.Comment: AHFE 202

Assessing user experience of context-aware interfaces in a retail store

Context-awareness is becoming an essential functionality of mobile applications. However, it remains challenging to capture the contextual experience in innovation research, since early-stage technologies have not reached maturity to be implemented in a real-life context. Moreover, users have difficulty in evaluating implicit interactions with context-aware interfaces since imagination of users is limited. Assuming that context impacts user experience, virtual reality (VR) provides an untapped potential for the domain of innovation research. The aim of this study (in progress) is to investigate the potential of user tests in virtual reality (here virtual retail store) for human-computer interaction to better match the needs of users and designers. Initially, the mock-up has been implemented in a retail store with its context-awareness being simulated using the Wizard of Oz methodology (N = 18). This approach is found to be time-consuming and not sufficient for evaluating radical context-aware innovations

A Low Cost Virtual Reality Human Computer Interface for CAD Model Manipulation

Interactions with high volume complex three-dimensional data using traditional two-dimensional computer interfaces have, historically, been inefficient and restrictive. However, during the past decade, virtual reality (VR) has presented a new paradigm for human-computer interaction. This paper presents a VR human-computer interface system, which aims at providing a solution to the human-computer interaction problems present in today’s computer-aided design (CAD) software applications. A data glove device is used as a 3D interface for CAD model manipulation in a virtual design space. To make the visualization more realistic, real-time active stereo vision is provided using LCD shutter glasses. To determine the ease of use and intuitiveness of the interface, a human subject study was conducted for performing standard CAD manipulation tasks. Analysis results and technical issues are also presented and discussed

Keynote Talk 2: Social and Perceptual Fidelity of Avatars and Autonomous Agents in Virtual Reality

Advances in display, computing and sensor technologies have led to a revival of interest and excitement surrounding immersive virtual reality. Here, on the cusp of the arrival of practical and affordable virtual reality technology, are open questions regarding the factors that contribute to compelling and immersive virtual worlds. In order for virtual reality to be useful as a tool for use in training, education, communication, research, content-creation and entertainment, we must understand the degree to which the perception of the virtual environment and virtual characters resembles perception of the real world. Relatedly, virtual reality\u27s utility in these contexts demands evidence that goal-directed behaviors and interpersonal interactions in virtual reality mimic real-world actions and that learning in one domain transfers to the other. In particular, providing the virtual reality user with a compelling sense of self and co-presence with virtual others has implications not just for creating convincing social environments but even for conveying the intended sense of scale and space in virtual environments. This presentation discusses the importance and challenges involved in creating and depicting interactive avatars representing both human and computer-controlled agents. Special attention will be paid to the use of computer-controlled avatars to both investigate interpersonal processes and behaviors and to improve the fidelity and naturalism of these autonomous agents. Biographical sketch: Benjamin R. Kunz received his Ph.D. in Cognitive Psychology from the University of Utah in 2010. He is now an assistant professor in the Department of Psychology at the University of Dayton with research interests in visual-spatial perception and action in real and virtual environments, embodied cognition and the body schema, and social influences on spatial cognition

Presence In Virtuality \u3e Reality | Review & Commentary

Presence In Virtuality \u3e Reality | Review & Commentary Meyers, M., & Sonnenfeld, A. Presentation It has been demonstrated in previous literature that participants may feel more present in virtuality than in reality. Why is this? Our team of researchers propose that this phenomenon neither suggest invalidity in both objective and subjective presence measurement - nor invalidity of the construct itself. Presence, as the experience of being in an environment, is refined in our review from insight gained from three psychological schools of thought which have conflicted for over twenty years. Just as our definitions of presence evolved over the last two decades, however - so have we as a society. If individuals are capable of experiencing a heightened sense of present in virtuality than reality, then we must understand what the root cause of this contradiction is - and discuss the implications of such a phenomena for our own experiences in the real world. What does it mean to experience an environment – to feel present – and how do we measure this phenomenon? What could cause individuals, both in the present and future, to feel more present in a virtual world than a real one? To what extent have our virtual interactions taken precedence over our daily interactions? Does our embodied presence impact our lives more so than our physical presence? How can we – living in reality – design our experiences to match the involvement and immersion afforded by computer interfaces and virtual environments? The researchers attempt to answer these questions using the support of previous research in this domain – combining the perspectives of human factors and applied psychological research, human-computer interaction, business (via experiential design), and philosophy. The researchers identify what elements of virtuality make it more appealing to the experience of the individual than reality, propose design solutions for our experience in reality, and outline a foundation for future research. Without continued investigation with support of the scientific community, modern society may remain unguided – perpetuating toward a future in which it will be impossible to feel present in reality, when virtual alternatives are both just as easily accessible and significant

Evaluation of Media-Based Social Interactions in Virtual Environments

The evaluation of users’ experiences in virtual environments is an important task for researchers in the fields of human-computer interaction and extended reality. It can be used to understand and enhance the quality of users’ mediated interactions and communications. In a constantly evolving world, where people are growing with technology, it is important to understand, evaluate and enhance the use of immersive media. In the research agenda of this Ph.D. thesis, the challenge of developing multi-user experiences in virtual environments and setting evaluation metrics for researchers are considered. This Ph.D. thesis showcases an interest in how to enhance trust formation in media-based social environments. The findings of this Ph.D. are expected to help create new open-source tools to facilitate the understanding of individuals and groups in extended reality applications

Hidden Markov Model Deep Learning Architecture for Virtual Reality Assessment to Compute Human–Machine Interaction-Based Optimization Model

Virtual Reality (VR) is a technology that immerses users in a simulated, computer-generated environment. It creates a sense of presence, allowing individuals to interact with and experience virtual worlds. Human-Machine Interaction (HMI) refers to the communication and interaction between humans and machines. Optimization plays a crucial role in Virtual Reality (VR) and Human-Machine Interaction (HMI) to enhance the overall user experience and system performance. This paper proposed an architecture of the Hidden Markov Model with  Grey Relational Analysis (GRA) integrated with Salp Swarm Algorithm (SSA) for the automated Human-Machine Interaction. The proposed architecture is stated as a Hidden Markov model Grey Relational Salp Swarm (HMM_ GRSS). The proposed HMM_GRSS model estimates the feature vector of the variables in the virtual reality platform and compute the feature spaces. The HMM_GRSS architecture aims to estimate the feature vector of variables within the VR platform and compute the feature spaces. Hidden Markov Models are used to model the temporal behavior and dynamics of the system, allowing for predictions and understanding of the interactions. Grey Relational Analysis is employed to evaluate the relationship and relevance between variables, aiding in feature selection and optimization. The SSA helps optimize the feature spaces by simulating the collective behavior of salp swarms, improving the efficiency and effectiveness of the HMI system. The proposed HMM_GRSS architecture aims to enhance the automated HMI process in a VR platform, allowing for improved interaction and communication between humans and machines. Simulation analysis provides a significant outcome for the proposed HMM_GRSS model for the estimation Human-Machine Interaction

Cross-benefits between virtual reality and games

electronic version (8 pp.)International audienceIn one hand, video games are dedicated to entertainment. In recent years, the emerging of consumers hardware dedicated to games induced great progress for realism and gameplay. Graphics rendering and physical engines, digital surround sound and new interaction interfaces are examples of areas which have benefited of these last improvements and widely contribute to the gaming experience. In another hand, virtual reality focus on user's presence which is its indubitable feeling of belonging to the virtual environment. As this goal is very hard to reach, studies have to focus on human through several research directions like immersion (3D vision, sound spatialization, haptic devices) and interaction which has to be as natural and non intrusive as possible. Recent researches on intersensoriality possibilities, metaphorical interactions or brain computer interfaces are examples of what would be achieved in immersion and interaction. At this point, we can argue that virtual reality can be a provider of new methods and resources for games. Unfortunately virtual reality room are expensive and difficult to deploy, what is probably the main reasons why virtual reality is still a laboratory experiment or confined to industrial simulator. Here is our double contribution : to combine video games and virtual reality through two different virtual reality game solutions and to design them with consumer grade components. This paper first presents a survey of both current video game evolutions and virtual reality researches. We will also give some examples of cross-benefits between video games and virtual reality. To illustrate this last point we will describe two virtual reality applications created by our research team and dedicated to gaming. Finally, as a prospective talk we will deal with three points : some recent virtual reality systems supposedly applicable to home gaming, some good points from DG that VR developers should incorporate in VR systems and last point, some lines of enquiry so that the union between VR and DG be at last consummate

Enabling natural interaction for virtual reality

This research focuses on the exploration of software and methods to support natural interaction within a virtual environment. Natural interaction refers to the ability of the technology to support human interactions with computer generated simulations that most accurately reflect interactions with real objects. Over the years since the invention of computer-aided design tools, computers have become ubiquitous in the product design process. Increasingly, engineers and designers are using immersive virtual reality to evaluate virtual products throughout the entire design process. The goal of this research is to develop tools that support verisimilitude, or likeness to reality, particularly with respect to human interaction with virtual objects. Increasing the verisimilitude of the interactions and experiences in a virtual environment has the potential to increase the external validity of such data, resulting in more reliable decisions and better products. First, interface software is presented that extends the potential reach of virtual reality to include low-cost, consumer-grade motion sensing devices, thus enabling virtual reality on a broader scale. Second, a software platform, VR JuggLua, is developed to enable rapid and iterative creation of natural interactions in virtual environments, including by end-user programmers. Based on this software platform, the focus of the rest of the research is on supporting virtual assembly and decision making. The SPARTA software incorporates a powerful physically-based modeling simulation engine tuned for haptic interaction. The workspace of a haptic device is both virtually expanded, though an extension to the bubble technique, and physically expanded, through integration of a haptic device with a multi-directional mobile platform. Finally, a class of hybrid methods for haptic collision detection and response is characterized in terms of five independent tasks. One such novel hybrid method, which selectively restores degrees of freedom in haptic assembly, is developed and assessed with respect to low-clearance CAD assembly. It successfully maintains the high 1000 Hz update rate required for stable haptics unlike previous related approaches. Overall, this work forms a pattern of contributions towards enabling natural interaction for virtual reality and advances the ability to use an immersive environment in decision making during product design