Agent Behaviour Simulator (ABS):a platform for urban behaviour development

Computer Graphics have become important for many applicationsand the quality of the produced images have greatly improved. Oneof the interesting remaining problems is the representation of densedynamic environments such as populated cities. Although recentlywe saw some successfulwork on the rendering such environments,the real?time simulation of virtual cities populated by thousands ofintelligent animated agents is still very challenging.In this paperwe describe a platformthat aims to accelerate the developmentof agent behaviours. The platform makes it easy to enterlocal rules and callbacks which govern the individual behaviours.It automatically performs the routine tasks such as collision detectionallowing the user to concentrate on defining the more involvedtasks. The platform is based on a 2D-grid with a four-layered structure.The two first layers are used to compute the collision detectionagainst the environment and other agents and the last two are usedfor more complex behaviours.A set of visualisation tools is incorporated that allows the testingof the real?time simulation. The choices made for the visualisationallow the user to better understand the way agents move inside theworld and how they take decisions, so that the user can evaluate ifit simulates the expected behaviour.Experimentation with the system has shown that behaviours inenvironments with thousands of agents can be developed and visualisedin effortlessly

Real-Time Global Illumination for VR Applications

Real-time global illumination in VR systems enhances scene realism by incorporating soft shadows, reflections of objects in the scene, and color bleeding. The Virtual Light Field (VLF) method enables real-time global illumination rendering in VR. The VLF has been integrated with the Extreme VR system for realtime GPU-based rendering in a Cave Automatic Virtual Environment

Participatory Design and Evaluation of a Real-World Virtual Environment for Architecture and Urban Planning

In this report we present a participatory design approach to the development of a VE, with an iterative, user-informed process throughout the entire design and development cycle. A preliminary survey was first undertaken with end-users, i.e., architects, chief engineers and decision makers of a real-world urban planning project, followed by a study of the traditional workflow employed. We then determined the elements required to make the VE useful in the real-world setting, choosing appropriate elements (image-based textures for facades, realistic vegetation, shadows, 3D sound and crowds) to develop a rich and audiovisually realistic VE. Our participatory design approach guided the development of an appropriate interface and an evaluation methodology to test the overall usability of the system. The VE was evaluated both in the laboratory and in the users' natural work environments. The results suggest that participatory design can help ensure that the VE will meet the practical needs of its end-users; that appropriately chosen multiple views of the scene are useful in urban planning, and that the realism enhancements introduced increase the effectiveness of VEs for the chosen context

Acting rehearsal in collaborative multimodal mixed reality environments

This paper presents the use of our multimodal mixed reality telecommunication system to support remote acting rehearsal. The rehearsals involved two actors, located in London and Barcelona, and a director in another location in London. This triadic audiovisual telecommunication was performed in a spatial and multimodal collaborative mixed reality environment based on the 'destination-visitor' paradigm, which we define and put into use. We detail our heterogeneous system architecture, which spans the three distributed and technologically asymmetric sites, and features a range of capture, display, and transmission technologies. The actors' and director's experience of rehearsing a scene via the system are then discussed, exploring successes and failures of this heterogeneous form of telecollaboration. Overall, the common spatial frame of reference presented by the system to all parties was highly conducive to theatrical acting and directing, allowing blocking, gross gesture, and unambiguous instruction to be issued. The relative inexpressivity of the actors' embodiments was identified as the central limitation of the telecommunication, meaning that moments relying on performing and reacting to consequential facial expression and subtle gesture were less successful

Decreased corticospinal excitability after the illusion of missing part of the arm

Previous studies on body ownership illusions have shown that under certain multimodal conditions, healthy people can experience artificial body-parts as if they were part of their own body, with direct physiological consequences for the real limb that gets ‘substituted.' In this study we wanted to assess (a) whether healthy people can experience ‘missing’ a body-part through illusory ownership of an amputated virtual body, and (b) whether this would cause corticospinal excitability changes in muscles associated with the ‘missing’ body-part. Forty right-handed participants saw a virtual body from a first person perspective but for half of them the virtual body was missing a part of its right arm. Single pulse transcranial magnetic stimulation was applied before and after the experiment to left and right motor cortices. Motor evoked potentials (MEPs) were recorded from the first dorsal interosseous (FDI) and the extensor digitorum communis (EDC) of each hand. We found that the stronger the illusion of amputation and arm ownership, the more the reduction of MEP amplitudes of the EDC muscle for the contralateral sensorimotor cortex. In contrast, no association was found for the EDC amplitudes in the ipsilateral cortex and for the FDI amplitudes in both contralateral and ipsilateral cortices. Our study provides evidence that a short-term illusory perception of missing a body-part can trigger inhibitory effects on corticospinal pathways and importantly in the absence of any limb deafferentation or disuse

Multisensory Stimulation Can Induce an Illusion of Larger Belly Size in Immersive Virtual Reality

Background: Body change illusions have been of great interest in recent years for the understanding of how the brain represents the body. Appropriate multisensory stimulation can induce an illusion of ownership over a rubber or virtual arm, simple types of out-of-the-body experiences, and even ownership with respect to an alternate whole body. Here we use immersive virtual reality to investigate whether the illusion of a dramatic increase in belly size can be induced in males through (a) first person perspective position (b) synchronous visual-motor correlation between real and virtual arm movements, and (c) self-induced synchronous visual-tactile stimulation in the stomach area.Methodology: Twenty two participants entered into a virtual reality (VR) delivered through a stereo head-tracked wide field-of-view head-mounted display. They saw from a first person perspective a virtual body substituting their own that had an inflated belly. For four minutes they repeatedly prodded their real belly with a rod that had a virtual counterpart that they saw in the VR. There was a synchronous condition where their prodding movements were synchronous with what they felt and saw and an asynchronous condition where this was not the case. The experiment was repeated twice for each participant in counter-balanced order. Responses were measured by questionnaire, and also a comparison of before and after self-estimates of belly size produced by direct visual manipulation of the virtual body seen from the first person perspective.Conclusions: The results show that first person perspective of a virtual body that substitutes for the own body in virtual reality, together with synchronous multisensory stimulation can temporarily produce changes in body representation towards the larger belly size. This was demonstrated by (a) questionnaire results, (b) the difference between the self-estimated belly size, judged from a first person perspective, after and before the experimental manipulation, and (c) significant positive correlations between these two measures. We discuss this result in the general context of body ownership illusions, and suggest applications including treatment for body size distortion illnesses

An image-based approach to the rendering of crowds in real time

EThOS - Electronic Theses Online ServiceGBUnited Kingdo

Remote Tele-assistance System for Maintenance Operators in Mines

Complex technologies such as fully automated and semi-automated equipment and teleoperated machines are being introduced to improve productivity in mines. Consequently, the maintenance and operation of these complex machines is becoming an issue. There is a growing interest in industry in the use and development of technologies to support the collaboration between a local worker and a remote helper to deliver expertise to guide the local worker in undertaking maintenance and other activities. The productivity of the future mine relies on the effective delivery, of remote guidance. ReMoTe (Remote Mobile Tele-assistance), a mobile augmented reality system for remote guiding, has been developed at CSIRO as part of the work in the Transforming the Future Mine Theme