Combining virtual reality enabled simulation with 3D scanning technologies towards smart manufacturing

Recent introduction of low-cost 3D sensing and affordable immersive virtual reality have lowered the barriers for creating and maintaining 3D virtual worlds. In this paper, we propose a way to combine these technologies with discrete-event simulation to improve the use of simulation in decision making in manufacturing. This work will describe how feedback is possible from real world systems directly into a simulation model to guide smart behaviors. Technologies included in the research include feedback from RGBD images of shop floor motion and human interaction within full immersive virtual reality that includes the latest headset technologies

Immersion and interaction: Creating virtual 3d worlds for stage performances

This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel University.This thesis formulates an approach towards the creation of a gesture activated and body movement controlled real time virtual 3d world in a dance performance context. It investigates immersion and navigation techniques derived from modern video games and methodologies and proposes how they can be used to further involve a performer into a virtual space as well as simultaneously offer a stimulating visual spectacle for an audience. The argument presented develops through practice-based methodology and artistic production strategies in interdisciplinary and collaborative contexts. Two choreographic performance/installations are used as cases studies to demonstrate in practice the proposed methodologies. First, the interactive dance work Suna No Onna, created in collaboration with Birringer/Danjoux and the Dap Lab, investigates the use of interactive pre-rendered animations in a real time setting and in real time by incorporating wearable sensors in the performance. Secondly, the potentials offered by the sensor technology and real time rendering engines led to the “creation scene", a key scene in the choreographic installation UKIYO (Moveable Worlds). This thesis investigates the design, creation and interaction qualities of virtual 3d spaces by exploring the potentialities offered by a shared space, between an intelligent space and a dancer in a hybrid world. The methodology applied uses as a theoretical base the phenomenological approach of Merleau-Ponty and Mark Hansen‟s mixed reality paradigm proposing the concept of the “space schema", a system which replicates and embeds proprioception, perception and motility into the space fabric offering a world which “lives”, functions and interacts with the performer. The outcome of the research is the generation of an interactive, non-linear, randomized 3d virtual space that collaborates with a technologically embedded performer in creating a 3d world which evolves and transforms, driven by the performer‟s intention and agency. This research contributes to the field of interactive performance art by making transparent the methodology, the instruments and the code used, in a non-technical terminology, making it accessible for both team members with less technological expertise as well as artists aspiring to engage interactive 3d media promoting further experimentation and conceptual discussions

A Sensor-Based Interactive Digital Installation System for Virtual Painting Using MAX/MSP/Jitter

Interactive art is rapidly becoming a part of cosmopolitan society through public displays, video games, and art exhibits. It is a means of exploring the connections between our physical bodies and the virtual world. However, a sense of disconnection often exists between the users and technology because users are driving actions within an environment from which they are physically separated. This research involves the creation of a custom interactive, immersive, and real-time video-based mark-making installation as public art. Using a variety of input devices including video cameras, sensors, and special lighting, a painterly mark-making experience is contemporized, enabling the participant to immerse himself in a world he helps create. This work illustrates the potential of making the user-technology disconnection more seamless between the physical and virtual worlds. Using unobtrusive interfaces, the user?s physical interactions can be encouraged. The development of this installation progressed through improvements based on user feedback from iterative public displays of the work. This process is to serve as a guideline for other artists working in interactive media who are also exploring perceived intimacy in user interactions

+SPACES: Serious Games for Role-Playing Government Policies

The paper explores how role-play simulations can be used to support policy discussion and refinement in virtual worlds. Although the work described is set primarily within the context of policy formulation for government, the lessons learnt are applicable to online learning and collaboration within virtual environments. The paper describes how the +Spaces project is using both 2D and 3D virtual spaces to engage with citizens to explore issues relevant to new government policies. It also focuses on the most challenging part of the project, which is to provide environments that can simulate some of the complexities of real life. Some examples of different approaches to simulation in virtual spaces are provided and the issues associated with them are further examined. We conclude that the use of role-play simulations seem to offer the most benefits in terms of providing a generalizable framework for citizens to engage with real issues arising from future policy decisions. Role-plays have also been shown to be a useful tool for engaging learners in the complexities of real-world issues, often generating insights which would not be possible using more conventional techniques

Visual communication in urban planning and urban design

This report documents the current status of visual communication in urban design and planning. Visual communication is examined through discussion of standalone and network media, specifically concentrating on visualisation on the World Wide Web(WWW).Firstly, we examine the use of Solid and Geometric Modelling for visualising urban planning and urban design. This report documents and compares examples of the use of Virtual Reality Modelling Language (VRML) and proprietary WWW based Virtual Reality modelling software. Examples include the modelling of Bath and Glasgow using both VRML 1.0 and 2.0. A review is carried out on the use of Virtual Worldsand their role in visualising urban form within multi-user environments. The use of Virtual Worlds is developed into a case study of the possibilities and limitations of Virtual Internet Design Arenas (ViDAs), an initiative undertaken at the Centre for Advanced Spatial Analysis, University College London. The use of Virtual Worlds and their development towards ViDAs is seen as one of the most important developments in visual communication for urban planning and urban design since the development plan.Secondly, photorealistic media in the process of communicating plans is examined.The process of creating photorealistic media is documented, examples of the Virtual Streetscape and Wired Whitehall Virtual Urban Interface System are provided. The conclusion is drawn that although the use of photo-realistic media on the WWW provides a way to visually communicate planning information, its use is limited. The merging of photorealistic media and solid geometric modelling is reviewed in the creation of Augmented Reality. Augmented Reality is seen to provide an important step forward in the ability to quickly and easily visualise urban planning and urban design information.Thirdly, the role of visual communication of planning data through GIS is examined interms of desktop, three dimensional and Internet based GIS systems. The evolution to Internet GIS is seen as a critical component in the development of virtual cities which will allow urban planners and urban designers to visualise and model the complexity of the built environment in networked virtual reality.Finally a viewpoint is put forward of the Virtual City, linking Internet GIS with photorealistic multi-user Virtual Worlds. At present there are constraints on how far virtual cities can be developed, but a view is provided on how these networked virtual worlds are developing to aid visual communication in urban planning and urban design

Serious Games in Cultural Heritage

Although the widespread use of gaming for leisure purposes has been well documented, the use of games to support cultural heritage purposes, such as historical teaching and learning, or for enhancing museum visits, has been less well considered. The state-of-the-art in serious game technology is identical to that of the state-of-the-art in entertainment games technology. As a result the field of serious heritage games concerns itself with recent advances in computer games, real-time computer graphics, virtual and augmented reality and artificial intelligence. On the other hand, the main strengths of serious gaming applications may be generalised as being in the areas of communication, visual expression of information, collaboration mechanisms, interactivity and entertainment. In this report, we will focus on the state-of-the-art with respect to the theories, methods and technologies used in serious heritage games. We provide an overview of existing literature of relevance to the domain, discuss the strengths and weaknesses of the described methods and point out unsolved problems and challenges. In addition, several case studies illustrating the application of methods and technologies used in cultural heritage are presented

Education Unleashed: Participatory Culture, Education, and Innovation in Second Life

Part of the Volume on the Ecology of Games: Connecting Youth, Games, and LearningWhile virtual worlds share common technologies and audiences with games, they possess many unique characteristics. Particularly when compared to massively multiplayer online role-playing games, virtual worlds create very different learning and teaching opportunities through markets, creation, and connections to the real world, and lack of overt game goals. This chapter aims to expose a wide audience to the breadth and depth of learning occurring within Second Life (SL). From in-world classes in the scripting language to mixed-reality conferences about the future of broadcasting, a tremendous variety of both amateurs and experts are leveraging SL as a platform for education. In one sense, this isn't new since every technology is co-opted by communities for communication, but SL is different because every aspect of it was designed to encourage this co-opting, this remixing of the virtual and the real

3D virtual worlds as environments for literacy learning

Background: Although much has been written about the ways in which new technology might transform educational practice, particularly in the area of literacy learning, there is relatively little empirical work that explores the possibilities and problems - or even what such a transformation might look like in the classroom. 3D virtual worlds offer a range of opportunities for children to use digital literacies in school, and suggest one way in which we might explore changing literacy practices in a playful, yet meaningful context. Purpose: This paper identifies some of the key issues that emerged in designing and implementing virtual world work in a small number of primary schools in the UK. It examines the tensions between different discourses about literacy and literacy learning and shows how these were played out by teachers and pupils in classroom settings.Sources of evidence: Case study data are used as a basis for exploring and illustrating key aspects of design and implementation. The case study material includes views from a number of perspectives including classroom observations, chatlogs, in-world avatar interviews with teachers and also pupils, as well as the author’s field notes of the planning process with accompanying minutes and meeting documents.Main argument: From a Foucauldian perspective, the article suggests that social control of pedagogical practice through the regulation of curriculum time, the normalisation of teaching routines and the regimes of individual assessment restricts teachers’ and pupils’ conceptions of what constitutes literacy. The counternarrative, found in recent work in new litearcies (Lankshear & Knobel, 2006) provides an attractive alternative, but a movement in this direction requires a fundamental shift of emphasis and a re-conceptualisation of what counts as learning.Conclusions: This work on 3D virtual worlds questions the notion of how transformative practice can be achieved with the use of new technologies. It suggests that changes in teacher preparation, continuing professional development as well as wider educational reform may be needed