Exploitation of multiplayer interaction and development of virtual puppetry storytelling using gesture control and stereoscopic devices

With the rapid development of human-computer interaction technologies, the new media generation demands novel learning experiences with natural interaction and immersive experience. Considering that digital storytelling is a powerful pedagogical tool for young children, in this paper, we design an immersive storytelling environment that allows multiple players to use naturally interactive hand gestures to manipulate virtual puppetry for assisting narration. A set of multimodal interaction techniques is presented for a hybrid user interface that integrates existing 3D visualization and interaction devices including head-mounted displays and depth motion sensor. In this system, the young players could intuitively use hand gestures to manipulate virtual puppets to perform a story and interact with props in a virtual stereoscopic environment. We have conducted a user experiment with four young children for pedagogical evaluation, as well as system acceptability and interactivity evaluation by postgraduate students. The results show that our framework has great potential to stimulate learning abilities of young children through collaboration tasks. The stereoscopic head-mounted display outperformed the traditional monoscopic display in a comparison between the two

Development of a Collaborative Design Tool for Structural Analysis in an Immersive Virtual Environment

This paper contains the results of an on-going collaborative research effort by the departments of Architecture and Computer Science of Virginia Polytechnic Institute and State University, U.S.A., to develop a computer visualization application for the structural analysis of building structures. The VIRTUAL-SAP computer program is being developed by linking PC-SAP4 (Structural Analysis Program), and virtual environment software developed using the SVE (Simple Virtual Environment) library. VIRTUAL-SAP is intended for use as a collaborative design tool to facilitate the interaction between the architect, engineer, and contractor by providing an environment that they can walk-through and observe the consequences of design alterations. Therefore, this software can be used as an interactive computer-aided analysis of building systems

Traditional museums, virtual museums. Dissemination role of ICTs.

Molti spazi della cultura, che si configurano come musei di sé stessi, presentano al loro interno pochi reperti esposti. È il caso di musei in edifici o aree archeologiche di seconda fascia, dai quali la maggior parte dei reperti è stata spostata in musei di importanza superiore o dove i reperti sono stati rimossi per diverse esigenze organizzative/espositive. In queste situazioni le ICT permettono di sviluppare un efficace sistema di comunicazione e disseminazione, coinvolgendo i visitatori e gli studiosi mediante l’utilizzo di procedure collegate all’Edutainment, all’interactive ed immersive experience, ai serious games e alla gamification. Come caso studio sono presi il Museo delle Mura, come museo in un edificio, e la Villa di Massenzio, come area archeologica, entrambi collocati sulla Via Appia Antica a Roma. Le esigenze della Sovrintendenza sono di valorizzare e divulgare: - la presenza del Museo, collocato in una delle numerose porte romane ancora ben conservate e site nel giro delle Mura Aureliane; - la storia della porta e del breve tratto di mura ad essa connesse; - la storia e l’articolazione delle mura di Roma. Per la Villa di Massenzio l’obiettivo principale è far comprendere la storia e la funzione delle due strutture (il circo ed il Mausoleo di Romolo), oggi visibili e visitabili, garantendo una maggiore comprensione di un’area di circa 4 ettari, in cui i visitatori oggi possono beneficiare solo di alcuni pannelli informativi.Many cultural spaces, which have been transformed into museums contain very few exhibits. In particular, museums in buildings or second-tier archaeological areas, where most of the finds have been moved to museums of major importance or exhibits that have been removed for different organizational/exhibition needs. In these situations, the use of ICT affords the possibility to incorporate effective communication and dissemination systems. As a result, it involves visitors and scholars within the exhibit using procedures related to edutainment, interactive and immersive experiences, serious games and gamification. As a case study are taken the Museum of the Walls, as a museum in building, and the archaeological area of the Maxentius archaeological complex, as an open-air museum, both located on the Ancient Appia road. In the Museum of the Walls Superintendent's requirements are to enhance and disseminate: - the presence of the Museum, located in one of the many well-preserved Roman city gates located in the Aurelian Walls; - the history of the city gate and of the short section of walls connected to it; - the history and articulation of the walls of Rome. In the Maxentius archaeological the main goal is to make understand the history and the function of the two main structures (the circus and a Mausoleum of Romulus), which are visible and open to visitors, ensuring a greater understanding of an area with the size of about 4 hectares, where visitors today can only benefit information from some panels

Computer game technology, collaborative software environments and participatory design

This paper presents a project that explores the possibilities for the use of computer game technologies in the participatory design process. Interactive 3D environments designed with the Virtools development environment were used in a Home Zone consultation process, which allowed participants to navigate, explore and contribute to proposed developments to their residential environment. These technologies were observed to benefit the participatory design process in some areas, namely the visualization and contextualizing of the developments, but also presented traditional technological barriers in others. While these barriers did not completely remove the participants from the process, they reduced the apparent level of engagement of these participants with the process. This paper concludes that the technology overall, is a positive addition to the participatory design process, and while there is still much research to be undertaken, it has many more potential applications in related areas

Interactive Narrative in Virtual Reality

Interactive fiction is a literary genre that is rapidly gaining popularity. In this genre, readers are able to explicitly take actions in order to guide the course of the story. With the recent popularity of narrative focused games, we propose to design and develop an interactive narrative tool for content creators. In this extended abstract, we show how we leverage this interactive medium to present a tool for interactive storytelling in virtual reality. Using a simple markup language, content creators and researchers are now able to create interactive narratives in a virtual reality environment. We further discuss the potential future directions for a virtual reality storytelling engine

Teaching programming at a distance: the Internet software visualization laboratory

This paper describes recent developments in our approach to teaching computer programming in the context of a part-time Masters course taught at a distance. Within our course, students are sent a pack which contains integrated text, software and video course material, using a uniform graphical representation to tell a consistent story of how the programming language works. The students communicate with their tutors over the phone and through surface mail. Through our empirical studies and experience teaching the course we have identified four current problems: (i) students' difficulty mapping between the graphical representations used in the course and the programs to which they relate, (ii) the lack of a conversational context for tutor help provided over the telephone, (iii) helping students who due to their other commitments tend to study at 'unsociable' hours, and (iv) providing software for the constantly changing and expanding range of platforms and operating systems used by students. We hope to alleviate these problems through our Internet Software Visualization Laboratory (ISVL), which supports individual exploration, and both synchronous and asynchronous communication. As a single user, students are aided by the extra mappings provided between the graphical representations used in the course and their computer programs, overcoming the problems of the original notation. ISVL can also be used as a synchronous communication medium whereby one of the users (generally the tutor) can provide an annotated demonstration of a program and its execution, a far richer alternative to technical discussions over the telephone. Finally, ISVL can be used to support asynchronous communication, helping students who work at unsociable hours by allowing the tutor to prepare short educational movies for them to view when convenient. The ISVL environment runs on a conventional web browser and is therefore platform independent, has modest hardware and bandwidth requirements, and is easy to distribute and maintain. Our planned experiments with ISVL will allow us to investigate ways in which new technology can be most appropriately applied in the service of distance education

Diversity in virtual reality landscape modelling

This paper examines the range of decisions that landscape architects need to consider in communicating the future of the landscape. The objective of this research paper was to investigate the issues affecting the landscape modelling process. It also aimed to provide a better understanding of the creators of landscape visualisations and the role they play in determining what audiences, often from many disciplines, see and debate. Interviews were conducted to gather ideas from practice and academia. The paper acknowledges that this was a limited exploration with the intention of establishing a base for a further study. Issues relating to the diversity of audiences, diversity of interpretation, appropriate levels of representation and representing the passage of time in VR models and technologies currently available for VR modelling were the focus of the interviews