Towards Communicating Agents and Avatars in Virtual Worlds

We report about ongoing research in a virtual reality environment where visitors can interact with agents that help them to obtain information, to perform certain transactions and to collaborate with them in order to get some tasks done. In addition, in a multi-user version of the system visitors can chat with each other. Our environment is a laboratory for research and for experiments with users interacting with agents in multimodal ways, referring to visualized information and making use of knowledge possessed by domain agents, but also by agents that represent other visitors of this environment. We discuss standards that are under development for designing such environments. Our environment models a local theatre in our hometown. We discuss our attempts to let this environment evolve into a theatre community where we do not only have goal-directed visitors buying tickets, but also visitors that that are not yet sure whether they want to buy or just want information or visitors who just want to look around, talk with others, etc. It is shown that we need a multi-user and multi-agent environment to realize our goals and that we need to have a unifying framework in order to be able to introduce and maintain different agents and user avatars with different abilities, including intellectual, interaction and animation abilities

Shared task proposal: Instruction giving in virtual worlds

This paper reports on the results of the working group “Virtual Environ-ments ” at the Workshop on Shared Tasks and Comparative Evaluation for NLG. This working group discussed the use of virtual environments as a platform for NLG evaluation, and more specifically of the generation of in

Specification Techniques for Multi-Modal Dialogues in the U-Wish Project

In this paper we describe the development of a specification\ud technique for specifying interactive web-based services. We\ud wanted to design a language that can be a means of\ud communication between designers and developers of interactive services, that makes it easier to develop web-based services fitted to the users and that shortens the pathway from design to implementation. The language, still under development, is based on process algebra and can be\ud connected to the results of task analysis. We have been\ud working on the automatic generation of executable prototypes\ud out of the specifications. In this way the specification\ud language can establish a connection between users, design\ud and implementation. A first version of this language is\ud available as well as prototype tools for executing the specifications. Ideas will be given as to how to make the connection between specifications and task analysis

Supporting Computer-supported collaborative work (CSCW) in conceptual design

In order to gain a better understanding of online conceptual collaborative design processes this paper investigates how student designers make use of a shared virtual synchronous environment when engaged in conceptual design. The software enables users to talk to each other and share sketches when they are remotely located. The paper describes a novel methodology for observing and analysing collaborative design processes by adapting the concepts of grounded theory. Rather than concentrating on narrow aspects of the final artefacts, emerging “themes” are generated that provide a broader picture of collaborative design process and context descriptions. Findings on the themes of “grounding – mutual understanding” and “support creativity” complement findings from other research, while important themes associated with “near-synchrony” have not been emphasised in other research. From the study, a series of design recommendations are made for the development of tools to support online computer-supported collaborative work in design using a shared virtual environment

Moving between virtual and real worlds: second language learning through massively multiplayer online role playing games (MMORPGs)

Massively Multiplayer Online Role Playing Games (MMORPGs) bring players together in a large virtual community. This type of online gaming can serve many purposes such as entertainment, social interaction, information exchange and education and is now an integral part of many people's lives particularly the younger generation. This research study investigates the use of openly available MMORPGs to supplement second language teaching for higher education students. MMORPGs provide informal virtual worlds in which students can communicate in their second language with people from across the globe. The research approach combines ethnography and action research in the virtual and real worlds. In the real world the researcher observes the interaction with the MMORPGs by the students both through their informal discussion in the classroom and through screen video captures of their game play in the MMORPG. In addition the researcher takes on the role of a character within the MMORPG allowing for observation inside the virtual world from the viewpoint of another game character. Through action research, the researcher observes, plans and then interacts with the students' MMORPG characters within the game. This enables the researcher to provide anonymous but tailored support to the students including advice on the game play, a confidence boost where needed, a friendly face where needed and some support around language issues. In the real world, action research is also used to provide tutorial exercises and discussions based on the students' experiences with the MMORPG, facilitating further enhancement opportunities for their language development. This paper concludes that MMORPGs provide a safe, relaxed and engaging environment in which students can practice and improve their language skills

Sketch-Based Interfaces to Support Collaborative Conceptual Design Learning

In order to gain a better understanding of online collaborative conceptual design processes this paper investigates how student designers make use of Lyceum, a shared virtual synchronous environment when engaged in conceptual design. The software enables users to talk to each other and share sketches when they are remotely located. The paper describes a novel methodology for observing and analysing collaborative design processes by adapting the concepts of grounded theory. Rather than concentrating on narrow aspects of the final artefacts, emerging 'themes' are generated that provide a broader picture of collaborative design process and context descriptions. Findings on the themes of 'grounding – mutual understanding' and 'support creativity' complement findings from other research, while important themes associated with 'near-synchrony' have not been emphasised in other research. From the study, a series of design recommendations are made for the development of tools to support online computer-supported collaborative work in design using a shared virtual environment