Multimodal augmented reality tangible gaming

This paper presents tangible augmented reality gaming environment that can be used to enhance entertainment using a multimodal tracking interface. Players can interact using different combinations between a pinch glove, a Wiimote, a six-degrees-of-freedom tracker, through tangible ways as well as through I/O controls. Two tabletop augmented reality games have been designed and implemented including a racing game and a pile game. The goal of the augmented reality racing game is to start the car and move around the track without colliding with either the wall or the objects that exist in the gaming arena. Initial evaluation results showed that multimodal-based interaction games can be beneficial in gaming. Based on these results, an augmented reality pile game was implemented with goal of completing a circuit of pipes (from a starting point to an end point on a grid). Initial evaluation showed that tangible interaction is preferred to keyboard interaction and that tangible games are much more enjoyable

A pervasive augmented reality serious game

This paper presents a pervasive augmented reality serious game that can be used to enhance entertainment using a multimodal tracking interface. The main objective of the research is to design and implement generic pervasive interfaces that are user-friendly and can be used by a wide range of users including people with disabilities. A pervasive AR racing game has been designed and implemented. The goal of the game is to start the car and move around the track without colliding with either the wall or the objects that exist in the gaming arena. Users can interact using a pinch glove, a Wiimote, through tangible ways as well as through I/O controls of the UMPC. Initial evaluation results showed that multimodal-based interaction games can be beneficial in serious games

Using gaming paratexts in the literacy classroom

This paper illustrates how digital game paratexts may effectively be used in the high school English to meet a variety of traditional and multimodal literacy outcomes. Paratexts are texts that refer to digital gaming and game cultures, and using them in the classroom enables practitioners to focus on and valorise the considerable literacies and skills that young people develop and deploy in their engagement with digital gaming and game cultures. The effectiveness of valorizing paratexts in this manner is demonstrated through two examples of assessment by students in classes where teachers had designed curriculum and assessment activities using paratexts

Investigation of dynamic three-dimensional tangible touchscreens: Usability and feasibility

The ability for touchscreen controls to move from two physical dimensions to three dimensions may soon be possible. Though solutions exist for enhanced tactile touchscreen interaction using vibrotactile devices, no definitive commercial solution yet exists for providing real, physical shape to the virtual buttons on a touchscreen display. Of the many next steps in interface technology, this paper concentrates on the path leading to tangible, dynamic, touchscreen surfaces. An experiment was performed that explores the usage differences between a flat surface touchscreen and one augmented with raised surface controls. The results were mixed. The combination of tactile-visual modalities had a negative effect on task completion time when visual attention was focused on a single task (single target task time increased by 8% and the serial target task time increased by 6%). On the other hand, the dual modality had a positive effect on error rate when visual attention was divided between two tasks (the serial target error rate decreased by 50%). In addition to the experiment, this study also investigated the feasibility of creating a dynamic, three dimensional, tangible touchscreen. A new interface solution may be possible by inverting the traditional touchscreen architecture and integrating emerging technologies such as organic light emitting diode (OLED) displays and electrorheological fluid based tactile pins

Exploring Oculus Rift: A Historical Analysis of the ‘Virtual Reality’ Paradigm

This paper will first provide background information about Virtual Reality in order to better analyze its development throughout history and into the future. Next, this essay begins an in-depth historical analysis of how virtual reality has developed prior to 1970, a pivotal year in Virtual Reality history, followed by an exploration of how this development paradigm shifted between the 1970\u27s and the turn of the century. The historical analysis of virtual reality is concluded by covering the modern period from 2000-present. Finally, this paper examines the layout of the virtual reality field in respect to he history and innovations presented

Human-display interaction technology: Emerging remote interfaces for pervasive display environments

This is the author's accepted manuscript. The final published article is available from the link below. Copyright @ 2010 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works.We're living in a world where information processing isn't confined to desktop computers - it's being integrated into everyday objects and activities. Pervasive computation is human centered: it permeates our physical world, helping us achieve goals and fulfill our needs with minimum effort by exploiting natural interaction styles. Remote interaction with screen displays requires a sensor-based, multimodal, touchless approach. For example, by processing user hand gestures, this paradigm removes constraints requiring physical contact and permits natural interaction with tangible digital information. Such touchless interaction can be multimodal, exploiting the visual, auditory, and olfactory senses.Ministerio de Educación y Ciencia and Amper Sistemas, SA

Literacy for digital futures : Mind, body, text

The unprecedented rate of global, technological, and societal change calls for a radical, new understanding of literacy. This book offers a nuanced framework for making sense of literacy by addressing knowledge as contextualised, embodied, multimodal, and digitally mediated. In today’s world of technological breakthroughs, social shifts, and rapid changes to the educational landscape, literacy can no longer be understood through established curriculum and static text structures. To prepare teachers, scholars, and researchers for the digital future, the book is organised around three themes – Mind and Materiality; Body and Senses; and Texts and Digital Semiotics – to shape readers’ understanding of literacy. Opening up new interdisciplinary themes, Mills, Unsworth, and Scholes confront emerging issues for next-generation digital literacy practices. The volume helps new and established researchers rethink dynamic changes in the materiality of texts and their implications for the mind and body, and features recommendations for educational and professional practice

A case study of augmented reality serious games

The study introduced in this paper examines some of the issues involved in the design and implementation of serious games that make use of tangible AR environments. Our motivation is to understand how augmented reality serious games (ARSG) can be applied to some very difficult problems in the real gaming world. Emphasis is given on the interface and the interactions between the players and the serious games themselves. In particular, two case studies are presented, ARPuzzle and ARBreakout. Results from both case studies indicate that AR gaming has the potential of revolutionizing the way that current games are played and used as well as that it can help educate players while playing

Bringing tabletop technologies to kindergarten children

Taking computer technology away from the desktop and into a more physical, manipulative space, is known that provide many benefits and is generally considered to result in a system that is easier to learn and more natural to use. This paper describes a design solution that allows kindergarten children to take the benefits of the new pedagogical possibilities that tangible interaction and tabletop technologies offer for manipulative learning. After analysis of children's cognitive and psychomotor skills, we have designed and tuned a prototype game that is suitable for children aged 3 to 4 years old. Our prototype uniquely combines low cost tangible interaction and tabletop technology with tutored learning. The design has been based on the observation of children using the technology, letting them freely play with the application during three play sessions. These observational sessions informed the design decisions for the game whilst also confirming the children's enjoyment of the prototype