Read-It: A Multi-modal Tangible Interface for Children Who Learn to Read

Multi-modal tabletop applications offer excellent opportunities for enriching the education of young children. Read-It is an example of an interactive game with a multi-modal tangible interface that was designed to combine the advantages of current physical games and computer exercises. It is a novel approach for supporting children who learn to read. The first experimental evaluation has demonstrated that the Read-It approach is indeed promising and meets a priori expectations

THE UNIVERSAL MEDIA BOOK

We explore the integration of projected imagery with a physical book that acts as a tangible interface to multimedia data. Using a camera and projector pair, a tracking framework is presented wherein the 3D position of planar pages are monitored as they are turned back and forth by a user, and data is correctly warped and projected onto each page at interactive rates to provide the user with an intuitive mixed-reality experience. The book pages are blank, so traditional camera-based approaches to tracking physical features on the display surface do not apply. Instead, in each frame, feature points are independently extracted from the camera and projector images, and matched to recover the geometry of the pages in motion. The book can be loaded with multimedia content, including images and videos. In addition, volumetric datasets can be explored by removing a page from the book and using it as a tool to navigate through a virtual 3D volume

Spatially Aware Computing for Natural Interaction

Spatial information refers to the location of an object in a physical or digital world. Besides, it also includes the relative position of an object related to other objects around it. In this dissertation, three systems are designed and developed. All of them apply spatial information in different fields. The ultimate goal is to increase the user friendliness and efficiency in those applications by utilizing spatial information. The first system is a novel Web page data extraction application, which takes advantage of 2D spatial information to discover structured records from a Web page. The extracted information is useful to re-organize the layout of a Web page to fit mobile browsing. The second application utilizes the 3D spatial information of a mobile device within a large paper-based workspace to implement interactive paper that combines the merits of paper documents and mobile devices. This application can overlay digital information on top of a paper document based on the location of a mobile device within a workspace. The third application further integrates 3D space information with sound detection to realize an automatic camera management system. This application automatically controls multiple cameras in a conference room, and creates an engaging video by intelligently switching camera shots among meeting participants based on their activities. Evaluations have been made on all three applications, and the results are promising. In summary, this dissertation comprehensively explores the usage of spatial information in various applications to improve the usability

Designing technology for young children: guidelines grounded in a literature investigation on child development and children's technology

This thesis is about the design of technology for children from five to eight years of age. The majority of available guidelines and principles for design or evaluation of technology support the design of products aimed at adults. The limited guidelines available for design of young children's technology do not focus sufficiently on age-related requirements or they offer high-level advice that is only useful in the planning stages of design. Working from the assumption that knowledge available in the literature provides sufficient information to support this process, my aim with this study was to demonstrate how a dependable and useful set of guidelines for the design of technology for children aged five to eight years could be derived from an existing body of knowledge. Development of the guidelines firstly involved research into the psychological theories of children's development to identify those elements of development and the characteristics of children that may have bearing on children's use of technology. Secondly, the literature on children's development of specific skills such as literacy and mathematics was investigated. The available literature on young children's use of technology was studied next and, finally, the applicability of existing design guidelines and principles for children's products evaluated. Throughout this literature investigation the researcher gathered design-relevant factors that could potentially become design guidelines. Using qualitative data analysis techniques, more than five hundred such data elements were systematically coded, processed, analysed and categorised. The result is three hundred and fifty guidelines organised into a framework of six categories and twenty-six subcategories that integrates the relevant theoretical fields and provides practical support for designers. To demonstrate the credibility and usefulness of the emerging guidelines they were used to do an evaluation and re-design of an existing product aimed at the target group. The thesis reports in detail on the different stages of the research, and systematically takes the reader through the process of deriving guidelines from existing theory and research findings, and integrating them into a useful framework.School of ComputingPhD. (Computer Science

The Visual Interaction Platform

Abstract: The Visual Interaction Platform (VIP) is an Augmented Reality system that builds on human skills of real world object manipulation and allows unhindered human-human communication in a collaborative situation. The platform supports architectural design and medical planning through the use of physical props for interaction with 2D and 3D data. Keywords: Augmented Reality, Human-Computer Interaction, Pen interaction, 3D interaction 1 Platform Components The Visual Interaction Platform (VIP) is an augmented reality platform that enables different natural interaction techniques such as writing, sketching, manipulating and navigating in 2D and 3D data (Aliakseyeu et al 2002). The set up of the VIP uses the following (Figure 1): • An LCD projector to create a large computer workspace on a horizontal surface – actionperception space (2 in Figure 1). • An UltraPad A2 ® (Wacom ®) digitizer tablet as the horizontal surface (6 in Figure 1). • An ultrasonic wireless position-tracking device o

Basic image analysis applied to the visual interaction platform

no abstrac