Touching creativity; a review and early pilot test of haptic tooling to support design practice, within a distance learning curriculum

Machine haptics has been shown to assist and enhance human–computer interactions. Research from previous studies in the field of haptics has focused on developing a user’s sense of realism of touch when using a haptic device. This paper examines the use of haptics for education, specifically for creative online education. The paper is presented in two parts. First, a review of literature was conducted and used to aid the rationale and underpin the design of a pilot test. Second, a pilot test was designed using a single-point kinaesthetic haptic device with a haptic rendered interface, to support the assembly of a virtual design prototype. The pilot test proved to be extremely valuable in creating and developing a rich virtual environment for non-sighted and sighted participants to use. The results from the initial pilot test showed that although users were positive about their experience of using the haptic device, there were improvements to be made to the interface to enhance the user experience in the next phase of testing

A Haptic Study to Inclusively Aid Teaching and Learning in the Discipline of Design

Designers are known to use a blend of manual and virtual processes to produce design prototype solutions. For modern designers, computer-aided design (CAD) tools are an essential requirement to begin to develop design concept solutions. CAD, together with augmented reality (AR) systems have altered the face of design practice, as witnessed by the way a designer can now change a 3D concept shape, form, color, pattern, and texture of a product by the click of a button in minutes, rather than the classic approach to labor on a physical model in the studio for hours. However, often CAD can limit a designer’s experience of being ‘hands-on’ with materials and processes. The rise of machine haptic1 (MH) tools have afforded a great potential for designers to feel more ‘hands-on’ with the virtual modeling processes. Through the use of MH, product designers are able to control, virtually sculpt, and manipulate virtual 3D objects on-screen. Design practitioners are well placed to make use of haptics, to augment 3D concept creation which is traditionally a highly tactile process. For similar reasoning, it could also be said that, non-sighted and visually impaired (NS, VI) communities could also benefit from using MH tools to increase touch-based interactions, thereby creating better access for NS, VI designers. In spite of this the use of MH within the design industry (specifically product design), or for use by the non-sighted community is still in its infancy. Therefore the full benefit of haptics to aid non-sighted designers has not yet been fully realised. This thesis empirically investigates the use of multimodal MH as a step closer to improving the virtual hands-on process, for the benefit of NS, VI and fully sighted (FS) Designer-Makers. This thesis comprises four experiments, embedded within four case studies (CS1-4). Case study 1and2 worked with self-employed NS, VI Art Makers at Henshaws College for the Blind and Visual Impaired. The study examined the effects of haptics on NS, VI users, evaluations of experience. Case study 3 and4, featuring experiments 3 and4, have been designed to examine the effects of haptics on distance learning design students at the Open University. The empirical results from all four case studies showed that NS, VI users were able to navigate and perceive virtual objects via the force from the haptically rendered objects on-screen. Moreover, they were assisted by the whole multimodal MH assistance, which in CS2 appeared to offer better assistance to NS versus FS participants. In CS3 and 4 MH and multimodal assistance afforded equal assistance to NS, VI, and FS, but haptics were not as successful in bettering the time results recorded in manual (M) haptic conditions. However, the collision data between M and MH showed little statistical difference. The thesis showed that multimodal MH systems, specifically used in kinesthetic mode have enabled human (non-disabled and disabled) to credibly judge objects within the virtual realm. It also shows that multimodal augmented tooling can improve the interaction and afford better access to the graphical user interface for a wider body of users

Using Augmented Reality as a Medium to Assist Teaching in Higher Education

In this paper we describe the use of a high-level augmented reality (AR) interface for the construction of collaborative educational applications that can be used in practice to enhance current teaching methods. A combination of multimedia information including spatial three-dimensional models, images, textual information, video, animations and sound, can be superimposed in a student-friendly manner into the learning environment. In several case studies different learning scenarios have been carefully designed based on human-computer interaction principles so that meaningful virtual information is presented in an interactive and compelling way. Collaboration between the participants is achieved through use of a tangible AR interface that uses marker cards as well as an immersive AR environment which is based on software user interfaces (UIs) and hardware devices. The interactive AR interface has been piloted in the classroom at two UK universities in departments of Informatics and Information Science

Towards a multimodal interaction space: Categorisation and applications

Based on many experiences of developing interactive systems by the authors, a framework for the description and analysis of interaction has been developed. The dimensions of this multimodal interaction space have been identified as sensory modalities, modes and levels of interaction. To illustrate and validate this framework, development of multimodal interaction styles is carried out and interactions in the real world are studied, going from theory to practice and back again. The paper describes the framework and two recent projects, one in the field of interactive architecture and another in the field of multimodal HCI research. Both projects use multiple modalities for interaction, particularly movement based interaction styles. © Springer-Verlag London Limited 2007

Gaming techniques and the product development process : commonalities and cross-applications

The use of computer-based tools is now firmly embedded within the product development process, providing a wide range of uses from visualisation to analysis. However, the specialisation required to make effective use of these tools has led to the compartmentalisation of expertise in design teams, resulting in communication problems between individual members. This paper therefore considers how computer gaming techniques and strategies could be used to enhance communication and group design activities throughout the product design process

Virtual Reality Games for Motor Rehabilitation

This paper presents a fuzzy logic based method to track user satisfaction without the need for devices to monitor users physiological conditions. User satisfaction is the key to any product’s acceptance; computer applications and video games provide a unique opportunity to provide a tailored environment for each user to better suit their needs. We have implemented a non-adaptive fuzzy logic model of emotion, based on the emotional component of the Fuzzy Logic Adaptive Model of Emotion (FLAME) proposed by El-Nasr, to estimate player emotion in UnrealTournament 2004. In this paper we describe the implementation of this system and present the results of one of several play tests. Our research contradicts the current literature that suggests physiological measurements are needed. We show that it is possible to use a software only method to estimate user emotion

The feasibility of using virtual prototyping technologies for product evaluation

With the continuous development in computer and communications technology the use of computer aided design in design processes is becoming more commonplace. A wide range of virtual prototyping technologies are currently in development, some of which are commercially viable for use within a product design process. These virtual prototyping technologies range from graphics tablets to haptic devices. With the compression of design cycles the feasibility of using these technologies for product evaluation is becoming an ever more important consideration. This thesis begins by presenting the findings of a comprehensive literature review defining product design with a focus on product evaluation and a discussion of current virtual prototyping technologies. From the literature review it was clear that user involvement in the product evaluation process is critical. The literature review was followed by a series of interconnected studies starting with an investigation into design consultancies' access and use of prototyping technologies and their evaluation methods. Although design consultancies are already using photo-realistic renderings, animations and sometimes 3600 view CAD models for their virtual product evaluations, current virtual prototyping hardware and software is often unsatisfactory for their needs. Some emergent technologies such as haptic interfaces are currently not commonly used in industry. This study was followed by an investigation into users' psychological acceptance and physiological discomfort when using a variety of virtual prototyping tools for product evaluation compared with using physical prototypes, ranging from on-screen photo-realistic renderings to 3D 3600 view models developed using a range of design software. The third study then went on to explore the feasibility of using these virtual prototyping tools and the effect on product preference when compared to using physical prototypes. The forth study looked at the designer's requirements for current and future virtual prototyping tools, design tools and evaluation methods. In the final chapters of the thesis the relative strengths and weaknesses of these technologies were re-evaluated and a definitive set of user requirements based on the documentary evidence of the previous studies was produced. This was followed by the development of a speculative series of scenarios for the next generation of virtual prototyping technologies ranging from improvements to existing technologies through to blue sky concepts. These scenarios were then evaluated by designers and consumers to produce documentary evidence and recommendations for preferred and suitable combinations of virtual prototyping technologies. Such hardware and software will require a user interface that is intuitive, simple, easy to use and suitable for both the designers who create the virtual prototypes and the consumers who evaluate them

Virtual reality as an educational tool in interior architecture

Ankara : The Department of Interior Architecture and Environmental Design and the Institute of Fine Arts of Bilkent Univ., 1997.Thesis (Master's) -- Bilkent University, 1997.Includes bibliographical references.This thesis discusses the use of virtual reality technology as an educational tool in interior architectural design. As a result of this discussion, it is proposed that virtual reality can be of use in aiding three-dimensional design and visualization, and may speed up the design process. It may also be of help in getting the designers/students more involved in their design projects. Virtual reality can enhance the capacity of designers to design in three dimensions. The virtual reality environment used in designing should be capable of aiding both the design and the presentation process. The tradeoffs of the technology, newly emerging trends and future directions in virtual reality are discussed.Aktaş, OrkunM.S

AUXie: Initial evaluation of a blind-accessible virtual museum tour

Remotely accessible audio-based virtual tours can offer great utility for blind or vision impaired persons, eliminating the difficulties posed by travel to unfamiliar locations, and allowing truly independent exploration. This paper draws upon sonification techniques used in previous implementations of audio-based 3D environments to develop a prototype of blind-accessible virtual tours specifically tailored to the needs of cultural sites. A navigable 3D world is presented using spatially positioned musical earcons, accompanied by synthesised speech descriptions and navigation aids. The worlds are read from X3D models enhanced with metadata to identify and describe the rooms and exhibits, thus enabling an audio modality for existing 3D worlds and simplifying the tour creation process. The prototype, named AUXie, was evaluated by 11 volunteers with total blindness to establish a proof of concept and identify the problematic aspects of the interface. The positive response obtained confirmed the validity of the approach and yielded valuable insight into how such tours can be further improved. Copyright the author(s) and CHISIG