Detecting Error-Related Negativity for Interaction Design

This paper examines the ability to detect a characteristic brain potential called the Error-Related Negativity (ERN) using off-the-shelf headsets and explores its applicability to HCI. ERN is triggered when a user either makes a mistake or the application behaves differently from their expectation. We first show that ERN can be seen on signals captured by EEG headsets like Emotiv™ when doing a typical multiple choice reaction time (RT) task – Flanker task. We then present a single-trial online ERN algorithm that works by pre-computing the coefficient matrix of a logistic regression classifier using some data from a multiple choice reaction time task and uses it to classify incoming signals of that task on a single trial of data. We apply it to an interactive selection task that involved users selecting an object under time pressure. Furthermore the study was conducted in a typical office environment with ambient noise. Our results show that online single trial ERN detection is possible using off-the-shelf headsets during tasks that are typical of interactive applications. We then design a Superflick experiment with an integrated module mimicking an ERN detector to evaluate the accuracy of detecting ERN in the context of assisting users in interactive tasks. Based on these results we discuss and present several HCI scenarios for use of ERN.This paper examines the ability to detect a characteristic brain potential called the Error-Related Negativity (ERN) using off-the-shelf headsets and explores its applicability to HCI. ERN is triggered when a user either makes a mistake or the application behaves differently from their expectation. We first show that ERN can be seen on signals captured by EEG headsets like Emotiv™ when doing a typical multiple choice reaction time (RT) task – Flanker task. We then present a single-trial online ERN algorithm that works by pre-computing the coefficient matrix of a logistic regression classifier using some data from a multiple choice reaction time task and uses it to classify incoming signals of that task on a single trial of data. We apply it to an interactive selection task that involved users selecting an object under time pressure. Furthermore the study was conducted in a typical office environment with ambient noise. Our results show that online single trial ERN detection is possible using off-the-shelf headsets during tasks that are typical of interactive applications. We then design a Superflick experiment with an integrated module mimicking an ERN detector to evaluate the accuracy of detecting ERN in the context of assisting users in interactive tasks. Based on these results we discuss and present several HCI scenarios for use of ERN

An Introduction to 3D User Interface Design

3D user interface design is a critical component of any virtual environment (VE) application. In this paper, we present a broad overview of three-dimensional (3D) interaction and user interfaces. We discuss the effect of common VE hardware devices on user interaction, as well as interaction techniques for generic 3D tasks and the use of traditional two-dimensional interaction styles in 3D environments. We divide most user interaction tasks into three categories: navigation, selection/manipulation, and system control. Throughout the paper, our focus is on presenting not only the available techniques, but also practical guidelines for 3D interaction design and widely held myths. Finally, we briefly discuss two approaches to 3D interaction design, and some example applications with complex 3D interaction requirements. We also present an annotated online bibliography as a reference companion to this article

Interaction Design: Foundations, Experiments

Interaction Design: Foundations, Experiments is the result of a series of projects, experiments and curricula aimed at investigating the foundations of interaction design in particular and design research in general. The first part of the book - Foundations - deals with foundational theoretical issues in interaction design. An analysis of two categorical mistakes -the empirical and interactive fallacies- forms a background to a discussion of interaction design as act design and of computational technology as material in design. The second part of the book - Experiments - describes a range of design methods, programs and examples that have been used to probe foundational issues through systematic questioning of what is given. Based on experimental design work such as Slow Technology, Abstract Information Displays, Design for Sound Hiders, Zero Expression Fashion, and IT+Textiles, this section also explores how design experiments can play a central role when developing new design theory

Designing for interaction

At present, the design of computer-supported group-based learning (CS)GBL) is often based on subjective decisions regarding tasks, pedagogy and technology, or concepts such as ‘cooperative learning’ and ‘collaborative learning’. Critical review reveals these concepts as insufficiently substantial to serve as a basis for (CS)GBL design. Furthermore, the relationship between outcome and group interaction is rarely specified a priori. Thus, there is a need for a more systematic approach to designing (CS)GBL that focuses on the elicitation of expected interaction processes. A framework for such a process-oriented methodology is proposed. Critical elements that affect interaction are identified: learning objectives, task-type, level of pre-structuring, group size and computer support. The proposed process-oriented method aims to stimulate designers to adopt a more systematic approach to (CS)GBL design according to the interaction expected, while paying attention to critical elements that affect interaction. This approach may bridge the gap between observed quality of interaction and learning outcomes and foster (CS)GBL design that focuses on the heart of the matter: interaction

Seamful interweaving: heterogeneity in the theory and design of interactive systems

Design experience and theoretical discussion suggest that a narrow design focus on one tool or medium as primary may clash with the way that everyday activity involves the interweaving and combination of many heterogeneous media. Interaction may become seamless and unproblematic, even if the differences, boundaries and 'seams' in media are objectively perceivable. People accommodate and take advantage of seams and heterogeneity, in and through the process of interaction. We use an experiment with a mixed reality system to ground and detail our discussion of seamful design, which takes account of this process, and theory that reflects and informs such design. We critique the 'disappearance' mentioned by Weiser as a goal for ubicomp, and Dourish's 'embodied interaction' approach to HCI, suggesting that these design ideals may be unachievable or incomplete because they underemphasise the interdependence of 'invisible' non-rationalising interaction and focused rationalising interaction within ongoing activity

Interaction design issues for car navigation systems

We describe a study on the interaction design of in-car navigation systems. It focused on a commercial product. Critical incident analysis was performed based on natural use of the system by a usability analyst. A cognitive walkthrough was then performed based on actual scenarios from the natural use. This is a non-classic application of cognitive walkthrough. It allowed anecdotal critical incidents to be theoretically grounded. We draw conclusions about the interaction design of car navigation systems

Webbox+Page Blossom: exploring design for AKTive data interaction

We give away our data to multiple data services without, for the most part, being able to get that data back to reuse in any other way, leaving us, at best, to re-find, re-cover, retype, remember and re-manage this material. In this work in progress, we hypothesize that if we facilitate easy interaction to store, access and reuse our personal, social and public data, we will not only decrease time spent to recreate it for multiple walled data contexts, but in particular, we will develop novel interactions for new kinds of knowledge building. To facilitate exploration of this hypothesis, we propose Page Blossom an exemplar of such dynamic data interaction that is based on data reuse via our open data platform Webbox + Active (active knowledge technology) lenses

A frame signature matrix for analysing and comparing interaction design behaviour

Protocol studies are an established method to investigate design behaviour. In the context of a project to investigate novice interaction design (ID) behaviour across protocols and cultures, we found that existing design behaviour analysis frameworks did not provide reliable results. This paper describes the development of a new approach to analyse and compare ID behaviour using verbal protocols. We augment Schön’s basic design and reflection cycle with construction of a frame signature matrix and analogical categorisation coding. We demonstrate this approach by comparing two protocols of novice interaction designers in Botswana. The initial findings indicate that this approach increases consistency and accuracy of coding, and that there are different degrees of reframing for the design problem and solutions