I did that! Measuring Users’ Experience of Agency in their own Actions

Cognitive neuroscience defines the sense of agency as the experience of controlling one’s own actions and, through this control, affecting the external world. We believe that the sense of personal agency is a key factor in how people experience interactions with technology. This paper draws on theoretical perspectives in cognitive neuroscience and describes two implicit methods through which personal agency can be empirically investigated. We report two experiments applying these methods to HCI problems. One shows that a new input modality - skin-based interaction - can substantially increase users' sense of agency. The second demonstrates that variations in the parameters of assistance techniques such as predictive mouse acceleration can have a significant impact on users' sense of agency. The methods presented provide designers with new ways of evaluating and refining empowering interaction techniques and interfaces, in which users experience an instinctive sense of control and ownership over their actions

Replicating and Applying a Neuro-Cognitive Experimental Technique in HCI Research

In cognitive neuroscience the sense of agency is defined as the as the experience of controlling ones own actions and, through this control, affecting the external world. At CHI 2012 I presented a paper entitled I did that! Measuring Users Experience of Agency in their own Actions [1]. This extended abstract draws heavily on that paper, which described an implicit measure called intentional binding. This measure, developed by researchers in cognitive neuroscience, has been shown to provide a robust implicit measure for the sense of agency. My interest in intentional binding stemmed from prior HCI literature, (e.g. the work of Shneiderman) which emphasises the importance of the sense of control in human-computer interactions. The key question behind the CHI 2012 paper was: can we apply intention binding to provide an implicit measure for the experience of control in human-computer interactions? In investigating this question, replication was a key element of the experimental process.Comment: 4 pages, presented at RepliCHI2013 at ACM CHI 201

Investigating the effect of relative time delay on companion screen experiences

Mobile devices are increasingly used while watching television, leading to the development of companion apps that complement the content of programmes. A concern for these applications is the extent to which companion app and television content need to be temporally aligned for live synchronisation. In this study, 18 participants watched a nature programme while being shown companion content on a tablet. Temporal synchronisation of content between the devices was varied. Participants completed questionnaires measuring immersion and affect and were tested on their recall for companion app content. While there were no statistically significant effects on these measures, qualitative interviews with participants after viewing consistently revealed that longer 10s delays in content synchronisation were frustrating. This suggests that poor content synchronisation can produce a negative companion experience for viewers and should be avoided

I feel it in my fingers! Sense of agency with mid-air haptics

Recent technological advances incorporate mid- air haptic feedback, enriching sensory experience during touchless virtual interactions. We investigated how this impacts the user’s sense of agency. Sense of agency refers to the feeling of controlling external events through one’s actions and has attracted growing interest from human-computer interaction researchers. This is mainly due to the fact that the user’s experience of control over a system is of primary importance. Here we measured sense of agency during a virtual button- pressing task, where the button press caused a tone outcome to occur after intervals of different durations. We explored the effect of manipulating a) mid-air haptic feedback and b) the latency of the virtual hand’s movement with respect to the actual hand movement. Sense of agency was quantified with implicit and explicit measures. Results showed that haptic feedback increased implicit sense of agency for the longest action-outcome interval length. Results also showed that latency led to a decrease in explicit sense of agency, but that this reduction was attenuated in the presence of haptic feedback. We discuss the implications of these findings, focusing on the idea that haptic feedback can be used to protect, or even increase, users’ experiences of agency in virtual interactions

Empirical evidence for a diminished sense of agency in speech interfaces

While the technology underlying speech interfaces has improved in recent years, our understanding of the human side of speech interactions remains limited. This paper provides new insight on one important human aspect of speech interactions: the sense of agency - defined as the experience of controlling one’s own actions and their outcomes. Two experiments are described. In each case a voice command is compared with keyboard input. Agency is measured using an implicit metric: intentional binding. In both experiments we find that participants’ sense of agency is significantly reduced for voice commands as compared to keyboard input. This finding presents a fundamental challenge for the design of effective speech interfaces. We reflect on this finding and, based on current theory in HCI and cognitive neuroscience, offer possible explanations for the reduced sense of agency observed in speech interfaces

Agency in mid-air interfaces

Touchless interfaces allow users to view, control and manipulate digital content without physically touching an interface. They are being explored in a wide range of application scenarios from medical surgery to car dashboard controllers. One aspect of touchless interaction that has not been explored to date is the Sense of Agency (SoA). The SoA refers to the subjective experience of voluntary control over actions in the external world. In this paper, we investigated the SoA in touchless systems using the intentional binding paradigm. We first compare touchless systems with physical interactions and then augmented different types of haptic feedback to explore how different outcome modalities influence users’ SoA. From our experiments, we demonstrated that an intentional binding effect is observed in both physical and touchless interactions with no statistical difference. Additionally, we found that haptic and auditory feedback help to increase SoA compared with visual feedback in touchless interfaces. We discuss these findings and identify design opportunities that take agency into consideration

I did that! Measuring users' experience of agency in their own actions

Cognitive neuroscience defines the sense of agency as the experience of controlling one's own actions and, through this control, affecting the external world. We believe that the sense of personal agency is a key factor in how people experience interactions with technology. This paper draws on theoretical perspectives in cognitive neuroscience and describes two implicit methods through which personal agency can be empirically investigated. We report two experiments applying these methods to HCI problems. One shows that a new input modality - skin-based interaction - can substantially increase users' sense of agency. The second demonstrates that variations in the parameters of assistance techniques such as predictive mouse acceleration can have a significant impact on users' sense of agency. The methods presented provide designers with new ways of evaluating and refining empowering interaction techniques and interfaces, in which users experience an instinctive sense of control and ownership over their actions. Copyright 2012 ACM

Beyond the Libet clock: modality variants for agency measurements

The Sense of Agency (SoA) refers to our capability to control our own actions and influence the world around us. Recent research in HCI has been exploring SoA to provide users an instinctive sense of “I did that” as opposed to “the system did that”. However, current agency measurements are limited. The Intentional Binding (IB) paradigm provides an implicit measure of the SoA. However, it is constrained by requiring high visual attention to a “Libet clock” onscreen. In this paper, we extend the timing stimulus through auditory and tactile cues. Our results demonstrate that audio timing through voice commands and haptic timing through tactile cues on the hand are alternative techniques to measure the SoA using the IB paradigm. They both address limitations of the traditional method (e.g., lack of engagement and visual demand). We discuss how our results can be applied to measure SoA in tasks involving different interactive scenarios common in HCI

Interacting with an inferred world: The challenge of machine learning for humane computer interaction

<div class="page" title="Page 1"><div class="layoutArea"><div class="column"><p><span>Classic theories of user interaction have been framed in relation to symbolic models of planning and problem solving, responding in part to the cognitive theories associated with AI research. However, the behavior of modern machine-learning systems is determined by statistical models of the world rather than explicit symbolic descriptions. Users increasingly interact with the world and with others in ways that are mediated by such models. This paper explores the way in which this new generation of technology raises fresh challenges for the critical evaluation of interactive systems. It closes with some proposed measures for the design of inference-based systems that are more open to humane design and use. </span></p></div></div></div>This is the author accepted manuscript. The final version is available from the Association for Computing Machinery via http://dx.doi.org/10.7146/aahcc.v1i1.2119