What does not happen: quantifying embodied engagement using NIMI and self-adaptors

Previous research into the quantification of embodied intellectual and emotional engagement using non-verbal movement parameters has not yielded consistent results across different studies. Our research introduces NIMI (Non-Instrumental Movement Inhibition) as an alternative parameter. We propose that the absence of certain types of possible movements can be a more holistic proxy for cognitive engagement with media (in seated persons) than searching for the presence of other movements. Rather than analyzing total movement as an indicator of engagement, our research team distinguishes between instrumental movements (i.e. physical movement serving a direct purpose in the given situation) and non-instrumental movements, and investigates them in the context of the narrative rhythm of the stimulus. We demonstrate that NIMI occurs by showing viewers’ movement levels entrained (i.e. synchronised) to the repeating narrative rhythm of a timed computer-presented quiz. Finally, we discuss the role of objective metrics of engagement in future context-aware analysis of human behaviour in audience research, interactive media and responsive system and interface design

A time series feature of variability to detect two types of boredom from motion capture of the head and shoulders

Boredom and disengagement metrics are crucial to the correctly timed implementation of adaptive interventions in interactive systems. psychological research suggests that boredom (which other HCI teams have been able to partially quantify with pressure-sensing chair mats) is actually a composite: lethargy and restlessness. Here we present an innovative approach to the measurement and recognition of these two kinds of boredom, based on motion capture and video analysis of changes in head and shoulder positions. Discrete, three-minute, computer-presented stimuli (games, quizzes, films and music) covering a spectrum from engaging to boring/disengaging were used to elicit changes in cognitive/emotional states in seated, healthy volunteers. Interaction with the stimuli occurred with a handheld trackball instead of a mouse, so movements were assumed to be non-instrumental. Our results include a feature (standard deviation of windowed ranges) that may be more specific to boredom than mean speed of head movement, and that could be implemented in computer vision algorithms for disengagement detection

A manifesto for cognitive ergonomics: re-evaluating technology usability for the 21st century

Computer infiltration into the workplace and society has been extensive, yet the ideals of efficacy, efficiency and satisfaction have not been wholly met. We propose an ambitious framework to take forward Cognitive Ergonomics. We define Cognitive Ergonomics as an interdisciplinary field of research and practice dedicated towards: • Improving human wellbeing, mankind and our environment • By understanding and supporting human cognition • When at work or performing goal-directed tasks • With computers and other engineered artefacts. This revitalizing framework will be based on: • Interdisciplinary Research • Research-based Policy • Education The proposed interdisciplinary framework will refocus on the classical facets of usability and include work-relevant emotions as well as understanding the minimal requirements for successful interactions (including understanding agency). The research-based policy will focus on efficacy in terms of human cognitive ergonomics in a holistic perspective (i.e. producing the effects we want without adverse effects). This will include complex questions about interface design in the context of the organisational and business models that influence its development (e.g. monetization). The educational concerns will focus on efficiency and include minimal programmes for all computer scientists and all end-users, as well as the consequences of digital mediation in learning generally. This framework will differentiate cognitive ergonomics from its cognate fields of Human-Computer Interaction and Psychology, and address a gap between the social sciences and engineering that has become more urgent in the past 5-10 years. It is ideally suited to be carried forward by the European Association of Cognitive Ergonomics, as this framework is specifically a collaborative effort grounded in European intellectual and scientific tradition; a perspective that offers a much-needed contrast and complement to Anglosphere research and development agendas in interactive technologies

Correcting an estimator of a multivariate monotone function with isotonic regression

In many problems, a sensible estimator of a possibly multivariate monotone function may fail to be monotone. We study the correction of such an estimator obtained via projection onto the space of functions monotone over a finite grid in the domain. We demonstrate that this corrected estimator has no worse supremal estimation error than the initial estimator, and that analogously corrected confidence bands contain the true function whenever the initial bands do, at no loss to band width. Additionally, we demonstrate that the corrected estimator is asymptotically equivalent to the initial estimator if the initial estimator satisfies a stochastic equicontinuity condition and the true function is Lipschitz and strictly monotone. We provide simple sufficient conditions in the special case that the initial estimator is asymptotically linear, and illustrate the use of these results for estimation of a G-computed distribution function. Our stochastic equicontinuity condition is weaker than standard uniform stochastic equicontinuity, which has been required for alternative correction procedures. This allows us to apply our results to the bivariate correction of the local linear estimator of a conditional distribution function known to be monotone in its conditioning argument. Our experiments suggest that the projection step can yield significant practical improvements

Comparison of modelled and monitored deposition fluxes of sulphur and nitrogen to ICP-forest sites in Europe

The EMEP MSC-W Eulerian chemical transport model, and its predictions of deposition of acidifying and eutrophying pollutants over Europe, play a key role in the development of emission control strategies for Europe. It is important that this model is tested against observational data. Here we compare the results of the EMEP model with measured data from 160 sites of the European Union/ICP Forest (Level II) monitoring network, for the years 1997 and 2000. This comparison comprises: (a) Precipitation amount, (b) Total deposition of SO42- to coniferous and deciduous forests, (c) Wet deposition of SO42-, NO3- and NH4+ in open field sites, and (d) Concentrations of SO42-, NO3- and NH4+ in precipitation. Concerning precipitation, the EMEP model and ICP network showed very similar overall levels (within 4% for 1997 and 11% for 2000). The correlation was, however, poor (r2=0.15-0.23). This can be attributed largely to the influence of a few outliers, combined with a small range of rainfall amounts for most points. Correlations between modelled and observed deposition values in this study were rather high (r2 values between 0.4-0.8 for most components and years), with mean values across all sites being within 30%. The EMEP model tends to give somewhat lower values for SO42-, NO3- and NH4+ wet deposition to ICP, but differences in mean values were within 20% in 1997 and 30% in 2000. Modelled and observed concentrations of SO 42-, NO3- and NH4+ in precipitation are very similar on average (differences of 0-14%), with good correlation between modelled and observed data (r 2=0.50-0.78). Differences between the EMEP model and ICP measurements are thought to arise from a mixture of problems with both the observations and model. However, the overall conclusion is that the EMEP model performs rather well in reproducing patterns of S and N deposition to European forests

Wearable sensor metric for fidgeting: screen engagement rather than interest causes NIMI of wrists and ankles

Measuring fidgeting is an important goal for the psychology of mind-wandering and for human computer interaction (HCI). Previous work measuring the movement of the head, torso and thigh during HCI has shown that engaging screen content leads to non-instrumental movement inhibition (NIMI). Camera-based methods for measuring wrist movements are limited by the occlusion, supination and friction of the arm. Here we used a high pass filtered magnitude of wearable tri-axial accelerometer recordings during 2-minute passive HCI stimuli as a surrogate for movement of the wrists and ankles. With 24 seated, healthy volunteers experiencing HCI, this metric showed that wrists moved significantly more than ankles. We found that NIMI could be detected in the wrists and ankles; it distinguished extremes of interest and boredom via restlessness. We conclude that both free-willed and forced screen engagement can elicit NIMI of the wrists and ankles

Stepping Up The Pressure: Arousal Can Be Associated With A Reduction In Male Aggression

The attentional myopia model of behavioral control [Mann and Ward, 2007] was tested in an experiment investigating the relationship between physiological arousal and aggression. Drawing on previous work linking arousal and narrowed attentional focus, the model predicts that arousal will lead to behavior that is relatively disinhibited in situations in which promoting pressures to aggress are highly salient. In situations in which inhibitory pressures are more salient, the model predicts behavior that is relatively restrained. In the experiment, 81 male undergraduates delivered noise-blasts against a provoking confederate while experiencing either high or low levels of physiological arousal and, at the same time, being exposed to cues that served either to promote or inhibit aggression. In addition to supporting the predictions of the model, this experiment provided some of the first evidence for enhanced control of aggression under conditions of heightened physiological arousal. Implications for interventions designed to reduce aggression are discussed. Aggr. Behav. 34:584–592, 2008. © 2008 Wiley-Liss, Inc

Experience design: video without faces increases engagement but not empathy

Counter to prior claims that empathy is required for higher levels of engagement in human-computer interaction, our team has previously found that, in an analysis of 844 stimulus presentations, empathy is sufficient for high engagement, but is not necessary. Here, we ran a carefully controlled study of human-computer interactions with musical stimuli --- with and without visuals, and with and without recognizable people -- to directly test whether we could design an engaging stimulus that did not elicit empathy, by avoiding human faces or personal interaction. We measured subjective responses by visual analogue scale and found that the faceless stimulus was as engaging as the face-containing stimulus, but much less empathy-provoking. Therefore, we propose that empathy and engagement be considered independently during interaction design, because they are not monotonically related