Identifying Emotions Expressed by Mobile Users through 2D Surface and 3D Motion Gestures

Session: Feelings and emotionsInternational audienceOnly intrusive and expensive ways of precisely expressing emotions has been proposed, which are not likely to appear soon in everyday Ubicomp environments. In this paper, we study to which extent we can identify the emotion a user is explicitly expressing through 2D and 3D gestures. Indeed users already often manipulate mobile devices with touch screen and accelerometers. We conducted a field study where we asked participants to explicitly express their emotion through gestures and to report their affective states. We contribute by (1) showing a high number of significant correlations in 3D motion descriptors of gestures and in the arousal dimension; (2) defining a space of affective gestures. We identify (3) groups of descriptors that structure the space and are related to arousal. Finally, we provide with (4) a preliminary model of arousal and we identify (5) interesting patterns in particular classes of gestures. Such results are useful for Ubicomp application designers in order to envision the use of gestures as a cheap and non-intrusive affective modality

How can people’s spatial behaviour be used to dynamically lay out content on multi-user, interactive screens, and how does this dynamic layout affect people’s spatial behaviour?

This thesis aims to explore the influencing factors of layout and presentation changes of large interactive and adaptive displays in multi-user interactions and social organisation. While significant bodies of work have considered the interactivity of digital displays to identify phenomena of use, these have been conducted in localised isolation, and do not address the wider ecological impacts for the influences of emergent organisations of simultaneous use where a system or display may support this. Through considerations of how display presentation and layout can influence the emergence of social organisations, a series of iterative lab-based studies have been carried out to assess and inform a number of interaction modalities. This leads to a series of design recommendations around a system-led approach in presenting a mechanism to support approach behaviours and the maximised utility of a large display, whilst mitigating conflict between social boundaries and impact to user experience. This has identified a range of factors in both the mechanisms of natural social organisation and supporting layout changes and adaptations in maintaining user experience leading towards wider use, scaffolding features of the environment, on-going use, and adaptation within a novel system-led approach. This has presented clear implications to the field, and identified significant areas for further research to refine the subtle factors of interaction which have been identified here

How can people’s spatial behaviour be used to dynamically lay out content on multi-user, interactive screens, and how does this dynamic layout affect people’s spatial behaviour?

This thesis aims to explore the influencing factors of layout and presentation changes of large interactive and adaptive displays in multi-user interactions and social organisation. While significant bodies of work have considered the interactivity of digital displays to identify phenomena of use, these have been conducted in localised isolation, and do not address the wider ecological impacts for the influences of emergent organisations of simultaneous use where a system or display may support this. Through considerations of how display presentation and layout can influence the emergence of social organisations, a series of iterative lab-based studies have been carried out to assess and inform a number of interaction modalities. This leads to a series of design recommendations around a system-led approach in presenting a mechanism to support approach behaviours and the maximised utility of a large display, whilst mitigating conflict between social boundaries and impact to user experience. This has identified a range of factors in both the mechanisms of natural social organisation and supporting layout changes and adaptations in maintaining user experience leading towards wider use, scaffolding features of the environment, on-going use, and adaptation within a novel system-led approach. This has presented clear implications to the field, and identified significant areas for further research to refine the subtle factors of interaction which have been identified here