How Can Affect Be Detected and Represented in Technological Support for Physical Rehabilitation?

Although clinical best practice suggests that affect awareness could enable more effective technological support for physical rehabilitation through personalisation to psychological needs, designers need to consider what affective states matter and how they should be tracked and addressed. In this paper, we set the standard by analysing how the major affective factors in chronic pain (pain, fear/anxiety, and low/depressed mood) interfere with everyday physical functioning. Further, based on discussion of the modality that should be used to track these states to enable technology to address them, we investigated the possibility of using movement behaviour to automatically detect the states. Using two body movement datasets on people with chronic pain, we show that movement behaviour enables very good discrimination between two emotional distress levels (F1=0.86), and three pain levels (F1=0.9). Performance remained high (F1=0.78 for two pain levels) with a reduced set of movement sensors. Finally, in an overall discussion, we suggest how technology-provided encouragement and awareness can be personalised given the capability to automatically monitor the relevant states, towards addressing the barriers that they pose. In addition, we highlight movement behaviour features to be tracked to provide technology with information necessary for such personalisation

Relevant body cues for the classification of emotional body expression in daily actions

International audienc

Linking body cues to emotions for elementary aged children: an understanding by design curriculum for social-emotional learning

America’s elementary-aged children are struggling in school. Teachers and parents report that children are demonstrating difficulty attending to and staying engaged with instructional activities in classrooms nationwide. As a result, teachers must manage children's dysregulation as it may impact their immediate learning abilities and produce further downstream consequences in the K-12 environment. These elementary-aged children are often referred to school-based occupational therapy. The referrals indicate social-emotional learning (SEL) deficits. These social-emotional processes and the child’s learning are negatively impacted by increased anxiety. Evidence supports these findings. In fact, the current literature on the topic reveals multiple contributing factors including sensory functions that link body cues to emotions. This doctoral project provides an overview of My Body Feelings (My BF) curriculum. This project details the curriculum’s development, and the specific connection of school-based interventions. My BF is informed by three educational theories including Sociocultural Theory, Social Cognitive Theory, and the Theory of Constructed Emotions. Curriculum materials and lessons are organized as well as structured for the instructors using the Understanding by Design Framework. The program incorporates current evidence-based intervention strategies in 21 accessible 30-minute sessions complete with take home Exit Tickets. The result is an educational curriculum which directly addresses decreased self-regulation in children. The skills developed in the program will drive situation-specific coping skill development in children in grade levels 1-5. The anticipated outcome is improved emotional health and well-being of today's elementary-aged children impacting their important occupational role of student

Automatic Monitoring of Physical Activity Related Affective States for Chronic Pain Rehabilitation

Chronic pain is a prevalent disorder that affects engagement in valued activities. This is a consequence of cognitive and affective barriers, particularly low self-efficacy and emotional distress (i.e. fear/anxiety and depressed mood), to physical functioning. Although clinicians intervene to reduce these barriers, their support is limited to clinical settings and its effects do not easily transfer to everyday functioning which is key to self-management for the person with pain. Analysis carried out in parallel with this thesis points to untapped opportunities for technology to support pain self-management or improved function in everyday activity settings. With this long-term goal for technology in mind, this thesis investigates the possibility of building systems that can automatically detect relevant psychological states from movement behaviour, making three main contributions. First, extension of the annotation of an existing dataset of participants with and without chronic pain performing physical exercises is used to develop a new model of chronic disabling pain where anxiety acts as mediator between pain and self-efficacy, emotional distress, and movement behaviour. Unlike previous models, which are largely theoretical and draw from broad measures of these variables, the proposed model uses event-specific data that better characterise the influence of pain and related states on engagement in physical activities. The model further shows that the relationship between these states and guarding during movement (the behaviour specified in the pain behaviour literature) is complex and behaviour descriptions of a lower level of granularity are needed for automatic classification of the states. The model also suggests that some of the states may be expressed via other movement behaviour types. Second, addressing this using the aforementioned dataset with the additional labels, and through an in-depth analysis of movement, this thesis provides an extended taxonomy of bodily cues for the automatic classification of pain, self-efficacy and emotional distress. In particular, the thesis provides understanding of novel cues of these states and deeper understanding of known cues of pain and emotional distress. Using machine learning algorithms, average F1 scores (mean across movement types) of 0.90, 0.87, and 0.86 were obtained for automatic detection of three levels of pain and self-efficacy and of two levels of emotional distress respectively, based on the bodily cues described and thus supporting the discriminative value of the proposed taxonomy. Third, based on this, the thesis acquired a new dataset of both functional and exercise movements of people with chronic pain based on low-cost wearable sensors designed for this thesis and informed by the previous studies. The modelling results of average F1 score of 0.78 for two-level detection of both pain and self-efficacy point to the possibility of automatic monitoring of these states in everyday functioning. With these contributions, the thesis provides understanding and tools necessary to advance the area of pain-related affective computing and groundbreaking insight that is critical to the understanding of chronic pain. Finally, the contributions lay the groundwork for physical rehabilitation technology to facilitate everyday functioning of people with chronic pain