Emotions in context: examining pervasive affective sensing systems, applications, and analyses

Pervasive sensing has opened up new opportunities for measuring our feelings and understanding our behavior by monitoring our affective states while mobile. This review paper surveys pervasive affect sensing by examining and considering three major elements of affective pervasive systems, namely; “sensing”, “analysis”, and “application”. Sensing investigates the different sensing modalities that are used in existing real-time affective applications, Analysis explores different approaches to emotion recognition and visualization based on different types of collected data, and Application investigates different leading areas of affective applications. For each of the three aspects, the paper includes an extensive survey of the literature and finally outlines some of challenges and future research opportunities of affective sensing in the context of pervasive computing

Physiological Self Regulation with Biofeedback Games

Mental stress is a global epidemic that can have serious health consequences including cardiovascular diseases and diabetes. Several techniques are available to teach stress self-regulation skills including therapy, meditation, deep breathing, and biofeedback. While effective, these methods suffer from high drop-outs due to the monotonic nature of the exercises and are generally practiced in quiet relaxed environment, which may not transfer to real-world scenarios. To address these issues, this dissertation presents a novel intervention for stress training using games and wearable sensors. The approach consists of monitoring the user’s physiological signals during gameplay, mapping them into estimates of stress levels, and adapting the game in a way that promotes states of low arousal. This approach offers two key advantages. First, it allows users to focus on the gameplay rather than on monitoring their physiological signals, which makes the training far more engaging. More importantly, it teaches users to self-regulate their stress response, while performing a task designed to increase arousal. Within this broad framework, this dissertation studies three specific problems. First, the dissertation evaluates three physiological signals (breathing rate, heart rate variability, and electrodermal activity) that span across the dimensions of degrees of selectivity in measuring arousal and voluntary control in their effectiveness in lowering arousal. This will identify the signal appropriate for game based stress training and the associated bio-signal processing techniques for real-time arousal estimation. Second, this dissertation investigates different methods of biofeedback presentation e.g. visual feedback and game adaptation during gameplay. Selection of appropriate biofeedback mechanism is critical since it provides the necessary information to improve the perception of visceral states (e.g. stress) to the user. Furthermore, these modalities facilitate skill acquisition in distinct ways (i.e., top-down and bottom-up learning) and influence retention of skills. Third, this dissertation studies reinforcement scheduling in a game and its effect on skill learning and retention. A reinforcement schedule determines which occurrences of the target response are reinforced. This study focuses on continuous and partial reinforcement schedules in GBF and their effect on resistance to extinction (i.e. ability to retain learned skills) after the biofeedback is removed. The main contribution of this dissertation is in demonstrating that stress self-regulation training can be embedded in videogames and help individuals develop more adaptive responses to reduce physiological stress encountered both at home and work

NMC Horizon Report: 2017 Higher Education Edition

The NMC Horizon Report > 2017 Higher Education Edition is a collaborative effort between the NMC and the EDUCAUSE Learning Initiative (ELI). This 14th edition describes annual findings from the NMC Horizon Project, an ongoing research project designed to identify and describe emerging technologies likely to have an impact on learning, teaching, and creative inquiry in education. Six key trends, six significant challenges, and six important developments in educational technology are placed directly in the context of their likely impact on the core missions of universities and colleges. The three key sections of this report constitute a reference and straightforward technology-planning guide for educators, higher education leaders, administrators, policymakers, and technologists. It is our hope that this research will help to inform the choices that institutions are making about technology to improve, support, or extend teaching, learning, and creative inquiry in higher education across the globe. All of the topics were selected by an expert panel that represented a range of backgrounds and perspectives

Knowledge management framework based on brain models and human physiology

The life of humans and most living beings depend on sensation and perception for the best assessment of the surrounding world. Sensorial organs acquire a variety of stimuli that are interpreted and integrated in our brain for immediate use or stored in memory for later recall. Among the reasoning aspects, a person has to decide what to do with available information. Emotions are classifiers of collected information, assigning a personal meaning to objects, events and individuals, making part of our own identity. Emotions play a decisive role in cognitive processes as reasoning, decision and memory by assigning relevance to collected information. The access to pervasive computing devices, empowered by the ability to sense and perceive the world, provides new forms of acquiring and integrating information. But prior to data assessment on its usefulness, systems must capture and ensure that data is properly managed for diverse possible goals. Portable and wearable devices are now able to gather and store information, from the environment and from our body, using cloud based services and Internet connections. Systems limitations in handling sensorial data, compared with our sensorial capabilities constitute an identified problem. Another problem is the lack of interoperability between humans and devices, as they do not properly understand human’s emotional states and human needs. Addressing those problems is a motivation for the present research work. The mission hereby assumed is to include sensorial and physiological data into a Framework that will be able to manage collected data towards human cognitive functions, supported by a new data model. By learning from selected human functional and behavioural models and reasoning over collected data, the Framework aims at providing evaluation on a person’s emotional state, for empowering human centric applications, along with the capability of storing episodic information on a person’s life with physiologic indicators on emotional states to be used by new generation applications

Investigating different approaches and analyses of psychological variables to enhance sport and exercise

This thesis addresses the acquisition of knowledge through a logical step by step process during the PhD course, highlighting five research activities with a main focus on sport and exercise psychology. The ultimate goal for research looked at exploring wearable devices and associated digital technology to deliver interventions aimed to increase exercise while measuring psychological variables such as stress. A foundation was initially set with a systematic review and meta-analysis on correlations between physical activity and key variables such as self-efficacy, self-regulation, and anxiety measured using validated questionnaires. A continued interest in exploring psychometric tools and their validation in sport drove the analysis of a motivation scales and related parameters in a cohort of Italian rugby players. With the beginning of the COVID-19 pandemic, however, community-based sports activities stopped, and the way in which exercise was performed and measured rapidly changed, as I highlighted in the report “Physical activity: Benefits and challenges during the COVID-19 pandemic”. In this unexpected scenario, government agencies as well as private entities and academic institutions applied digital technology to deliver health and wellbeing messages. The use of novel tools was beneficial while facing increased sedentarism occurring during restrictions and lock-down periods. The study performed, involving office workers and electronically delivering exercise interventions in the form of active breaks, showed improvement in wellbeing and stress reduction. Finally, the last study presented can be viewed as a marker in time, as people return to normality, exercising and performing their normal routine but with a new emphasis in keeping track of their own health and wellbeing through wearable technology, following the change in measuring physical and psychological variables consolidated during the pandemic. The results met the intended goal to successfully provide a message-based, digitally delivered intervention aimed at increasing exercise and reducing stress among university students, using wearables to measure the outcome. Moreover, the comparison of wearable-associated stress (based on physiological stimuli) with self-reported stress using a validated questionnaire (e.g., Perceived Stress Scale-10) showed a promising connection. I intend to continue in this direction to further explore benefits and limitations of digital technology in sport and exercise psychology

Mobile devices for the remote acquisition of physiological and behavioral biomarkers in psychiatric clinical research

Psychiatric disorders are linked to a variety of biological, psychological, and contextual causes and consequences. Laboratory studies have elucidated the importance of several key physiological and behavioral biomarkers in the study of psychiatric disorders, but much less is known about the role of these biomarkers in naturalistic settings. These gaps are largely driven by methodological barriers to assessing biomarker data rapidly, reliably, and frequently outside the clinic or laboratory. Mobile health (mHealth) tools offer new opportunities to study relevant biomarkers in concert with other types of data (e.g., self-reports, global positioning system data). This review provides an overview on the state of this emerging field and describes examples from the literature where mHealth tools have been used to measure a wide array of biomarkers in the context of psychiatric functioning (e.g., psychological stress, anxiety, autism, substance use). We also outline advantages and special considerations for incorporating mHealth tools for remote biomarker measurement into studies of psychiatric illness and treatment and identify several specific opportunities for expanding this promising methodology. Integrating mHealth tools into this area may dramatically improve psychiatric science and facilitate highly personalized clinical care of psychiatric disorders

Tracking in the wild: exploring the everyday use of physical activity trackers

As the rates of chronical diseases, such as obesity, cardiovascular disease and diabetes continue to increase, the development of tools that support people in achieving healthier habits is becoming ever more important. Personal tracking systems, such as activity trackers, have emerged as a promising class of tools to support people in managing their everyday health. However, for this promise to be fulfilled, these systems need to be well designed, not only in terms of how they implement specific behavior change techniques, but also in how they integrate into people’s daily lives and address their daily needs. My dissertations provides evidence that accounting for people’s daily practices and needs can help to design activity tracking systems that help people get more value from their tracking practices. To understand how people derive value from their activity tracking practices, I have conducted two inquiries into people’s daily uses of activity tracking systems. In a fist attempt, I led a 10-month study of the adoption of Habito, our own activity tracking mobile app. Habito logged not only users’ physical activity, but also their interactions with the app. This data was used to acquire an estimate of the adoption rate of Habito, and understanding of how adoption is affected by users’ ‘readiness’, i.e., their attitude towards behavior change. In a follow-up study, I turned to the use of video methods and direct, in-situ observations of users’ interactions to understand what motivates people to engage with these tools in their everyday life, and how the surrounding environment shapes their use. These studies revealed some of the complexities of tracking, while extending some of the underlying ideas of behavior change. Among key results: (1) people’s use of activity trackers was found to be predominantly impulsive, where they simultaneously reflect, learn and change their behaviors as they collect data; (2) people’s use of trackers is deeply entangled with their daily routines and practices, and; (3) people use of trackers often is not in line with the traditional vision of these tools as mediators of change – trackers are also commonly used to simply learn about behaviors and engage in moments of self-discovery. Examining how to design activity tracking interfaces that best support people’s different needs , my dissertation further describes an inquiry into the design space of behavioral feedback interfaces. Through a iterative process of synthesis and analysis of research on activity tracking, I devise six design qualities for creating feedback that supports people in their interactions with physical activity data. Through the development and field deployment of four concepts in a field study, I show the potential of these displays for highlighting opportunities for action and learning.À medida que a prevalência de doenças crónicas como a obesidade, doenças cardiovasculares e diabetes continua a aumentar, o desenvolvimento de ferramentas que suportam pessoas a atingir mudanças de comportamento tem-se tornado essencial. Ferramentas de monitorização de comportamentos, tais como monitores de atividade física, têm surgido com a promessa de encorajar um dia a dia mais saudável. Contudo, para que essa promessa seja cumprida, torna-se essencial que estas ferramentas sejam bem concebidas, não só na forma como implementam determinadas estratégias de mudança de comportamento, mas também na forma como são integradas no dia-a-dia das pessoas. A minha dissertação demonstra a importância de considerar as necessidades e práticas diárias dos utilizadores destas ferramentas, de forma a ajudá-las a tirar melhor proveito da sua monitorização de atividade física. De modo a entender como é que os utilizadores destas ferramentas derivam valor das suas práticas de monitorização, a minha dissertação começa por explorar as práticas diárias associadas ao uso de monitores de atividade física. A minha dissertação contribui com duas investigações ao uso diário destas ferramentas. Primeiro, é apresentada uma investigação da adoção de Habito, uma aplicação para monitorização de atividade física. Habito não só registou as instâncias de atividade física dos seus utilizadores, mas também as suas interações com a própria aplicação. Estes dados foram utilizados para adquirir uma taxa de adopção de Habito e entender como é que essa adopção é afetada pela “prontidão” dos utilizadores, i.e., a sua atitude em relação à mudança de comportamento. Num segundo estudo, recorrendo a métodos de vídeo e observações diretas e in-situ da utilização de monitores de atividade física, explorei as motivações associadas ao uso diário destas ferramentas. Estes estudos expandiram algumas das ideias subjacentes ao uso das ferramentas para mudanças de comportamento. Entre resultados principais: (1) o uso de monitores de atividade física é predominantemente impulsivo, onde pessoas refletem, aprendem e alteram os seus comportamentos à medida que recolhem dados sobe estes mesmos comportamentos; (2) o uso de monitores de atividade física está profundamente interligado com as rotinas e práticas dos seus utilizadores, e; (3) o uso de monitores de atividade física nem sempre está ligado a mudanças de comportamento – estas ferramentas também são utilizadas para divertimento e aprendizagem. A minha dissertação contribui ainda com uma exploração do design de interfaces para a monitorização de atividade física. Através de um processo iterativo de síntese e análise de literatura, seis qualidades para a criação de interfaces são derivadas. Através de um estudo de campo, a minha dissertação demonstro o potencial dessas interfaces para ajudar pessoas a aprender e gerir a sua saúde diária