Lesson Learned from Collecting Quantified Self Information via Mobile and Wearable Devices

The ubiquity and affordability of mobile and wearable devices has enabled us to continually and digitally record our daily life activities. Consequently, we are seeing the growth of data collection experiments in several scientific disciplines. Although these have yielded promising results, mobile and wearable data collection experiments are often restricted to a specific configuration that has been designed for a unique study goal. These approaches do not address all the real-world challenges of “continuous data collection” systems. As a result, there have been few discussions or reports about such issues that are faced when “implementing these platforms” in a practical situation. To address this, we have summarized our technical and user-centric findings from three lifelogging and Quantified Self data collection studies, which we have conducted in real-world settings, for both smartphones and smartwatches. In addition to (i) privacy and (ii) battery related issues; based on our findings we recommend further works to consider (iii) implementing multivariate reflection of the data; (iv) resolving the uncertainty and data loss; and (v) consider to minimize the manual intervention required by users. These findings have provided insights that can be used as a guideline for further Quantified Self or lifelogging studies

Collecting Shared Experiences through Lifelogging: Lessons Learned

The emergence of widespread pervasive sensing, personal recording technologies, and systems for the quantified self are creating an environment in which one can capture fine-grained activity traces. Such traces have wide applicability in domains such as human memory augmentation, behavior change, and healthcare. However, obtaining these traces for research is nontrivial, especially those containing photographs of everyday activities. To source data for their own work, the authors created an experimental setup in which they collected detailed traces of a group of researchers over 2.75 days. They share their experiences of this process and present a series of lessons learned for other members of the research community conducting similar studies

A Natural Language Query Interface for Searching Personal Information on Smartwatches

Currently, personal assistant systems, run on smartphones and use natural language interfaces. However, these systems rely mostly on the web for finding information. Mobile and wearable devices can collect an enormous amount of contextual personal data such as sleep and physical activities. These information objects and their applications are known as quantified-self, mobile health or personal informatics, and they can be used to provide a deeper insight into our behavior. To our knowledge, existing personal assistant systems do not support all types of quantified-self queries. In response to this, we have undertaken a user study to analyze a set of “textual questions/queries” that users have used to search their quantified-self or mobile health data. Through analyzing these questions, we have constructed a light-weight natural language based query interface - including a text parser algorithm and a user interface - to process the users’ queries that have been used for searching quantified-self information. This query interface has been designed to operate on small devices, i.e. smartwatches, as well as augmenting the personal assistant systems by allowing them to process end users’ natural language queries about their quantified-self data

A Lifelogging Platform Towards Detecting Negative Emotions in Everyday Life using Wearable Devices

Repeated experiences of negative emotions, such as stress, anger or anxiety, can have long-term consequences for health. These episodes of negative emotion can be associated with inflammatory changes in the body, which are clinically relevant for the development of disease in the long-term. However, the development of effective coping strategies can mediate this causal chain. The proliferation of ubiquitous and unobtrusive sensor technology supports an increased awareness of those physiological states associated with negative emotion and supports the development of effective coping strategies. Smartphone and wearable devices utilise multiple on-board sensors that are capable of capturing daily behaviours in a permanent and comprehensive manner, which can be used as the basis for self-reflection and insight. However, there are a number of inherent challenges in this application, including unobtrusive monitoring, data processing, and analysis. This paper posits a mobile lifelogging platform that utilises wearable technology to monitor and classify levels of stress. A pilot study has been undertaken with six participants, who completed up to ten days of data collection. During this time, they wore a wearable device on the wrist during waking hours to collect instances of heart rate (HR) and Galvanic Skin Resistance (GSR). Preliminary data analysis was undertaken using three supervised machine learning algorithms: Linear Discriminant Analysis (LDA), Quadratic Discriminant Analysis (QDA) and Decision Tree (DT). An accuracy of 70% was achieved using the Decision Tree algorithm

Review of Wearable Devices and Data Collection Considerations for Connected Health

Wearable sensor technology has gradually extended its usability into a wide range of well-known applications. Wearable sensors can typically assess and quantify the wearer’s physiology and are commonly employed for human activity detection and quantified self-assessment. Wearable sensors are increasingly utilised to monitor patient health, rapidly assist with disease diagnosis, and help predict and often improve patient outcomes. Clinicians use various self-report questionnaires and well-known tests to report patient symptoms and assess their functional ability. These assessments are time consuming and costly and depend on subjective patient recall. Moreover, measurements may not accurately demonstrate the patient’s functional ability whilst at home. Wearable sensors can be used to detect and quantify specific movements in different applications. The volume of data collected by wearable sensors during long-term assessment of ambulatory movement can become immense in tuple size. This paper discusses current techniques used to track and record various human body movements, as well as techniques used to measure activity and sleep from long-term data collected by wearable technology devices

COUNTING ON: Humanizing self-tracked data in a connected world

This thesis explores the evolving role of the Quantified Self and self-tracking culture within personalized healthcare. Health and fitness wearables are proliferating globally. However, wearable device abandonment rates are also surging. Wearables can sometimes be authoritative or punitive when presenting wearers with their biological data. In the past, some devices have even triggered adverse health-related conditions. This thesis proposes an approach to visualizing biological data from wearables, in ways that are coherent, contextual, and humane. It critiques normative data visualizations in commercial wearables and speculates alternate futures for self-tracking to empower individuals to manage their health and well-being autonomously. Through an iterative development process to prototype creation, the author gathers biological data using a consumer wearable device and uses it to propose an information architecture that categorizes the data coherently. The architecture is applied in hand-drawn, domestic, embedded visualization prototypes that present the author’s biological data. Lastly, user interviews are conducted to acquire responses to the prototypes and plan possibilities for future iterations. The purpose of this research is to advocate empathy and compassion in the emerging culture of living with data while considering the intricacies of everyday life, the imperfections of being human, and the need for autonomy in personal data management

Signal Processing of Multimodal Mobile Lifelogging Data towards Detecting Stress in Real-World Driving

Stress is a negative emotion that is part of everyday life. However, frequent episodes or prolonged periods of stress can be detrimental to long-term health. Nevertheless, developing self-awareness is an important aspect of fostering effective ways to self-regulate these experiences. Mobile lifelogging systems provide an ideal platform to support self-regulation of stress by raising awareness of negative emotional states via continuous recording of psychophysiological and behavioural data. However, obtaining meaningful information from large volumes of raw data represents a significant challenge because these data must be accurately quantified and processed before stress can be detected. This work describes a set of algorithms designed to process multiple streams of lifelogging data for stress detection in the context of real world driving. Two data collection exercises have been performed where multimodal data, including raw cardiovascular activity and driving information, were collected from twenty-one people during daily commuter journeys. Our approach enabled us to 1) pre-process raw physiological data to calculate valid measures of heart rate variability, a significant marker of stress, 2) identify/correct artefacts in the raw physiological data and 3) provide a comparison between several classifiers for detecting stress. Results were positive and ensemble classification models provided a maximum accuracy of 86.9% for binary detection of stress in the real-world

An interval type-2 fuzzy logic based system for improved instruction within intelligent e-learning platforms

E-learning is becoming increasingly more popular. However, for such platforms (where the students and tutors are geographically separated), it is necessary to estimate the degree of students' engagement with the course contents. Such feedback is highly important and useful for assessing the teaching quality and adjusting the teaching delivery in large-scale online learning platforms. When the number of attendees is large, it is essential to obtain overall engagement feedback, but it is also challenging to do so because of the high levels of uncertainty associated with the environments and students. To handle such uncertainties, we present a type-2 fuzzy logic based system using visual RGB-D features including head pose direction and facial expressions captured from a low-cost but robust 3D camera (Kinect v2) to estimate the engagement degree of the students for both remote and on-site education. This system enriches another self- learning type-2 fuzzy logic system which provides the instructors with suggestions to vary their teaching means to suit the level of course students and improve the course instruction and delivery. This proposed dynamic e-learning environment involves on-site students, distance students, and a teacher who delivers the lecture to all attending onsite and remote students. The rules are learned from the students' behavior and the system is continuously updated to give the teacher the ability to adapt the lecture delivery instructional approach to varied learners' engagement levels. The efficiency of the proposed system has been evaluated through various real-world experiments in the University of Essex iClassroom on a sample of thirty students and six teachers. These experiments demonstrate the efficiency of the proposed interval type-2 fuzzy logic based system to handle the faced uncertainties and produce superior improved average learners' engagements when compared to type-1 fuzzy systems and nonadaptive systems