Lifelogging Data Validation Model for Internet of Things enabled Personalized Healthcare

The rapid advance of the Internet of Things (IoT) technology offers opportunities to monitor lifelogging data by a variety of IoT assets, like wearable sensors, mobile apps, etc. But due to heterogeneity of connected devices and diverse life patterns in an IoT environment, lifelogging personal data contains much uncertainty and are hardly used for healthcare studies. Effective validation of lifelogging personal data for longitudinal health assessment is demanded. In this paper, it takes lifelogging physical activity as a target to explore the possibility of improving validity of lifelogging data in an IoT based healthcare environment. A rule based adaptive lifelogging physical activity validation model, LPAV-IoT, is proposed for eliminating irregular uncertainties and estimating data reliability in IoT healthcare environments. In LPAV-IoT, a methodology specifying four layers and three modules is presented for analyzing key factors impacting validity of lifelogging physical activity. A series of validation rules are designed with uncertainty threshold parameters and reliability indicators and evaluated through experimental investigations. Following LPAV-IoT, a case study on an IoT enabled personalized healthcare platform MHA [38] connecting three state-of-the-art wearable devices and mobile apps are carried out. The results reflect that the rules provided by LPAV-IoT enable efficiently filtering at least 75% of irregular uncertainty and adaptively indicating the reliability of lifelogging physical activity data on certain condition of an IoT personalized environment

Uncertainty Investigation for Personalised Lifelogging Physical Activity Intensity Pattern Assessment with Mobile Devices

Lifelogging physical activity (PA) assessment is crucial to healthcare technologies and studies for the purpose of treatments and interventions of chronic diseases. Traditional lifelogging PA monitoring is conducted in non-naturalistic settings by means of wearable devices or mobile phones such as fixed placements, controlled durations or dedicated sensors. Although they achieved satisfactory outcomes for healthcare studies, the practicability become the key issues. Recent advance of mobile devices make lifelogging PA tracking for healthy or unhealthy individuals possible. However, owning to diverse physical characteristics, immaturity of PA recognition techniques, different settings from manufactories and a majority of uncertainties in real life, the results of PA measurement is leading to be inapplicable for PA pattern detection in a long range, especially hardly exploited in the wellbeing monitoring or behaviour changes. This paper investigates and compares uncertainties of existing mobile devices for individual’s PA tracking. Irregular uncertainties (IU) are firstly removed by exploiting Ellipse fitting model, and then monthly density maps that contain regular uncertainties (RU) are constructed based on metabolic equivalents (METs) of different activity types. Five months of four subjects PA intensity changes using the mobile app tracker Moves [1] and Google Fit app on wearable device Samsung wear S2 are carried out from a mobile personalised healthcare platform MHA [2]. The result indicates that uncertainty of PA intensity monitored by mobile phone is 90% lower than wearable device, where the datasets tend to be further explored by healthcare/fitness studies. Whilst PA activity monitoring by mobile phone is still a challenging issue by far due to much more uncertainties than wearable devices

Multiple Density Maps Information Fusion for Effectively Assessing Intensity Pattern of Lifelogging Physical Activity

Physical activity (PA) measurement is a crucial task in healthcare technology aimed at monitoring the progression and treatment of many chronic diseases. Traditional lifelogging PA measures require relatively high cost and can only be conducted in controlled or semi-controlled environments, though they exhibit remarkable precision of PA monitoring outcomes. Recent advancement of commercial wearable devices and smartphones for recording one’s lifelogging PA has popularized data capture in uncontrolled environments. However, due to diverse life patterns and heterogeneity of connected devices as well as the PA recognition accuracy, lifelogging PA data measured by wearable devices and mobile phones contains much uncertainty thereby limiting their adoption for healthcare studies. To improve the feasibility of PA tracking datasets from commercial wearable/mobile devices, this paper proposes a lifelogging PA intensity pattern decision making approach for lifelong PA measures. The method is to firstly remove some irregular uncertainties (IU) via an Ellipse fitting model, and then construct a series of monthly based hour-day density map images for representing PA intensity patterns with regular uncertainties (RU) on each month. Finally it explores Dempster-Shafer theory of evidence fusing information from these density map images for generating a decision making model of a final personal lifelogging PA intensity pattern. The approach has significantly reduced the uncertainties and incompleteness of datasets from third party devices. Two case studies on a mobile personalized healthcare platform MHA [1] connecting the mobile app Moves are carried out. The results indicate that the proposed approach can improve effectiveness of PA tracking devices or apps for various types of people who frequently use them as a healthcare indicator

Internet of Things Enabled Technologies for Behaviour Analytics in Elderly Person Care: A Survey

The advances in sensor technology over recent years has provided new ways for researchers to monitor the elderly in uncontrolled environments. Sensors have become smaller, cheaper and can be worn on the body, potentially creating a network of sensors. Smart phones are also more common in the average household and can also provide some behavioural analysis due to the built in sensors. As a result of this, researchers are able to monitor behaviours in a more natural setting, which can lead to more useful data. This is important for those that may be suffering from mental illness as it allows for continuous, non-invasive monitoring in order to diagnose symptoms from different behaviours. However there are various challenges that need to be addressed ranging from issues with sensors to the involvement of human factors. It is vital that these challenges are taken into consideration along with the major behavioural symptoms that can appear in an Elderly Person. For a person suffering with Dementia, the application of sensor technologies can improve the quality of life of the person and also monitor the progress of the disease through behavioural analysis. This paper will consider the behaviours that can be associated with dementia and how these behaviours can be monitored through sensor technology. We will also provide an insight into some sensors and algorithms gathered through survey in order to provide advantages and disadvantages of these technologies as well as to present any challenges that may face future research

SAW Delay Line based Smart Sensing in Water Distribution System

Wireless Passive Surface Acoustic Wave (SAW) sensors have attracted great attention in numerous applications. They are powered by interrogating Radio Frequency (RF) pulses rather than batteries. In this study, a wireless passive SAW temperature and pressure delay line sensor was adapted in a designed framework which can control the ambient liquid temperature and pressure and characterised. The experimental results meet the theoretical analysis that the related phase delay of the response signal depends linearly on the temperature (pressure) when the pressure (temperature) keeps constant

An overview of data fusion techniques for internet of things enabled physical activity recognition and measure

Due to importantly beneficial effects on physical and mental health and strong association with many rehabilitation programs, Physical Activity Recognition and Measure (PARM) has been widely recognised as a key paradigm for a variety of smart healthcare applications. Traditional methods for PARM relies on designing and utilising Data fusion or machine learning techniques in processing ambient and wearable sensing data for classifying types of physical activity and removing their uncertainties. Yet they mostly focus on controlled environments with the aim of increasing types of identifiable activity subjects, improved recognition accuracy and measure robustness. The emergence of the Internet of Things (IoT) enabling technology is transferring PARM studies to an open and dynamic uncontrolled ecosystem by connecting heterogeneous cost-effective wearable devices and mobile apps and various groups of users. Little is currently known about whether traditional Data fusion techniques can tackle new challenges of IoT environments and how to effectively harness and improve these technologies. In an effort to understand potential use and opportunities of Data fusion techniques in IoT enabled PARM applications, this paper will give a systematic review, critically examining PARM studies from a perspective of a novel 3D dynamic IoT based physical activity collection and validation model. It summarized traditional state-of-the-art data fusion techniques from three plane domains in the 3D dynamic IoT model: devices, persons and timeline. The paper goes on to identify some new research trends and challenges of data fusion techniques in the IoT enabled PARM studies, and discusses some key enabling techniques for tackling them

Designing and evaluating a user interface for continous embedded lifelogging based on physical context

PhD ThesisAn increase in both personal information and storage capacity has encouraged people to store and archive their life experience in multimedia formats. The usefulness of such large amounts of data will remain inadequate without the development of both retrieval techniques and interfaces that help people access and navigate their personal collections. The research described in this thesis investigates lifelogging technology from the perspective of the psychology of memory and human-computer interaction. The research described seeks to increase my understanding of what data can trigger memories and how I might use this insight to retrieve past life experiences in interfaces to lifelogging technology. The review of memory and previous research on lifelogging technology allows and support me to establish a clear understanding of how memory works and design novel and effective memory cues; whilst at the same time I critiqued existing lifelogging systems and approaches to retrieving memories of past actions and activities. In the initial experiments I evaluated the design and implementation of a prototype which exposed numerous problems both in the visualisation of data and usability. These findings informed the design of novel lifelogging prototype to facilitate retrieval. I assessed the second prototype and determined how an improved system supported access and retrieval of users’ past life experiences, in particular, how users group their data into events, how they interact with their data, and the classes of memories that it supported. In this doctoral thesis I found that visualizing the movements of users’ hands and bodies facilitated grouping activities into events when combined with the photos and other data captured at the same time. In addition, the movements of the user's hand and body and the movements of some objects can promote an activity recognition or support user detection and grouping of them into events. Furthermore, the ability to search for specific movements significantly reduced the amount of time that it took to retrieve data related to specific events. I revealed three major strategies that users followed to understand the combined data: skimming sequences, cross sensor jumping and continued scanning

Lesson Learned from Collecting Quantified Self Information via Mobile and Wearable Devices

The ubiquity and affordability of mobile and wearable devices has enabled us to continually and digitally record our daily life activities. Consequently, we are seeing the growth of data collection experiments in several scientific disciplines. Although these have yielded promising results, mobile and wearable data collection experiments are often restricted to a specific configuration that has been designed for a unique study goal. These approaches do not address all the real-world challenges of “continuous data collection” systems. As a result, there have been few discussions or reports about such issues that are faced when “implementing these platforms” in a practical situation. To address this, we have summarized our technical and user-centric findings from three lifelogging and Quantified Self data collection studies, which we have conducted in real-world settings, for both smartphones and smartwatches. In addition to (i) privacy and (ii) battery related issues; based on our findings we recommend further works to consider (iii) implementing multivariate reflection of the data; (iv) resolving the uncertainty and data loss; and (v) consider to minimize the manual intervention required by users. These findings have provided insights that can be used as a guideline for further Quantified Self or lifelogging studies