Automatically detecting "significant events" on SenseCam

SenseCam™ is a wearable, automatic camera with support for memory recall used as a lifelogging device. Recent and continuing work in Dublin City University to apply sophisticated time series analysis methods to the multiple time series generated on a Microsoft SenseCam™ have proved useful in detecting ‘‘Significant Events’’

Signal Processing of Multimodal Mobile Lifelogging Data towards Detecting Stress in Real-World Driving

Stress is a negative emotion that is part of everyday life. However, frequent episodes or prolonged periods of stress can be detrimental to long-term health. Nevertheless, developing self-awareness is an important aspect of fostering effective ways to self-regulate these experiences. Mobile lifelogging systems provide an ideal platform to support self-regulation of stress by raising awareness of negative emotional states via continuous recording of psychophysiological and behavioural data. However, obtaining meaningful information from large volumes of raw data represents a significant challenge because these data must be accurately quantified and processed before stress can be detected. This work describes a set of algorithms designed to process multiple streams of lifelogging data for stress detection in the context of real world driving. Two data collection exercises have been performed where multimodal data, including raw cardiovascular activity and driving information, were collected from twenty-one people during daily commuter journeys. Our approach enabled us to 1) pre-process raw physiological data to calculate valid measures of heart rate variability, a significant marker of stress, 2) identify/correct artefacts in the raw physiological data and 3) provide a comparison between several classifiers for detecting stress. Results were positive and ensemble classification models provided a maximum accuracy of 86.9% for binary detection of stress in the real-world

Remotely Monitoring and Preventing the Development of Pressure Ulcers with the Aid of Human Digital Memories

There is growing concern, among senior personnel in the National Health Service in the UK, over the increased development of pressure ulcers. The occurrence of pressure ulcers has been attributed to prolong sedentary behaviour. Providing care, for this preventable condition, is costly and time-consuming for patients and medical practitioners. Extra bedside assistance is needed; however, with the workload of medical staff increasing, this is not always practical. In order to prevent the occurrence of pressure ulcers new and novel ways of remotely monitoring patients is essential. An interesting approach worth considering is the use of human digital memories, which provide visual life logs of a patient’s physiological and environmental data. This paper discusses some of the current technologies used within the area and how they might be applied to the management and prevention of pressure ulcers. We have successfully developed a working prototype system to demonstrate the applicability of our approach

Advancing the objective measurement of physical activity and sedentary behaviour context

Objective data from national surveillance programmes show that, on average, individuals accumulate high amounts of sedentary time per day and only a small minority of adults achieve physical activity guidelines. One potential explanation for the failure of interventions to increase population levels of physical activity or decrease sedentary time is that research to date has been unable to identify the specific behavioural levers in specific contexts needed to change behaviour. Novel technology is emerging with the potential to elucidate these specific behavioural contexts and thus identify these specific behavioural levers. Therefore the aims of this four study thesis were to identify novel technologies capable of measuring the behavioural context, to evaluate and validate the most promising technology and to then pilot this technology to assess the behavioural context of older adults, shown by surveillance programmes to be the least physically active and most sedentary age group. Study one Purpose: To identify, via a systematic review, technologies which have been used or could be used to measure the location of physical activity or sedentary behaviour. Methods: Four electronic databases were searched using key terms built around behaviour, technology and location. To be eligible for inclusion papers were required to be published in English and describe a wearable or portable technology or device capable of measuring location. Searches were performed from the inception of the database up to 04/02/2015. Searches were also performed using three internet search engines. Specialised software was used to download search results and thus mitigate the potential pitfalls of changing search algorithms. Results: 188 research papers met the inclusion criteria. Global positioning systems were the most widely used location technology in the published research, followed by wearable cameras and Radio-frequency identification. Internet search engines identified 81 global positioning systems, 35 real-time locating systems and 21 wearable cameras. Conclusion: The addition of location information to existing measures of physical activity and sedentary behaviour will provide important behavioural information. Study Two Purpose: This study investigated the Actigraph proximity feature across three experiments. The aim of Experiment One was to assess the basic characteristics of the Actigraph RSSI signal across a range of straight line distances. Experiment Two aimed to assess the level of receiver device signal detection in a single room under unobstructed conditions, when various obstructions are introduced and the impacts these obstructions have on the intra and inter unit variability of the RSSI signal. Finally, Experiment Three aimed to assess signal contamination across multiple rooms (i.e. one beacon being detected in multiple rooms). Methods: Across all experiments, the receiver(s) collected data at 10 second epochs, the highest resolution possible. In Experiment One two devices, one receiver and one beacon, were placed opposite each other at 10cm increments for one minute at each distance. The RSSI-distance relationship was then visually assessed for linearity. In Experiment Two, a test room was demarcated into 0.5 x 0.5 m grids with receivers simultaneously placed in each demarcated grid. This process was then repeated under wood, metal and human obstruction conditions. Descriptive tallies were used to assess the signal detection achieved for each receiver from each beacon in each grid. Mean RSSI signal was calculated for each condition alongside intra and inter-unit standard deviation, coefficient of variation and standard error of the measurement. In Experiment Three, a test apartment was used with three beacons placed across two rooms. The researcher then completed simulated conditions for 10 minutes each across the two rooms. The percentage of epochs where a signal was detected from each of the three beacons across each test condition was then calculated. Results: In Experiment One, the relationship between RSSI and distance was found to be non-linear. In Experiment Two, high signal detection was achieved in all conditions; however, there was a large degree of intra and inter-unit variability in RSSI. In Experiment Three, there was a large degree of multi-room signal contamination. Conclusion: The Actigraph proximity feature can provide a binary indicator of room level location. Study Three Purpose: To use novel technology in three small feasibility trials to ascertain where the greatest utility can be demonstrated. Methods: Feasibility Trial One assessed the concurrent validity of electrical energy monitoring and wearable cameras as measures of television viewing. Feasibility Trial Two utilised indoor location monitoring to assess where older adult care home residents accumulate their sedentary time. Lastly, Feasibility Trial Three investigated the use of proximity sensors to quantify exposure to a height adjustable desk Results: Feasibility Trial One found that on average the television is switched on for 202 minutes per day but is visible in just 90 minutes of wearable camera images with a further 52 minutes where the participant is in their living room but the television is not visible in the image. Feasibility Trial Two found that residents were highly sedentary (sitting for an average of 720 minutes per day) and spent the majority of their time in their own rooms with more time spent in communal areas in the morning than in the afternoon. Feasibility Trial Three found a discrepancy between self-reported work hours and objectively measured office dwell time. Conclusion: The feasibility trials outlined in this study show the utility of objectively measuring context to provide more detailed and refined data. Study Four Purpose: To objectively measure the context of sedentary behaviour in the most sedentary age group, older adults. Methods: 26 residents and 13 staff were recruited from two care homes. Each participant wore an Actigraph GT9X on their non-dominant wrist and a LumoBack posture sensor on their lower back for one week. The Actigraph recorded proximity every 10 seconds and acceleration at 100 Hz. LumoBack data were provided as summaries per 5 minutes. Beacon Actigraphs were placed around each care home in the resident s rooms, communal areas and corridors. Proximity and posture data were combined in 5 minute epochs with descriptive analysis of average time spent sitting in each area produced. Acceleration data were summarised into 10 second epochs and combined with proximity data to show the average count per epoch in each area of the care home. Mann-Whitney tests were performed to test for differences between care homes. Results: No significant differences were found between Care Home One and Care Home Two in the amount of time spent sitting in communal areas of the care home (301 minutes per day and 39 minutes per day respectively, U=23, p=0.057) or in the amount of time residents spent sitting in their own room (215 minutes per day and 337 minutes per day in Care Home One and Two respectively, U=32, p=0.238). In both care homes, accelerometer measured average movement increases with the number of residents in the communal area. Conclusion: The Actigraph proximity system was able to quantify the context of sedentary behaviour in older adults. This enabled the identification of levers for behaviour change which can be used to reduce sedentary time in this group. Overall conclusion: There are a large number of technologies available with the potential to measure the context of physical activity or sedentary time. The Actigraph proximity feature is one such technology. This technology is able to provide a binary measure of proximity via the detection or non-detection of Bluetooth signal: however, the variability of the signal prohibits distance estimation. The Actigraph proximity feature, in combination with a posture sensor, is able to elucidate the context of physical activity and sedentary time

The development and evaluation of a novel online tool for assessing dietary intake and physical activity levels for use in adult populations

The Synchronised Nutrition and Activity Program for Adults (SNAPA™) was developed to address the need for accurate, reliable, feasible, inexpensive and low burden methods for measuring diet and physical activity behaviours in free-living adult populations. Usability testing (n=5) identified a number of usability issues and the program was revised accordingly. Test-retest reliability (n=44) revealed no substantial systematic shifts in mean values. Outcome variables were percentage food energy from fat (%fat), number of fruit and vegetable portions (FV), and minutes of moderate to vigorous activity (MVPA). Single measure intra-class correlations (ICC) ranged from 0.62 to 0.72 and average measure ICC range from 0.76 to 0.84. The preliminary method comparison study (n=71) revealed correlations between SNAPA™ and multiple pass recall dietary interview-derived %fat and FV portions of 0.48 (bootstrapped 90% CI 0.31, 0.64) and 0.42 (bootstrapped 90% CI 0.22, 0.60) respectively. The correlation between SNAPA™ and accelerometry-derived MVPA was 0.39 (bootstrapped 90% CI 0.08, 0.64). The in-depth primary method comparison study (n=77) investigated the agreement between SNAPA™ and dietary observation and combined heart rate and accelerometry. The mean match and phantom rates between SNAPA™ and lunchtime dietary observation was 81.7% and 5.6%, respectively. Correlations between SNAPA™ and the reference method outcomes ranged between 0.39 and 0.56. Passing-Bablok (type II) regression analysis revealed both fixed and proportional bias for the estimation of energy intake; proportional bias for fat intake (g); a fixed bias for MVPA, and no substantial biases for %fat or FV portions. SNAPA™ was used to collect diet and physical activity data in a health promotion campaign, ‘Get a Better Life’ (n=1201), providing useful information on the feasibility of using the program in a real-world initiative. SNAPA™ is a promising tool for the surveillance of diet and physical behaviours at a group level in adult populations

From Context to Content: Designing Sensor Support for Reflective Learning

This thesis examines how wearable sensor systems can support reflective learning by monitoring work experiences. A design space is defined that guides designers to build systems that can provide content for reflection. Wearable sensors and applications have been developed and evaluated to capture the affective and social context in workplace settings. It is a first step towards the generation of learning content from sensor data

Advancement in Dietary Assessment and Self-Monitoring Using Technology

Although methods to assess or self-monitor intake may be considered similar, the intended function of each is quite distinct. For the assessment of dietary intake, methods aim to measure food and nutrient intake and/or to derive dietary patterns for determining diet-disease relationships, population surveillance or the effectiveness of interventions. In comparison, dietary self-monitoring primarily aims to create awareness of and reinforce individual eating behaviours, in addition to tracking foods consumed. Advancements in the capabilities of technologies, such as smartphones and wearable devices, have enhanced the collection, analysis and interpretation of dietary intake data in both contexts. This Special Issue invites submissions on the use of novel technology-based approaches for the assessment of food and/or nutrient intake and for self-monitoring eating behaviours. Submissions may document any part of the development and evaluation of the technology-based approaches. Examples may include: web adaption of existing dietary assessment or self-monitoring tools (e.g., food frequency questionnaires, screeners) image-based or image-assisted methods mobile/smartphone applications for capturing intake for assessment or self-monitoring wearable cameras to record dietary intake or eating behaviours body sensors to measure eating behaviours and/or dietary intake use of technology-based methods to complement aspects of traditional dietary assessment or self-monitoring, such as portion size estimation