Probabilistic modelling of gait for robust passive monitoring in daily life

Passive monitoring in daily life may provide valuable insights into a person's health throughout the day. Wearable sensor devices play a key role in enabling such monitoring in a non-obtrusive fashion. However, sensor data collected in daily life reflect multiple health and behavior-related factors together. This creates the need for a structured principled analysis to produce reliable and interpretable predictions that can be used to support clinical diagnosis and treatment. In this work we develop a principled modelling approach for free-living gait (walking) analysis. Gait is a promising target for non-obtrusive monitoring because it is common and indicative of many different movement disorders such as Parkinson's disease (PD), yet its analysis has largely been limited to experimentally controlled lab settings. To locate and characterize stationary gait segments in free-living using accelerometers, we present an unsupervised probabilistic framework designed to segment signals into differing gait and non-gait patterns. We evaluate the approach using a new video-referenced dataset including 25 PD patients with motor fluctuations and 25 age-matched controls, performing unscripted daily living activities in and around their own houses. Using this dataset, we demonstrate the framework's ability to detect gait and predict medication induced fluctuations in PD patients based on free-living gait. We show that our approach is robust to varying sensor locations, including the wrist, ankle, trouser pocket and lower back

Real time event-based segmentation to classify locomotion activities through a single inertial sensor

We propose an event-based dynamic segmentation technique for the classification of locomotion activities, able to detect the mid-swing, initial contact and end contact events. This technique is based on the use of a shank-mounted inertial sensor incorporating a tri-axial accelerometer and a tri-axial gyroscope, and it is tested on four different locomotion activities: walking, stair ascent, stair descent and running. Gyroscope data along one component are used to dynamically determine the window size for segmentation, and a number of features are then extracted from these segments. The event-based segmentation technique has been compared against three different fixed window size segmentations, in terms of classification accuracy on two different datasets, and with two different feature sets. The dynamic event-based segmentation showed an improvement in terms of accuracy of around 5% (97% vs. 92% and 92% vs. 87%) and 1-2% (89% vs. 87% and 97% vs. 96%) for the two dataset, respectively, thus confirming the need to incorporate an event-based criterion to increase performance in the classification of motion activities

Window Selection Impact in Human Activity Recognition

Signal segmentation is usually applied in the pre-processing step to make the data analysis easier. Windowing approach is commonly used for signal segmentation. However, it is unclear which type of window should be used to get optimum accuracy in human activity recognition. This study aimed to evaluat e which window type yields the optimum accuracy in human activity recognition. The acceleration data of walking, jogging, and running were collected from 20 young adults. Then, the recognition accuracy of each window types is evaluated and compared to determine the impact of window selection in human movement data. From the evaluation, the overlapping 75% window with 0.1 s length provides the highest accuracy with mean, standard deviation, maximum, minimum, and energy as the features. The result of this study could be used for future researches in relation to human activity recognition.&nbsp

A quantitative comparison of Overlapping and Non-overlapping sliding windows effects for human activity recognition using inertial sensors

The sliding window technique is widely used to segment inertial sensor signals, i.e., accelerometers and gyroscopes, for activity recognition. In this technique, the sensor signals are partitioned into fix-sized time windows which can be of two types: (1) non-overlapping windows, in which time windows do not intersect, and (2) overlapping windows, in which they do. There is a generalized idea about the positive impact of using overlapping sliding windows on the performance of recognition systems in Human Activity Recognition. In this thesis, we analyze the impact of overlapping sliding windows on the performance of Human Activity Recognition systems with different evaluation techniques, namely subject-dependent cross validation and subject-independent cross validation. Our results show that the performance improvements regarding to overlapping windowing reported in the literature seem to be associated with the underlying limitations of subject-dependent cross validation. Furthermore, we do not observe any performance gain from the use of such technique in conjunction with subject-independent cross validation. We conclude that when using subject-independent cross validation, non-overlapping sliding windows reach the same performance as sliding windows. This result has significant implications on the resource usage for training the human activity recognition systems

Quantifying the Effects of Knee Joint Biomechanics on Acoustical Emissions

The knee is one of the most injured body parts, causing 18 million patients to be seen in clinics every year. Because the knee is a weight-bearing joint, it is prone to pathologies such as osteoarthritis and ligamentous injuries. Existing technologies for monitoring knee health can provide accurate assessment and diagnosis for acute injuries. However, they are mainly confined to clinical or laboratory settings only, time-consuming, expensive, and not well-suited for longitudinal monitoring. Developing a novel technology for joint health assessment beyond the clinic can further provide insights on the rehabilitation process and quantitative usage of the knee joint. To better understand the underlying properties and fundamentals of joint sounds, this research will investigate the relationship between the changes in the knee joint structure (i.e. structural damage and joint contact force) and the JAEs while developing novel techniques for analyzing these sounds. We envision that the possibility of quantifying joint structure and joint load usage from these acoustic sensors would advance the potential of JAE as the next biomarker of joint health that can be captured with wearable technology. First, we developed a novel processing technique for JAEs that quantify on the structural change of the knee from injured athletes and human lower-limb cadaver models. Second, we quantified whether JAEs can detect the increase in the mechanical stress on the knee joint using an unsupervised graph mining algorithm. Lastly, we quantified the directional bias of the load distribution between medial and lateral compartment using JAEs. Understanding and monitoring the quantitative usage of knee loads in daily activities can broaden the implications for longitudinal joint health monitoring.Ph.D

Privacy-Protecting Techniques for Behavioral Data: A Survey

Our behavior (the way we talk, walk, or think) is unique and can be used as a biometric trait. It also correlates with sensitive attributes like emotions. Hence, techniques to protect individuals privacy against unwanted inferences are required. To consolidate knowledge in this area, we systematically reviewed applicable anonymization techniques. We taxonomize and compare existing solutions regarding privacy goals, conceptual operation, advantages, and limitations. Our analysis shows that some behavioral traits (e.g., voice) have received much attention, while others (e.g., eye-gaze, brainwaves) are mostly neglected. We also find that the evaluation methodology of behavioral anonymization techniques can be further improved

An IoT based Virtual Coaching System (VSC) for Assisting Activities of Daily Life

Nowadays aging of the population is becoming one of the main concerns of theworld. It is estimated that the number of people aged over 65 will increase from 461million to 2 billion in 2050. This substantial increment in the elderly population willhave significant consequences in the social and health care system. Therefore, in thecontext of Ambient Intelligence (AmI), the Ambient Assisted Living (AAL) has beenemerging as a new research area to address problems related to the aging of the population. AAL technologies based on embedded devices have demonstrated to be effectivein alleviating the social- and health-care issues related to the continuous growing of theaverage age of the population. Many smart applications, devices and systems have beendeveloped to monitor the health status of elderly, substitute them in the accomplishment of activities of the daily life (especially in presence of some impairment or disability),alert their caregivers in case of necessity and help them in recognizing risky situations.Such assistive technologies basically rely on the communication and interaction be-tween body sensors, smart environments and smart devices. However, in such contextless effort has been spent in designing smart solutions for empowering and supportingthe self-efficacy of people with neurodegenerative diseases and elderly in general. Thisthesis fills in the gap by presenting a low-cost, non intrusive, and ubiquitous VirtualCoaching System (VCS) to support people in the acquisition of new behaviors (e.g.,taking pills, drinking water, finding the right key, avoiding motor blocks) necessary tocope with needs derived from a change in their health status and a degradation of theircognitive capabilities as they age. VCS is based on the concept of extended mind intro-duced by Clark and Chalmers in 1998. They proposed the idea that objects within theenvironment function as a part of the mind. In my revisiting of the concept of extendedmind, the VCS is composed of a set of smart objects that exploit the Internet of Things(IoT) technology and machine learning-based algorithms, in order to identify the needsof the users and react accordingly. In particular, the system exploits smart tags to trans-form objects commonly used by people (e.g., pillbox, bottle of water, keys) into smartobjects, it monitors their usage according to their needs, and it incrementally guidesthem in the acquisition of new behaviors related to their needs. To implement VCS, thisthesis explores different research directions and challenges. First of all, it addresses thedefinition of a ubiquitous, non-invasive and low-cost indoor monitoring architecture byexploiting the IoT paradigm. Secondly, it deals with the necessity of developing solu-tions for implementing coaching actions and consequently monitoring human activitiesby analyzing the interaction between people and smart objects. Finally, it focuses on the design of low-cost localization systems for indoor environment, since knowing theposition of a person provides VCS with essential information to acquire information onperformed activities and to prevent risky situations. In the end, the outcomes of theseresearch directions have been integrated into a healthcare application scenario to imple-ment a wearable system that prevents freezing of gait in people affected by Parkinson\u2019sDisease

Behaviour Profiling using Wearable Sensors for Pervasive Healthcare

In recent years, sensor technology has advanced in terms of hardware sophistication and miniaturisation. This has led to the incorporation of unobtrusive, low-power sensors into networks centred on human participants, called Body Sensor Networks. Amongst the most important applications of these networks is their use in healthcare and healthy living. The technology has the possibility of decreasing burden on the healthcare systems by providing care at home, enabling early detection of symptoms, monitoring recovery remotely, and avoiding serious chronic illnesses by promoting healthy living through objective feedback. In this thesis, machine learning and data mining techniques are developed to estimate medically relevant parameters from a participant‘s activity and behaviour parameters, derived from simple, body-worn sensors. The first abstraction from raw sensor data is the recognition and analysis of activity. Machine learning analysis is applied to a study of activity profiling to detect impaired limb and torso mobility. One of the advances in this thesis to activity recognition research is in the application of machine learning to the analysis of 'transitional activities': transient activity that occurs as people change their activity. A framework is proposed for the detection and analysis of transitional activities. To demonstrate the utility of transition analysis, we apply the algorithms to a study of participants undergoing and recovering from surgery. We demonstrate that it is possible to see meaningful changes in the transitional activity as the participants recover. Assuming long-term monitoring, we expect a large historical database of activity to quickly accumulate. We develop algorithms to mine temporal associations to activity patterns. This gives an outline of the user‘s routine. Methods for visual and quantitative analysis of routine using this summary data structure are proposed and validated. The activity and routine mining methodologies developed for specialised sensors are adapted to a smartphone application, enabling large-scale use. Validation of the algorithms is performed using datasets collected in laboratory settings, and free living scenarios. Finally, future research directions and potential improvements to the techniques developed in this thesis are outlined