Recognition of Activities of Daily Living and Environments Using Acoustic Sensors Embedded on Mobile Devices

The identification of Activities of Daily Living (ADL) is intrinsic with the user’s environment recognition. This detection can be executed through standard sensors present in every-day mobile devices. On the one hand, the main proposal is to recognize users’ environment and standing activities. On the other hand, these features are included in a framework for the ADL and environment identification. Therefore, this paper is divided into two parts—firstly, acoustic sensors are used for the collection of data towards the recognition of the environment and, secondly, the information of the environment recognized is fused with the information gathered by motion and magnetic sensors. The environment and ADL recognition are performed by pattern recognition techniques that aim for the development of a system, including data collection, processing, fusion and classification procedures. These classification techniques include distinctive types of Artificial Neural Networks (ANN), analyzing various implementations of ANN and choosing the most suitable for further inclusion in the following different stages of the developed system. The results present 85.89% accuracy using Deep Neural Networks (DNN) with normalized data for the ADL recognition and 86.50% accuracy using Feedforward Neural Networks (FNN) with non-normalized data for environment recognition. Furthermore, the tests conducted present 100% accuracy for standing activities recognition using DNN with normalized data, which is the most suited for the intended purpose.This work is funded by FCT/MEC through national funds and co-funded by FEDER-PT2020 partnership agreement under the project UID/EEA/50008/2019

Predictive modeling of health status using motion analysis from mobile phones

It is unknown what physiological functions can be monitored at clinical quality with a normal smartphone, which is ubiquitous. There are standard measures like walk speed, pulmonary function and oxygen saturation variation for health status of cardiopulmonary patients. The dissertation is to summarize my studies of using sensor data from regular smartphones to accurately measure walking patterns, in order to monitoring health status for cardiopulmonary patients. Fifty five pulmonary patients were participated in the study. The sensor data for their walk test and free walk are collected and stored by a novel designed Android smartphone application. Different machine learning techniques are applied and compared to predict gait speed, pulmonary function and oxygen saturation. The result shows that walking patterns are highly correlated with health status. The trained models can predict health status accurately for each patient. Initial testing indicates the same high accuracy as with active monitors, for patients in hospitals during walk tests. The ultimate goal is that patients can simply carry their phones during everyday living, while models support automatic prediction of pulmonary function for health monitoring