Real-time human ambulation, activity, and physiological monitoring:taxonomy of issues, techniques, applications, challenges and limitations

Automated methods of real-time, unobtrusive, human ambulation, activity, and wellness monitoring and data analysis using various algorithmic techniques have been subjects of intense research. The general aim is to devise effective means of addressing the demands of assisted living, rehabilitation, and clinical observation and assessment through sensor-based monitoring. The research studies have resulted in a large amount of literature. This paper presents a holistic articulation of the research studies and offers comprehensive insights along four main axes: distribution of existing studies; monitoring device framework and sensor types; data collection, processing and analysis; and applications, limitations and challenges. The aim is to present a systematic and most complete study of literature in the area in order to identify research gaps and prioritize future research directions

Recognition of elementary upper limb movements in an activity of daily living using data from wrist mounted accelerometers

In this paper we present a methodology as a proof of concept for recognizing fundamental movements of the humanarm (extension, flexion and rotation of the forearm) involved in ‘making-a-cup-of-tea’, typical of an activity of daily-living (ADL). The movements are initially performed in a controlled environment as part of a training phase and the data are grouped into three clusters using k-means clustering. Movements performed during ADL, forming part of the testing phase, are associated with each cluster label using a minimum distance classifier in a multi-dimensional feature space, comprising of features selected from a ranked set of 30 features, using Euclidean and Mahalonobis distance as the metric. Experiments were performed with four healthy subjects and our results show that the proposed methodology can detect the three movements with an overall average accuracy of 88% across all subjects and arm movement types using Euclidean distance classifier

Central monitoring system for ambient assisted living

Smart homes for aged care enable the elderly to stay in their own homes longer. By means of various types of ambient and wearable sensors information is gathered on people living in smart homes for aged care. This information is then processed to determine the activities of daily living (ADL) and provide vital information to carers. Many examples of smart homes for aged care can be found in literature, however, little or no evidence can be found with respect to interoperability of various sensors and devices along with associated functions. One key element with respect to interoperability is the central monitoring system in a smart home. This thesis analyses and presents key functions and requirements of a central monitoring system. The outcomes of this thesis may benefit developers of smart homes for aged care

Recognizing Activities of Daily Living of People with Parkinson's

Tese de mestrado, Informática, Universidade de Lisboa, Faculdade de Ciências, 2022Parkinson's disease is a common neurodegenerative disease that affects a large part of the world's population. This disease involves a lot of symptoms, however the most prevalent is the change in the patient's movements or even the loss of functionality. There is no treatment, however it exists medication that relieves and reduces the symptoms for a period. A Parkinson’s patient needs to be watched by clinicians to understand if the medication is working correctly and to analyse the disease progression. The current way of doing this evaluation is at clinics where the patient needs to go to the clinic or to live there. With this into consideration it was requested a monitoring system of activities of daily living for Parkinson’s patient. The monitoring system consists in a mobile application in an Android smartphone serving as a diary for the patient of clinician to record the activities done at that moment. With this application, the patient needs to wear an accelerometer in the wrist to gather the acceleration in the 3-axis. The application besides the monitoring function, it gives the ability to the clinician to schedule lists of activities for the patient to do during the day, allowing the clinician to have some control. We carried out a study with 10 healthy participants which used the monitorization system for 3 days each. The patient would worn the accelerometer and record the activities that they would do throughout the day, was asked a minimum of 5 activities per day. Alongside this recording it was schedule 1 list of activities to be carried out each day, this list only had motor activities such as walk, sit down, and stand up. At the end of each participant study, it was made a questionnaire with standard usability questions and an interview that helped us understand if the system was reliable or not

Recognition of elementary arm movements using orientation of a tri-axial accelerometer located near the wrist

In this paper we present a method for recognising three fundamental movements of the human arm (reach and retrieve, lift cup to mouth, rotation of the arm) by determining the orientation of a tri-axial accelerometer located near the wrist. Our objective is to detect the occurrence of such movements performed with the impaired arm of a stroke patient during normal daily activities as a means to assess their rehabilitation. The method relies on accurately mapping transitions of predefined, standard orientations of the accelerometer to corresponding elementary arm movements. To evaluate the technique, kinematic data was collected from four healthy subjects and four stroke patients as they performed a number of activities involved in a representative activity of daily living, 'making-a-cup-of-tea'. Our experimental results show that the proposed method can independently recognise all three of the elementary upper limb movements investigated with accuracies in the range 91–99% for healthy subjects and 70–85% for stroke patients

Inferring Complex Activities for Context-aware Systems within Smart Environments

The rising ageing population worldwide and the prevalence of age-related conditions such as physical fragility, mental impairments and chronic diseases have significantly impacted the quality of life and caused a shortage of health and care services. Over-stretched healthcare providers are leading to a paradigm shift in public healthcare provisioning. Thus, Ambient Assisted Living (AAL) using Smart Homes (SH) technologies has been rigorously investigated to help address the aforementioned problems. Human Activity Recognition (HAR) is a critical component in AAL systems which enables applications such as just-in-time assistance, behaviour analysis, anomalies detection and emergency notifications. This thesis is aimed at investigating challenges faced in accurately recognising Activities of Daily Living (ADLs) performed by single or multiple inhabitants within smart environments. Specifically, this thesis explores five complementary research challenges in HAR. The first study contributes to knowledge by developing a semantic-enabled data segmentation approach with user-preferences. The second study takes the segmented set of sensor data to investigate and recognise human ADLs at multi-granular action level; coarse- and fine-grained action level. At the coarse-grained actions level, semantic relationships between the sensor, object and ADLs are deduced, whereas, at fine-grained action level, object usage at the satisfactory threshold with the evidence fused from multimodal sensor data is leveraged to verify the intended actions. Moreover, due to imprecise/vague interpretations of multimodal sensors and data fusion challenges, fuzzy set theory and fuzzy web ontology language (fuzzy-OWL) are leveraged. The third study focuses on incorporating uncertainties caused in HAR due to factors such as technological failure, object malfunction, and human errors. Hence, existing studies uncertainty theories and approaches are analysed and based on the findings, probabilistic ontology (PR-OWL) based HAR approach is proposed. The fourth study extends the first three studies to distinguish activities conducted by more than one inhabitant in a shared smart environment with the use of discriminative sensor-based techniques and time-series pattern analysis. The final study investigates in a suitable system architecture with a real-time smart environment tailored to AAL system and proposes microservices architecture with sensor-based off-the-shelf and bespoke sensing methods. The initial semantic-enabled data segmentation study was evaluated with 100% and 97.8% accuracy to segment sensor events under single and mixed activities scenarios. However, the average classification time taken to segment each sensor events have suffered from 3971ms and 62183ms for single and mixed activities scenarios, respectively. The second study to detect fine-grained-level user actions was evaluated with 30 and 153 fuzzy rules to detect two fine-grained movements with a pre-collected dataset from the real-time smart environment. The result of the second study indicate good average accuracy of 83.33% and 100% but with the high average duration of 24648ms and 105318ms, and posing further challenges for the scalability of fusion rule creations. The third study was evaluated by incorporating PR-OWL ontology with ADL ontologies and Semantic-Sensor-Network (SSN) ontology to define four types of uncertainties presented in the kitchen-based activity. The fourth study illustrated a case study to extended single-user AR to multi-user AR by combining RFID tags and fingerprint sensors discriminative sensors to identify and associate user actions with the aid of time-series analysis. The last study responds to the computations and performance requirements for the four studies by analysing and proposing microservices-based system architecture for AAL system. A future research investigation towards adopting fog/edge computing paradigms from cloud computing is discussed for higher availability, reduced network traffic/energy, cost, and creating a decentralised system. As a result of the five studies, this thesis develops a knowledge-driven framework to estimate and recognise multi-user activities at fine-grained level user actions. This framework integrates three complementary ontologies to conceptualise factual, fuzzy and uncertainties in the environment/ADLs, time-series analysis and discriminative sensing environment. Moreover, a distributed software architecture, multimodal sensor-based hardware prototypes, and other supportive utility tools such as simulator and synthetic ADL data generator for the experimentation were developed to support the evaluation of the proposed approaches. The distributed system is platform-independent and currently supported by an Android mobile application and web-browser based client interfaces for retrieving information such as live sensor events and HAR results

An Internet of Things based bed-egress alerting paradigm using wearable sensors in elderly care environment

The lack of healthcare staff and increasing proportions of elderly population is alarming. The traditional means to look after elderly has resulted in 255,000 reported falls (only within UK). This not only resulted in extensive aftercare needs and surgeries (summing up to £4.4 billion) but also in added suffering and increased mortality. In such circumstances, the technology can greatly assist by offering automated solutions for the problem at hand. The proposed work offers an Internet of things (IoT) based patient bed-exit monitoring system in clinical settings, capable of generating a timely response to alert the healthcare workers and elderly by analyzing the wireless data streams, acquired through wearable sensors. This work analyzes two different datasets obtained from divergent families of sensing technologies, i.e., smartphone-based accelerometer and radio frequency identification (RFID) based accelerometer. The findings of the proposed system show good efficacy in monitoring the bed-exit and discriminate other ambulating activities. Furthermore, the proposed work manages to keep the average end-to-end system delay (i.e., communications of sensed data to Data Sink (DS)/Control Center (CC) + machine-based feature extraction and class identification + feedback communications to a relevant healthcare worker/elderly) below 1 10 th of a second

An Internet of Things Based Bed-Egress Alerting Paradigm Using Wearable Sensors in Elderly Care Environment

The lack of healthcare staff and increasing proportions of elderly population is alarming. The traditional means to look after elderly has resulted in 255,000 reported falls (only within UK). This not only resulted in extensive aftercare needs and surgeries (summing up to £4.4 billion) but also in added suffering and increased mortality. In such circumstances, the technology can greatly assist by offering automated solutions for the problem at hand. The proposed work offers an Internet of things (IoT) based patient bed-exit monitoring system in clinical settings, capable of generating a timely response to alert the healthcare workers and elderly by analyzing the wireless data streams, acquired through wearable sensors. This work analyzes two different datasets obtained from divergent families of sensing technologies, i.e., smartphone-based accelerometer and radio frequency identification (RFID) based accelerometer. The findings of the proposed system show good efficacy in monitoring the bed-exit and discriminate other ambulating activities. Furthermore, the proposed work manages to keep the average end-to-end system delay (i.e., communications of sensed data to Data Sink (DS)/Control Center (CC) + machine-based feature extraction and class identification + feedback communications to a relevant healthcare worker/elderly) below 1 10 th of a second