Unsupervised monitoring of an elderly person\u27s activities of daily living using Kinect sensors and a power meter

The need for greater independence amongst the growing population of elderly people has made the concept of “ageing in place” an important area of research. Remote home monitoring strategies help the elderly deal with challenges involved in ageing in place and performing the activities of daily living (ADLs) independently. These monitoring approaches typically involve the use of several sensors, attached to the environment or person, in order to acquire data about the ADLs of the occupant being monitored. Some key drawbacks associated with many of the ADL monitoring approaches proposed for the elderly living alone need to be addressed. These include the need to label a training dataset of activities, use wearable devices or equip the house with many sensors. These approaches are also unable to concurrently monitor physical ADLs to detect emergency situations, such as falls, and instrumental ADLs to detect deviations from the daily routine. These are all indicative of deteriorating health in the elderly. To address these drawbacks, this research aimed to investigate the feasibility of unsupervised monitoring of both physical and instrumental ADLs of elderly people living alone via inexpensive minimally intrusive sensors. A hybrid framework was presented which combined two approaches for monitoring an elderly occupant’s physical and instrumental ADLs. Both approaches were trained based on unlabelled sensor data from the occupant’s normal behaviours. The data related to physical ADLs were captured from Kinect sensors and those related to instrumental ADLs were obtained using a combination of Kinect sensors and a power meter. Kinect sensors were employed in functional areas of the monitored environment to capture the occupant’s locations and 3D structures of their physical activities. The power meter measured the power consumption of home electrical appliances (HEAs) from the electricity panel. A novel unsupervised fuzzy approach was presented to monitor physical ADLs based on depth maps obtained from Kinect sensors. Epochs of activities associated with each monitored location were automatically identified, and the occupant’s behaviour patterns during each epoch were represented through the combinations of fuzzy attributes. A novel membership function generation technique was presented to elicit membership functions for attributes by analysing the data distribution of attributes while excluding noise and outliers in the data. The occupant’s behaviour patterns during each epoch of activity were then classified into frequent and infrequent categories using a data mining technique. Fuzzy rules were learned to model frequent behaviour patterns. An alarm was raised when the occupant’s behaviour in new data was recognised as frequent with a longer than usual duration or infrequent with a duration exceeding a data-driven value. Another novel unsupervised fuzzy approach to monitor instrumental ADLs took unlabelled training data from Kinect sensors and a power meter to model the key features of instrumental ADLs. Instrumental ADLs in the training dataset were identified based on associating the occupant’s locations with specific power signatures on the power line. A set of fuzzy rules was then developed to model the frequency and regularity of the instrumental activities tailored to the occupant. This set was subsequently used to monitor new data and to generate reports on deviations from normal behaviour patterns. As a proof of concept, the proposed monitoring approaches were evaluated using a dataset collected from a real-life setting. An evaluation of the results verified the high accuracy of the proposed technique to identify the epochs of activities over alternative techniques. The approach adopted for monitoring physical ADLs was found to improve elderly monitoring. It generated fuzzy rules that could represent the person’s physical ADLs and exclude noise and outliers in the data more efficiently than alternative approaches. The performance of different membership function generation techniques was compared. The fuzzy rule set obtained from the output of the proposed technique could accurately classify more scenarios of normal and abnormal behaviours. The approach for monitoring instrumental ADLs was also found to reliably distinguish power signatures generated automatically by self-regulated devices from those generated as a result of an elderly person’s instrumental ADLs. The evaluations also showed the effectiveness of the approach in correctly identifying elderly people’s interactions with specific HEAs and tracking simulated upward and downward deviations from normal behaviours. The fuzzy inference system in this approach was found to be robust in regards to errors when identifying instrumental ADLs as it could effectively classify normal and abnormal behaviour patterns despite errors in the list of the used HEAs

Real-time human ambulation, activity, and physiological monitoring:taxonomy of issues, techniques, applications, challenges and limitations

Automated methods of real-time, unobtrusive, human ambulation, activity, and wellness monitoring and data analysis using various algorithmic techniques have been subjects of intense research. The general aim is to devise effective means of addressing the demands of assisted living, rehabilitation, and clinical observation and assessment through sensor-based monitoring. The research studies have resulted in a large amount of literature. This paper presents a holistic articulation of the research studies and offers comprehensive insights along four main axes: distribution of existing studies; monitoring device framework and sensor types; data collection, processing and analysis; and applications, limitations and challenges. The aim is to present a systematic and most complete study of literature in the area in order to identify research gaps and prioritize future research directions

proposal and experimental evaluation of fall detection solution based on wearable and depth data fusion

Fall injury issues represent a serious problem for elderly in our society. These people want to live in their home as long as possible and technology can improve their security and independence. In this work we study the joint use of a camera based system and wearable devices, in the so called data fusion approach, to design a fall detection solution. The synchronization issues between the heterogeneous data provided by the devices are properly treated, and three different fall detection algorithms are implemented. Experimental results are also provided, to compare the proposed solutions

A Study on Human Fall Detection Systems: Daily Activity Classification and Sensing Techniques

Fall detection for elderly is a major topic as far as assistive technologies are concerned. This is due to the high demand for the products and technologies related to fall detection with the ageing population around the globe. This paper gives a review of previous works on human fall detection devices and a preliminary results from a developing depth sensor based device. The three main approaches used in fall detection devices such as wearable based devices, ambient based devices and vision based devices are identified along with the sensors employed.  The frameworks and algorithms applied in each of the approaches and their uniqueness is also illustrated. After studying the performance and the shortcoming of the available systems a future solution using depth sensor is also proposed with preliminary results

Elderly Fall Detection Systems: A Literature Survey

Falling is among the most damaging event elderly people may experience. With the ever-growing aging population, there is an urgent need for the development of fall detection systems. Thanks to the rapid development of sensor networks and the Internet of Things (IoT), human-computer interaction using sensor fusion has been regarded as an effective method to address the problem of fall detection. In this paper, we provide a literature survey of work conducted on elderly fall detection using sensor networks and IoT. Although there are various existing studies which focus on the fall detection with individual sensors, such as wearable ones and depth cameras, the performance of these systems are still not satisfying as they suffer mostly from high false alarms. Literature shows that fusing the signals of different sensors could result in higher accuracy and lower false alarms, while improving the robustness of such systems. We approach this survey from different perspectives, including data collection, data transmission, sensor fusion, data analysis, security, and privacy. We also review the benchmark data sets available that have been used to quantify the performance of the proposed methods. The survey is meant to provide researchers in the field of elderly fall detection using sensor networks with a summary of progress achieved up to date and to identify areas where further effort would be beneficial

A multi-sensory approach for remote health monitoring of older people

Growing life expectancy and increasing incidence of multiple chronic health conditions are significant societal challenges. Different technologies have been proposed to address these issues, detect critical events, such as stroke or falls, and monitor automatically human activities for health condition inference and anomaly detection. This paper aims to investigate two types of sensing technologies proposed for assisted living: wearable and radar sensors. First, different feature selection methods are validated and compared in terms of accuracy and computational loads. Then, information fusion is applied to enhance activity classification accuracy combining the two sensors. Improvements in classification accuracy of approximately 12% using feature level fusion are achieved with both support vector machine s (SVMs) and k-nearest neighbor (KNN) classifiers. Decision-level fusion schemes are also investigated, yielding classification accuracy in the order of 97%-98%

Real-time Assessment and Visual Feedback for Patient Rehabilitation Using Inertial Sensors

Rehabilitation exercises needs have been continuously increasing and have been projected to increase in future as well based on its demand for aging population, recovering from surgery, injury and illness and the living and working lifestyle of the people. This research aims to tackle one of the most critical issues faced by the exercise administers-Adherence or Non-Adherence to Home Exercise problems especially has been a significant issue resulting in extensive research on the psychological analysis of people involved. In this research, a solution is provided to increase the adherence of such programs through an automated real-time assessment with constant visual feedback providing a game like an environment and recording the same for analysis purposes. Inertial sensors like Accelerometer and Gyroscope has been used to implement a rule-based framework for human activity recognition for measuring the ankle joint angle. This system is also secure as it contains only the recordings of the data and the avatar that could be live fed or recorded for the treatment analysis purposes which could save time and cost. The results obtained after testing on four healthy human subjects shows that with proper implementation of rule parameters, good quality and quantity of the exercises can be assessed in real time

Fusion of Artificial Intelligence in Neuro-Rehabilitation Video Games

In this paper, an intuitive neuro-rehabilitation video game has been developed employing the fusion of artificial neural networks (ANNs), inverse kinematics (IK), and fuzzy logic (FL) algorithms. The embedded algorithms automatically adjust the game difficulty level based on the player’s interaction with the game. Moreover, it is manifested as an alternative approach for possible movements to improve incorrect positioning through real-time visual feedback on the screen; 52 participants volunteered to engage in the program. Motor assessment scale (MAS) was determined to assess the participants’ functional ability pre- and post-treatments. The system input is received via the Microsoft Kinect, a foot Pedal (Saitek), and the Thalmic Myo armband. The ANN classifier integrates the limb joints orientation, angular velocity, lower arms’ muscle activity, hand gestures, feet sole (plantar) pressure parameters, and the MAS scores to learn from data and predict the improvement following the intervention. The fuzzy input generates a crisp output and provides a personalized rehabilitation program with the potential to be integrated into clinical protocols. Experiments to obtain the input signals and desired outputs were conducted for the learning and validation of the network. The networks pattern recognition, self-organizing map, and non-linear auto-regression analysis performed using feed-forward and Levenberg–Marquardt backpropagation (LMBP) procedure. The results showed the effectiveness of the non-linear auto-regression using the optimized LMBP algorithm to classify and visualize the target categories. Furthermore, the state of the network demonstrates the prediction accuracy exceeding 94%. Clustering algorithm grouped the data based on the similarity. Self-organizing map trained the network to learn the topology of samples with high correlation, presented outputs with high achievement