Radar and RGB-depth sensors for fall detection: a review

This paper reviews recent works in the literature on the use of systems based on radar and RGB-Depth (RGB-D) sensors for fall detection, and discusses outstanding research challenges and trends related to this research field. Systems to detect reliably fall events and promptly alert carers and first responders have gained significant interest in the past few years in order to address the societal issue of an increasing number of elderly people living alone, with the associated risk of them falling and the consequences in terms of health treatments, reduced well-being, and costs. The interest in radar and RGB-D sensors is related to their capability to enable contactless and non-intrusive monitoring, which is an advantage for practical deployment and users’ acceptance and compliance, compared with other sensor technologies, such as video-cameras, or wearables. Furthermore, the possibility of combining and fusing information from The heterogeneous types of sensors is expected to improve the overall performance of practical fall detection systems. Researchers from different fields can benefit from multidisciplinary knowledge and awareness of the latest developments in radar and RGB-D sensors that this paper is discussing

Human behavioural analysis with self-organizing map for ambient assisted living

This paper presents a system for automatically classifying the resting location of a moving object in an indoor environment. The system uses an unsupervised neural network (Self Organising Feature Map) fully implemented on a low-cost, low-power automated home-based surveillance system, capable of monitoring activity level of elders living alone independently. The proposed system runs on an embedded platform with a specialised ceiling-mounted video sensor for intelligent activity monitoring. The system has the ability to learn resting locations, to measure overall activity levels and to detect specific events such as potential falls. First order motion information, including first order moving average smoothing, is generated from the 2D image coordinates (trajectories). A novel edge-based object detection algorithm capable of running at a reasonable speed on the embedded platform has been developed. The classification is dynamic and achieved in real-time. The dynamic classifier is achieved using a SOFM and a probabilistic model. Experimental results show less than 20% classification error, showing the robustness of our approach over others in literature with minimal power consumption. The head location of the subject is also estimated by a novel approach capable of running on any resource limited platform with power constraints

Neural Networks for Indoor Person Tracking With Infrared Sensors

Indoor localization has many pervasive applications, like energy management, health monitoring, and security. Tagless localization detects directly the human body, like passive infrared sensing, and is the most amenable to different users and use cases. We evaluate the localization and tracking performance, as well as resource and processing requirements of various neural network (NN) types using directly the data from a low resolution 16-pixel thermopile sensor array in a 3 m x 3 m room. Out of the multilayer perceptron, autoregressive, 1D-CNN, and LSTM NN architectures that we test, the latter require more resources but can accurately locate and capture best the person movement dynamics, while the 1D-CNN provides the best compromise between localization accuracy (9.6 cm RMSE) and movement tracking smoothness with the least resources, and seem more suited for embedded applications

Real-time human ambulation, activity, and physiological monitoring:taxonomy of issues, techniques, applications, challenges and limitations

Automated methods of real-time, unobtrusive, human ambulation, activity, and wellness monitoring and data analysis using various algorithmic techniques have been subjects of intense research. The general aim is to devise effective means of addressing the demands of assisted living, rehabilitation, and clinical observation and assessment through sensor-based monitoring. The research studies have resulted in a large amount of literature. This paper presents a holistic articulation of the research studies and offers comprehensive insights along four main axes: distribution of existing studies; monitoring device framework and sensor types; data collection, processing and analysis; and applications, limitations and challenges. The aim is to present a systematic and most complete study of literature in the area in order to identify research gaps and prioritize future research directions

A Study on Human Fall Detection Systems: Daily Activity Classification and Sensing Techniques

Fall detection for elderly is a major topic as far as assistive technologies are concerned. This is due to the high demand for the products and technologies related to fall detection with the ageing population around the globe. This paper gives a review of previous works on human fall detection devices and a preliminary results from a developing depth sensor based device. The three main approaches used in fall detection devices such as wearable based devices, ambient based devices and vision based devices are identified along with the sensors employed.  The frameworks and algorithms applied in each of the approaches and their uniqueness is also illustrated. After studying the performance and the shortcoming of the available systems a future solution using depth sensor is also proposed with preliminary results

Adaptive thermal sensor array placement for human segmentation and occupancy estimation

Thermal sensor array (TSA) offers privacy-preserving, low-cost, and non-invasive features, which makes it suitable for various indoor applications such as anomaly detection, health monitoring, home security, and monitoring energy efficiency applications. Previous approaches to human-centred applications using the TSA usually relied on the use of a fixed sensor location to make the human-sensor distance and the human presence shape fixed. However, placing this sensor in different locations and new indoor environments can pose a significant challenge. In this paper, a novel framework based on a deep convolutional encoder-decoder network is proposed to address this challenge in real-life deployment. The framework presents a semantic segmentation of the human presence and estimates the occupancy in indoor-environment. It is also capable to segment the human presence and counts the number of people from different sensor locations, indoor environments, and human to sensor distance. Furthermore, the impact of the distance on the human presence using the TSA is investigated. The framework is evaluated to estimate the occupancy in different sensor locations, the number of occupants, environments, and human distance with classification and regression machine learning approaches. This paper shows that the classification approach using the adaptive boosting algorithm is an accurate approach which has achieves an accuracy of 98.43% and 100% from vertical and overhead sensor locations respectively

Home monitoring for older singles: A gas sensor array system

Many residential environments have been equipped with sensing technologies both to provide assistance to older people who have opted for aging-in-place and to provide information to caregivers and family. However, such technologies are often accompanied by physical discomfort, privacy concerns, and complexity of use. We explored the feasibility of monitoring home activity using chemical sensors that pose fewer privacy concerns than, for example, video-cameras and which do not suffer from blind spots. We built a monitoring device that integrates a sensor array and IoT capabilities to gather the necessary data about a resident in his/her living space. Over a period of 3 months, we uninterruptedly measured the living space of a typical elder person living on his/her own. To record the level of activity during the same period and obtain a ground truth for the activity, a set of motion sensors were also deployed in the house. Home activity was extracted from a PCA space moving-window which translated sensor data into the event space; this also compensated for environmental and sensor drift. Our results show that it is possible to monitor the person’s home activity and detect sudden deviations from it using a low-cost, non-invasive, system based on gas sensors that gather data on the air composition in the living space. We made the dataset publicly available at https://archive.ics.uci.edu/ml/index.php2.This work was supported by the Spanish Ministry of Economy and Competitiveness (www.mineco.gob.es) PID2021-122952OB-I00, DPI2017-89827-R, Networking Biomedical Research Centre in the subject area of Bioengineering, Biomaterials and Nanomedicine (CIBER-BBN), initiatives of Instituto de Investigación Carlos III (ISCIII), Share4Rare project (Grant Agreement 780262), ISCIII (grant AC22/00035), ACCIÓ (grant Innotec ACE014/20/000018) and Pla de Doctorats Industrials de la Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya (2022 DI 014), and the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie (grant No. 101029808). JF also acknowledges the CERCA Program/Generalitat de Catalunya and the Serra Húnter Program. B2SLab is certified as 2017 SGR 952.Peer ReviewedPostprint (author's final draft