A combined Adaptive Neuro-Fuzzy and Bayesian strategy for recognition and prediction of gait events using wearable sensors

A robust strategy for recognition and prediction of gait events using wearable sensors is presented in this paper. The strategy adopted here uses a combination of two computational intelligence approaches: Adaptive Neuro-Fuzzy and Bayesian methods. Recognition of gait events is performed by a Bayesian method which iteratively accumulates evidence to reduce uncertainty from sensor measurements. Prediction of gait events is based on the observation of decisions and actions made over time by our perception system. An Adaptive Neuro-Fuzzy system evaluates the reliability of predictions, learns a weighting parameter and controls the amount of predicted information to be used by our Bayesian method. Thus, this strategy ensures the achievement of better recognition and prediction performance in both accuracy and speed. The methods are validated with experiments for recognition and prediction of gait events with different walking activities, using data from wearable sensors attached to lower limbs of participants. Overall, results show the benefits of our combined Adaptive Neuro-Fuzzy and Bayesian strategy to achieve fast and accurate decisions, but also to evaluate and adapt its own performance, making it suitable for the development of intelligent assistive and rehabilitation robots

Learning architecture for the recognition of walking and prediction of gait period using wearable sensors

This work presents a novel learning architecture for the recognition and prediction of walking activity and gait period, respectively, using wearable sensors. This approach is composed of a Convolutional Neural Network (CNN), a Predicted Information Gain (PIG) module and an adaptive combination of information sources. The CNN provides the recognition of walking and gait periods. This information is used by the proposed PIG method to estimate the next most probable gait period along the gait cycle. The outputs from the CNN and PIG modules are combined by a proposed adaptive process, which relies on data from the source that shows to be more reliable. This adaptive combination ensures that the learning architecture provides accurate recognition and prediction of walking activity and gait periods over time. The learning architecture uses data from an array of three inertial measurement units attached to the lower limbs of individuals. The validation of this work is performed by the recognition of level-ground walking, ramp ascent and ramp descent, and the prediction of gait periods. The recognition of walking activity and gait period is 100% and 98.63%, respectively, when the CNN model is employed alone. The recognition of gait periods achieves a 99.9% accuracy, when the PIG method and adaptive combination are also used. These results demonstrate the benefit of having a system capable of predicting or anticipating the next information or event over time. Overall, the learning architecture offers an alternative approach for accurate activity recognition, which is essential for the development of wearable robots capable of reliably and safely assisting humans in activities of daily living

Adaptive Bayesian inference system for recognition of walking activities and prediction of gait events using wearable sensors

In this paper, a novel approach for recognition of walking activities and gait events with wearable sensors is presented. This approach, called adaptive Bayesian inference system (BasIS), uses a probabilistic formulation with a sequential analysis method, for recognition of walking activities performed by participants. Recognition of gait events, needed to identify the state of the human body during the walking activity, is also provided by the proposed method. In addition, the BasIS system includes an adaptive action-perception method for the prediction of gait events. The adaptive approach uses the knowledge gained from decisions made over time by the inference system. The actionperception method allows the BasIS system to autonomously adapt its performance, based on the evaluation of its own predictions and decisions made over time. The proposed approach is implemented in a layered architecture and validated with the recognition of three walking activities; level-ground, ramp ascent and ramp descent. The validation process employs real data from three inertial measurements units attached to the thigh, shanks and foot of participants while performing walking activities. The experiments show that mean decision times of 240 ms and 40 ms are needed to achieve mean accuracies of 99.87% and 99.82% for recognition of walking activities and gait events, respectively. The validation experiments also show that the performance, in accuracy and speed, is not significantly affected when noise is added to sensor measurements. These results show that the proposed adaptive recognition system is accurate, fast and robust to sensor noise, but also capable to adapt its own performance over time. Overall, the adaptive BasIS system demonstrates to be a robust and suitable computational approach for the intelligent recognition of activities of daily living using wearable sensors

From Wearable Sensors to Smart Implants – Towards Pervasive and Personalised Healthcare

<p>Objective: This article discusses the evolution of pervasive healthcare from its inception for activity recognition using wearable sensors to the future of sensing implant deployment and data processing. Methods: We provide an overview of some of the past milestones and recent developments, categorised into different generations of pervasive sensing applications for health monitoring. This is followed by a review on recent technological advances that have allowed unobtrusive continuous sensing combined with diverse technologies to reshape the clinical workflow for both acute and chronic disease management. We discuss the opportunities of pervasive health monitoring through data linkages with other health informatics systems including the mining of health records, clinical trial databases, multi-omics data integration and social media. Conclusion: Technical advances have supported the evolution of the pervasive health paradigm towards preventative, predictive, personalised and participatory medicine. Significance: The sensing technologies discussed in this paper and their future evolution will play a key role in realising the goal of sustainable healthcare systems.</p> <p> </p

Application of data fusion techniques and technologies for wearable health monitoring

Technological advances in sensors and communications have enabled discrete integration into everyday objects, both in the home and about the person. Information gathered by monitoring physiological, behavioural, and social aspects of our lives, can be used to achieve a positive impact on quality of life, health, and well-being. Wearable sensors are at the cusp of becoming truly pervasive, and could be woven into the clothes and accessories that we wear such that they become ubiquitous and transparent. To interpret the complex multidimensional information provided by these sensors, data fusion techniques are employed to provide a meaningful representation of the sensor outputs. This paper is intended to provide a short overview of data fusion techniques and algorithms that can be used to interpret wearable sensor data in the context of health monitoring applications. The application of these techniques are then described in the context of healthcare including activity and ambulatory monitoring, gait analysis, fall detection, and biometric monitoring. A snap-shot of current commercially available sensors is also provided, focusing on their sensing capability, and a commentary on the gaps that need to be bridged to bring research to market

Simultaneous Bayesian recognition of locomotion and gait phases with wearable sensors

Recognition of movement is a crucial process to assist humans in activities of daily living, such as walking. In this work, a high-level method for the simultaneous recognition of locomotion and gait phases using wearable sensors is presented. A Bayesian formulation is employed to iteratively accumulate evidence to reduce uncertainty, and to improve the recognition accuracy. This process uses a sequential analysis method to autonomously make decisions, whenever the recognition system perceives that there is enough evidence accumulated. We use data from three wearable sensors, attached to the thigh, shank, and foot of healthy humans. Level-ground walking, ramp ascent and descent activities are used for data collection and recognition. In addition, an approach for segmentation of the gait cycle for recognition of stance and swing phases is presented. Validation results show that the simultaneous Bayesian recognition method is capable to recognize walking activities and gait phases with mean accuracies of 99.87% and 99.20%. This process requires a mean of 25 and 13 sensor samples to make a decision for locomotion mode and gait phases, respectively. The recognition process is analyzed using different levels of confidence to show that our method is highly accurate, fast, and adaptable to specific requirements of accuracy and speed. Overall, the simultaneous Bayesian recognition method demonstrates its benefits for recognition using wearable sensors, which can be employed to provide reliable assistance to humans in their walking activities

Automatic recognition of gait patterns in human motor disorders using machine learning: A review

Background: automatic recognition of human movement is an effective strategy to assess abnormal gait patterns. Machine learning approaches are mainly applied due to their ability to work with multidimensional nonlinear features. Purpose: to compare several machine learning algorithms employed for gait pattern recognition in motor disorders using discriminant features extracted from gait dynamics. Additionally, this work highlights procedures that improve gait recognition performance. Methods: we conducted an electronic literature search on Web of Science, IEEE, and Scopus, using “human recognition”, “gait patterns’’, and “feature selection methods” as relevant keywords. Results: analysis of the literature showed that kernel principal component analysis and genetic algorithms are efficient at reducing dimensional features due to their ability to process nonlinear data and converge to global optimum. Comparative analysis of machine learning performance showed that support vector machines (SVMs) exhibited higher accuracy and proper generalization for new instances. Conclusions: automatic recognition by combining dimensional data reduction, cross-validation and normalization techniques with SVMs may offer an objective and rapid tool for investigating the subject's clinical status. Future directions comprise the real-time application of these tools to drive powered assistive devices in free-living conditions.This work was supported by the FCT - Fundação para a Ciência e Tecnologia - with the reference scholarship SFRH/BD/108309/2015, and the reference project UID/EEA/04436/2013, by FEDER funds through the COMPETE 2020 - Programa Operacional Competitividade e Internacionalização (POCI) - with the reference project POCI-01-0145-FEDER-006941. Also, this work was partially supported by grant RYC-2014-16613 by Spanish Ministry of Economy and Competitiveness

The Development of an assistive chair for elderly with sit to stand problems

A thesis submitted to the University of Bedfordshire in partial fulfilment of the requirements for the degree of Doctor of PhilosophyStanding up from a seated position, known as sit-to-stand (STS) movement, is one of the most frequently performed activities of daily living (ADLs). However, the aging generation are often encountered with STS issues owning to their declined motor functions and sensory capacity for postural control. The motivated is rooted from the contemporary market available STS assistive devices that are lack of genuine interaction with elderly users. Prior to the software implementation, the robot chair platform with integrated sensing footmat is developed with STS biomechanical concerns for the elderly. The work has its main emphasis on recognising the personalised behavioural patterns from the elderly users’ STS movements, namely the STS intentions and personalised STS feature prediction. The former is known as intention recognition while the latter is defined as assistance prediction, both achieved by innovative machine learning techniques. The proposed intention recognition performs well in multiple subjects scenarios with different postures involved thanks to its competence of handling these uncertainties. To the provision of providing the assistance needed by the elderly user, a time series prediction model is presented, aiming to configure the personalised ground reaction force (GRF) curve over time which suggests successful movement. This enables the computation of deficits between the predicted oncoming GRF curve and the personalised one. A multiple steps ahead prediction into the future is also implemented so that the completion time of actuation in reality is taken into account

Human Activity Recognition and Control of Wearable Robots

abstract: Wearable robotics has gained huge popularity in recent years due to its wide applications in rehabilitation, military, and industrial fields. The weakness of the skeletal muscles in the aging population and neurological injuries such as stroke and spinal cord injuries seriously limit the abilities of these individuals to perform daily activities. Therefore, there is an increasing attention in the development of wearable robots to assist the elderly and patients with disabilities for motion assistance and rehabilitation. In military and industrial sectors, wearable robots can increase the productivity of workers and soldiers. It is important for the wearable robots to maintain smooth interaction with the user while evolving in complex environments with minimum effort from the user. Therefore, the recognition of the user's activities such as walking or jogging in real time becomes essential to provide appropriate assistance based on the activity. This dissertation proposes two real-time human activity recognition algorithms intelligent fuzzy inference (IFI) algorithm and Amplitude omega ($A \omega$) algorithm to identify the human activities, i.e., stationary and locomotion activities. The IFI algorithm uses knee angle and ground contact forces (GCFs) measurements from four inertial measurement units (IMUs) and a pair of smart shoes. Whereas, the $A \omega$ algorithm is based on thigh angle measurements from a single IMU. This dissertation also attempts to address the problem of online tuning of virtual impedance for an assistive robot based on real-time gait and activity measurement data to personalize the assistance for different users. An automatic impedance tuning (AIT) approach is presented for a knee assistive device (KAD) in which the IFI algorithm is used for real-time activity measurements. This dissertation also proposes an adaptive oscillator method known as amplitude omega adaptive oscillator ($A\omega AO$) method for HeSA (hip exoskeleton for superior augmentation) to provide bilateral hip assistance during human locomotion activities. The $A \omega$ algorithm is integrated into the adaptive oscillator method to make the approach robust for different locomotion activities. Experiments are performed on healthy subjects to validate the efficacy of the human activities recognition algorithms and control strategies proposed in this dissertation. Both the activity recognition algorithms exhibited higher classification accuracy with less update time. The results of AIT demonstrated that the KAD assistive torque was smoother and EMG signal of Vastus Medialis is reduced, compared to constant impedance and finite state machine approaches. The $A\omega AO$ method showed real-time learning of the locomotion activities signals for three healthy subjects while wearing HeSA. To understand the influence of the assistive devices on the inherent dynamic gait stability of the human, stability analysis is performed. For this, the stability metrics derived from dynamical systems theory are used to evaluate unilateral knee assistance applied to the healthy participants.Dissertation/ThesisDoctoral Dissertation Aerospace Engineering 201

Computational Intelligence in Healthcare

This book is a printed edition of the Special Issue Computational Intelligence in Healthcare that was published in Electronic