Computational Analysis of Upper Extremity Movements for People Post-Stroke

Wearable sensors have been beneficial in assessing motor impairment after stroke. Individuals who have experienced stroke may benefit from the use of wearable sensors to quantify and assess quality of motions in unobserved environments. Seven individuals participated in a study wherein they performed various gestures from the Fugl-Meyer Assessment (FMA), a measure of post-stroke impairment. Participants performed these gestures while being monitored by wearable sensors placed on each wrist. A series of MATLAB functions were written to process recorded sensor data, extract meaningful features from the data, and prepare those features for further use with various machine learning techniques. A combination of linear and nonlinear regression was applied to frequency domain values from each gesture to determine which can more accurately predict the time spent performing the gesture, and the associated gesture FMA score. General performance suggests that linear regression techniques appear to better fit paretic gestures, while nonlinear regression techniques appear to better fit non-paretic gestures. A use of classifier techniques were used to determine if a classifier can distinguish between paretic and non-paretic gestures. The combinations include determining if a higher performance is obtained through the use of either accelerometer, rate gyroscope, or both modalities combined. Our findings indicate that, for upper-extremity motion, classifiers trained using a combination of accelerometer and rate gyroscope data performed the best (accuracy of 73.1%). Classifiers trained using accelerometer data alone and rate gyroscope data alone performed slightly worse than the combined data classifier (70.2% and 65.7%, respectively). These results suggest specific features and methods suitable for the quantification of impairment after stroke

Gait Analysis Using Wearable Sensors

Gait analysis using wearable sensors is an inexpensive, convenient, and efficient manner of providing useful information for multiple health-related applications. As a clinical tool applied in the rehabilitation and diagnosis of medical conditions and sport activities, gait analysis using wearable sensors shows great prospects. The current paper reviews available wearable sensors and ambulatory gait analysis methods based on the various wearable sensors. After an introduction of the gait phases, the principles and features of wearable sensors used in gait analysis are provided. The gait analysis methods based on wearable sensors is divided into gait kinematics, gait kinetics, and electromyography. Studies on the current methods are reviewed, and applications in sports, rehabilitation, and clinical diagnosis are summarized separately. With the development of sensor technology and the analysis method, gait analysis using wearable sensors is expected to play an increasingly important role in clinical applications

Applications of MEMS Gyroscope for Human Gait Analysis

After decades of development, quantitative instruments for human gait analysis have become an important tool for revealing underlying pathologies manifested by gait abnormalities. However, the gold standard instruments (e.g., optical motion capture systems) are commonly expensive and complex while needing expert operation and maintenance and thereby be limited to a small number of specialized gait laboratories. Therefore, in current clinical settings, gait analysis still mainly relies on visual observation and assessment. Due to recent developments in microelectromechanical systems (MEMS) technology, the cost and size of gyroscopes are decreasing, while the accuracy is being improved, which provides an effective way for qualifying gait features. This chapter aims to give a close examination of human gait patterns (normal and abnormal) using gyroscope-based wearable technology. Both healthy subjects and hemiparesis patients participated in the experiment, and experimental results show that foot-mounted gyroscopes could assess gait abnormalities in both temporal and spatial domains. Gait analysis systems constructed of wearable gyroscopes can be more easily used in both clinical and home environments than their gold standard counterparts, which have few requirements for operation, maintenance, and working environment, thereby suggesting a promising future for gait analysis

IMU-based Modularized Wearable Device for Human Motion Classification

Human motion analysis is used in many different fields and applications. Currently, existing systems either focus on one single limb or one single class of movements. Many proposed systems are designed to be used in an indoor controlled environment and must possess good technical know-how to operate. To improve mobility, a less restrictive, modularized, and simple Inertial Measurement units based system is proposed that can be worn separately and combined. This allows the user to measure singular limb movements separately and also monitor whole body movements over a prolonged period at any given time while not restricted to a controlled environment. For proper analysis, data is conditioned and pre-processed through possible five stages namely power-based, clustering index-based, Kalman filtering, distance-measure-based, and PCA-based dimension reduction. Different combinations of the above stages are analyzed using machine learning algorithms for selected case studies namely hand gesture recognition and environment and shoe parameter-based walking pattern analysis to validate the performance capability of the proposed wearable device and multi-stage algorithms. The results of the case studies show that distance-measure-based and PCA-based dimension reduction will significantly improve human motion identification accuracy. This is further improved with the introduction of the Kalman filter. An LSTM neural network is proposed as an alternate classifier and the results indicate that it is a robust classifier for human motion recognition. As the results indicate, the proposed wearable device architecture and multi-stage algorithms are cable of distinguishing between subtle human limb movements making it a viable tool for human motion analysis.Comment: 10 pages, 12 figures, 28 reference

3D Orientation Estimation Using Inertial Sensors

Recently, inertial sensors have been widely used in the measurement of 3D orientations because of their small size and relative low cost. One of the useful applications in the area of Neurorehabilitation is to assess the upper limb motion for patients who are under neurorehabilitation. In this paper, the computation of the 3D orientation is discussed utilising the outputs from accelerometers, gyroscopes and magnetometers. Different 3D orientation representations are discussed to give recommendations for different use scenarios. Based on the results form the 3D orientation, 2D and 3D position tracking techniques are also calculated by considering the joint links and kinematics constraints from the upper limb segments. The results showed that the performance using complementary filter can make good estimation of the orientation.

Human Motion Analysis with Wearable Inertial Sensors

High-resolution, quantitative data obtained by a human motion capture system can be used to better understand the cause of many diseases for effective treatments. Talking about the daily care of the aging population, two issues are critical. One is to continuously track motions and position of aging people when they are at home, inside a building or in the unknown environment; the other is to monitor their health status in real time when they are in the free-living environment. Continuous monitoring of human movement in their natural living environment potentially provide more valuable feedback than these in laboratory settings. However, it has been extremely challenging to go beyond laboratory and obtain accurate measurements of human physical activity in free-living environments. Commercial motion capture systems produce excellent in-studio capture and reconstructions, but offer no comparable solution for acquisition in everyday environments. Therefore in this dissertation, a wearable human motion analysis system is developed for continuously tracking human motions, monitoring health status, positioning human location and recording the itinerary. In this dissertation, two systems are developed for seeking aforementioned two goals: tracking human body motions and positioning a human. Firstly, an inertial-based human body motion tracking system with our developed inertial measurement unit (IMU) is introduced. By arbitrarily attaching a wearable IMU to each segment, segment motions can be measured and translated into inertial data by IMUs. A human model can be reconstructed in real time based on the inertial data by applying high efficient twists and exponential maps techniques. Secondly, for validating the feasibility of developed tracking system in the practical application, model-based quantification approaches for resting tremor and lower extremity bradykinesia in Parkinson’s disease are proposed. By estimating all involved joint angles in PD symptoms based on reconstructed human model, angle characteristics with corresponding medical ratings are employed for training a HMM classifier for quantification. Besides, a pedestrian positioning system is developed for tracking user’s itinerary and positioning in the global frame. Corresponding tests have been carried out to assess the performance of each system

Gait rehabilitation monitor

This work presents a simple wearable, non-intrusive affordable mobile framework that allows remote patient monitoring during gait rehabilitation, by doctors and physiotherapists. The system includes a set of 2 Shimmer3 9DoF Inertial Measurement Units (IMUs), Bluetooth compatible from Shimmer, an Android smartphone for collecting and primary processing of data and persistence in a local database. Low computational load algorithms based on Euler angles and accelerometer, gyroscope and magnetometer signals were developed and used for the classification and identification of several gait disturbances. These algorithms include the alignment of IMUs sensors data by means of a common temporal reference as well as heel strike and stride detection algorithms to help segmentation of the remotely collected signals by the System app to identify gait strides and extract relevant features to feed, train and test a classifier to predict gait abnormalities in gait sessions. A set of drivers from Shimmer manufacturer is used to make the connection between the app and the set of IMUs using Bluetooth. The developed app allows users to collect data and train a classification model for identifying abnormal and normal gait types. The system provides a REST API available in a backend server along with Java and Python libraries and a PostgreSQL database. The machine-learning type is Supervised using Extremely Randomized Trees method. Frequency, time and time-frequency domain features were extracted from the collected and processed signals to train the classifier. To test the framework a set of gait abnormalities and normal gait were used to train a model and test the classifier.Este trabalho apresenta uma estrutura móvel acessível, simples e não intrusiva, que permite a monitorização e a assistência remota de pacientes durante a reabilitação da marcha, por médicos e fisioterapeutas que monitorizam a reabilitação da marcha do paciente. O sistema inclui um conjunto de 2 IMUs (Inertial Mesaurement Units) Shimmer3 da marca Shimmer, compatíveís com Bluetooth, um smartphone Android para recolha, e pré-processamento de dados e armazenamento numa base de dados local. Algoritmos de baixa carga computacional baseados em ângulos Euler e sinais de acelerómetros, giroscópios e magnetómetros foram desenvolvidos e utilizados para a classificação e identificação de diversas perturbações da marcha. Estes algoritmos incluem o alinhamento e sincronização dos dados dos sensores IMUs usando uma referência temporal comum, além de algoritmos de detecção de passos e strides para auxiliar a segmentação dos sinais recolhidos remotamente pelaappdestaframeworke identificar os passos da marcha extraindo as características relevantes para treinar e testar um classificador que faça a predição de deficiências na marcha durante as sessões de monitorização. Um conjunto de drivers do fabricante Shimmer é usado para fazer a conexão entre a app e o conjunto de IMUs através de Bluetooth. A app desenvolvida permite aos utilizadores recolher dados e treinar um modelo de classificação para identificar os tipos de marcha normais e patológicos. O sistema fornece uma REST API disponível num servidor backend recorrendo a bibliotecas Java e Python e a uma base de dados PostgreSQL. O tipo de machine-learning é Supervisionado usando Extremely Randomized Trees. Features no domínio do tempo, da frequência e do tempo-frequência foram extraídas dos sinais recolhidos e processados para treinar o classificador. Para testar a estrutura, um conjunto de marchas patológicas e normais foram utilizadas para treinar um modelo e testar o classificador

Latest research trends in gait analysis using wearable sensors and machine learning: a systematic review

Gait is the locomotion attained through the movement of limbs and gait analysis examines the patterns (normal/abnormal) depending on the gait cycle. It contributes to the development of various applications in the medical, security, sports, and fitness domains to improve the overall outcome. Among many available technologies, two emerging technologies that play a central role in modern day gait analysis are: A) wearable sensors which provide a convenient, efficient, and inexpensive way to collect data and B) Machine Learning Methods (MLMs) which enable high accuracy gait feature extraction for analysis. Given their prominent roles, this paper presents a review of the latest trends in gait analysis using wearable sensors and Machine Learning (ML). It explores the recent papers along with the publication details and key parameters such as sampling rates, MLMs, wearable sensors, number of sensors, and their locations. Furthermore, the paper provides recommendations for selecting a MLM, wearable sensor and its location for a specific application. Finally, it suggests some future directions for gait analysis and its applications