Inertial Sensors for Human Motion Analysis: A Comprehensive Review

Inertial motion analysis is having a growing interest during the last decades due to its advantages over classical optical systems. The technological solution based on inertial measurement units allows the measurement of movements in daily living environments, such as in everyday life, which is key for a realistic assessment and understanding of movements. This is why research in this field is still developing and different approaches are proposed. This presents a systematic review of the different proposals for inertial motion analysis found in the literature. The search strategy has been carried out on eight different platforms, including journal articles and conference proceedings, which are written in English and published until August 2022. The results are analyzed in terms of the publishers, the sensors used, the applications, the monitored units, the algorithms of use, the participants of the studies, and the validation systems employed. In addition, we delve deeply into the machine learning techniques proposed in recent years and in the approaches to reduce the estimation error. In this way, we show an overview of the research carried out in this field, going into more detail in recent years, and providing some research directions for future wor

Human Motion Analysis with Wearable Inertial Sensors

High-resolution, quantitative data obtained by a human motion capture system can be used to better understand the cause of many diseases for effective treatments. Talking about the daily care of the aging population, two issues are critical. One is to continuously track motions and position of aging people when they are at home, inside a building or in the unknown environment; the other is to monitor their health status in real time when they are in the free-living environment. Continuous monitoring of human movement in their natural living environment potentially provide more valuable feedback than these in laboratory settings. However, it has been extremely challenging to go beyond laboratory and obtain accurate measurements of human physical activity in free-living environments. Commercial motion capture systems produce excellent in-studio capture and reconstructions, but offer no comparable solution for acquisition in everyday environments. Therefore in this dissertation, a wearable human motion analysis system is developed for continuously tracking human motions, monitoring health status, positioning human location and recording the itinerary. In this dissertation, two systems are developed for seeking aforementioned two goals: tracking human body motions and positioning a human. Firstly, an inertial-based human body motion tracking system with our developed inertial measurement unit (IMU) is introduced. By arbitrarily attaching a wearable IMU to each segment, segment motions can be measured and translated into inertial data by IMUs. A human model can be reconstructed in real time based on the inertial data by applying high efficient twists and exponential maps techniques. Secondly, for validating the feasibility of developed tracking system in the practical application, model-based quantification approaches for resting tremor and lower extremity bradykinesia in Parkinson’s disease are proposed. By estimating all involved joint angles in PD symptoms based on reconstructed human model, angle characteristics with corresponding medical ratings are employed for training a HMM classifier for quantification. Besides, a pedestrian positioning system is developed for tracking user’s itinerary and positioning in the global frame. Corresponding tests have been carried out to assess the performance of each system

Intelligent signal processing for digital healthcare monitoring

Ein gesunder Gang ist ein komplexer Prozess und erfordert ein Gleichgewicht zwischen verschiedenen neurophysiologischen Systemen im Körper und gilt als wesentlicher Indikator für den physischen und kognitiven Gesundheitszustand einer Person. Folglich würden Anwendungen im Bereich der Bioinformatik und des Gesundheitswesens erheblich von den Informationen profitieren, die sich aus einer längeren oder ständigen Überwachung des Gangs, der Gewohnheiten und des Verhaltens von Personen unter ihren natürlichen Lebensbedingungen und bei ihren täglichen Aktivitäten mit Hilfe intelligenter Geräte ergeben. Vergleicht man Trägheitsmess- und stationäre Sensorsysteme, so bieten erstere hervorragende Möglichkeiten für Ganganalyseanwendungen und bieten mehrere Vorteile wie geringe Größe, niedriger Preis, Mobilität und sind leicht in tragbare Systeme zu integrieren. Die zweiten gelten als der Goldstandard, sind aber teuer und für Messungen im Freien ungeeignet. Diese Arbeit konzentriert sich auf die Verbesserung der Zeit und Qualität der Gangrehabilitation nach einer Operation unter Verwendung von Inertialmessgeräten, indem sie eine neuartige Metrik zur objektiven Bewertung des Fortschritts der Gangrehabilitation in realen Umgebungen liefert und die Anzahl der verwendeten Sensoren für praktische, reale Szenarien reduziert. Daher wurden die experimentellen Messungen für eine solche Analyse in einer stark kontrollierten Umgebung durchgeführt, um die Datenqualität zu gewährleisten. In dieser Arbeit wird eine neue Gangmetrik vorgestellt, die den Rehabilitationsfortschritt anhand kinematischer Gangdaten von Aktivitäten in Innen- und Außenbereichen quantifiziert und verfolgt. In dieser Arbeit wird untersucht, wie Signalverarbeitung und maschinelles Lernen formuliert und genutzt werden können, um robuste Methoden zur Bewältigung von Herausforderungen im realen Leben zu entwickeln. Es wird gezeigt, dass der vorgeschlagene Ansatz personalisiert werden kann, um den Fortschritt der Gangrehabilitation zu verfolgen. Ein weiteres Thema dieser Arbeit ist die erfolgreiche Anwendung von Methoden des maschinellen Lernens auf die Ganganalyse aufgrund der großen Datenmenge, die von den tragbaren Sensorsystemen erzeugt wird. In dieser Arbeit wird das neuartige Konzept des ``digitalen Zwillings'' vorgestellt, das die Anzahl der verwendeten Wearable-Sensoren in einem System oder im Falle eines Sensorausfalls reduziert. Die Evaluierung der vorgeschlagenen Metrik mit gesunden Teilnehmern und Patienten unter Verwendung statistischer Signalverarbeitungs- und maschineller Lernmethoden hat gezeigt, dass die Einbeziehung der extrahierten Signalmerkmale in realen Szenarien robust ist, insbesondere für das Szenario mit Rehabilitations-Gehübungen in Innenräumen. Die Methodik wurde auch in einer klinischen Studie evaluiert und lieferte eine gute Leistung bei der Überwachung des Rehabilitationsfortschritts verschiedener Patienten. In dieser Arbeit wird ein Prototyp einer mobilen Anwendung zur objektiven Bewertung des Rehabilitationsfortschritts in realen Umgebungen vorgestellt

Nonlinearity Compensation in a Multi-DoF Shoulder Sensing Exosuit for Real-Time Teleoperation

The compliant nature of soft wearable robots makes them ideal for complex multiple degrees of freedom (DoF) joints, but also introduce additional structural nonlinearities. Intuitive control of these wearable robots requires robust sensing to overcome the inherent nonlinearities. This paper presents a joint kinematics estimator for a bio-inspired multi-DoF shoulder exosuit capable of compensating the encountered nonlinearities. To overcome the nonlinearities and hysteresis inherent to the soft and compliant nature of the suit, we developed a deep learning-based method to map the sensor data to the joint space. The experimental results show that the new learning-based framework outperforms recent state-of-the-art methods by a large margin while achieving 12ms inference time using only a GPU-based edge-computing device. The effectiveness of our combined exosuit and learning framework is demonstrated through real-time teleoperation with a simulated NAO humanoid robot.Comment: 8 pages, 7 figures, 3 tables. Accepted to be published in IEEE RoboSoft 202

UTILIZING OF MEMS SENSORS IN REHABILITATION PROCESS

The potential for utilizing of MEMS sensors, especially of accelerometers and gyroscopes is significant. They are used not only in consumer’s electronics, but also in so called wearable sensors that can be worn on body or in part of garment without interrupting comfort of person who is wearing these sensors. In the same time, we are able to collect data about person carrying the device. This paper focuses on analysis of current state of utilizing of MEMS sensors in rehabilitation process or in motion analysis

Fusion of pose and head tracking data for immersive mixed-reality application development

This work addresses the creation of a development framework where application developers can create, in a natural way, immersive physical activities where users experience a 3D first-person perception of full body control. The proposed frame-work is based on commercial motion sensors and a Head-Mounted Display (HMD), and a uses Unity 3D as a unifying environment where user pose, virtual scene and immersive visualization functions are coordinated. Our proposal is exemplified by the development of a toy application showing its practical us

Upper Body Pose Estimation Using Wearable Inertial Sensors and Multiplicative Kalman Filter

Estimating the limbs pose in a wearable way may benefit multiple areas such as rehabilitation, teleoperation, human-robot interaction, gaming, and many more. Several solutions are commercially available, but they are usually expensive or not wearable/portable. We present a wearable pose estimation system (WePosE), based on inertial measurements units (IMUs), for motion analysis and body tracking. Differently from camera-based approaches, the proposed system does not suffer from occlusion problems and lighting conditions, it is cost effective and it can be used in indoor and outdoor environments. Moreover, since only accelerometers and gyroscopes are used to estimate the orientation, the system can be used also in the presence of iron and magnetic disturbances. An experimental validation using a high precision optical tracker has been performed. Results confirmed the effectiveness of the proposed approach

Recent Advances in Motion Analysis

The advances in the technology and methodology for human movement capture and analysis over the last decade have been remarkable. Besides acknowledged approaches for kinematic, dynamic, and electromyographic (EMG) analysis carried out in the laboratory, more recently developed devices, such as wearables, inertial measurement units, ambient sensors, and cameras or depth sensors, have been adopted on a wide scale. Furthermore, computational intelligence (CI) methods, such as artificial neural networks, have recently emerged as promising tools for the development and application of intelligent systems in motion analysis. Thus, the synergy of classic instrumentation and novel smart devices and techniques has created unique capabilities in the continuous monitoring of motor behaviors in different fields, such as clinics, sports, and ergonomics. However, real-time sensing, signal processing, human activity recognition, and characterization and interpretation of motion metrics and behaviors from sensor data still representing a challenging problem not only in laboratories but also at home and in the community. This book addresses open research issues related to the improvement of classic approaches and the development of novel technologies and techniques in the domain of motion analysis in all the various fields of application