Survey of Motion Tracking Methods Based on Inertial Sensors: A Focus on Upper Limb Human Motion

Motion tracking based on commercial inertial measurements units (IMUs) has been widely studied in the latter years as it is a cost-effective enabling technology for those applications in which motion tracking based on optical technologies is unsuitable. This measurement method has a high impact in human performance assessment and human-robot interaction. IMU motion tracking systems are indeed self-contained and wearable, allowing for long-lasting tracking of the user motion in situated environments. After a survey on IMU-based human tracking, five techniques for motion reconstruction were selected and compared to reconstruct a human arm motion. IMU based estimation was matched against motion tracking based on the Vicon marker-based motion tracking system considered as ground truth. Results show that all but one of the selected models perform similarly (about 35 mm average position estimation error)

Measurement of Upper Limb Range of Motion Using Wearable Sensors: A Systematic Review.

Background: Wearable sensors are portable measurement tools that are becoming increasingly popular for the measurement of joint angle in the upper limb. With many brands emerging on the market, each with variations in hardware and protocols, evidence to inform selection and application is needed. Therefore, the objectives of this review were related to the use of wearable sensors to calculate upper limb joint angle. We aimed to describe (i) the characteristics of commercial and custom wearable sensors, (ii) the populations for whom researchers have adopted wearable sensors, and (iii) their established psychometric properties. Methods: A systematic review of literature was undertaken using the following data bases: MEDLINE, EMBASE, CINAHL, Web of Science, SPORTDiscus, IEEE, and Scopus. Studies were eligible if they met the following criteria: (i) involved humans and/or robotic devices, (ii) involved the application or simulation of wearable sensors on the upper limb, and (iii) calculated a joint angle. Results: Of 2191 records identified, 66 met the inclusion criteria. Eight studies compared wearable sensors to a robotic device and 22 studies compared to a motion analysis system. Commercial (n = 13) and custom (n = 7) wearable sensors were identified, each with variations in placement, calibration methods, and fusion algorithms, which were demonstrated to influence accuracy. Conclusion: Wearable sensors have potential as viable instruments for measurement of joint angle in the upper limb during active movement. Currently, customised application (i.e. calibration and angle calculation methods) is required to achieve sufficient accuracy (error < 5°). Additional research and standardisation is required to guide clinical application

Human Motion Analysis with Wearable Inertial Sensors

High-resolution, quantitative data obtained by a human motion capture system can be used to better understand the cause of many diseases for effective treatments. Talking about the daily care of the aging population, two issues are critical. One is to continuously track motions and position of aging people when they are at home, inside a building or in the unknown environment; the other is to monitor their health status in real time when they are in the free-living environment. Continuous monitoring of human movement in their natural living environment potentially provide more valuable feedback than these in laboratory settings. However, it has been extremely challenging to go beyond laboratory and obtain accurate measurements of human physical activity in free-living environments. Commercial motion capture systems produce excellent in-studio capture and reconstructions, but offer no comparable solution for acquisition in everyday environments. Therefore in this dissertation, a wearable human motion analysis system is developed for continuously tracking human motions, monitoring health status, positioning human location and recording the itinerary. In this dissertation, two systems are developed for seeking aforementioned two goals: tracking human body motions and positioning a human. Firstly, an inertial-based human body motion tracking system with our developed inertial measurement unit (IMU) is introduced. By arbitrarily attaching a wearable IMU to each segment, segment motions can be measured and translated into inertial data by IMUs. A human model can be reconstructed in real time based on the inertial data by applying high efficient twists and exponential maps techniques. Secondly, for validating the feasibility of developed tracking system in the practical application, model-based quantification approaches for resting tremor and lower extremity bradykinesia in Parkinson’s disease are proposed. By estimating all involved joint angles in PD symptoms based on reconstructed human model, angle characteristics with corresponding medical ratings are employed for training a HMM classifier for quantification. Besides, a pedestrian positioning system is developed for tracking user’s itinerary and positioning in the global frame. Corresponding tests have been carried out to assess the performance of each system

Ergowear: desenvolvimento de um vestuário inteligente para monitorização postural e biofeedback

Dissertação de mestrado em Engenharia Biomédica (especialização em Eletrónica Médica)Atualmente, as Lesões Musculoesqueléticas Relacionadas com o Trabalho (LMERT) são considera das o ”problema relacionado com o trabalho mais prevalente”na União Europeia, levando a um custo estimado de cerca de 240 biliões de euros. Em casos mais severos, estes distúrbios podem causar danos vitalícios à saúde do trabalhador, reduzindo a sua qualidade de vida. De facto, LMERTs são con sideradas a principal causa da reforma precoce dos trabalhadores. Foi reportado que os segmentos da parte superior do corpo são mais suceptíveis ao desenvolvimento de LMERTs. Para mitigar a prevalência de LMERTs, ergonomistas maioritariamente aplicam métodos de avaliação observacionais, que são alta mente dependentes da experiência do analista, e apresentam baixa objetividade e repetibilidade. Desta maneira, esforços têm sido feitos para desenvolver ferramentas de avaliação ergonómica baseadas na instrumentação, para compensar essas limitações. Além disso, com a ascensão do conceito da indústria 5.0, o trabalhador humano volta a ser o foco principal na indústria, juntamente com o robô colaborativo. No entanto, para alcançar uma relação verdadeiramente colaborativa e simbiótica entre o trabalhador e o robô, este último precisa de reconhecer as intenções do trabalhador. Para superar este obstáculo, sis temas de captura de movimento podem ser integrados nesta estrutura, fornecendo dados de movimento ao robô colaborativo. Esta dissertação visa a melhoria de um sistema de captura de movimento autónomo, da parte supe rior do corpo, de abordagem inercial que servirá, não apenas para monitorizar a postura do trabalhador, mas também avaliar a ergonomia do usuário e fornecer consciencialização postural ao usuário, por meio de motores de biofeedback. Além disso, o sistema foi já idealizado tendo em mente a sua integração numa estrutura colaborativa humano-robô. Para atingir estes objetivos, foi aplicada uma metodologia de design centrado no utilizador, começando pela análise do Estado da Arte, a avaliação das limitações do sistema anterior, a definição dos requisitos do sistema, o desenvolvimento da peça de vestuário, arquite tura do hardware e arquitetura do software do sistema. Por fim, o sistema foi validado para verificar se estava em conformidade com os requisitos especificados. O sistema é composto por 9 Unidades de Medição Inercial (UMI), posicionados na parte inferior e superior das costas, cabeça, braços, antebraços e mãos. Também foi integrado um sistema de atuação, para biofeedback postural, composto por 6 motores vibrotáteis, localizados na região lombar e próximo do pescoço, cotovelos e pulsos. O sistema é alimentado por uma powerbank e todos os dados adquiridos são enviados para uma estação de processamento, via WiFi (User Datagram Protocol (UDP)), garantindo autonomia. O sistema tem integrado um filtro de fusão Complementar Extendido e uma sequência de calibração Sensor-para-Segmento estática, de maneira a aumentar a precisão da estimativa dos ângulos das articulações. Além disso, o sistema é capaz de amostrar os dados angulares a 240 Hz, enquanto que o sistema anterior era capaz de amostrar no máximo a 100 Hz, melhorando a resolução da aquisição dos dados. O sistema foi validado em termos de hardware e usabilidade. Os testes de hardware abordaram a caracterização da autonomia, frequência de amostragem, robustez mecânica e desempenho da comuni cação sem fio do sistema, em diversos contextos, e também para verificar se estes estão em conformidade com os requisitos técnicos previamente definidos, que foi o caso. Adicionalmente, as especificações da nova versão do sistema foram comparadas com a anterior, onde se observou uma melhoria direta signifi cativa, como por exemplo, maior frequência de amostragem, menor perda de pacote, menor consumo de corrente, entre outras, e com sistemas comerciais de referência (XSens Link). Testes de usabilidade foram realizados com 9 participantes que realizaram vários movimentos uniarticulares e complexos. Após os testes, os usuários responderam a um questionário baseado na Escala de Usabilidade do Sistema (EUS). O sistema foi bem aceite pelos os usuários, em termos de estética e conforto, em geral, comprovando um elevado nível de vestibilidade.Nowadays, Work-Related Musculoskeletal Disorders (WRMSDs) are considered the ”most prevalent work-related problem” in the European Union (EU), leading to an estimated cost of about 240 billion EUR. In more severe cases, these disorders can cause life-long impairments to the workers’ health, reducing their quality of life. In fact, WRMSDs are the main cause for the workers’ early retirement. It was reported that the upper body segments of the worker are more susceptible to the development of WRMSDs. To mitigate the prevalence of WRMSD, ergonomists mostly apply observational assessment methods, which are highly dependant on the analyst’s expertise, have low objectivity and repeatability. Therefore, efforts have been made to develop instrumented-based ergonomic assessment tools, to compensate for these limitations. Moreover, with the rise of the 5.0 industry concept, the human worker is once again the main focus in the industry, along with the Collaborative Robot (cobot). However, to achieve a truly collaborative relation between the worker and the cobot, the latter needs to know the worker’s intentions. To surpass this obstacle, Motion Capture (MoCap) systems can be integrated in this framework, providing motion data to the cobot. This dissertation aims at the improvement of a stand-alone, upper-body, inertial, MoCap system, that will serve to not only monitor the worker’s posture, but also to assess the user’s ergonomics and provide posture awareness to the user, through biofeedback motors. Furthermore, it was also designed to integrate a human-robot collaborative framework. To achieve this, a user-centred design methodology was applied, starting with analyzing the State of Art (SOA), assessing the limitations of the previous system, defining the system’s requirements, developing the garment, hardware architecture and software architecture of the system. Lastly, the system was validated to ascertain if it is in conformity with the specified requirements. The developed system is composed of 9 Inertial Measurement Units (IMUs), placed on the lower and upper back, head, upper arms, forearms and hands. An actuation system was also integrated, for postural biofeedback, and it is comprised of 6 vibrotactile motors, located in the lower back, and in close proximity to the neck, elbows and wrists. The system is powered by a powerbank and all of the acquired data is sent to a main station, via WiFi (UDP), granting a standalone characteristic. The system integrates an Extended Complementary Filter (ECF) and a static Sensor-to-Segment (STS) calibration sequence to increase the joint angle estimation accuracy. Furthermore, the system is able to sample the angular data at 240 Hz, while the previous system was able to sample it at a maximum 100 Hz, improving the resolution of the data acquisition. The system was validated in terms of hardware and usability. The hardware tests addressed the char acterization of the system’s autonomy, sampling frequency, mechanical robustness and wireless commu nication performance in different contexts, and ascertain if they comply with the technical requirements, which was the case. Moreover, the specifications of the new version were compared with the previous one, where a significant direct improvement was observed, such as, higher sampling frequency, lower packet loss, lower current consumption, among others, and with a commercial system of reference (XSens Link). Usability tests were carried out with 9 participants who performed several uni-joint and complex motions. After testing, users answered a questionnaire based on the System Usability Scale (SUS). The system was very well accepted by the participants, regarding aesthetics and overall comfort, proving to have a high level of wearability

Recognition of elementary arm movements using orientation of a tri-axial accelerometer located near the wrist

In this paper we present a method for recognising three fundamental movements of the human arm (reach and retrieve, lift cup to mouth, rotation of the arm) by determining the orientation of a tri-axial accelerometer located near the wrist. Our objective is to detect the occurrence of such movements performed with the impaired arm of a stroke patient during normal daily activities as a means to assess their rehabilitation. The method relies on accurately mapping transitions of predefined, standard orientations of the accelerometer to corresponding elementary arm movements. To evaluate the technique, kinematic data was collected from four healthy subjects and four stroke patients as they performed a number of activities involved in a representative activity of daily living, 'making-a-cup-of-tea'. Our experimental results show that the proposed method can independently recognise all three of the elementary upper limb movements investigated with accuracies in the range 91–99% for healthy subjects and 70–85% for stroke patients

Inertial Sensors for Human Motion Analysis: A Comprehensive Review

Inertial motion analysis is having a growing interest during the last decades due to its advantages over classical optical systems. The technological solution based on inertial measurement units allows the measurement of movements in daily living environments, such as in everyday life, which is key for a realistic assessment and understanding of movements. This is why research in this field is still developing and different approaches are proposed. This presents a systematic review of the different proposals for inertial motion analysis found in the literature. The search strategy has been carried out on eight different platforms, including journal articles and conference proceedings, which are written in English and published until August 2022. The results are analyzed in terms of the publishers, the sensors used, the applications, the monitored units, the algorithms of use, the participants of the studies, and the validation systems employed. In addition, we delve deeply into the machine learning techniques proposed in recent years and in the approaches to reduce the estimation error. In this way, we show an overview of the research carried out in this field, going into more detail in recent years, and providing some research directions for future wor

Upper Body Pose Estimation Using Wearable Inertial Sensors and Multiplicative Kalman Filter

Estimating the limbs pose in a wearable way may benefit multiple areas such as rehabilitation, teleoperation, human-robot interaction, gaming, and many more. Several solutions are commercially available, but they are usually expensive or not wearable/portable. We present a wearable pose estimation system (WePosE), based on inertial measurements units (IMUs), for motion analysis and body tracking. Differently from camera-based approaches, the proposed system does not suffer from occlusion problems and lighting conditions, it is cost effective and it can be used in indoor and outdoor environments. Moreover, since only accelerometers and gyroscopes are used to estimate the orientation, the system can be used also in the presence of iron and magnetic disturbances. An experimental validation using a high precision optical tracker has been performed. Results confirmed the effectiveness of the proposed approach

Wearable Movement Sensors for Rehabilitation: From Technology to Clinical Practice

This Special Issue shows a range of potential opportunities for the application of wearable movement sensors in motor rehabilitation. However, the papers surely do not cover the whole field of physical behavior monitoring in motor rehabilitation. Most studies in this Special Issue focused on the technical validation of wearable sensors and the development of algorithms. Clinical validation studies, studies applying wearable sensors for the monitoring of physical behavior in daily life conditions, and papers about the implementation of wearable sensors in motor rehabilitation are under-represented in this Special Issue. Studies investigating the usability and feasibility of wearable movement sensors in clinical populations were lacking. We encourage researchers to investigate the usability, acceptance, feasibility, reliability, and clinical validity of wearable sensors in clinical populations to facilitate the application of wearable movement sensors in motor rehabilitation

Methods and good practice guidelines for human joint kinematics estimation through magnetic and inertial wearable sensors

According to the World Health Organization, the ability to move is recognized as a key factor for the human well-being. From the wearable Magnetic and Inertial Measurement Units (MIMUs) signals it is possible to extract several digital mobility outcomes including the joint kinematics. To this end, it is first required to estimate the orientation of the MIMUs by means of a sensor fusion algorithm (SFA). After that, the relative orientation is computed and then decomposed to obtain the joint angles. However, the MIMUs do not provide a direct output of the physical quantity of interest which can be only determined after an ad hoc processing of their signals. It follows that the joint angle accuracy mostly depends on multiple factors. The first one is the magnitude of the MIMU measurements errors and up to date there is still a lack of methods for their characterization. A second crucial factor is the choice of the SFA to use. Despite the abundance of formulations in the literature, no-well established conclusions about their accuracy have been reached yet. The last factor is the biomechanical model used to compute the joint angles. In this context, unconstrained methods offer a simple way to decompose the relative orientation using the Euler angles but suffer from the inherent issues related to the SFA. In contrast, constrained approaches aim at increasing the robustness of the estimates by adopting models in which an objective function is minimized through the definition of physiological constraints. This thesis proposed the methods to accurately estimate the human joint kinematics starting from the MIMU signals. Three main contributions were provided. The first consisted in the design of a comprehensive battery of tests to completely characterize the sources of errors affecting the quality of the measurements. These tests rely on simple hypotheses based on the sensor working principles and do not require expensive equipment. Nine parameters were defined to quantify the signal accuracy improvements (if any) of 24 MIMUs before and after the refinement of their calibration coefficients. The second contribution was focused on the SFAs. Ten among the most popular SFAs were compared under different experimental conditions including different MIMU models and rotation rate magnitudes. To perform a “fair” comparison it was necessary to set the optimal parameter values for each SFA. The most important finding was that all the errors fall within a range from 3.8 deg to 7.1 deg thus making it impossible to draw any conclusions about the best performing SFA since no statistically significant differences were found. In addition, the orientation accuracy was heavily influenced by the experimental variables. After that, a novel method was designed to estimate the suboptimal parameter values of a given SFA without relying on any orientation reference. The maximum difference between the errors obtained using optimal and suboptimal parameter values amounted to 3.7 deg and to 0.6 deg on average. The last contribution consisted in the design of an unconstrained and a constrained methods for estimating the joint kinematics without considering the magnetometer to avoid the ferromagnetic disturbances. The unconstrained method was employed in a telerehabilitation platform in which the joint angles were estimated in real time. Errors collected during the execution of a full-body protocol were lower than 5 deg (considered the acceptability threshold). However, this method may be inaccurate after few minutes since no solutions can be taken to mitigate the drift error. To overcome this limitation a constrained method was developed based on a robotic model of the upper limb to set appropriate constraints. Errors relative to a continuous robot motion for twenty minutes were lower than 3 deg at most suggesting the feasibility of employing these solutions in the rehabilitation programs to properly plan the treatment and to accurately evaluate the outcomes