Upper Body Pose Estimation Using Wearable Inertial Sensors and Multiplicative Kalman Filter

Estimating the limbs pose in a wearable way may benefit multiple areas such as rehabilitation, teleoperation, human-robot interaction, gaming, and many more. Several solutions are commercially available, but they are usually expensive or not wearable/portable. We present a wearable pose estimation system (WePosE), based on inertial measurements units (IMUs), for motion analysis and body tracking. Differently from camera-based approaches, the proposed system does not suffer from occlusion problems and lighting conditions, it is cost effective and it can be used in indoor and outdoor environments. Moreover, since only accelerometers and gyroscopes are used to estimate the orientation, the system can be used also in the presence of iron and magnetic disturbances. An experimental validation using a high precision optical tracker has been performed. Results confirmed the effectiveness of the proposed approach

Survey of Motion Tracking Methods Based on Inertial Sensors: A Focus on Upper Limb Human Motion

Motion tracking based on commercial inertial measurements units (IMUs) has been widely studied in the latter years as it is a cost-effective enabling technology for those applications in which motion tracking based on optical technologies is unsuitable. This measurement method has a high impact in human performance assessment and human-robot interaction. IMU motion tracking systems are indeed self-contained and wearable, allowing for long-lasting tracking of the user motion in situated environments. After a survey on IMU-based human tracking, five techniques for motion reconstruction were selected and compared to reconstruct a human arm motion. IMU based estimation was matched against motion tracking based on the Vicon marker-based motion tracking system considered as ground truth. Results show that all but one of the selected models perform similarly (about 35 mm average position estimation error)

Using Accelerometer Data to Tune the Parameters of an Extended Kalman Filter for Optical Motion Capture: Preliminary Application to Gait Analysis

[Abstract] Optical motion capture is currently the most popular method for acquiring motion data in biomechanical applications. However, it presents a number of problems that make the process difficult and inefficient, such as marker occlusions and unwanted reflections. In addition, the obtained trajectories must be numerically differentiated twice in time in order to get the accelerations. Since the trajectories are normally noisy, they need to be filtered first, and the selection of the optimal amount of filtering is not trivial. In this work, an extended Kalman filter (EKF) that manages marker occlusions and undesired reflections in a robust way is presented. A preliminary test with inertial measurement units (IMUs) is carried out to determine their local reference frames. Then, the gait analysis of a healthy subject is performed using optical markers and IMUs simultaneously. The filtering parameters used in the optical motion capture process are tuned in order to achieve good correlation between the obtained accelerations and those measured by the IMUs. The results show that the EKF provides a robust and efficient method for optical system-based motion analysis, and that the availability of accelerations measured by inertial sensors can be very helpful for the adjustment of the filters.This work was funded by the Spanish MCI under project PGC2018-095145-B-I00, co-financed by the EU through the EFRD program, and by the Galician Government under grant ED431C2019/29. Moreover, F. Michaud would like to acknowledge the support of the Spanish MCI by means of the doctoral research contract BES-2016-076901, co-financed by the EU through the ESF programXunta de Galicia; ED431C2019/2

Wearable Textile Platform for Assessing Stroke Patient Treatment in Daily Life Conditions

Monitoring physical activities during post-stroke rehabilitation in daily life may help physicians to optimize and tailor the training program for patients. The European research project INTERACTION (FP7-ICT-2011-7-287351) evaluated motor capabilities in stroke patients during the recovery treatment period. We developed wearable sensing platform based on the sensor fusion among inertial, knitted piezoresistive sensors and textile EMG electrodes. The device was conceived in modular form and consists of a separate shirt, trousers, glove, and shoe. Thanks to the novel fusion approach it has been possible to develop a model for the shoulder taking into account the scapulo-thoracic joint of the scapular girdle, considerably improving the estimation of the hand position in reaching activities. In order to minimize the sensor set used to monitor gait, a single inertial sensor fused with a textile goniometer proved to reconstruct the orientation of all the body segments of the leg. Finally, the sensing glove, endowed with three textile goniometers and three force sensors showed good capabilities in the reconstruction of grasping activities and evaluating the interaction of the hand with the environment, according to the project specifications. This paper reports on the design and the technical evaluation of the performance of the sensing platform, tested on healthy subjects

Explaining the Ergonomic Assessment of Human Movement in Industrial Contexts

Manufacturing processes are based on human labour and the symbiosis between human operators and machines. The operators are required to follow predefined sequences of movements. The operations carried out at assembly lines are repetitive, being identified as a risk factor for the onset of musculoskeletal disorders. Ergonomics plays a big role in preventing occupational diseases. Ergonomic risk scores measure the overall risk exposure of operators however these methods still present challenges: the scores are often associated to a given workstation, being agnostic to the variability among operators. Observation methods are most often employed yet require a significant amount of effort, preventing an accurate and continuous ergonomic evaluation to the entire population of operators. Finally, the risk’s results are rendered as index scores, hindering a more comprehensive interpretation by occupational physicians. This dissertation developed a solution for automatic operator risk exposure in assembly lines. Three main contributions were presented: (1) an upper limb and torso motion tracking algorithm which relies on inertial sensors to estimate the orientation of anatomical joints; (2) an adjusted ergonomic risk score; (3) an ergonomic risk explanation approach based on the analysis of the angular risk factors. Throughout the research, two experimental assessments were conducted: laboratory validation and field evaluation. The laboratory tests enabled the creation of a movements’ dataset and used an optical motion capture system as reference. The field evaluation dataset was acquired on an automotive assembly line and serve as the basis for an ergonomic risk evaluation study. The experimental results revealed that the proposed solution has the potential to be applied in a real environment. Through direct measures, the ergonomic feedback is fastened, and consequently, the evaluation can be extended to more operators, ultimately preventing, in long-term, work-related injuries

FlightGoggles: A Modular Framework for Photorealistic Camera, Exteroceptive Sensor, and Dynamics Simulation

FlightGoggles is a photorealistic sensor simulator for perception-driven robotic vehicles. The key contributions of FlightGoggles are twofold. First, FlightGoggles provides photorealistic exteroceptive sensor simulation using graphics assets generated with photogrammetry. Second, it provides the ability to combine (i) synthetic exteroceptive measurements generated in silico in real time and (ii) vehicle dynamics and proprioceptive measurements generated in motio by vehicle(s) in a motion-capture facility. FlightGoggles is capable of simulating a virtual-reality environment around autonomous vehicle(s). While a vehicle is in flight in the FlightGoggles virtual reality environment, exteroceptive sensors are rendered synthetically in real time while all complex extrinsic dynamics are generated organically through the natural interactions of the vehicle. The FlightGoggles framework allows for researchers to accelerate development by circumventing the need to estimate complex and hard-to-model interactions such as aerodynamics, motor mechanics, battery electrochemistry, and behavior of other agents. The ability to perform vehicle-in-the-loop experiments with photorealistic exteroceptive sensor simulation facilitates novel research directions involving, e.g., fast and agile autonomous flight in obstacle-rich environments, safe human interaction, and flexible sensor selection. FlightGoggles has been utilized as the main test for selecting nine teams that will advance in the AlphaPilot autonomous drone racing challenge. We survey approaches and results from the top AlphaPilot teams, which may be of independent interest.Comment: Initial version appeared at IROS 2019. Supplementary material can be found at https://flightgoggles.mit.edu. Revision includes description of new FlightGoggles features, such as a photogrammetric model of the MIT Stata Center, new rendering settings, and a Python AP

Rigid Body Attitude Estimation: An Overview and Comparative Study

The attitude estimation of rigid body systems has attracted the attention of many researchers over the years. The development of efficient estimation algorithms that can accurately estimate the orientation of a rigid body is a crucial step towards a reliable implementation of control schemes for underwater and flying vehicles. The primary focus of this thesis consists in investigating various attitude estimation techniques and their applications. Two major classes are discussed. The first class consists of the earliest static attitude determination techniques relying solely on a set of body vector measurements of known vectors in the inertial frame. The second class consists of dynamic attitude estimation and filtering techniques, relying on body vector measurements as well other measurements, and using the dynamical equations of the system under consideration. Various attitude estimation algorithms, including the latest nonlinear attitude observers, are presented and discussed, providing a survey that covers the evolution and structural differences of these estimation methods. Simulation results have been carried out for a selected number of such attitude estimators. Their performance in the presence of noisy measurements, as well as their advantages and disadvantages are discussed

Posture Risk Assessment in an Automotive Assembly Line using Inertial Sensors

Publisher Copyright: AuthorMusculoskeletal disorders (MSD) are a highly prevalent work-related health problem. Biomechanical exposure to hazardous postures during work is a risk factor for the development of MSD. This study focused on developing an inertial sensor-based approach to evaluate posture in industrial contexts, particularly in automotive assembly lines. The analysis was divided into two stages: 1) a comparative study of joint angles calculated during movements of the upper body segments using the proposed motion tracking framework and the ones provided by a state-of-the-art inertial motion capture system and 2) a work-related posture risk evaluation of operators working in an automative assembly line. For the comparative study, we selected data collected in laboratory (N = 8 participants) and assembly line settings (N = 9 participants), while for the work-related posture risk evaluation, we only considered data acquired within the automotive assembly line. The results revealed that the proposed framework could be applied to track industrial tasks movements performed on the sagittal plane, and the posture evaluation uncovered posture risk differences among different operators that are not considered in traditional posture risk assessment instruments.publishersversionepub_ahead_of_prin