Tracking and modelling motion for biomechanical analysis

This thesis focuses on the problem of determining appropriate skeletal configurations for which a virtual animated character moves to desired positions as smoothly, rapidly, and as accurately as possible. During the last decades, several methods and techniques, sophisticated or heuristic, have been presented to produce smooth and natural solutions to the Inverse Kinematics (IK) problem. However, many of the currently available methods suffer from high computational cost and production of unrealistic poses. In this study, a novel heuristic method, called Forward And Backward Reaching Inverse Kinematics (FABRIK), is proposed, which returns visually natural poses in real-time, equally comparable with highly sophisticated approaches. It is capable of supporting constraints for most of the known joint types and it can be extended to solve problems with multiple end effectors, multiple targets and closed loops. FABRIK was compared against the most popular IK approaches and evaluated in terms of its robustness and performance limitations. This thesis also includes a robust methodology for marker prediction under multiple marker occlusion for extended time periods, in order to drive real-time centre of rotation (CoR) estimations. Inferred information from neighbouring markers has been utilised, assuming that the inter-marker distances remain constant over time. This is the first time where the useful information about the missing markers positions which are partially visible to a single camera is deployed. Experiments demonstrate that the proposed methodology can effectively track the occluded markers with high accuracy, even if the occlusion persists for extended periods of time, recovering in real-time good estimates of the true joint positions. In addition, the predicted positions of the joints were further improved by employing FABRIK to relocate their positions and ensure a fixed bone length over time. Our methodology is tested against some of the most popular methods for marker prediction and the results confirm that our approach outperforms these methods in estimating both marker and CoR positions. Finally, an efficient model for real-time hand tracking and reconstruction that requires a minimum number of available markers, one on each finger, is presented. The proposed hand model is highly constrained with joint rotational and orientational constraints, restricting the fingers and palm movements to an appropriate feasible set. FABRIK is then incorporated to estimate the remaining joint positions and to fit them to the hand model. Physiological constraints, such as inertia, abduction, flexion etc, are also incorporated to correct the final hand posture. A mesh deformation algorithm is then applied to visualise the movements of the underlying hand skeleton for comparison with the true hand poses. The mathematical framework used for describing and implementing the techniques discussed within this thesis is Conformal Geometric Algebra (CGA)

Investigation of the Dynamic Interaction between the Human Body and Car Seat Using a Unique Simulation Technique

Numerical simulations and mathematical models have been developed over last many years on the certain portions of human body, car seat or automobile to characterise, monitor and assess the level of vibration and its effects on the human occupant inside the automotive. Though, the numerical simulations can define the level and nature of vibration and its transmissibility up to a certain stage, vibration measurement techniques have also been gaining importance for last several years to fill the limitations of the theoretical models. Efforts have also been made to carry out vibration related investigations using combined numerical simulation and measurement procedure for the car seat and the seated human body inside car, though the numbers of case studies carried out with the combination of simulation and measurement procedure are very less. Some technologies have been achieved to judge the level of vibration inside the car seat and its human occupant, though those technologies cover only effects of vibration, dynamics or measurement techniques on specific portions of the car or the human body without considering all the real life factors, e.g., human gender, shape of the human portions, size specific stiffness properties, in-vehicle operating conditions and damping factors. Approaches to provide a comprehensive solution to estimate the level of vibration without real life testing have not been carried out by the existing technologies very well. More than that the existing technologies investigate only particular modules of the entire human-car dynamic systems, e.g., a specific human part, seat and human interaction, vibration transmission from seat to human body or the vibration measurement technique. So, there is enormous scope of further improvement and the aim of this research work is to provide a unique simulated system considering all the critical real life factors. Outcome of this simulation study will evaluate the vibration levels inside the segments of seated human body inside a car and car seat omitting the necessity of real-life practical testing and provide the solution by linking module-wise investigations of human body and car seat. Initiative has been taken to fill up the gaps in the existing technologies and offer a novel study on the comprehensive simulation model of the combined human body and car seat bio-dynamic system to optimize the health, safety and comfort levels of the car seated human body. Present research work covered the tasks of establishing the simulations for non-linear bio-dynamic model of the seated human body, feasibility and behaviour inspection of polyurethane foam cushions, contact mechanism assignment between the human body and the car seat and establishing the simulation of car seated human occupant under the real life environment. Vertical displacements, vertical accelerations and frequencies at designated points of human body and car seat have been extracted from the simulation outcome and the obtained results have been validated though real-life vibration testing data. This unique simulation methodology can successfully be implemented to predict the final vibration levels inside the car seat and the car seated human body to optimize the health, safety and comfort of the human-car seat system. The outlined novel technique contributed knowledge to the entire human body and car seat dynamic system rather than focusing only on a very specific portion of the system. An industrial guideline has been presented to implement this unique simulation methodology in similar sectors, which will lead various industries to avoid time consuming and expensive bio-dynamic vibration testing methods and help to understand the impact of vibration on the in-vehicle human body in a better way

Real-Time Human Motion Capture Driven by a Wireless Sensor Network

The motion of a real object model is reconstructed through measurements of the position, direction, and angle of moving objects in 3D space in a process called “motion capture.” With the development of inertial sensing technology, motion capture systems that are based on inertial sensing have become a research hot spot. However, the solution of motion attitude remains a challenge that restricts the rapid development of motion capture systems. In this study, a human motion capture system based on inertial sensors is developed, and the real-time movement of a human model controlled by real people’s movement is achieved. According to the features of the system of human motion capture and reappearance, a hierarchical modeling approach based on a 3D human body model is proposed. The method collects articular movement data on the basis of rigid body dynamics through a miniature sensor network, controls the human skeleton model, and reproduces human posture according to the features of human articular movement. Finally, the feasibility of the system is validated by testing of system properties via capture of continuous dynamic movement. Experiment results show that the scheme utilizes a real-time sensor network-driven human skeleton model to achieve the accurate reproduction of human motion state. The system also has good application value

A novel musculoskeletal joint modelling for orthopaedic applications

This thesis was submitted for the degree of Docter of Philosophy and awarded by Brunel University.The objective of the work carried out in this thesis was to develop analytical and computational tools to model and investigate musculoskeletal human joints. It was recognised that the FEA was used by many researchers in modelling human musculoskeletal motion, loading and stresses. However the continuum mechanics played only a minor role in determining the articular joint motion, and its value was questionable. This is firstly due to the computational cost and secondly due to its impracticality for this application. On the other hand, there isn’t any suitable software for precise articular joint motion analysis to deal with the local joint stresses or non standard joints. The main requirement in orthopaedics field is to develop a modeller software (and its associated theories) to model anatomic joint as it is, without any simplification with respect to joint surface morphology and material properties of surrounding tissues. So that the proposed modeller can be used for evaluating and diagnosing different joint abnormalities but furthermore form the basis for performing implant insertion and analysis of the artificial joints. The work which is presented in this thesis is a new frame work and has been developed for human anatomic joint analysis which describes the joint in terms of its surface geometry and surrounding musculoskeletal tissues. In achieving such a framework several contributions were made to the 6DOF linear and nonlinear joint modelling, the mathematical definition of joint stiffness, tissue path finding and wrapping and the contact with collision analysis. In 6DOF linear joint modelling, the contribution is the development of joint stiffness and damping matrices. This modelling approach is suitable for the linear range of tissue stiffness and damping properties. This is the first of its kind and it gives a firm analytical basis for investigating joints with surrounding tissue and the cartilage. The 6DOF nonlinear joint modelling is a new scheme which is described for modelling the motion of multi bodies joined by non-linear stiffness and contact elements. The proposed method requires no matrix assembly for the stiffness and damping elements or mass elements. The novelty in the nonlinear modelling, relates to the overall algorithmic approach and handling local non-linearity by procedural means. The mathematical definition of joint stiffness is also a new proposal which is based on the mathematical definition of stiffness between two bodies. Based on the joint stiffness matrix properties, number of joint stiffness invariants was obtained analytically such as the centre of stiffness, the principal translational stiffnesses, and the principal rotational stiffnesses. In corresponding to these principal stiffnesses, their principal axes have been also obtained. Altogether, a joint is assessed by six principal axes and six principal stiffnesses and its centre of stiffness. These formulations are new and show that a joint can be described in terms of inherent stiffness properties. It is expected that these will be better in characterising a joint in comparison to laxity based characterisation. The development of tissue path finding and wrapping algorithms are also introduced as new approaches. The musculoskeletal tissue wrapping involves calculating the shortest distance between two points on a meshed surface. A new heuristic algorithm was proposed. The heuristic is based on minimising the accumulative divergence from the straight line between two points on the surface and the direction of travel on the surface (i.e. bone). In contact and collision based development, the novel algorithm has been proposed that detects possible colliding points on the motion trajectory by redefining the distance as a two dimensional measure along the velocity approach vector and perpendicular to this vector. The perpendicular distance determines if there are potentially colliding points, and the distance along the velocity determines how close they are. The closest pair among the potentially colliding points gives the “time to collision”. The algorithm can eliminate the “fly pass” situation where very close points may not collide because of the direction of their relative velocity. All these developed algorithms and modelling theories, have been encompassed in the developed prototype software in order to simulate the anatomic joint articulations through modelling formulations developed. The software platform provides a capability for analysing joints as 6DOF joints based on anatomic joint surfaces. The software is highly interactive and driven by well structured database, designed to be highly flexible for the future developments. Particularly, two case studies are carried out in this thesis in order to generate results relating to all the proposed elements of the study. The results obtained from the case studies show good agreement with previously published results or model based results obtained from Lifemod software, whenever comparison was possible. In some cases the comparison was not possible because there were no equivalent results; the results were supported by other indicators. The modelling based results were also supported by experiments performed in the Brunel Orthopaedic Research and Learning Centre

Bipedal Walking Analysis, Control, and Applications Towards Human-Like Behavior

Realizing the essentials of bipedal walking balance is one of the core studies in both robotics and biomechanics. Although the recent developments of walking control on bipedal robots have brought the humanoid automation to a different level, the walking performance is still limited compared to human walking, which also restricts the related applications in biomechanics and rehabilitation. To mitigate the discrepancy between robotic walking and human walking, this dissertation is broken into three parts to develop the control methods to improve three important perspectives: predictive walking behavior, gait optimization, and stepping strategy. To improve the predictive walking behavior captured by the model predictive control (MPC) which is transitionally applied with the nonlinear tracking control in sequence, a quadratic program (QP)-based controller is proposed to unify center of mass (COM) planning using MPC and a nonlinear torque control with control Lyapunov function (CLF). For the gait optimization, we focus on the algorithms of trajectory optimization with direct collocation framework. We propose a robust trajectory optimization using step-time sampling for a simple walker under terrain uncertainties. Towards generating human-like walking gait with multi-domain (phases), we improve the optimization through contact with more accurate transcription method for level walking, and generalize the hybrid zero dynamics (HZD) gait optimization with modified contact conditions for walking on various terrains. The results are compared with human walking gaits, where the similar trends and the sources of discrepancies are identified. In the third part for stepping strategy, we perform step estimation based on capture point (CP) for different human movements, including single-step (balance) recovery, walking and walking with slip. The analysis provides the insights of the efficacy and limitation of CP-based step estimation for human gait

Biomechanical analysis of the diabetic foot: an integrated approach using movement analysis and finite element simulation

Objective:High plantar pressures have been associated with foot ulceration in patients with diabetes. Treatment usually includes an in-shoe intervention designed to reduce plantar pressure under the heel by using insoles. Finite element (FE) analysis provides an efficient computational framework to investigate the performance of different insoles for optimal pressure reduction [Goeske et al. 2005]. The aim of this study is to design a patient specific, 2-dimensional (2D) FE model of diabetic hindfoot and to apply on it patient-specific forces.Method: A 2D FE model of the hindfoot was developed from reconstruction of magnetic resonance images (Simpleware ScanIP-ScanFE, v.5.0 and Rhinoceros v.4.0). FE software ABAQUS was used to perform the numerical stress analyses. A diabetic subject (age, 72 years, BMI, 25.1 kg/m2) and a healthy subject (age 28 years, BMI 20.2 kg/m2) were acquired. The foot biomechanics analysis was carried out as in [Sawacha et al. 2012]. Vertical ground reaction forces (Bertec), taken from the various phases of the gait, were applied to the FE model. Validation of the pressure state was achieved by comparing model predictions of contact pressure distribution with experimental plantar pressure measures Result: A nonlinear 2D FE hindfoot model was developed and meshed with quadratic elements. The measured and model predicted peak plantar pressures of the diabetic subject was respectively 682.32 KPa and 602.82 KPa. The values for the healthy subject were 483.63 KPa for the measured peak plantar pressure and 428.63 KPa for the simulated one. The model predicted structural response of the heel pad was in agreement with experimental results unless 10% of error. Conclusion: The proposed model will be useful to simulate the different insole material and their contribution in decreasing the plantar pressure

A biomechanics-based articulation model for medical applications

Computer Graphics came into the medical world especially after the arrival of 3D medical imaging. Computer Graphics techniques are already integrated in the diagnosis procedure by means of the visual tridimensional analysis of computer tomography, magnetic resonance and even ultrasound data. The representations they provide, nevertheless, are static pictures of the patients' body, lacking in functional information. We believe that the next step in computer assisted diagnosis and surgery planning depends on the development of functional 3D models of human body. It is in this context that we propose a model of articulations based on biomechanics. Such model is able to simulate the joint functionality in order to allow for a number of medical applications. It was developed focusing on the following requirements: it must be at the same time simple enough to be implemented on computer, and realistic enough to allow for medical applications; it must be visual in order for applications to be able to explore the joint in a 3D simulation environment. Then, we propose to combine kinematical motion for the parts that can be considered as rigid, such as bones, and physical simulation of the soft tissues. We also deal with the interaction between the different elements of the joint, and for that we propose a specific contact management model. Our kinematical skeleton is based on anatomy. Special considerations have been taken to include anatomical features like axis displacements, range of motion control, and joints coupling. Once a 3D model of the skeleton is built, it can be simulated by data coming from motion capture or can be specified by a specialist, a clinician for instance. Our deformation model is an extension of the classical mass-spring systems. A spherical volume is considered around mass points, and mechanical properties of real materials can be used to parameterize the model. Viscoelasticity, anisotropy and non-linearity of the tissues are simulated. We particularly proposed a method to configure the mass-spring matrix such that the objects behave according to a predefined Young's modulus. A contact management model is also proposed to deal with the geometric interactions between the elements inside the joint. After having tested several approaches, we proposed a new method for collision detection which measures in constant time the signed distance to the closest point for each point of two meshes subject to collide. We also proposed a method for collision response which acts directly on the surfaces geometry, in a way that the physical behavior relies on the propagation of reaction forces produced inside the tissue. Finally, we proposed a 3D model of a joint combining the three elements: anatomical skeleton motion, biomechanical soft tissues deformation, and contact management. On the top of that we built a virtual hip joint and implemented a set of medical applications prototypes. Such applications allow for assessment of stress distribution on the articular surfaces, range of motion estimation based on ligament constraint, ligament elasticity estimation from clinically measured range of motion, and pre- and post-operative evaluation of stress distribution. Although our model provides physicians with a number of useful variables for diagnosis and surgery planning, it should be improved for effective clinical use. Validation has been done partially. However, a global clinical validation is necessary. Patient specific data are still difficult to obtain, especially individualized mechanical properties of tissues. The characterization of material properties in our soft tissues model can also be improved by including control over the shear modulus

The Future of Humanoid Robots

This book provides state of the art scientific and engineering research findings and developments in the field of humanoid robotics and its applications. It is expected that humanoids will change the way we interact with machines, and will have the ability to blend perfectly into an environment already designed for humans. The book contains chapters that aim to discover the future abilities of humanoid robots by presenting a variety of integrated research in various scientific and engineering fields, such as locomotion, perception, adaptive behavior, human-robot interaction, neuroscience and machine learning. The book is designed to be accessible and practical, with an emphasis on useful information to those working in the fields of robotics, cognitive science, artificial intelligence, computational methods and other fields of science directly or indirectly related to the development and usage of future humanoid robots. The editor of the book has extensive R&D experience, patents, and publications in the area of humanoid robotics, and his experience is reflected in editing the content of the book

Fetus safety in motor vehicle accidents

Motor vehicle accidents are statistically the major cause of accidental severe injuries for pregnant women and fetuses fatality. Volunteers, post mortem human surrogates, anthropomorphic crash test devices and computational occupant models are used to improve human safety in motor vehicle accidents. However, due to the ethical issues, pregnant women and their fetuses cannot be used as volunteers or post mortem human surrogates to investigate the effects of crashes on them. The only anthropomorphic test device representing pregnant women is very limited in design and lacks a fetus. There is no computational pregnant occupant model with a fetus other than 'Expecting'. This thesis focuses on understanding the risk of placental abruption for pregnant drivers involved in road accidents, hence assessing the risk to fetus fatality. An extensive review of existing models in general and pregnant women models in particular is reported. The time line of successive development of crash test dummies and their positive effect on automotive passive safety design are examined. 'Expecting', the computational pregnant occupant model with a finite element uterus and a multibody fetus, is used in this research to determine the strain levels in the uteroplacental interface. External factors, such as the effect of restraint systems and crash speeds are considered. Internal factors, such as the effect of placental location in the uterus, and the inclusion and exclusion of a fetus are investigated. The head of the multibody fetus is replaced with a deformable head model to investigate the effects of a deformable fetus head on strain levels. The computational pregnant driver model with a fetus offers a more realistic representation of the response to crash impact hence provides a useful tool to investigate fetus safety in motor vehicle accidents. Seat belt, airbag and steering wheel interact directly with the pregnant abdomen and play an important role on fetus safety in motor vehicle accidents. The results prove that the use of a three-point seat belt with the airbag offer the greatest protection to the fetus for frontal crash impacts. The model without a fetus underestimates the strain levels. The outcome of this research should assist automobile manufacturers to address the potential safety issues at the design level

Simulating Humans: Computer Graphics, Animation, and Control

People are all around us. They inhabit our home, workplace, entertainment, and environment. Their presence and actions are noted or ignored, enjoyed or disdained, analyzed or prescribed. The very ubiquitousness of other people in our lives poses a tantalizing challenge to the computational modeler: people are at once the most common object of interest and yet the most structurally complex. Their everyday movements are amazingly uid yet demanding to reproduce, with actions driven not just mechanically by muscles and bones but also cognitively by beliefs and intentions. Our motor systems manage to learn how to make us move without leaving us the burden or pleasure of knowing how we did it. Likewise we learn how to describe the actions and behaviors of others without consciously struggling with the processes of perception, recognition, and language