The Sliced Gaussian Mixture Filter with Adaptive State Decomposition Depending on Linearization Error

In this paper, a novel nonlinear/non-linear model decomposition for the Sliced Gaussian Mixture Filter is presented. Based on the level of nonlinearity of the model, the overall estimation problem is decomposed into a severely nonlinear and a slightly nonlinear part, which are processed by different estimation techniques. To further improve the efficiency of the estimator, an adaptive state decomposition algorithm is introduced that allows decomposition according to the linearization error for nonlinear system and measurement models. Simulations show that this approach has orders of magnitude less complexity compared to other state of the art estimators, while maintaining comparable estimation errors

Nonlinear Gaussian Filtering : Theory, Algorithms, and Applications

By restricting to Gaussian distributions, the optimal Bayesian filtering problem can be transformed into an algebraically simple form, which allows for computationally efficient algorithms. Three problem settings are discussed in this thesis: (1) filtering with Gaussians only, (2) Gaussian mixture filtering for strong nonlinearities, (3) Gaussian process filtering for purely data-driven scenarios. For each setting, efficient algorithms are derived and applied to real-world problems

Nonlinear state and parameter estimation of spatially distributed systems

In this thesis two probabilistic model-based estimators are introduced that allow the reconstruction and identification of space-time continuous physical systems. The Sliced Gaussian Mixture Filter (SGMF) exploits linear substructures in mixed linear/nonlinear systems, and thus is well-suited for identifying various model parameters. The Covariance Bounds Filter (CBF) allows the efficient estimation of widely distributed systems in a decentralized fashion

An Efficient 1 Iteration Learning Algorithm for Gaussian Mixture Model And Gaussian Mixture Embedding For Neural Network

We propose an Gaussian Mixture Model (GMM) learning algorithm, based on our previous work of GMM expansion idea. The new algorithm brings more robustness and simplicity than classic Expectation Maximization (EM) algorithm. It also improves the accuracy and only take 1 iteration for learning. We theoretically proof that this new algorithm is guarantee to converge regardless the parameters initialisation. We compare our GMM expansion method with classic probability layers in neural network leads to demonstrably better capability to overcome data uncertainty and inverse problem. Finally, we test GMM based generator which shows a potential to build further application that able to utilized distribution random sampling for stochastic variation as well as variation control

Performance Analysis of Bearings-only Tracking Problems for Maneuvering Target and Heterogeneous Sensor Applications

State estimation, i.e. determining the trajectory, of a maneuvering target from noisy measurements collected by a single or multiple passive sensors (e.g. passive sonar and radar) has wide civil and military applications, for example underwater surveillance, air defence, wireless communications, and self-protection of military vehicles. These passive sensors are listening to target emitted signals without emitting signals themselves which give them concealing properties. Tactical scenarios exists where the own position shall not be revealed, e.g. for tracking submarines with passive sonar or tracking an aerial target by means of electro-optic image sensors like infrared sensors. This estimation process is widely known as bearings-only tracking. On the one hand, a challenge is the high degree of nonlinearity in the estimation process caused by the nonlinear relation of angular measurements to the Cartesian state. On the other hand, passive sensors cannot provide direct target location measurements, so bearings-only tracking suffers from poor target trajectory estimation accuracy due to marginal observability from sensor measurements. In order to achieve observability, that means to be able to estimate the complete target state, multiple passive sensor measurements must be fused. The measurements can be recorded spatially distributed by multiple dislocated sensor platforms or temporally distributed by a single, moving sensor platform. Furthermore, an extended case of bearings-only tracking is given if heterogeneous measurements from targets emitting different types of signals, are involved. With this, observability can also be achieved on a single, not necessarily moving platform. In this work, a performance bound for complex motion models, i.e. piecewisely maneuvering targets with unknown maneuver change times, by means of bearings-only measurements from a single, moving sensor platform is derived and an efficient estimator is implemented and analyzed. Furthermore, an observability analysis is carried out for targets emitting acoustic and electromagnetic signals. Here, the different signal propagation velocities can be exploited to ensure observability on a single, not necessarily moving platform. Based on the theoretical performance and observability analyses a distributed fusion system has been realized by means of heterogeneous sensors, which shall detect an event and localize a threat. This is performed by a microphone array to detect sound waves emitted by the threat as well as a radar detector that detects electromagnetic emissions from the threat. Since multiple platforms are involved to provide increased observability and also redundancy against possible breakdowns, a WiFi mobile ad hoc network is used for communications. In order to keep up the network in a breakdown OLSR (optimized link state routing) routing approach is employed

EKF based State Estimation in a CFI Copolymerization Reactor including Polymer Quality Information

State estimation is an integral part of modern control techniques, as it allows to characterize the state information of complex plants based on a limited number of measurements and the knowledge of the process model. The benefit is twofold: on one hand it has the potential to rationalize the number of measurements required to monitor the plant, thus reducing costs, on the other hand it enables to extract information about variables that have an effect on the system but would otherwise be inaccessible to direct measurement. The scope of this thesis is to design a state estimator for a tubular copolymerization reactor, with the aim to provide the full state information of the plant and to characterize the quality of the product. Due to the fact that, with the existing set of measurements, only a small number of state variables can be observed, a new differential pressure sensor is installed in the plant to provide the missing information, and a model for the pressure measurement is developed. Following, the state estimation problem is approached rigorously and a comprehensive method for analyzing, tuning and implementing the state estimator is assembled from scientific literature, using a variety of tools from graph theory, linear observability theory and matrix algebra. Data reduction and visualization techniques are also employed to make sense of high dimensional information. The proposed method is then tested in simulations to assess the effect of the tuning parameters and measured set on the estimator performance during initialization and in case of estimation with plant-model mismatch. Finally, the state estimator is tested with plant data

Human skill capturing and modelling using wearable devices

Industrial robots are delivering more and more manipulation services in manufacturing. However, when the task is complex, it is difficult to programme a robot to fulfil all the requirements because even a relatively simple task such as a peg-in-hole insertion contains many uncertainties, e.g. clearance, initial grasping position and insertion path. Humans, on the other hand, can deal with these variations using their vision and haptic feedback. Although humans can adapt to uncertainties easily, most of the time, the skilled based performances that relate to their tacit knowledge cannot be easily articulated. Even though the automation solution may not fully imitate human motion since some of them are not necessary, it would be useful if the skill based performance from a human could be firstly interpreted and modelled, which will then allow it to be transferred to the robot. This thesis aims to reduce robot programming efforts significantly by developing a methodology to capture, model and transfer the manual manufacturing skills from a human demonstrator to the robot. Recently, Learning from Demonstration (LfD) is gaining interest as a framework to transfer skills from human teacher to robot using probability encoding approaches to model observations and state transition uncertainties. In close or actual contact manipulation tasks, it is difficult to reliabley record the state-action examples without interfering with the human senses and activities. Therefore, wearable sensors are investigated as a promising device to record the state-action examples without restricting the human experts during the skilled execution of their tasks. Firstly to track human motions accurately and reliably in a defined 3-dimensional workspace, a hybrid system of Vicon and IMUs is proposed to compensate for the known limitations of the individual system. The data fusion method was able to overcome occlusion and frame flipping problems in the two camera Vicon setup and the drifting problem associated with the IMUs. The results indicated that occlusion and frame flipping problems associated with Vicon can be mitigated by using the IMU measurements. Furthermore, the proposed method improves the Mean Square Error (MSE) tracking accuracy range from 0.8˚ to 6.4˚ compared with the IMU only method. Secondly, to record haptic feedback from a teacher without physically obstructing their interactions with the workpiece, wearable surface electromyography (sEMG) armbands were used as an indirect method to indicate contact feedback during manual manipulations. A muscle-force model using a Time Delayed Neural Network (TDNN) was built to map the sEMG signals to the known contact force. The results indicated that the model was capable of estimating the force from the sEMG armbands in the applications of interest, namely in peg-in-hole and beater winding tasks, with MSE of 2.75N and 0.18N respectively. Finally, given the force estimation and the motion trajectories, a Hidden Markov Model (HMM) based approach was utilised as a state recognition method to encode and generalise the spatial and temporal information of the skilled executions. This method would allow a more representative control policy to be derived. A modified Gaussian Mixture Regression (GMR) method was then applied to enable motions reproduction by using the learned state-action policy. To simplify the validation procedure, instead of using the robot, additional demonstrations from the teacher were used to verify the reproduction performance of the policy, by assuming human teacher and robot learner are physical identical systems. The results confirmed the generalisation capability of the HMM model across a number of demonstrations from different subjects; and the reproduced motions from GMR were acceptable in these additional tests. The proposed methodology provides a framework for producing a state-action model from skilled demonstrations that can be translated into robot kinematics and joint states for the robot to execute. The implication to industry is reduced efforts and time in programming the robots for applications where human skilled performances are required to cope robustly with various uncertainties during tasks execution

Motion-capture-based hand gesture recognition for computing and control

This dissertation focuses on the study and development of algorithms that enable the analysis and recognition of hand gestures in a motion capture environment. Central to this work is the study of unlabeled point sets in a more abstract sense. Evaluations of proposed methods focus on examining their generalization to users not encountered during system training. In an initial exploratory study, we compare various classification algorithms based upon multiple interpretations and feature transformations of point sets, including those based upon aggregate features (e.g. mean) and a pseudo-rasterization of the capture space. We find aggregate feature classifiers to be balanced across multiple users but relatively limited in maximum achievable accuracy. Certain classifiers based upon the pseudo-rasterization performed best among tested classification algorithms. We follow this study with targeted examinations of certain subproblems. For the first subproblem, we introduce the a fortiori expectation-maximization (AFEM) algorithm for computing the parameters of a distribution from which unlabeled, correlated point sets are presumed to be generated. Each unlabeled point is assumed to correspond to a target with independent probability of appearance but correlated positions. We propose replacing the expectation phase of the algorithm with a Kalman filter modified within a Bayesian framework to account for the unknown point labels which manifest as uncertain measurement matrices. We also propose a mechanism to reorder the measurements in order to improve parameter estimates. In addition, we use a state-of-the-art Markov chain Monte Carlo sampler to efficiently sample measurement matrices. In the process, we indirectly propose a constrained k-means clustering algorithm. Simulations verify the utility of AFEM against a traditional expectation-maximization algorithm in a variety of scenarios. In the second subproblem, we consider the application of positive definite kernels and the earth mover\u27s distance (END) to our work. Positive definite kernels are an important tool in machine learning that enable efficient solutions to otherwise difficult or intractable problems by implicitly linearizing the problem geometry. We develop a set-theoretic interpretation of ENID and propose earth mover\u27s intersection (EMI). a positive definite analog to ENID. We offer proof of EMD\u27s negative definiteness and provide necessary and sufficient conditions for ENID to be conditionally negative definite, including approximations that guarantee negative definiteness. In particular, we show that ENID is related to various min-like kernels. We also present a positive definite preserving transformation that can be applied to any kernel and can be used to derive positive definite EMD-based kernels, and we show that the Jaccard index is simply the result of this transformation applied to set intersection. Finally, we evaluate kernels based on EMI and the proposed transformation versus ENID in various computer vision tasks and show that END is generally inferior even with indefinite kernel techniques. Finally, we apply deep learning to our problem. We propose neural network architectures for hand posture and gesture recognition from unlabeled marker sets in a coordinate system local to the hand. As a means of ensuring data integrity, we also propose an extended Kalman filter for tracking the rigid pattern of markers on which the local coordinate system is based. We consider fixed- and variable-size architectures including convolutional and recurrent neural networks that accept unlabeled marker input. We also consider a data-driven approach to labeling markers with a neural network and a collection of Kalman filters. Experimental evaluations with posture and gesture datasets show promising results for the proposed architectures with unlabeled markers, which outperform the alternative data-driven labeling method

PREDICTION OF RESPIRATORY MOTION

Radiation therapy is a cancer treatment method that employs high-energy radiation beams to destroy cancer cells by damaging the ability of these cells to reproduce. Thoracic and abdominal tumors may change their positions during respiration by as much as three centimeters during radiation treatment. The prediction of respiratory motion has become an important research area because respiratory motion severely affects precise radiation dose delivery. This study describes recent radiotherapy technologies including tools for measuring target position during radiotherapy and tracking-based delivery systems. In the first part of our study we review three prediction approaches of respiratory motion, i.e., model-based methods, model-free heuristic learning algorithms, and hybrid methods. In the second part of our work we propose respiratory motion estimation with hybrid implementation of extended Kalman filter. The proposed method uses the recurrent neural network as the role of the predictor and the extended Kalman filter as the role of the corrector. In the third part of our work we further extend our research work to present customized prediction of respiratory motion with clustering from multiple patient interactions. For the customized prediction we construct the clustering based on breathing patterns of multiple patients using the feature selection metrics that are composed of a variety of breathing features. In the fourth part of our work we retrospectively categorize breathing data into several classes and propose a new approach to detect irregular breathing patterns using neural networks. We have evaluated the proposed new algorithm by comparing the prediction overshoot and the tracking estimation value. The experimental results of 448 patients’ breathing patterns validated the proposed irregular breathing classifier