Dirichlet process approach for radio-based simultaneous localization and mapping

Due to 5G millimeter wave (mmWave), spatial channel parameters are becoming highly resolvable, enabling accurate vehicle localization and mapping. We propose a novel method of radio simultaneous localization and mapping (SLAM) with the Dirichlet process (DP). The DP, which can estimate the number of clusters as well as clustering, is capable of identifying the locations of reflectors by classifying signals when such 5G signals are reflected and received from various objects. We generate birth points using the measurements from 5G mmWave signals received by the vehicle and classify objects by clustering birth points generated over time. Each time we use the DP clustering method, we can map landmarks in the environment in challenging situations where false alarms exist in the measurements and change the cardinality of received signals. Simulation results demonstrate the performance of the proposed scheme. By comparing the results with the SLAM based on the Rao-Blackwellized probability hypothesis density filter, we confirm a slight drop in SLAM performance, but as a result, we validate that it has a significant gain in computational complexity

A flat Dirichlet process switching model for Bayesian estimation of hybrid systems

AbstractHybrid systems are often used to describe many complex dynamic phenomena by combining multiple modes of dynamics into whole systems. In this paper, we present a flat Dirichlet process switching (FDPS) model that defines a prior on mode switching dynamics of hybrid systems. Compared with the classical Markovian jump system (MJS) models, the FDPS model is nonparametric and can be applied to the hybrid systems with an unbounded number of potential modes. On the other hand, the probability structure of the new model is simpler and more flexible than the recently proposed hierarchical Dirichlet process (HDP) based MJS. Furthermore, we develop a Markov chain Monte Carlo (MCMC) method for estimating the states of hybrid systems with FDPS prior. And the numerical simulations of a hybrid system in different conditions are employed to show the effectiveness of the proposed approach

Bayesian Nonparametric Inference of Switching Linear Dynamical Systems

Many complex dynamical phenomena can be effectively modeled by a system that switches among a set of conditionally linear dynamical modes. We consider two such models: the switching linear dynamical system (SLDS) and the switching vector autoregressive (VAR) process. Our Bayesian nonparametric approach utilizes a hierarchical Dirichlet process prior to learn an unknown number of persistent, smooth dynamical modes. We additionally employ automatic relevance determination to infer a sparse set of dynamic dependencies allowing us to learn SLDS with varying state dimension or switching VAR processes with varying autoregressive order. We develop a sampling algorithm that combines a truncated approximation to the Dirichlet process with efficient joint sampling of the mode and state sequences. The utility and flexibility of our model are demonstrated on synthetic data, sequences of dancing honey bees, the IBOVESPA stock index, and a maneuvering target tracking application.Comment: 50 pages, 7 figure

Nonparametric Bayesian behavior modeling

Thesis (S.M.)--Massachusetts Institute of Technology, Dept. of Aeronautics and Astronautics, 2008.Includes bibliographical references (p. 91-94).As autonomous robots are increasingly used in complex, dynamic environments, it is crucial that the dynamic elements are modeled accurately. However, it is often difficult to generate good models due to either a lack of domain understanding or the domain being intractably large. In many domains, even defining the size of the model can be a challenge. While methods exist to cluster data of dynamic agents into common motion patterns, or "behaviors," assumptions of the number of expected behaviors must be made. This assumption can cause clustering processes to under-fit or over-fit the training data. In a poorly understood domain, knowing the number of expected behaviors a priori is unrealistic and in an extremely large domain, correctly fitting the training data is difficult. To overcome these obstacles, this thesis takes a Bayesian approach and applies a Dirichlet process (DP) prior over behaviors, which uses experience to reduce the likelihood of over-fitting or under-fitting the model complexity. Additionally, the DP maintains a probability mass associated with a novel behavior and can address countably infinite behaviors. This learning technique is applied to modeling agents driving in an urban setting. The learned DP-based driver behavior model is first demonstrated on a simulated city. Building on successful simulation results, the methodology is applied to GPS data of taxis driving around Boston. Accurate prediction of future vehicle behavior from the model is shown in both domains.by Joshua Mason Joseph.S.M

Unraveling the Thousand Word Picture: An Introduction to Super-Resolution Data Analysis

Super-resolution microscopy provides direct insight into fundamental biological processes occurring at length scales smaller than light’s diffraction limit. The analysis of data at such scales has brought statistical and machine learning methods into the mainstream. Here we provide a survey of data analysis methods starting from an overview of basic statistical techniques underlying the analysis of super-resolution and, more broadly, imaging data. We subsequently break down the analysis of super-resolution data into four problems: the localization problem, the counting problem, the linking problem, and what we’ve termed the interpretation problem

Bayesian Nonparametric Modeling and Inference for Multiple Object Tracking

abstract: The problem of multiple object tracking seeks to jointly estimate the time-varying cardinality and trajectory of each object. There are numerous challenges that are encountered in tracking multiple objects including a time-varying number of measurements, under varying constraints, and environmental conditions. In this thesis, the proposed statistical methods integrate the use of physical-based models with Bayesian nonparametric methods to address the main challenges in a tracking problem. In particular, Bayesian nonparametric methods are exploited to efficiently and robustly infer object identity and learn time-dependent cardinality; together with Bayesian inference methods, they are also used to associate measurements to objects and estimate the trajectory of objects. These methods differ from the current methods to the core as the existing methods are mainly based on random finite set theory. The first contribution proposes dependent nonparametric models such as the dependent Dirichlet process and the dependent Pitman-Yor process to capture the inherent time-dependency in the problem at hand. These processes are used as priors for object state distributions to learn dependent information between previous and current time steps. Markov chain Monte Carlo sampling methods exploit the learned information to sample from posterior distributions and update the estimated object parameters. The second contribution proposes a novel, robust, and fast nonparametric approach based on a diffusion process over infinite random trees to infer information on object cardinality and trajectory. This method follows the hierarchy induced by objects entering and leaving a scene and the time-dependency between unknown object parameters. Markov chain Monte Carlo sampling methods integrate the prior distributions over the infinite random trees with time-dependent diffusion processes to update object states. The third contribution develops the use of hierarchical models to form a prior for statistically dependent measurements in a single object tracking setup. Dependency among the sensor measurements provides extra information which is incorporated to achieve the optimal tracking performance. The hierarchical Dirichlet process as a prior provides the required flexibility to do inference. Bayesian tracker is integrated with the hierarchical Dirichlet process prior to accurately estimate the object trajectory. The fourth contribution proposes an approach to model both the multiple dependent objects and multiple dependent measurements. This approach integrates the dependent Dirichlet process modeling over the dependent object with the hierarchical Dirichlet process modeling of the measurements to fully capture the dependency among both object and measurements. Bayesian nonparametric models can successfully associate each measurement to the corresponding object and exploit dependency among them to more accurately infer the trajectory of objects. Markov chain Monte Carlo methods amalgamate the dependent Dirichlet process with the hierarchical Dirichlet process to infer the object identity and object cardinality. Simulations are exploited to demonstrate the improvement in multiple object tracking performance when compared to approaches that are developed based on random finite set theory.Dissertation/ThesisDoctoral Dissertation Electrical Engineering 201

Sequential Monte Carlo Samplers For Nonparametric Bayesian Mixture Models

Tez (Doktora) -- İstanbul Teknik Üniversitesi, Fen Bilimleri Enstitüsü, 2012Thesis (PhD) -- İstanbul Technical University, Institute of Science and Technology, 2012Bu çalışmanın temel amacı, parametrik olmayan Bayesçi model seçim teknikleri içinde önemli bir yere sahip olan Dirichlet süreci karışım modelleri (DPM) için etkin ardışık Monte Carlo (SMC) örnekleyiciler tasarlamaktır. Tasarlanan algoritmalar, önerilen sınıf güncelleme metotları sayesinde, yeni gelen gözlemlerin ışığında parçacık gezingelerinde değişiklik yaparak gerçek DPM sonsal dağılımına daha iyi bir yaklaşıklık sağlamaktadır. Önerilen metot, DPM sonsal dağılımının çözümünde kullanılan diğer ardışık Monte Carlo örnekleyicileri genelleme özelliğe sahiptir. Tek ve çok boyutlu olasılık dağılımı kestirim problemlerinde yapılan değerlendirmelerde, özellikle sonsal dağılımın izole modlara sahip olduğu koşullarda, önerilen metodun klasik metotlara göre çok daha yüksek doğrulukta sonuca yakınsayabildiği görülmüştür. Ayrıca, manevralı hedeflerin takibinde ortaya atılan en yenilikçi modellerden biri olan değişken oranlı parçacık süzgeçleri (VRPF) tezde ele alınmış ve çoklu model yaklaşımları değişken oranlı modeller ile birleştirilerek, takip başarımını arttıran çoklu model değişken oranlı parçacık süzgeçleri (MM-VRPF) önerilmiştir. Çoklu model yaklaşımının manevralı hedef gezingelerini daha iyi modellediği benzetim sonuçları ile gösterilmiştir.In this thesis, we developed a novel online algorithm for posterior inference in Dirichlet Process Mixture (DPM) models that is based on the sequential Monte Carlo (SMC) samplers framework. The proposed method enables us to design new clustering update schemes, such as updating past trajectories of the particles in light of recent observations, and still ensures convergence to the true DPM posterior distribution asymptotically. Our method generalizes many sequential importance sampling based approaches and provides a computationally efficient improvement to particle filtering that is less prone to getting trapped in isolated modes. Performance has been evaluated in univariate and multivariate infinite Gaussian mixture density estimation problems. It is shown that the proposed algorithm outperforms conventional Monte Carlo approaches in terms of estimation variance and average log-marginal. Moreover, in this thesis we dealt with the maneuvering target tracking problem. We incorporated multiple model approach with the recently introduced variable rate particle filters (VRPF) in order to improve the tracking performance. The proposed variable rate model structure, referred as Multiple Model Variable Rate Particle Filter (MM-VRPF) results in a much more accurate tracking.DoktoraPh

Nonparametric Bayesian methods in robotic vision

In this dissertation non-parametric Bayesian methods are used in the application of robotic vision. Robots make use of depth sensors that represent their environment using point clouds. Non-parametric Bayesian methods can (1) determine how good an object is recognized, and (2) determine how many objects a particular scene contains. When there is a model available for the object to be recognized and the nature of perceptual error is known, a Bayesian method will act optimally.In this dissertation Bayesian models are developed to represent geometric objects such as lines and line segments (consisting out of points). The infinite line model and the infinite line segment model use a non-parametric Bayesian model, to be precise, a Dirichlet process, to represent the number of objects. The line or the line segment is represented by a probability distribution. The lines can be represented by conjugate distributions and then Gibbs sampling can be used. The line segments are not represented by conjugate distributions and therefore a split-merge sampler is used.A split-merge sampler fits line segments by assigning points to a hypothetical line segment. Then it proposes splits of a single line segment or merges of two line segments. A new sampler, the triadic split-merge sampler, introduces steps that involve three line segments. In this dissertation, the new sampler is compared to a conventional split-merge sampler. The triadic sampler can be applied to other problems as well, i.e., not only problems in robotic perception.The models for objects can also be learned. In the dissertation this is done for more complex objects, such as cubes, built up out of hundreds of points. An auto-encoder then learns to generate a representative object given the data. The auto-encoder uses a newly defined reconstruction distance, called the partitioning earth mover’s distance. The object that is learned by the auto-encoder is used in a triadic sampler to (1) identify the point cloud objects and to (2) establish multiple occurrences of those objects in the point cloud.Algorithms and the Foundations of Software technolog