Multi-Modal Mean-Fields via Cardinality-Based Clamping

Mean Field inference is central to statistical physics. It has attracted much interest in the Computer Vision community to efficiently solve problems expressible in terms of large Conditional Random Fields. However, since it models the posterior probability distribution as a product of marginal probabilities, it may fail to properly account for important dependencies between variables. We therefore replace the fully factorized distribution of Mean Field by a weighted mixture of such distributions, that similarly minimizes the KL-Divergence to the true posterior. By introducing two new ideas, namely, conditioning on groups of variables instead of single ones and using a parameter of the conditional random field potentials, that we identify to the temperature in the sense of statistical physics to select such groups, we can perform this minimization efficiently. Our extension of the clamping method proposed in previous works allows us to both produce a more descriptive approximation of the true posterior and, inspired by the diverse MAP paradigms, fit a mixture of Mean Field approximations. We demonstrate that this positively impacts real-world algorithms that initially relied on mean fields.Comment: Submitted for review to CVPR 201

Certainty Closure: Reliable Constraint Reasoning with Incomplete or Erroneous Data

Constraint Programming (CP) has proved an effective paradigm to model and solve difficult combinatorial satisfaction and optimisation problems from disparate domains. Many such problems arising from the commercial world are permeated by data uncertainty. Existing CP approaches that accommodate uncertainty are less suited to uncertainty arising due to incomplete and erroneous data, because they do not build reliable models and solutions guaranteed to address the user's genuine problem as she perceives it. Other fields such as reliable computation offer combinations of models and associated methods to handle these types of uncertain data, but lack an expressive framework characterising the resolution methodology independently of the model. We present a unifying framework that extends the CP formalism in both model and solutions, to tackle ill-defined combinatorial problems with incomplete or erroneous data. The certainty closure framework brings together modelling and solving methodologies from different fields into the CP paradigm to provide reliable and efficient approches for uncertain constraint problems. We demonstrate the applicability of the framework on a case study in network diagnosis. We define resolution forms that give generic templates, and their associated operational semantics, to derive practical solution methods for reliable solutions.Comment: Revised versio

Fast non-negative deconvolution for spike train inference from population calcium imaging

Calcium imaging for observing spiking activity from large populations of neurons are quickly gaining popularity. While the raw data are fluorescence movies, the underlying spike trains are of interest. This work presents a fast non-negative deconvolution filter to infer the approximately most likely spike train for each neuron, given the fluorescence observations. This algorithm outperforms optimal linear deconvolution (Wiener filtering) on both simulated and biological data. The performance gains come from restricting the inferred spike trains to be positive (using an interior-point method), unlike the Wiener filter. The algorithm is fast enough that even when imaging over 100 neurons, inference can be performed on the set of all observed traces faster than real-time. Performing optimal spatial filtering on the images further refines the estimates. Importantly, all the parameters required to perform the inference can be estimated using only the fluorescence data, obviating the need to perform joint electrophysiological and imaging calibration experiments.Comment: 22 pages, 10 figure

Systematic Stochastic Reduction of Inertial Fluid-Structure Interactions subject to Thermal Fluctuations

We present analysis for the reduction of an inertial description of fluid-structure interactions subject to thermal fluctuations. We show how the viscous coupling between the immersed structures and the fluid can be simplified in the regime where this coupling becomes increasingly strong. Many descriptions in fluid mechanics and in the formulation of computational methods account for fluid-structure interactions through viscous drag terms to transfer momentum from the fluid to immersed structures. In the inertial regime, this coupling often introduces a prohibitively small time-scale into the temporal dynamics of the fluid-structure system. This is further exacerbated in the presence of thermal fluctuations. We discuss here a systematic reduction technique for the full inertial equations to obtain a simplified description where this coupling term is eliminated. This approach also accounts for the effective stochastic equations for the fluid-structure dynamics. The analysis is based on use of the Infinitesmal Generator of the SPDEs and a singular perturbation analysis of the Backward Kolomogorov PDEs. We also discuss the physical motivations and interpretation of the obtained reduced description of the fluid-structure system. Working paper currently under revision. Please report any comments or issues to [email protected]: 19 pages, 1 figure. arXiv admin note: substantial text overlap with arXiv:1009.564