Synchronization and Noise: A Mechanism for Regularization in Neural Systems

To learn and reason in the presence of uncertainty, the brain must be capable of imposing some form of regularization. Here we suggest, through theoretical and computational arguments, that the combination of noise with synchronization provides a plausible mechanism for regularization in the nervous system. The functional role of regularization is considered in a general context in which coupled computational systems receive inputs corrupted by correlated noise. Noise on the inputs is shown to impose regularization, and when synchronization upstream induces time-varying correlations across noise variables, the degree of regularization can be calibrated over time. The proposed mechanism is explored first in the context of a simple associative learning problem, and then in the context of a hierarchical sensory coding task. The resulting qualitative behavior coincides with experimental data from visual cortex.Comment: 32 pages, 7 figures. under revie

Robust filtering for bilinear uncertain stochastic discrete-time systems

Copyright [2002] IEEE. This material is posted here with permission of the IEEE. Such permission of the IEEE does not in any way imply IEEE endorsement of any of Brunel University's products or services. Internal or personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution must be obtained from the IEEE by writing to [email protected]. By choosing to view this document, you agree to all provisions of the copyright laws protecting it.This paper deals with the robust filtering problem for uncertain bilinear stochastic discrete-time systems with estimation error variance constraints. The uncertainties are allowed to be norm-bounded and enter into both the state and measurement matrices. We focus on the design of linear filters, such that for all admissible parameter uncertainties, the error state of the bilinear stochastic system is mean square bounded, and the steady-state variance of the estimation error of each state is not more than the individual prespecified value. It is shown that the design of the robust filters can be carried out by solving some algebraic quadratic matrix inequalities. In particular, we establish both the existence conditions and the explicit expression of desired robust filters. A numerical example is included to show the applicability of the present method

Rare Events and Scale--Invariant Dynamics of Perturbations in Delayed Dynamical Systems

We study the dynamics of perturbations in time delayed dynamical systems. Using a suitable space-time coordinate transformation, we find that the time evolution of the linearized perturbations (Lyapunov vector) can be mapped to the linear Zhang surface growth model [Y.-C. Zhang, J. Phys. France {\bf 51}, 2129 (1990)], which is known to describe surface roughening driven by power-law distributed noise. As a consequence, Lyapunov vector dynamics is dominated by rare random events that lead to non-Gaussian fluctuations and multiscaling properties.Comment: Final version to appear in Phys. Rev. Lett., 4 pages, 3 eps fig

Exponential stability for infinite-dimensional non-autonomous port-Hamiltonian Systems

We study the non-autonomous version of an infinite-dimensional port-Hamiltonian system on an interval $[a, b]$. Employing abstract results on evolution families, we show $C^1$-well-posedness of the corresponding Cauchy problem, and thereby existence and uniqueness of classical solutions for sufficiently regular initial data. Further, we demonstrate that a dissipation condition in the style of the dissipation condition sufficient for uniform exponential stability in the autonomous case also leads to a uniform exponential decay of the energy in this non-autonomous setting

Learning Joint Nonlinear Effects from Single-variable Interventions in the Presence of Hidden Confounders

We propose an approach to estimate the effect of multiple simultaneous interventions in the presence of hidden confounders. To overcome the problem of hidden confounding, we consider the setting where we have access to not only the observational data but also sets of single-variable interventions in which each of the treatment variables is intervened on separately. We prove identifiability under the assumption that the data is generated from a nonlinear continuous structural causal model with additive Gaussian noise. In addition, we propose a simple parameter estimation method by pooling all the data from different regimes and jointly maximizing the combined likelihood. We also conduct comprehensive experiments to verify the identifiability result as well as to compare the performance of our approach against a baseline on both synthetic and real-world data.Comment: Accepted to The Conference on Uncertainty in Artificial Intelligence (UAI) 202

Computational burden reduction in Min-Max MPC

Min–max model predictive control (MMMPC) is one of the strategies used to control plants subject to bounded uncertainties. The implementation of MMMPC suffers a large computational burden due to the complex numerical optimization problem that has to be solved at every sampling time. This paper shows how to overcome this by transforming the original problem into a reduced min–max problem whose solution is much simpler. In this way, the range of processes to which MMMPC can be applied is considerably broadened. Proofs based on the properties of the cost function and simulation examples are given in the paper

An LFT/SDP approach to the uncertainty analysis for state

A state estimator is an algorithm that computes the current state of a time-varying system from on-line measurements. Physical quantities such as measurements and parameters are characterised by uncertainty. Understanding how uncertainty affects the accuracy of state estimates is therefore a pre-requisite to the application of such techniques to real systems. In this paper we develop a method of uncertainty analysis based on linear fractional transformations (LFT) and obtain ellipsoid-of-confidence bounds by recasting the LFT problem into a semidefinite programming problem (SDP). The ideas are illustrated by applying them to a simple water distribution network

A non-homogeneous dynamic Bayesian network with sequentially coupled interaction parameters for applications in systems and synthetic biology

An important and challenging problem in systems biology is the inference of gene regulatory networks from short non-stationary time series of transcriptional profiles. A popular approach that has been widely applied to this end is based on dynamic Bayesian networks (DBNs), although traditional homogeneous DBNs fail to model the non-stationarity and time-varying nature of the gene regulatory processes. Various authors have therefore recently proposed combining DBNs with multiple changepoint processes to obtain time varying dynamic Bayesian networks (TV-DBNs). However, TV-DBNs are not without problems. Gene expression time series are typically short, which leaves the model over-flexible, leading to over-fitting or inflated inference uncertainty. In the present paper, we introduce a Bayesian regularization scheme that addresses this difficulty. Our approach is based on the rationale that changes in gene regulatory processes appear gradually during an organism's life cycle or in response to a changing environment, and we have integrated this notion in the prior distribution of the TV-DBN parameters. We have extensively tested our regularized TV-DBN model on synthetic data, in which we have simulated short non-homogeneous time series produced from a system subject to gradual change. We have then applied our method to real-world gene expression time series, measured during the life cycle of Drosophila melanogaster, under artificially generated constant light condition in Arabidopsis thaliana, and from a synthetically designed strain of Saccharomyces cerevisiae exposed to a changing environment

Design and assessment of a multiple sensor fault tolerant robust control system

This paper presents an enhanced robust control design structure to realise fault tolerance towards sensor faults suitable for multi-input-multi-output (MIMO) systems implementation. The proposed design permits fault detection and controller elements to be designed with considerations to stability and robustness towards uncertainties besides multiple faults environment on a common mathematical platform. This framework can also cater to systems requiring fast responses. A design example is illustrated with a fast, multivariable and unstable system, that is, the double inverted pendulum system. Results indicate the potential of this design framework to handle fast systems with multiple sensor faults