Neural Lyapunov Control

We propose new methods for learning control policies and neural network Lyapunov functions for nonlinear control problems, with provable guarantee of stability. The framework consists of a learner that attempts to find the control and Lyapunov functions, and a falsifier that finds counterexamples to quickly guide the learner towards solutions. The procedure terminates when no counterexample is found by the falsifier, in which case the controlled nonlinear system is provably stable. The approach significantly simplifies the process of Lyapunov control design, provides end-to-end correctness guarantee, and can obtain much larger regions of attraction than existing methods such as LQR and SOS/SDP. We show experiments on how the new methods obtain high-quality solutions for challenging control problems.Comment: NeurIPS 201

Adapting Predictive Feedback Chaos Control for Optimal Convergence Speed

Stabilizing unstable periodic orbits in a chaotic invariant set not only reveals information about its structure but also leads to various interesting applications. For the successful application of a chaos control scheme, convergence speed is of crucial importance. Here we present a predictive feedback chaos control method that adapts a control parameter online to yield optimal asymptotic convergence speed. We study the adaptive control map both analytically and numerically and prove that it converges at least linearly to a value determined by the spectral radius of the control map at the periodic orbit to be stabilized. The method is easy to implement algorithmically and may find applications for adaptive online control of biological and engineering systems.Comment: 21 pages, 6 figure

How Gibbs distributions may naturally arise from synaptic adaptation mechanisms. A model-based argumentation

This paper addresses two questions in the context of neuronal networks dynamics, using methods from dynamical systems theory and statistical physics: (i) How to characterize the statistical properties of sequences of action potentials ("spike trains") produced by neuronal networks ? and; (ii) what are the effects of synaptic plasticity on these statistics ? We introduce a framework in which spike trains are associated to a coding of membrane potential trajectories, and actually, constitute a symbolic coding in important explicit examples (the so-called gIF models). On this basis, we use the thermodynamic formalism from ergodic theory to show how Gibbs distributions are natural probability measures to describe the statistics of spike trains, given the empirical averages of prescribed quantities. As a second result, we show that Gibbs distributions naturally arise when considering "slow" synaptic plasticity rules where the characteristic time for synapse adaptation is quite longer than the characteristic time for neurons dynamics.Comment: 39 pages, 3 figure

The Stability and Control of Stochastically Switching Dynamical Systems

Inherent randomness and unpredictability is an underlying property in most realistic phenomena. In this work, we present a new framework for introducing stochasticity into dynamical systems via intermittently switching between deterministic regimes. Extending the work by Belykh, Belykh, and Hasler, we provide analytical insight into how randomly switching network topologies behave with respect to their averaged, static counterparts (obtained by replacing the stochastic variables with their expectation) when switching is fast. Beyond fast switching, we uncover a highly nontrivial phenomenon by which a network can switch between two asynchronous regimes and synchronize against all odds. Then, we establish rigorous theory for this framework in discrete-time systems for arbitrary switching periods (not limited to switching at each time step). Using stability and ergodic theories, we are able to provide analytical criteria for the stability of synchronization for two coupled maps and the ability of a single map to control an arbitrary network of maps. This work not only presents new phenomena in stochastically switching dynamical systems, but also provides the first rigorous analysis of switching dynamical systems with an arbitrary switching period