67 research outputs found

    Singularly perturbed forward-backward stochastic differential equations: application to the optimal control of bilinear systems

    Get PDF
    We study linear-quadratic stochastic optimal control problems with bilinear state dependence for which the underlying stochastic differential equation (SDE) consists of slow and fast degrees of freedom. We show that, in the same way in which the underlying dynamics can be well approximated by a reduced order effective dynamics in the time scale limit (using classical homogenziation results), the associated optimal expected cost converges in the time scale limit to an effective optimal cost. This entails that we can well approximate the stochastic optimal control for the whole system by the reduced order stochastic optimal control, which is clearly easier to solve because of lower dimensionality. The approach uses an equivalent formulation of the Hamilton-Jacobi-Bellman (HJB) equation, in terms of forward-backward SDEs (FBSDEs). We exploit the efficient solvability of FBSDEs via a least squares Monte Carlo algorithm and show its applicability by a suitable numerical example

    Model reduction of controlled Fokker--Planck and Liouville-von Neumann equations

    Full text link
    Model reduction methods for bilinear control systems are compared by means of practical examples of Liouville-von Neumann and Fokker--Planck type. Methods based on balancing generalized system Gramians and on minimizing an H2-type cost functional are considered. The focus is on the numerical implementation and a thorough comparison of the methods. Structure and stability preservation are investigated, and the competitiveness of the approaches is shown for practically relevant, large-scale examples

    Multiscale Computations on Neural Networks: From the Individual Neuron Interactions to the Macroscopic-Level Analysis

    Full text link
    We show how the Equation-Free approach for multi-scale computations can be exploited to systematically study the dynamics of neural interactions on a random regular connected graph under a pairwise representation perspective. Using an individual-based microscopic simulator as a black box coarse-grained timestepper and with the aid of simulated annealing we compute the coarse-grained equilibrium bifurcation diagram and analyze the stability of the stationary states sidestepping the necessity of obtaining explicit closures at the macroscopic level. We also exploit the scheme to perform a rare-events analysis by estimating an effective Fokker-Planck describing the evolving probability density function of the corresponding coarse-grained observables

    Strong convergence of neutral stochastic functional differential equations with two time-scales

    Get PDF

    Hunting French Ducks in a Noisy Environment

    Get PDF
    We consider the effect of Gaussian white noise on fast-slow dynamical systems with one fast and two slow variables, containing a folded-node singularity. In the absence of noise, these systems are known to display mixed-mode oscillations, consisting of alternating large- and small-amplitude oscillations. We quantify the effect of noise and obtain critical noise intensities above which the small-amplitude oscillations become hidden by fluctuations. Furthermore we prove that the noise can cause sample paths to jump away from so-called canard solutions with high probability before deterministic orbits do. This early-jump mechanism can drastically influence the local and global dynamics of the system by changing the mixed-mode patterns.Comment: 60 pages, 9 figure
    corecore