81,285 research outputs found
Convex operator-theoretic methods in stochastic control
This paper is about operator-theoretic methods for solving nonlinear
stochastic optimal control problems to global optimality. These methods
leverage on the convex duality between optimally controlled diffusion processes
and Hamilton-Jacobi-Bellman (HJB) equations for nonlinear systems in an ergodic
Hilbert-Sobolev space. In detail, a generalized Bakry-Emery condition is
introduced under which one can establish the global exponential stabilizability
of a large class of nonlinear systems. It is shown that this condition is
sufficient to ensure the existence of solutions of the ergodic HJB for
stochastic optimal control problems on infinite time horizons. Moreover, a
novel dynamic programming recursion for bounded linear operators is introduced,
which can be used to numerically solve HJB equations by a Galerkin projection
Dynamic Programming for General Linear Quadratic Optimal Stochastic Control with Random Coefficients
We are concerned with the linear-quadratic optimal stochastic control problem
with random coefficients. Under suitable conditions, we prove that the value
field , is
quadratic in , and has the following form:
where is an essentially bounded nonnegative symmetric matrix-valued adapted
processes. Using the dynamic programming principle (DPP), we prove that is
a continuous semi-martingale of the form with being a
continuous process of bounded variation and and that with
is a solution to the associated backward stochastic
Riccati equation (BSRE), whose generator is highly nonlinear in the unknown
pair of processes. The uniqueness is also proved via a localized completion of
squares in a self-contained manner for a general BSRE. The existence and
uniqueness of adapted solution to a general BSRE was initially proposed by the
French mathematician J. M. Bismut (1976, 1978). It had been solved by the
author (2003) via the stochastic maximum principle with a viewpoint of
stochastic flow for the associated stochastic Hamiltonian system. The present
paper is its companion, and gives the {\it second but more comprehensive}
adapted solution to a general BSRE via the DDP. Further extensions to the
jump-diffusion control system and to the general nonlinear control system are
possible.Comment: 16 page
Controlled diffusion processes
This article gives an overview of the developments in controlled diffusion
processes, emphasizing key results regarding existence of optimal controls and
their characterization via dynamic programming for a variety of cost criteria
and structural assumptions. Stochastic maximum principle and control under
partial observations (equivalently, control of nonlinear filters) are also
discussed. Several other related topics are briefly sketched.Comment: Published at http://dx.doi.org/10.1214/154957805100000131 in the
Probability Surveys (http://www.i-journals.org/ps/) by the Institute of
Mathematical Statistics (http://www.imstat.org
- …