207 research outputs found
A Rotating-Grid Upwind Fast Sweeping Scheme for a Class of Hamilton-Jacobi Equations
We present a fast sweeping method for a class of Hamilton-Jacobi equations
that arise from time-independent problems in optimal control theory. The basic
method in two dimensions uses a four point stencil and is extremely simple to
implement. We test our basic method against Eikonal equations in different
norms, and then suggest a general method for rotating the grid and using
additional approximations to the derivatives in different directions in order
to more accurately capture characteristic flow. We display the utility of our
method by applying it to relevant problems from engineering
Finite-Element Discretization of Static Hamilton-Jacobi Equations Based on a Local Variational Principle
We propose a linear finite-element discretization of Dirichlet problems for
static Hamilton-Jacobi equations on unstructured triangulations. The
discretization is based on simplified localized Dirichlet problems that are
solved by a local variational principle. It generalizes several approaches
known in the literature and allows for a simple and transparent convergence
theory. In this paper the resulting system of nonlinear equations is solved by
an adaptive Gauss-Seidel iteration that is easily implemented and quite
effective as a couple of numerical experiments show.Comment: 19 page
Can local single-pass methods solve any stationary Hamilton-Jacobi-Bellman equation?
The use of local single-pass methods (like, e.g., the Fast Marching method)
has become popular in the solution of some Hamilton-Jacobi equations. The
prototype of these equations is the eikonal equation, for which the methods can
be applied saving CPU time and possibly memory allocation. Then, some natural
questions arise: can local single-pass methods solve any Hamilton-Jacobi
equation? If not, where the limit should be set? This paper tries to answer
these questions. In order to give a complete picture, we present an overview of
some fast methods available in literature and we briefly analyze their main
features. We also introduce some numerical tools and provide several numerical
tests which are intended to exhibit the limitations of the methods. We show
that the construction of a local single-pass method for general Hamilton-Jacobi
equations is very hard, if not impossible. Nevertheless, some special classes
of problems can be actually solved, making local single-pass methods very
useful from the practical point of view.Comment: 19 page
Piecewise Constant Policy Approximations to Hamilton-Jacobi-Bellman Equations
An advantageous feature of piecewise constant policy timestepping for
Hamilton-Jacobi-Bellman (HJB) equations is that different linear approximation
schemes, and indeed different meshes, can be used for the resulting linear
equations for different control parameters. Standard convergence analysis
suggests that monotone (i.e., linear) interpolation must be used to transfer
data between meshes. Using the equivalence to a switching system and an
adaptation of the usual arguments based on consistency, stability and
monotonicity, we show that if limited, potentially higher order interpolation
is used for the mesh transfer, convergence is guaranteed. We provide numerical
tests for the mean-variance optimal investment problem and the uncertain
volatility option pricing model, and compare the results to published test
cases
A Model for Optimal Human Navigation with Stochastic Effects
We present a method for optimal path planning of human walking paths in
mountainous terrain, using a control theoretic formulation and a
Hamilton-Jacobi-Bellman equation. Previous models for human navigation were
entirely deterministic, assuming perfect knowledge of the ambient elevation
data and human walking velocity as a function of local slope of the terrain.
Our model includes a stochastic component which can account for uncertainty in
the problem, and thus includes a Hamilton-Jacobi-Bellman equation with
viscosity. We discuss the model in the presence and absence of stochastic
effects, and suggest numerical methods for simulating the model. We discuss two
different notions of an optimal path when there is uncertainty in the problem.
Finally, we compare the optimal paths suggested by the model at different
levels of uncertainty, and observe that as the size of the uncertainty tends to
zero (and thus the viscosity in the equation tends to zero), the optimal path
tends toward the deterministic optimal path
An Efficient Policy Iteration Algorithm for Dynamic Programming Equations
We present an accelerated algorithm for the solution of static
Hamilton-Jacobi-Bellman equations related to optimal control problems. Our
scheme is based on a classic policy iteration procedure, which is known to have
superlinear convergence in many relevant cases provided the initial guess is
sufficiently close to the solution. In many cases, this limitation degenerates
into a behavior similar to a value iteration method, with an increased
computation time. The new scheme circumvents this problem by combining the
advantages of both algorithms with an efficient coupling. The method starts
with a value iteration phase and then switches to a policy iteration procedure
when a certain error threshold is reached. A delicate point is to determine
this threshold in order to avoid cumbersome computation with the value
iteration and, at the same time, to be reasonably sure that the policy
iteration method will finally converge to the optimal solution. We analyze the
methods and efficient coupling in a number of examples in dimension two, three
and four illustrating its properties
An efficient method for multiobjective optimal control and optimal control subject to integral constraints
We introduce a new and efficient numerical method for multicriterion optimal
control and single criterion optimal control under integral constraints. The
approach is based on extending the state space to include information on a
"budget" remaining to satisfy each constraint; the augmented
Hamilton-Jacobi-Bellman PDE is then solved numerically. The efficiency of our
approach hinges on the causality in that PDE, i.e., the monotonicity of
characteristic curves in one of the newly added dimensions. A semi-Lagrangian
"marching" method is used to approximate the discontinuous viscosity solution
efficiently. We compare this to a recently introduced "weighted sum" based
algorithm for the same problem. We illustrate our method using examples from
flight path planning and robotic navigation in the presence of friendly and
adversarial observers.Comment: The final version accepted by J. Comp. Math. : 41 pages, 14 figures.
Since the previous version: typos fixed, formatting improved, one mistake in
bibliography correcte
- …