386 research outputs found
A Penalty Method for the Numerical Solution of Hamilton-Jacobi-Bellman (HJB) Equations in Finance
We present a simple and easy to implement method for the numerical solution
of a rather general class of Hamilton-Jacobi-Bellman (HJB) equations. In many
cases, the considered problems have only a viscosity solution, to which,
fortunately, many intuitive (e.g. finite difference based) discretisations can
be shown to converge. However, especially when using fully implicit time
stepping schemes with their desirable stability properties, one is still faced
with the considerable task of solving the resulting nonlinear discrete system.
In this paper, we introduce a penalty method which approximates the nonlinear
discrete system to first order in the penalty parameter, and we show that an
iterative scheme can be used to solve the penalised discrete problem in
finitely many steps. We include a number of examples from mathematical finance
for which the described approach yields a rigorous numerical scheme and present
numerical results.Comment: 18 Pages, 4 Figures. This updated version has a slightly more
detailed introduction. In the current form, the paper will appear in SIAM
Journal on Numerical Analysi
Nonlinear Parabolic Equations arising in Mathematical Finance
This survey paper is focused on qualitative and numerical analyses of fully
nonlinear partial differential equations of parabolic type arising in financial
mathematics. The main purpose is to review various non-linear extensions of the
classical Black-Scholes theory for pricing financial instruments, as well as
models of stochastic dynamic portfolio optimization leading to the
Hamilton-Jacobi-Bellman (HJB) equation. After suitable transformations, both
problems can be represented by solutions to nonlinear parabolic equations.
Qualitative analysis will be focused on issues concerning the existence and
uniqueness of solutions. In the numerical part we discuss a stable
finite-volume and finite difference schemes for solving fully nonlinear
parabolic equations.Comment: arXiv admin note: substantial text overlap with arXiv:1603.0387
Transformation Method for Solving Hamilton-Jacobi-Bellman Equation for Constrained Dynamic Stochastic Optimal Allocation Problem
In this paper we propose and analyze a method based on the Riccati
transformation for solving the evolutionary Hamilton-Jacobi-Bellman equation
arising from the stochastic dynamic optimal allocation problem. We show how the
fully nonlinear Hamilton-Jacobi-Bellman equation can be transformed into a
quasi-linear parabolic equation whose diffusion function is obtained as the
value function of certain parametric convex optimization problem. Although the
diffusion function need not be sufficiently smooth, we are able to prove
existence, uniqueness and derive useful bounds of classical H\"older smooth
solutions. We furthermore construct a fully implicit iterative numerical scheme
based on finite volume approximation of the governing equation. A numerical
solution is compared to a semi-explicit traveling wave solution by means of the
convergence ratio of the method. We compute optimal strategies for a portfolio
investment problem motivated by the German DAX 30 Index as an example of
application of the method
A Probabilistic Numerical Method for Fully Nonlinear Parabolic PDEs
We consider the probabilistic numerical scheme for fully nonlinear PDEs
suggested in \cite{cstv}, and show that it can be introduced naturally as a
combination of Monte Carlo and finite differences scheme without appealing to
the theory of backward stochastic differential equations. Our first main result
provides the convergence of the discrete-time approximation and derives a bound
on the discretization error in terms of the time step. An explicit
implementable scheme requires to approximate the conditional expectation
operators involved in the discretization. This induces a further Monte Carlo
error. Our second main result is to prove the convergence of the latter
approximation scheme, and to derive an upper bound on the approximation error.
Numerical experiments are performed for the approximation of the solution of
the mean curvature flow equation in dimensions two and three, and for two and
five-dimensional (plus time) fully-nonlinear Hamilton-Jacobi-Bellman equations
arising in the theory of portfolio optimization in financial mathematics
Some numerical methods for solving stochastic impulse control in natural gas storage facilities
The valuation of gas storage facilities is characterized as a stochastic impulse control problem with finite horizon resulting in Hamilton-Jacobi-Bellman (HJB) equations for the value function. In this context the two catagories of solving schemes for optimal switching are discussed in a stochastic control framework. We reviewed some numerical methods which include approaches related to partial differential equations (PDEs), Markov chain approximation, nonparametric regression, quantization method and some practitioners’ methods. This paper considers optimal switching problem arising in valuation of gas storage contracts for leasing the storage facilities, and investigates the recent developments as well as their advantages and disadvantages of each scheme based on dynamic programming principle (DPP
Optimal Real-Time Bidding Strategies
The ad-trading desks of media-buying agencies are increasingly relying on
complex algorithms for purchasing advertising inventory. In particular,
Real-Time Bidding (RTB) algorithms respond to many auctions -- usually Vickrey
auctions -- throughout the day for buying ad-inventory with the aim of
maximizing one or several key performance indicators (KPI). The optimization
problems faced by companies building bidding strategies are new and interesting
for the community of applied mathematicians. In this article, we introduce a
stochastic optimal control model that addresses the question of the optimal
bidding strategy in various realistic contexts: the maximization of the
inventory bought with a given amount of cash in the framework of audience
strategies, the maximization of the number of conversions/acquisitions with a
given amount of cash, etc. In our model, the sequence of auctions is modeled by
a Poisson process and the \textit{price to beat} for each auction is modeled by
a random variable following almost any probability distribution. We show that
the optimal bids are characterized by a Hamilton-Jacobi-Bellman equation, and
that almost-closed form solutions can be found by using a fluid limit.
Numerical examples are also carried out
Penalty Methods for the Solution of Discrete HJB Equations -- Continuous Control and Obstacle Problems
In this paper, we present a novel penalty approach for the numerical solution
of continuously controlled HJB equations and HJB obstacle problems. Our results
include estimates of the penalisation error for a class of penalty terms, and
we show that variations of Newton's method can be used to obtain globally
convergent iterative solvers for the penalised equations. Furthermore, we
discuss under what conditions local quadratic convergence of the iterative
solvers can be expected. We include numerical results demonstrating the
competitiveness of our methods.Comment: 31 Pages, 7 Figure
A Neural Network Approach Applied to Multi-Agent Optimal Control
We propose a neural network approach for solving high-dimensional optimal
control problems. In particular, we focus on multi-agent control problems with
obstacle and collision avoidance. These problems immediately become
high-dimensional, even for moderate phase-space dimensions per agent. Our
approach fuses the Pontryagin Maximum Principle and Hamilton-Jacobi-Bellman
(HJB) approaches and parameterizes the value function with a neural network.
Our approach yields controls in a feedback form for quick calculation and
robustness to moderate disturbances to the system. We train our model using the
objective function and optimality conditions of the control problem. Therefore,
our training algorithm neither involves a data generation phase nor solutions
from another algorithm. Our model uses empirically effective HJB penalizers for
efficient training. By training on a distribution of initial states, we ensure
the controls' optimality is achieved on a large portion of the state-space. Our
approach is grid-free and scales efficiently to dimensions where grids become
impractical or infeasible. We demonstrate our approach's effectiveness on a
150-dimensional multi-agent problem with obstacles.Comment: 6 pages, 3 figures, 2021 European Control Conferenc
Adaptive interior penalty methods for Hamilton–Jacobi–Bellman equations with Cordes coefficients
In this paper we conduct a priori and a posteriori error analysis of the C0 interior penalty method for Hamilton–Jacobi–Bellman equations, with coefficients that satisfy the Cordes condition. These estimates show the quasi-optimality of the method, and provide one with an adaptive finite element method. In accordance with the proven regularity theory, we only assume that the solution of the Hamilton–Jacobi–Bellman equation belongs to H2
- …