Junction conditions for finite horizon optimal control problems on multi-domains with continuous and discontinuous solutions

This paper deals with junction conditions for Hamilton-Jacobi-Bellman (HJB) equations for finite horizon control problems on multi-domains. We consider two different cases where the final cost is continuous or lower semi-continuous. In the continuous case we extend the results of "Hamilton-Jacobi-Bellman equations on multi-domains" by the second and third authors in a more general framework with switching running costs and weaker controllability assumptions. The comparison principle has been established to guarantee the uniqueness and the stability results for the HJB system on such multi-domains. In the lower semi-continuous case, we characterize the value function as the unique lower semi-continuous viscosity solution of the HJB system, under a local controllability assumption

Level-set approach for Reachability Analysis of Hybrid Systems under Lag Constraints

International audienceThis study aims at characterizing a reachable set of a hybrid dynamical system with a lag constraint in the switch control. The setting does not consider any controllability assumptions and uses a level-set approach. The approach consists in the introduction of on adequate hybrid optimal control problem with lag constraints on the switch control whose value function allows a characterization of the reachable set. The value function is in turn characterized by a system of quasi-variational inequalities (SQVI). We prove a comparison principle for the SQVI which shows uniqueness of its solution. A class of numerical finite differences schemes for solving the system of inequalities is proposed and the convergence of the numerical solution towards the value function is studied using the comparison principle. Some numerical examples illustrating the method are presented. Our study is motivated by an industrial application, namely, that of range extender electric vehicles. This class of electric vehicles uses an additional module -- the range extender -- as an extra source of energy in addition to its main source -- a high voltage battery. The reachability study of this system is used to establish the maximum range of a simple vehicle model

Hamilton-Jacobi-Bellman Equations on Multi-Domains

International audienceA system of Hamilton Jacobi (HJ) equations on a partition of $\R^d$ is considered, and a uniqueness and existence result of viscosity solution is analyzed. While the notion of viscosity notion is by now well known, the question of uniqueness of solution, when the Hamiltonian is discontinuous, remains an important issue. A uniqueness result has been derived for a class of problems, where the behavior of the solution, in the region of discontinuity of the Hamiltonian, is assumed to be irrelevant and can be ignored (see reference [10]) . Here, we provide a new uniqueness result for a more general class of Hamilton-Jacobi equations

Monotone numerical schemes and feedback construction for hybrid control systems

International audienceHybrid systems are a general framework which can model a large class of control systems arising whenever a collection of continuous and discrete dynamics are put together in a single model. In this paper, we study the convergence of monotone numerical approximations of value functions associated to control problems governed by hybrid systems. We discuss also the feedback reconstruction and derive a convergence result for the approximate feedback control law. Some numerical examples are given to show the robustness of the monotone approximation schemes

Infinite horizon problems on stratifiable state-constraints sets

International audienceThis paper deals with a state-constrained control problem. It is well known that, unless some compatibility condition between constraints and dynamics holds, the value function has not enough regularity, or can fail to be the unique constrained viscosity solution of a Hamilton-Jacobi-Bellman (HJB) equation. Here, we consider the case of a set of constraints having a stratified structure. Under this circumstance, the interior of this set may be empty or disconnected, and the admissible trajectories may have the only option to stay on the boundary without possible approximation in the interior of the constraints. In such situations, the classical pointing qualification hypothesis are not relevant. The discontinuous value function is then characterized by means of a system of HJB equations on each stratum that composes the state constraints. This result is obtained under a local controllability assumption which is required only on the strata where some chattering phenomena could occur

Zubov's equation for state-constrained perturbed nonlinear systems

International audienceThe paper gives a characterization of the uniform robust domain of attraction for a nite non-linear controlled system subject to perturbations and state constraints. We extend the Zubov approach to characterize this domain by means of the value function of a suitable in nite horizon state-constrained control problem which at the same time is a Lyapunov function for the system. We provide associated Hamilton-Jacobi-Bellman equations and prove existence and uniqueness of the solutions of these generalized Zubov equations

Minimal Time Problems with Moving Targets and Obstacles

International audienceWe consider minimal time problems governed by nonlinear systems under general time dependant state constraints and in the two-player games setting. In general, it is known that the characterization of the minimal time function, as well as the study of its regularity properties, is a difficult task in particular when no controlability assumption is made. In addition to these difficulties, we are interested here to the case when the target, the state constraints and the dynamics are allowed to be time-dependent. We introduce a particular "reachability" control problem, which has a supremum cost function but is free of state constraints. This auxiliary control problem allows to characterize easily the backward reachable sets, and then, the minimal time function, without assuming any controllability assumption. These techniques are linked to the well known level-set approachs. Partial results of the study have been published recently by the authors in SICON. Here, we generalize the method to more complex problems of moving target and obstacle problems. Our results can be used to deal with motion planning problems with obstacle avoidance

Dynamic Programming and Error Estimates for Stochastic Control Problems with Maximum Cost

International audienceThis work is concerned with stochastic optimal control for a running maximum cost. A direct approach based on dynamic programming techniques is studied leading to the characterization of the value function as the unique viscosity solution of a second order Hamilton- Jacobi-Bellman (HJB) equation with an oblique derivative boundary condition. A general numerical scheme is proposed and a convergence result is provided. Error estimates are obtained for the semi-Lagrangian scheme. These results can apply to the case of lookback options in finance. Moreover, optimal control problems with maximum cost arise in the characterization of the reachable sets for a system of controlled stochastic differential equations. Some numerical simulations on examples of reachable analysis are included to illustrate our approach

The Mayer and Minimum Time Problems with Stratified State Constraints *

International audienceThis paper studies optimal control problems with state constraints by imposing structural assumptions on the constraint domain coupled with a tangential restriction with the dynamics. These assumptions replace pointing or controllability assumptions that are common in the literature, and provide a framework under which feasible boundary trajectories can be analyzed directly. The value functions associated with the state constrained Mayer and minimal time problems are characterized as solutions to a pair of Hamilton-Jacobi inequalities with appropriate boundary conditions. The novel feature of these inequalities lies in the choice of the Hamiltonian