5,839 research outputs found
Approximation of Continuous-Time Infinite-Horizon Optimal Control Problems Arising in Model Predictive Control - Supplementary Notes
These notes present preliminary results regarding two different
approximations of linear infinite-horizon optimal control problems arising in
model predictive control. Input and state trajectories are parametrized with
basis functions and a finite dimensional representation of the dynamics is
obtained via a Galerkin approach. It is shown that the two approximations
provide lower, respectively upper bounds on the optimal cost of the underlying
infinite dimensional optimal control problem. These bounds get tighter as the
number of basis functions is increased. In addition, conditions guaranteeing
convergence to the cost of the underlying problem are provided.Comment: Supplementary notes, 10 page
Online-Computation Approach to Optimal Control of Noise-Affected Nonlinear Systems with Continuous State and Control Spaces
© 2007 EUCA.A novel online-computation approach to optimal control of nonlinear, noise-affected systems with continuous state and control spaces is presented. In the proposed algorithm, system noise is explicitly incorporated into the control decision. This leads to superior results compared to state-of-the-art nonlinear controllers that neglect this influence. The solution of an optimal nonlinear controller for a corresponding deterministic system is employed to find a meaningful state space restriction. This restriction is obtained by means of approximate state prediction using the noisy system equation. Within this constrained state space, an optimal closed-loop solution for a finite decision-making horizon (prediction horizon) is determined within an adaptively restricted optimization space. Interleaving stochastic dynamic programming and value function approximation yields a solution to the considered optimal control problem. The enhanced performance of the proposed discrete-time controller is illustrated by means of a scalar example system. Nonlinear model predictive control is applied to address approximate treatment of infinite-horizon problems by the finite-horizon controller
Approximate Dynamic Programming via Sum of Squares Programming
We describe an approximate dynamic programming method for stochastic control
problems on infinite state and input spaces. The optimal value function is
approximated by a linear combination of basis functions with coefficients as
decision variables. By relaxing the Bellman equation to an inequality, one
obtains a linear program in the basis coefficients with an infinite set of
constraints. We show that a recently introduced method, which obtains convex
quadratic value function approximations, can be extended to higher order
polynomial approximations via sum of squares programming techniques. An
approximate value function can then be computed offline by solving a
semidefinite program, without having to sample the infinite constraint. The
policy is evaluated online by solving a polynomial optimization problem, which
also turns out to be convex in some cases. We experimentally validate the
method on an autonomous helicopter testbed using a 10-dimensional helicopter
model.Comment: 7 pages, 5 figures. Submitted to the 2013 European Control
Conference, Zurich, Switzerlan
Error estimates for a tree structure algorithm solving finite horizon control problems
In the Dynamic Programming approach to optimal control problems a crucial
role is played by the value function that is characterized as the unique
viscosity solution of a Hamilton-Jacobi-Bellman (HJB) equation. It is well
known that this approach suffers of the "curse of dimensionality" and this
limitation has reduced its practical in real world applications. Here we
analyze a dynamic programming algorithm based on a tree structure. The tree is
built by the time discrete dynamics avoiding in this way the use of a fixed
space grid which is the bottleneck for high-dimensional problems, this also
drops the projection on the grid in the approximation of the value function. We
present some error estimates for a first order approximation based on the
tree-structure algorithm. Moreover, we analyze a pruning technique for the tree
to reduce the complexity and minimize the computational effort. Finally, we
present some numerical tests
Robust Model Predictive Control for Signal Temporal Logic Synthesis
Most automated systems operate in uncertain or adversarial conditions, and have to be capable of reliably reacting to changes in the environment. The focus of this paper is on automatically synthesizing reactive controllers for cyber-physical systems subject to signal temporal logic (STL) specifications. We build on recent work that encodes STL specifications as mixed integer linear constraints on the variables of a discrete-time model of the system and environment dynamics. To obtain a reactive controller, we present solutions to the worst-case model predictive control (MPC) problem using a suite of mixed integer linear programming techniques. We demonstrate the comparative effectiveness of several existing worst-case MPC techniques, when applied to the problem of control subject to temporal logic specifications; our empirical results emphasize the need to develop specialized solutions for this domain
- …