172 research outputs found
Stability Verification of Neural Network Controllers using Mixed-Integer Programming
We propose a framework for the stability verification of Mixed-Integer Linear
Programming (MILP) representable control policies. This framework compares a
fixed candidate policy, which admits an efficient parameterization and can be
evaluated at a low computational cost, against a fixed baseline policy, which
is known to be stable but expensive to evaluate. We provide sufficient
conditions for the closed-loop stability of the candidate policy in terms of
the worst-case approximation error with respect to the baseline policy, and we
show that these conditions can be checked by solving a Mixed-Integer Quadratic
Program (MIQP). Additionally, we demonstrate that an outer and inner
approximation of the stability region of the candidate policy can be computed
by solving an MILP. The proposed framework is sufficiently general to
accommodate a broad range of candidate policies including ReLU Neural Networks
(NNs), optimal solution maps of parametric quadratic programs, and Model
Predictive Control (MPC) policies. We also present an open-source toolbox in
Python based on the proposed framework, which allows for the easy verification
of custom NN architectures and MPC formulations. We showcase the flexibility
and reliability of our framework in the context of a DC-DC power converter case
study and investigate its computational complexity
Robust explicit model predictive control for hybrid linear systems with parameter uncertainties
Explicit model-predictive control (MPC) is a widely used control design
method that employs optimization tools to find control policies offline;
commonly it is posed as a semi-definite program (SDP) or as a mixed-integer SDP
in the case of hybrid systems. However, mixed-integer SDPs are computationally
expensive, motivating alternative formulations, such as zonotope-based MPC
(zonotopes are a special type of symmetric polytopes). In this paper, we
propose a robust explicit MPC method applicable to hybrid systems. More
precisely, we extend existing zonotope-based MPC methods to account for
multiplicative parametric uncertainty. Additionally, we propose a convex
zonotope order reduction method that takes advantage of the iterative structure
of the zonotope propagation problem to promote diagonal blocks in the zonotope
generators and lower the number of decision variables. Finally, we developed a
quasi-time-free policy choice algorithm, allowing the system to start from any
point on the trajectory and avoid chattering associated with discrete switching
of linear control policies based on the current state's membership in
state-space regions. Last but not least, we verify the validity of the proposed
methods on two experimental setups, varying physical parameters between
experiments
Approximation of explicit model predictive control using regular piecewise affine functions: an input-to-state stability approach
Abstract Piecewise affine (PWA) feedback control laws defined on general polytopic partitions, as for instance obtained by explicit MPC, will often be prohibitively complex for fast systems. In this work we study the problem of approximating these high-complexity controllers by low-complexity PWA control laws defined on more regular partitions, facilitating faster on-line evaluation. The approach is based on the concept of input-to-state stability (ISS). In particular, the existence of an ISS Lyapunov function (LF) is exploited to obtain a priori conditions that guarantee asymptotic stability and constraint satisfaction of the approximate low-complexity controller. These conditions can be expressed as local semidefinite programs (SDPs) or linear programs (LPs), in case of 2-norm or 1, ∞-norm based ISS, respectively, and apply to PWA plants. In addition, as ISS is a prerequisite for our approximation method, we provide two tractable computational methods for deriving the necessary ISS inequalities from nominal stability. A numerical example is provided that illustrates the main results. The authors are with the Hybrid an
An Improved Constraint-Tightening Approach for Stochastic MPC
The problem of achieving a good trade-off in Stochastic Model Predictive
Control between the competing goals of improving the average performance and
reducing conservativeness, while still guaranteeing recursive feasibility and
low computational complexity, is addressed. We propose a novel, less
restrictive scheme which is based on considering stability and recursive
feasibility separately. Through an explicit first step constraint we guarantee
recursive feasibility. In particular we guarantee the existence of a feasible
input trajectory at each time instant, but we only require that the input
sequence computed at time remains feasible at time for most
disturbances but not necessarily for all, which suffices for stability. To
overcome the computational complexity of probabilistic constraints, we propose
an offline constraint-tightening procedure, which can be efficiently solved via
a sampling approach to the desired accuracy. The online computational
complexity of the resulting Model Predictive Control (MPC) algorithm is similar
to that of a nominal MPC with terminal region. A numerical example, which
provides a comparison with classical, recursively feasible Stochastic MPC and
Robust MPC, shows the efficacy of the proposed approach.Comment: Paper has been submitted to ACC 201
Approximate hybrid model predictive control for multi-contact push recovery in complex environments
Feedback control of robotic systems interacting with the environment through contacts is a central topic in legged robotics. One of the main challenges posed by this problem is the choice of a model sufficiently complex to capture the discontinuous nature of the dynamics but simple enough to allow online computations. Linear models have proved to be the most effective and reliable choice for smooth systems; we believe that piecewise affine (PWA) models represent their natural extension when contact phenomena occur. Discrete-time PWA systems have been deeply analyzed in the field of hybrid Model Predictive Control (MPC), but the straightforward application of MPC techniques to complex systems, such as a humanoid
robot, leads to mixed-integer optimization problems which are not solvable at real-time rates. Explicit MPC methods can
construct the entire control policy offline, but the resulting policy becomes too complex to compute for systems at the scale of a humanoid robot. In this paper we propose a novel algorithm which splits the computational burden between an offline sampling phase and a limited number of online convex optimizations, enabling the application of hybrid predictive controllers to higher-dimensional systems. In doing so we are willing to partially sacrifice feedback optimality, but we set stability of the system as an inviolable requirement. Simulation results of a simple planar humanoid that balances by making contact with its environment are presented to validate the proposed controller
- …