3,228 research outputs found
Warm Start of Mixed-Integer Programs for Model Predictive Control of Hybrid Systems
In hybrid Model Predictive Control (MPC), a Mixed-Integer Quadratic Program
(MIQP) is solved at each sampling time to compute the optimal control action.
Although these optimizations are generally very demanding, in MPC we expect
consecutive problem instances to be nearly identical. This paper addresses the
question of how computations performed at one time step can be reused to
accelerate (warm start) the solution of subsequent MIQPs.
Reoptimization is not a rare practice in integer programming: for small
variations of certain problem data, the branch-and-bound algorithm allows an
efficient reuse of its search tree and the dual bounds of its leaf nodes. In
this paper we extend these ideas to the receding-horizon settings of MPC. The
warm-start algorithm we propose copes naturally with arbitrary model errors,
has a negligible computational cost, and frequently enables an a-priori pruning
of most of the search space. Theoretical considerations and experimental
evidence show that the proposed method tends to reduce the combinatorial
complexity of the hybrid MPC problem to that of a one-step look-ahead
optimization, greatly easing the online computation burden
Fast Non-Parametric Learning to Accelerate Mixed-Integer Programming for Online Hybrid Model Predictive Control
Today's fast linear algebra and numerical optimization tools have pushed the
frontier of model predictive control (MPC) forward, to the efficient control of
highly nonlinear and hybrid systems. The field of hybrid MPC has demonstrated
that exact optimal control law can be computed, e.g., by mixed-integer
programming (MIP) under piecewise-affine (PWA) system models. Despite the
elegant theory, online solving hybrid MPC is still out of reach for many
applications. We aim to speed up MIP by combining geometric insights from
hybrid MPC, a simple-yet-effective learning algorithm, and MIP warm start
techniques. Following a line of work in approximate explicit MPC, the proposed
learning-control algorithm, LNMS, gains computational advantage over MIP at
little cost and is straightforward for practitioners to implement
Tailored Presolve Techniques in Branch-and-Bound Method for Fast Mixed-Integer Optimal Control Applications
Mixed-integer model predictive control (MI-MPC) can be a powerful tool for
modeling hybrid control systems. In case of a linear-quadratic objective in
combination with linear or piecewise-linear system dynamics and inequality
constraints, MI-MPC needs to solve a mixed-integer quadratic program (MIQP) at
each sampling time step. This paper presents a collection of block-sparse
presolve techniques to efficiently remove decision variables, and to remove or
tighten inequality constraints, tailored to mixed-integer optimal control
problems (MIOCP). In addition, we describe a novel heuristic approach based on
an iterative presolve algorithm to compute a feasible but possibly suboptimal
MIQP solution. We present benchmarking results for a C code implementation of
the proposed BB-ASIPM solver, including a branch-and-bound (B&B) method with
the proposed tailored presolve techniques and an active-set based interior
point method (ASIPM), compared against multiple state-of-the-art MIQP solvers
on a case study of motion planning with obstacle avoidance constraints.
Finally, we demonstrate the computational performance of the BB-ASIPM solver on
the dSPACE Scalexio real-time embedded hardware using a second case study of
stabilization for an underactuated cart-pole with soft contacts.Comment: 27 pages, 7 figures, 2 tables, submitted to journal of Optimal
Control Applications and Method
The Voice of Optimization
We introduce the idea that using optimal classification trees (OCTs) and
optimal classification trees with-hyperplanes (OCT-Hs), interpretable machine
learning algorithms developed by Bertsimas and Dunn [2017, 2018], we are able
to obtain insight on the strategy behind the optimal solution in continuous and
mixed-integer convex optimization problem as a function of key parameters that
affect the problem. In this way, optimization is not a black box anymore.
Instead, we redefine optimization as a multiclass classification problem where
the predictor gives insights on the logic behind the optimal solution. In other
words, OCTs and OCT-Hs give optimization a voice. We show on several realistic
examples that the accuracy behind our method is in the 90%-100% range, while
even when the predictions are not correct, the degree of suboptimality or
infeasibility is very low. We compare optimal strategy predictions of OCTs and
OCT-Hs and feedforward neural networks (NNs) and conclude that the performance
of OCT-Hs and NNs is comparable. OCTs are somewhat weaker but often
competitive. Therefore, our approach provides a novel insightful understanding
of optimal strategies to solve a broad class of continuous and mixed-integer
optimization problems
Computationally efficient solution of mixed integer model predictive control problems via machine learning aided Benders Decomposition
Mixed integer Model Predictive Control (MPC) problems arise in the operation
of systems where discrete and continuous decisions must be taken simultaneously
to compensate for disturbances. The efficient solution of mixed integer MPC
problems requires the computationally efficient and robust online solution of
mixed integer optimization problems, which are generally difficult to solve. In
this paper, we propose a machine learning-based branch and check Generalized
Benders Decomposition algorithm for the efficient solution of such problems. We
use machine learning to approximate the effect of the complicating variables on
the subproblem by approximating the Benders cuts without solving the
subproblem, therefore, alleviating the need to solve the subproblem multiple
times. The proposed approach is applied to a mixed integer economic MPC case
study on the operation of chemical processes. We show that the proposed
algorithm always finds feasible solutions to the optimization problem, given
that the mixed integer MPC problem is feasible, and leads to a significant
reduction in solution time (up to 97% or 50x) while incurring small error (in
the order of 1%) compared to the application of standard and accelerated
Generalized Benders Decomposition
- …