53,386 research outputs found
Stability Verification of Neural Network Controllers using Mixed-Integer Programming
We propose a framework for the stability verification of Mixed-Integer Linear
Programming (MILP) representable control policies. This framework compares a
fixed candidate policy, which admits an efficient parameterization and can be
evaluated at a low computational cost, against a fixed baseline policy, which
is known to be stable but expensive to evaluate. We provide sufficient
conditions for the closed-loop stability of the candidate policy in terms of
the worst-case approximation error with respect to the baseline policy, and we
show that these conditions can be checked by solving a Mixed-Integer Quadratic
Program (MIQP). Additionally, we demonstrate that an outer and inner
approximation of the stability region of the candidate policy can be computed
by solving an MILP. The proposed framework is sufficiently general to
accommodate a broad range of candidate policies including ReLU Neural Networks
(NNs), optimal solution maps of parametric quadratic programs, and Model
Predictive Control (MPC) policies. We also present an open-source toolbox in
Python based on the proposed framework, which allows for the easy verification
of custom NN architectures and MPC formulations. We showcase the flexibility
and reliability of our framework in the context of a DC-DC power converter case
study and investigate its computational complexity
Relaxation Methods for Mixed-Integer Optimal Control of Partial Differential Equations
We consider integer-restricted optimal control of systems governed by
abstract semilinear evolution equations. This includes the problem of optimal
control design for certain distributed parameter systems endowed with multiple
actuators, where the task is to minimize costs associated with the dynamics of
the system by choosing, for each instant in time, one of the actuators together
with ordinary controls. We consider relaxation techniques that are already used
successfully for mixed-integer optimal control of ordinary differential
equations. Our analysis yields sufficient conditions such that the optimal
value and the optimal state of the relaxed problem can be approximated with
arbitrary precision by a control satisfying the integer restrictions. The
results are obtained by semigroup theory methods. The approach is constructive
and gives rise to a numerical method. We supplement the analysis with numerical
experiments
Approximation of System Components for Pump Scheduling Optimisation
© 2015 The Authors. Published by Elsevier Ltd.The operation of pump systems in water distribution systems (WDS) is commonly the most expensive task for utilities with up to 70% of the operating cost of a pump system attributed to electricity consumption. Optimisation of pump scheduling could save 10-20% by improving efficiency or shifting consumption to periods with low tariffs. Due to the complexity of the optimal control problem, heuristic methods which cannot guarantee optimality are often applied. To facilitate the use of mathematical optimisation this paper investigates formulations of WDS components. We show that linear approximations outperform non-linear approximations, while maintaining comparable levels of accuracy
Mixed integer predictive control and shortest path reformulation
Mixed integer predictive control deals with optimizing integer and real
control variables over a receding horizon. The mixed integer nature of controls
might be a cause of intractability for instances of larger dimensions. To
tackle this little issue, we propose a decomposition method which turns the
original -dimensional problem into indipendent scalar problems of lot
sizing form. Each scalar problem is then reformulated as a shortest path one
and solved through linear programming over a receding horizon. This last
reformulation step mirrors a standard procedure in mixed integer programming.
The approximation introduced by the decomposition can be lowered if we operate
in accordance with the predictive control technique: i) optimize controls over
the horizon ii) apply the first control iii) provide measurement updates of
other states and repeat the procedure
Fast Non-Parametric Learning to Accelerate Mixed-Integer Programming for Online Hybrid Model Predictive Control
Today's fast linear algebra and numerical optimization tools have pushed the
frontier of model predictive control (MPC) forward, to the efficient control of
highly nonlinear and hybrid systems. The field of hybrid MPC has demonstrated
that exact optimal control law can be computed, e.g., by mixed-integer
programming (MIP) under piecewise-affine (PWA) system models. Despite the
elegant theory, online solving hybrid MPC is still out of reach for many
applications. We aim to speed up MIP by combining geometric insights from
hybrid MPC, a simple-yet-effective learning algorithm, and MIP warm start
techniques. Following a line of work in approximate explicit MPC, the proposed
learning-control algorithm, LNMS, gains computational advantage over MIP at
little cost and is straightforward for practitioners to implement
Reactive Planar Manipulation with Convex Hybrid MPC
This paper presents a reactive controller for planar manipulation tasks that
leverages machine learning to achieve real-time performance. The approach is
based on a Model Predictive Control (MPC) formulation, where the goal is to
find an optimal sequence of robot motions to achieve a desired object motion.
Due to the multiple contact modes associated with frictional interactions, the
resulting optimization program suffers from combinatorial complexity when
tasked with determining the optimal sequence of modes.
To overcome this difficulty, we formulate the search for the optimal mode
sequences offline, separately from the search for optimal control inputs
online. Using tools from machine learning, this leads to a convex hybrid MPC
program that can be solved in real-time. We validate our algorithm on a planar
manipulation experimental setup where results show that the convex hybrid MPC
formulation with learned modes achieves good closed-loop performance on a
trajectory tracking problem
Stochastic Model Predictive Control for Autonomous Mobility on Demand
This paper presents a stochastic, model predictive control (MPC) algorithm
that leverages short-term probabilistic forecasts for dispatching and
rebalancing Autonomous Mobility-on-Demand systems (AMoD, i.e. fleets of
self-driving vehicles). We first present the core stochastic optimization
problem in terms of a time-expanded network flow model. Then, to ameliorate its
tractability, we present two key relaxations. First, we replace the original
stochastic problem with a Sample Average Approximation (SAA), and characterize
the performance guarantees. Second, we separate the controller into two
separate parts to address the task of assigning vehicles to the outstanding
customers separate from that of rebalancing. This enables the problem to be
solved as two totally unimodular linear programs, and thus easily scalable to
large problem sizes. Finally, we test the proposed algorithm in two scenarios
based on real data and show that it outperforms prior state-of-the-art
algorithms. In particular, in a simulation using customer data from DiDi
Chuxing, the algorithm presented here exhibits a 62.3 percent reduction in
customer waiting time compared to state of the art non-stochastic algorithms.Comment: Submitting to the IEEE International Conference on Intelligent
Transportation Systems 201
On the continuum approximation of the on-and-off signal control on dynamic traffic networks
In the modeling of traffic networks, a signalized junction is typically treated using a binary variable to model the on-and-off nature of signal operation. While accurate, the use of binary variables can cause problems when studying large networks with many intersections. Instead, the signal control can be approximated through a continuum approach where the on-and-off control variable is replaced by a continuous priority parameter. Advantages of such approximation include elimination of the need for binary variables, lower time resolution requirements, and more flexibility and robustness in a decision environment. It also resolves the issue of discontinuous travel time functions arising from the context of dynamic traffic assignment. Despite these advantages in application, it is not clear from a theoretical point of view how accurate is such continuum approach; i.e., to what extent is this a valid approximation for the on-and-off case. The goal of this paper is to answer these basic research questions and provide further guidance for the application of such continuum signal model. In particular, by employing the Lighthill-Whitham-Richards model (Lighthill and Whitham, 1955; Richards, 1956) on a traffic network, we investigate the convergence of the on-and-off signal model to the continuum model in regimes of diminishing signal cycles. We also provide numerical analyses on the continuum approximation error when the signal cycles are not infinitesimal. As we explain, such convergence results and error estimates depend on the type of fundamental diagram assumed and whether or not vehicle spillback occurs to the signalized intersection in question. Finally, a traffic signal optimization problem is presented and solved which illustrates the unique advantages of applying the continuum signal model instead of the on-and-off model
- …