A Gauss-Newton-Like Hessian Approximation for Economic NMPC

Economic Model Predictive Control (EMPC) has recently become popular because of its ability to control constrained nonlinear systems while explicitly optimizing a prescribed performance criterion. Large performance gains have been reported for many applications and closed-loop stability has been recently investigated. However, computational performance still remains an open issue and only few contributions have proposed real-time algorithms tailored to EMPC. We perform a step towards computationally cheap algorithms for EMPC by proposing a new positive-definite Hessian approximation which does not hinder fast convergence and is suitable for being used within the real-time iteration (RTI) scheme. We provide two simulation examples to demonstrate the effectiveness of RTI-based EMPC relying on the proposed Hessian approximation

Variational and Time-Distributed Methods for Real-time Model Predictive Control

This dissertation concerns the theoretical, algorithmic, and practical aspects of solving optimal control problems (OCPs) in real-time. The topic is motivated by Model Predictive Control (MPC), a powerful control technique for constrained, nonlinear systems that computes control actions by solving a parameterized OCP at each sampling instant. To successfully implement MPC, these parameterized OCPs need to be solved in real-time. This is a significant challenge for systems with fast dynamics and/or limited onboard computing power and is often the largest barrier to the deployment of MPC controllers. The contributions of this dissertation are as follows. First, I present a system theoretic analysis of Time-distributed Optimization (TDO) in Model Predictive Control. When implemented using TDO, an MPC controller distributed optimization iterates over time by maintaining a running solution estimate for the optimal control problem and updating it at each sampling instant. The resulting controller can be viewed as a dynamic compensator which is placed in closed-loop with the plant. The resulting coupled plant-optimizer system is analyzed using input-to-state stability concepts and sufficient conditions for stability and constraint satisfaction are derived. When applied to time distributed sequential quadratic programming, the framework significantly extends the existing theoretical analysis for the real-time iteration scheme. Numerical simulations are presented that demonstrate the effectiveness of the scheme. Second, I present the Proximally Stabilized Fischer-Burmeister (FBstab) algorithm for convex quadratic programming. FBstab is a novel algorithm that synergistically combines the proximal point algorithm with a primal-dual semismooth Newton-type method. FBstab is numerically robust, easy to warmstart, handles degenerate primal-dual solutions, detects infeasibility/unboundedness and requires only that the Hessian matrix be positive semidefinite. The chapter outlines the algorithm, provides convergence and convergence rate proofs, and reports some numerical results from model predictive control benchmarks and from the Maros-Meszaros test set. Overall, FBstab shown to be is competitive with state of the art methods and to be especially promising for model predictive control and other parameterized problems. Finally, I present an experimental application of some of the approaches from the first two chapters: Emissions oriented supervisory model predictive control (SMPC) of a diesel engine. The control objective is to reduce engine-out cumulative NOx and total hydrocarbon (THC) emissions. This is accomplished using an MPC controller which minimizes deviation from optimal setpoints, subject to combustion quality constraints, by coordinating the fuel input and the EGR rate target provided to an inner-loop airpath controller. The SMPC controller is implemented using TDO and a variant of FBstab which allows us to achieve sub-millisecond controller execution times. We experimentally demonstrate 10-15% cumulative emissions reductions over the Worldwide Harmonized Light Vehicles Test Cycle (WLTC) drivecycle.PHDAerospace EngineeringUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttps://deepblue.lib.umich.edu/bitstream/2027.42/155167/1/dliaomcp_1.pd

A Study Model Predictive Control for Spark Ignition Engine Management and Testing

Pressure to improve spark-ignition (SI) engine fuel economy has driven thedevelopment and integration of many control actuators, creating complex controlsystems. Integration of a high number of control actuators into traditional map basedcontrollers creates tremendous challenges since each actuator exponentially increasescalibration time and investment. Model Predictive Control (MPC) strategies have thepotential to better manage this high complexity since they provide near-optimal controlactions based on system models. This research work focuses on investigating somepractical issues of applying MPC with SI engine control and testing.Starting from one dimensional combustion phasing control using spark timing(SPKT), this dissertation discusses challenges of computing the optimal control actionswith complex engine models. A nonlinear optimization is formulated to compute thedesired spark timing in real time, while considering knock and combustion variationconstraints. Three numerical approaches are proposed to directly utilize complex high-fidelity combustion models to find the optimal SPKT. A model based combustionphasing estimator that considers the influence of cycle-by-cycle combustion variations isalso integrated into the control system, making feedback and adaption functions possible.An MPC based engine management system with a higher number of controldimensions is also investigated. The control objective is manipulating throttle, externalEGR valve and SPKT to provide demanded torque (IMEP) output with minimum fuelconsumption. A cascaded control structure is introduced to simplify the formulation and solution of the MPC problem that solves for desired control actions. Sequential quadratic programming (SQP) MPC is applied to solve the nonlinear optimization problem in real time. A real-time linearization technique is used to formulate the sub-QP problems with the complex high dimensional engine system. Techniques to simplify the formulation of SQP and improve its convergence performance are also discussed in the context of tracking MPC. Strategies to accelerate online quadratic programming (QP) are explored. It is proposed to use pattern recognition techniques to “warm-start” active set QP algorithms for general linear MPC applications. The proposed linear time varying (LTV) MPC is used in Engine-in-Loop (EIL) testing to mimic the pedal actuations of human drivers who foresee the incoming traffic conditions. For SQP applications, the MPC is initialized with optimal control actions predicted by an ANN. Both proposed MPC methods significantly reduce execution time with minimal additional memory requirement

Fast numerical methods for mixed--integer nonlinear model--predictive control

This thesis aims at the investigation and development of fast numerical methods for nonlinear mixed--integer optimal control and model- predictive control problems. A new algorithm is developed based on the direct multiple shooting method for optimal control and on the idea of real--time iterations, and using a convex reformulation and relaxation of dynamics and constraints of the original predictive control problem. This algorithm relies on theoretical results and is based on a nonconvex SQP method and a new active set method for nonconvex parametric quadratic programming. It achieves real--time capable control feedback though block structured linear algebra for which we develop new matrix updates techniques. The applicability of the developed methods is demonstrated on several applications. This thesis presents novel results and advances over previously established techniques in a number of areas as follows: We develop a new algorithm for mixed--integer nonlinear model- predictive control by combining Bock's direct multiple shooting method, a reformulation based on outer convexification and relaxation of the integer controls, on rounding schemes, and on a real--time iteration scheme. For this new algorithm we establish an interpretation in the framework of inexact Newton-type methods and give a proof of local contractivity assuming an upper bound on the sampling time, implying nominal stability of this new algorithm. We propose a convexification of path constraints directly depending on integer controls that guarantees feasibility after rounding, and investigate the properties of the obtained nonlinear programs. We show that these programs can be treated favorably as MPVCs, a young and challenging class of nonconvex problems. We describe a SQP method and develop a new parametric active set method for the arising nonconvex quadratic subproblems. This method is based on strong stationarity conditions for MPVCs under certain regularity assumptions. We further present a heuristic for improving stationary points of the nonconvex quadratic subproblems to global optimality. The mixed--integer control feedback delay is determined by the computational demand of our active set method. We describe a block structured factorization that is tailored to Bock's direct multiple shooting method. It has favorable run time complexity for problems with long horizons or many controls unknowns, as is the case for mixed- integer optimal control problems after outer convexification. We develop new matrix update techniques for this factorization that reduce the run time complexity of all but the first active set iteration by one order. All developed algorithms are implemented in a software package that allows for the generic, efficient solution of nonlinear mixed-integer optimal control and model-predictive control problems using the developed methods

High performance implementation of MPC schemes for fast systems

In recent years, the number of applications of model predictive control (MPC) is rapidly increasing due to the better control performance that it provides in comparison to traditional control methods. However, the main limitation of MPC is the computational e ort required for the online solution of an optimization problem. This shortcoming restricts the use of MPC for real-time control of dynamic systems with high sampling rates. This thesis aims to overcome this limitation by implementing high-performance MPC solvers for real-time control of fast systems. Hence, one of the objectives of this work is to take the advantage of the particular mathematical structures that MPC schemes exhibit and use parallel computing to improve the computational e ciency. Firstly, this thesis focuses on implementing e cient parallel solvers for linear MPC (LMPC) problems, which are described by block-structured quadratic programming (QP) problems. Speci cally, three parallel solvers are implemented: a primal-dual interior-point method with Schur-complement decomposition, a quasi-Newton method for solving the dual problem, and the operator splitting method based on the alternating direction method of multipliers (ADMM). The implementation of all these solvers is based on C++. The software package Eigen is used to implement the linear algebra operations. The Open Message Passing Interface (Open MPI) library is used for the communication between processors. Four case-studies are presented to demonstrate the potential of the implementation. Hence, the implemented solvers have shown high performance for tackling large-scale LMPC problems by providing the solutions in computation times below milliseconds. Secondly, the thesis addresses the solution of nonlinear MPC (NMPC) problems, which are described by general optimal control problems (OCPs). More precisely, implementations are done for the combined multiple-shooting and collocation (CMSC) method using a parallelization scheme. The CMSC method transforms the OCP into a nonlinear optimization problem (NLP) and de nes a set of underlying sub-problems for computing the sensitivities and discretized state values within the NLP solver. These underlying sub-problems are decoupled on the variables and thus, are solved in parallel. For the implementation, the software package IPOPT is used to solve the resulting NLP problems. The parallel solution of the sub-problems is performed based on MPI and Eigen. The computational performance of the parallel CMSC solver is tested using case studies for both OCPs and NMPC showing very promising results. Finally, applications to autonomous navigation for the SUMMIT robot are presented. Specially, reference tracking and obstacle avoidance problems are addressed using an NMPC approach. Both simulation and experimental results are presented and compared to a previous work on the SUMMIT, showing a much better computational e ciency and control performance.Tesi

Distributed algorithms for nonlinear tree-sparse problems

[no abstract

Distributed Optimization with Application to Power Systems and Control

In many engineering domains, systems are composed of partially independent subsystems—power systems are composed of distribution and transmission systems, teams of robots are composed of individual robots, and chemical process systems are composed of vessels, heat exchangers and reactors. Often, these subsystems should reach a common goal such as satisfying a power demand with minimum cost, flying in a formation, or reaching an optimal set-point. At the same time, limited information exchange is desirable—for confidentiality reasons but also due to communication constraints. Moreover, a fast and reliable decision process is key as applications might be safety-critical. Mathematical optimization techniques are among the most successful tools for controlling systems optimally with feasibility guarantees. Yet, they are often centralized—all data has to be collected in one central and computationally powerful entity. Methods from distributed optimization control the subsystems in a distributed or decentralized fashion, reducing or avoiding central coordination. These methods have a long and successful history. Classical distributed optimization algorithms, however, are typically designed for convex problems. Hence, they are only partially applicable in the above domains since many of them lead to optimization problems with non-convex constraints. This thesis develops one of the first frameworks for distributed and decentralized optimization with non-convex constraints. Based on the Augmented Lagrangian Alternating Direction Inexact Newton (ALADIN) algorithm, a bi-level distributed ALADIN framework is presented, solving the coordination step of ALADIN in a decentralized fashion. This framework can handle various decentralized inner algorithms, two of which we develop here: a decentralized variant of the Alternating Direction Method of Multipliers (ADMM) and a novel decentralized Conjugate Gradient algorithm. Decentralized conjugate gradient is to the best of our knowledge the first decentralized algorithm with a guarantee of convergence to the exact solution in a finite number of iterates. Sufficient conditions for fast local convergence of bi-level ALADIN are derived. Bi-level ALADIN strongly reduces the communication and coordination effort of ALADIN and preserves its fast convergence guarantees. We illustrate these properties on challenging problems from power systems and control, and compare performance to the widely used ADMM. The developed methods are implemented in the open-source MATLAB toolbox ALADIN-—one of the first toolboxes for decentralized non-convex optimization. ALADIN- comes with a rich set of application examples from different domains showing its broad applicability. As an additional contribution, this thesis provides new insights why state-of-the-art distributed algorithms might encounter issues for constrained problems

Numerical optimal control with applications in aerospace

This thesis explores various computational aspects of solving nonlinear, continuous-time dynamic optimization problems (DOPs) numerically. Firstly, a direct transcription method for solving DOPs is proposed, named the integrated residual method (IRM). Instead of forcing the dynamic constraints to be satisfied only at a selected number of points as in direct collocation, this new approach alternates between minimizing and constraining the squared norm of the dynamic constraint residuals integrated along the whole solution trajectories. The method is capable of obtaining solutions of higher accuracy for the same mesh compared to direct collocation methods, enabling a flexible trade-off between solution accuracy and optimality, and providing reliable solutions for challenging problems, including those with singular arcs and high-index differential-algebraic equations. A number of techniques have also been proposed in this work for efficient numerical solution of large scale and challenging DOPs. A general approach for direct implementation of rate constraints on the discretization mesh is proposed. Unlike conventional approaches that may lead to singular control arcs, the solution of this on-mesh implementation has better numerical properties, while achieving computational speedups. Another development is related to the handling of inactive constraints, which do not contribute to the solution of DOPs, but increase the problem size and burden the numerical computations. A strategy to systematically remove the inactive and redundant constraints under a mesh refinement framework is proposed. The last part of this work focuses on the use of DOPs in aerospace applications, with a number of topics studied. Using example scenarios of intercontinental flights, the benefits of formulating DOPs directly according to problem specifications are demonstrated, with notable savings in fuel usage. The numerical challenges with direct collocation are also identified, with the IRM obtaining solutions of higher accuracy, and at the same time suppressing the singular arc fluctuations.Open Acces