Computational analysis of real-time convex optimization for control systems

Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Aeronautics and Astronautics, 2000.Includes bibliographical references (p. 177-189).Computational analysis is fundamental for certification of all real-time control software. Nevertheless, analysis of on-line optimization for control has received little attention to date. On-line software must pass rigorous standards in reliability, requiring that any embedded optimization algorithm possess predictable behavior and bounded run-time guarantees. This thesis examines the problem of certifying control systems which utilize real-time optimization. A general convex programming framework is used, to which primal-dual path-following algorithms are applied. The set of all optimization problem instances which may arise in an on-line procedure is characterized as a compact parametric set of convex programming problems. A method is given for checking the feasibility and well-posedness of this compact set of problems, providing certification that every problem instance has a solution and can be solved in finite time. The thesis then proposes several algorithm initialization methods, considering the fixed and time-varying constraint cases separately. Computational bounds are provided for both cases. In the event that the computational requirements cannot be met, several alternatives to on-line optimization are suggested. Of course, these alternatives must provide feasible solutions with minimal real-time computational overhead. Beyond this requirement, these methods approximate the optimal solution as well as possible. The methods explored include robust table look-up, functional approximation of the solution set, and ellipsoidal approximation of the constraint set. The final part of this thesis examines the coupled behavior of a receding horizon control scheme for constrained linear systems and real-time optimization. The driving requirement is to maintain closed-loop stability, feasibility and well-posedness of the optimal control problem, and bounded iterations for the optimization algorithm. A detailed analysis provides sufficient conditions for meeting these requirements. A realistic example of a small autonomous air vehicle is furnished, showing how a receding horizon control law using real-time optimization can be certified.by Lawrence Kent McGovern.Ph.D

Exploiting Structures in Mixed-Integer Second-Order Cone Optimization Problems for Branch-and-Conic-Cut Algorithms

This thesis studies computational approaches for mixed-integer second-order cone optimization (MISOCO) problems. MISOCO models appear in many real-world applications, so MISOCO has gained significant interest in recent years. However, despite recent advancements, there is a gap between the theoretical developments and computational practice. Three chapters of this thesis address three areas of computational methodology for an efficient branch-and-conic-cut (BCC) algorithm to solve MISOCO problems faster in practice. These chapters include a detailed discussion on practical work on adding cuts in a BCC algorithm, novel methodologies for warm-starting second-order cone optimization (SOCO) subproblems, and heuristics for MISOCO problems.The first part of this thesis concerns the development of a novel warm-starting method of interior-point methods (IPM) for SOCO problems. The method exploits the Jordan frames of an original instance and solves two auxiliary linear optimization problems. The solutions obtained from these problems are used to identify an ideal initial point of the IPM. Numerical results on public test sets indicate that the warm-start method works well in practice and reduces the number of iterations required to solve related SOCO problems by around 30-40%.The second part of this thesis presents novel heuristics for MISOCO problems. These heuristics use the Jordan frames from both continuous relaxations and penalty problems and present a way of finding feasible solutions for MISOCO problems. Numerical results on conic and quadratic test sets show significant performance in terms of finding a solution that has a small gap to optimality.The last part of this thesis presents application of disjunctive conic cuts (DCC) and disjunctive cylindrical cuts (DCyC) to asset allocation problems (AAP). To maximize the benefit from these powerful cuts, several decisions regarding the addition of these cuts are inspected in a practical setting. The analysis in this chapter gives insight about how these cuts can be added in case-specific settings

Fast numerical methods for mixed--integer nonlinear model--predictive control

This thesis aims at the investigation and development of fast numerical methods for nonlinear mixed--integer optimal control and model- predictive control problems. A new algorithm is developed based on the direct multiple shooting method for optimal control and on the idea of real--time iterations, and using a convex reformulation and relaxation of dynamics and constraints of the original predictive control problem. This algorithm relies on theoretical results and is based on a nonconvex SQP method and a new active set method for nonconvex parametric quadratic programming. It achieves real--time capable control feedback though block structured linear algebra for which we develop new matrix updates techniques. The applicability of the developed methods is demonstrated on several applications. This thesis presents novel results and advances over previously established techniques in a number of areas as follows: We develop a new algorithm for mixed--integer nonlinear model- predictive control by combining Bock's direct multiple shooting method, a reformulation based on outer convexification and relaxation of the integer controls, on rounding schemes, and on a real--time iteration scheme. For this new algorithm we establish an interpretation in the framework of inexact Newton-type methods and give a proof of local contractivity assuming an upper bound on the sampling time, implying nominal stability of this new algorithm. We propose a convexification of path constraints directly depending on integer controls that guarantees feasibility after rounding, and investigate the properties of the obtained nonlinear programs. We show that these programs can be treated favorably as MPVCs, a young and challenging class of nonconvex problems. We describe a SQP method and develop a new parametric active set method for the arising nonconvex quadratic subproblems. This method is based on strong stationarity conditions for MPVCs under certain regularity assumptions. We further present a heuristic for improving stationary points of the nonconvex quadratic subproblems to global optimality. The mixed--integer control feedback delay is determined by the computational demand of our active set method. We describe a block structured factorization that is tailored to Bock's direct multiple shooting method. It has favorable run time complexity for problems with long horizons or many controls unknowns, as is the case for mixed- integer optimal control problems after outer convexification. We develop new matrix update techniques for this factorization that reduce the run time complexity of all but the first active set iteration by one order. All developed algorithms are implemented in a software package that allows for the generic, efficient solution of nonlinear mixed-integer optimal control and model-predictive control problems using the developed methods