Fast numerical methods for mixed--integer nonlinear model--predictive control

This thesis aims at the investigation and development of fast numerical methods for nonlinear mixed--integer optimal control and model- predictive control problems. A new algorithm is developed based on the direct multiple shooting method for optimal control and on the idea of real--time iterations, and using a convex reformulation and relaxation of dynamics and constraints of the original predictive control problem. This algorithm relies on theoretical results and is based on a nonconvex SQP method and a new active set method for nonconvex parametric quadratic programming. It achieves real--time capable control feedback though block structured linear algebra for which we develop new matrix updates techniques. The applicability of the developed methods is demonstrated on several applications. This thesis presents novel results and advances over previously established techniques in a number of areas as follows: We develop a new algorithm for mixed--integer nonlinear model- predictive control by combining Bock's direct multiple shooting method, a reformulation based on outer convexification and relaxation of the integer controls, on rounding schemes, and on a real--time iteration scheme. For this new algorithm we establish an interpretation in the framework of inexact Newton-type methods and give a proof of local contractivity assuming an upper bound on the sampling time, implying nominal stability of this new algorithm. We propose a convexification of path constraints directly depending on integer controls that guarantees feasibility after rounding, and investigate the properties of the obtained nonlinear programs. We show that these programs can be treated favorably as MPVCs, a young and challenging class of nonconvex problems. We describe a SQP method and develop a new parametric active set method for the arising nonconvex quadratic subproblems. This method is based on strong stationarity conditions for MPVCs under certain regularity assumptions. We further present a heuristic for improving stationary points of the nonconvex quadratic subproblems to global optimality. The mixed--integer control feedback delay is determined by the computational demand of our active set method. We describe a block structured factorization that is tailored to Bock's direct multiple shooting method. It has favorable run time complexity for problems with long horizons or many controls unknowns, as is the case for mixed- integer optimal control problems after outer convexification. We develop new matrix update techniques for this factorization that reduce the run time complexity of all but the first active set iteration by one order. All developed algorithms are implemented in a software package that allows for the generic, efficient solution of nonlinear mixed-integer optimal control and model-predictive control problems using the developed methods

Convergence of Successive Linear Programming Algorithms for Noisy Functions

Gradient-based methods have been highly successful for solving a variety of both unconstrained and constrained nonlinear optimization problems. In real-world applications, such as optimal control or machine learning, the necessary function and derivative information may be corrupted by noise, however. Sun and Nocedal have recently proposed a remedy for smooth unconstrained problems by means of a stabilization of the acceptance criterion for computed iterates, which leads to convergence of the iterates of a trust-region method to a region of criticality, Sun and Nocedal (2022). We extend their analysis to the successive linear programming algorithm, Byrd et al. (2023a,2023b), for unconstrained optimization problems with objectives that can be characterized as the composition of a polyhedral function with a smooth function, where the latter and its gradient may be corrupted by noise. This gives the flexibility to cover, for example, (sub)problems arising image reconstruction or constrained optimization algorithms. We provide computational examples that illustrate the findings and point to possible strategies for practical determination of the stabilization parameter that balances the size of the critical region with a relaxation of the acceptance criterion (or descent property) of the algorithm

Relations between Abs-Normal NLPs and MPCCs. Part 1: Strong Constraint Qualifications

This work is part of an ongoing effort of comparing non-smooth optimization problems in abs-normal form to MPCCs. We study the general abs-normal NLP with equality and inequality constraints in relation to an equivalent MPCC reformulation. We show that kink qualifications and MPCC constraint qualifications of linear independence type and Mangasarian-Fromovitz type are equivalent. Then we consider strong stationarity concepts with first and second order optimality conditions, which again turn out to be equivalent for the two problem classes. Throughout we also consider specific slack reformulations suggested in [9], which preserve constraint qualifications of linear independence type but not of Mangasarian-Fromovitz type

Relations between Abs-Normal NLPs and MPCCs. Part 2: Weak Constraint Qualifications

This work continues an ongoing effort to compare non-smooth optimization problems in abs-normal form to Mathematical Programs with Complementarity Constraints (MPCCs). We study general Nonlinear Programs with equality and inequality constraints in abs-normal form, so-called Abs-Normal NLPs, and their relation to equivalent MPCC reformulations. We introduce the concepts of Abadie's and Guignard's kink qualification and prove relations to MPCC-ACQ and MPCC-GCQ for the counterpart MPCC formulations. Due to non-uniqueness of a specific slack reformulation suggested in [10], the relations are non-trivial. It turns out that constraint qualifications of Abadie type are preserved. We also prove the weaker result that equivalence of Guginard's (and Abadie's) constraint qualifications for all branch problems hold, while the question of GCQ preservation remains open. Finally, we introduce M-stationarity and B-stationarity concepts for abs-normal NLPs and prove first order optimality conditions corresponding to MPCC counterpart formulations

Molecular profiling of pediatric meningiomas shows tumor characteristics distinct from adult meningiomas

In contrast to adults, meningiomas are uncommon tumors in childhood and adolescence. Whether adult and pediatric meningiomas differ on a molecular level is unclear. Here we report detailed genomic analyses of 37 pediatric meningiomas by sequencing and DNA methylation profiling. Histologically, the series was dominated by meningioma subtypes with aggressive behavior, with 70% of patients suffering from WHO grade II or III meningiomas. The most frequent cytogenetic aberrations were loss of chromosomes 22 (23/37 [62%]), 1 (9/37 [24%]), 18 (7/37 [19%]), and 14 (5/37 [14%]). Tumors with NF2 alterations exhibited overall increased chromosomal instability. Unsupervised clustering of DNA methylation profiles revealed separation into three groups: designated group 1 composed of clear cell and papillary meningiomas, whereas group 2A comprised predominantly atypical meningiomas and group 2B enriched for rare high-grade subtypes (rhabdoid, chordoid). Meningiomas from NF2 patients clustered exclusively within groups 1 and 2A. When compared with a dataset of 105 adult meningiomas, the pediatric meningiomas largely grouped separately. Targeted panel DNA sequencing of 34 tumors revealed frequent NF2 alterations, while other typical alterations found in adult non-NF2 tumors were absent. These data demonstrate that pediatric meningiomas are characterized by molecular features distinct from adult tumors

Improved regularity assumptions for partial outer convexification of mixed-integer PDE-constrained optimization problems

Partial outer convexification is a relaxation technique for MIOCPs being constrained by time-dependent differential equations. Sum-Up-Rounding algorithms allow to approximate feasible points of the relaxed, convexified continuous problem with binary ones that are feasible up to an arbitrarily small δ > 0. We show that this approximation property holds for ODEs and semilinear PDEs under mild regularity assumptions on the nonlinearity and the solution trajectory of the PDE. In particular, requirements of differentiability and uniformly bounded derivatives on the involved functions from previous work are not necessary to show convergence of the method