Fast positive-real balanced truncation via quadratic alternating direction implicit iteration

Balanced truncation (BT), as applied to date in model order reduction (MOR), is known for its superior accuracy and computable error bounds. Positive-real BT (PRBT) is a particular BT procedure that preserves passivity and stability and imposes no structural constraints on the original state space. However, PRBT requires solving two algebraic Riccati equations (AREs), whose computational complexity limits its practical use in large-scale systems. This paper introduces a novel quadratic extension of the alternating direction implicit (ADI) iteration, which is called quadratic ADI (QADI), that efficiently solves an ARE. A Cholesky factor version of QADI, which is called CEQADI, exploits low-rank matrices and further accelerates PRBT. © 2007 IEEE.published_or_final_versio

Efficient positive-real balanced truncation of symmetric systems via cross-riccati equations

We present a highly efficient approach for realizing a positive-real balanced truncation (PRBT) of symmetric systems. The solution of a pair of dual algebraic Riccati equations in conventional PRBT, whose cost constrains practical large-scale deployment, is reduced to the solution of one cross-Riccati equation (XRE). The cross-Riccatian nature of the solution then allows a simple construction of PRBT projection matrices, using a Schur decomposition, without actual balancing. An invariant subspace method and a modified quadratic alternating-direction-implicit iteration scheme are proposed to efficiently solve the XRE. A low-rank variant of the latter is shown to offer a remarkably fast PRBT speed over the conventional implementations. The XRE-based framework can be applied to a large class of linear passive networks, and its effectiveness is demonstrated through numerical examples. © 2008 IEEE.published_or_final_versio

Quadratic alternating direction implicit iteration for the fast solution of algebraic Riccati equations

Algebraic Riccati equations (AREs) spread over many branches of signal processing and system design problems. Solution of large scale AREs, however, can be computationally prohibitive. This paper introduces a novel second order extension to the alternating direction implicit (ADI) iteration, called quadratic ADI or QADI, for the efficient solution of an ARE. QADI is simple to code and exhibits fast convergence. A Cholesky factor variant of QADI, called CFQADI, further accelerates computation by exploiting low rank matrices commonly found in physical system modeling. Application examples show remarkable efficiency and scalability of the QADI algorithms over conventional ARE solvers. © 2005 IEEE.published_or_final_versio

Efficient Numerical Solution of Large Scale Algebraic Matrix Equations in PDE Control and Model Order Reduction

Matrix Lyapunov and Riccati equations are an important tool in mathematical systems theory. They are the key ingredients in balancing based model order reduction techniques and linear quadratic regulator problems. For small and moderately sized problems these equations are solved by techniques with at least cubic complexity which prohibits their usage in large scale applications. Around the year 2000 solvers for large scale problems have been introduced. The basic idea there is to compute a low rank decomposition of the quadratic and dense solution matrix and in turn reduce the memory and computational complexity of the algorithms. In this thesis efficiency enhancing techniques for the low rank alternating directions implicit iteration based solution of large scale matrix equations are introduced and discussed. Also the applicability in the context of real world systems is demonstrated. The thesis is structured in seven central chapters. After the introduction chapter 2 introduces the basic concepts and notations needed as fundamental tools for the remainder of the thesis. The next chapter then introduces a collection of test examples spanning from easily scalable academic test systems to badly conditioned technical applications which are used to demonstrate the features of the solvers. Chapter four and five describe the basic solvers and the modifications taken to make them applicable to an even larger class of problems. The following two chapters treat the application of the solvers in the context of model order reduction and linear quadratic optimal control of PDEs. The final chapter then presents the extensive numerical testing undertaken with the solvers proposed in the prior chapters. Some conclusions and an appendix complete the thesis

A numerical comparison of solvers for large-scale, continuous-time algebraic Riccati equations and LQR problems

In this paper, we discuss numerical methods for solving large-scale continuous-time algebraic Riccati equations. These methods have been the focus of intensive research in recent years, and significant progress has been made in both the theoretical understanding and efficient implementation of various competing algorithms. There are several goals of this manuscript: first, to gather in one place an overview of different approaches for solving large-scale Riccati equations, and to point to the recent advances in each of them. Second, to analyze and compare the main computational ingredients of these algorithms, to detect their strong points and their potential bottlenecks. And finally, to compare the effective implementations of all methods on a set of relevant benchmark examples, giving an indication of their relative performance

System- and Data-Driven Methods and Algorithms

An increasing complexity of models used to predict real-world systems leads to the need for algorithms to replace complex models with far simpler ones, while preserving the accuracy of the predictions. This two-volume handbook covers methods as well as applications. This first volume focuses on real-time control theory, data assimilation, real-time visualization, high-dimensional state spaces and interaction of different reduction techniques

Scaling Algorithms for Unbalanced Transport Problems

This article introduces a new class of fast algorithms to approximate variational problems involving unbalanced optimal transport. While classical optimal transport considers only normalized probability distributions, it is important for many applications to be able to compute some sort of relaxed transportation between arbitrary positive measures. A generic class of such "unbalanced" optimal transport problems has been recently proposed by several authors. In this paper, we show how to extend the, now classical, entropic regularization scheme to these unbalanced problems. This gives rise to fast, highly parallelizable algorithms that operate by performing only diagonal scaling (i.e. pointwise multiplications) of the transportation couplings. They are generalizations of the celebrated Sinkhorn algorithm. We show how these methods can be used to solve unbalanced transport, unbalanced gradient flows, and to compute unbalanced barycenters. We showcase applications to 2-D shape modification, color transfer, and growth models

Control and Estimation Oriented Model Order Reduction for Linear and Nonlinear Systems

Optimization based controls are advantageous in meeting stringent performance requirements and accommodating constraints. Although computers are becoming more powerful, solving optimization problems in real-time remains an obstacle because of associated computational complexity. Research efforts to address real-time optimization with limited computational power have intensified over the last decade, and one direction that has shown some success is model order reduction. This dissertation contains a collection of results relating to open- and closed-loop reduction techniques for large scale unconstrained linear descriptor systems, constrained linear systems, and nonlinear systems. For unconstrained linear descriptor systems, this dissertation develops novel gramian and Riccati solution approximation techniques. The gramian approximation is used for an open-loop reduction technique following that of balanced truncation proposed by (Moore, 1981) for ordinary linear systems and (Stykel, 2004) for linear descriptor systems. The Riccati solution is used to generalize the Linear Quadratic Gaussian balanced truncation (LQGBT) of (Verriest, 1981) and (Jonckheere and Silverman, 1983). These are applied to an electric machine model to reduce the number of states from $>$100000 to 8 while improving accuracy over the state-of-the-art modal truncation of (Zhou, 2015) for the purpose of condition monitoring. Furthermore, a link between unconstrained model predictive control (MPC) with a terminal penalty and LQG of a linear system is noted, suggesting an LQGBT reduced model as a natural model for reduced MPC design. The efficacy of such a reduced controller is demonstrated by the real-time control of a diesel airpath. Model reduction generally introduces modeling errors, and controlling a constrained plant subject to modeling errors falls squarely into robust control. A standard assumption of robust control is that inputs/states/outputs are constrained by convex sets, and these sets are ``tightened'' for robust constraint satisfaction. However, robust control is often overly conservative, and resulting control strategies cannot take advantage of the true admissible sets. A new reduction problem is proposed that considers the reduced order model accuracy and constraint conservativeness. A constant tube methodology for reduced order constrained MPC is presented, and the proposed reduced order model is found to decrease the constraint conservativeness of the reduced order MPC law compared to reduced order models obtained by gramian and LQG reductions. For nonlinear systems, a reformulation of the empirical gramians of (Lall et al., 1999) and (Hahn et al., 2003) into simpler, yet more general forms is provided. The modified definitions are used in the balanced truncation of a nonlinear diesel airpath model, and the reduced order model is used to design a reduced MPC law for tracking control. Further exploiting the link between the gramian and Riccati solution for linear systems, the new empirical gramian formulation is extended to obtain empirical Riccati covariance matrices used for closed-loop model order reduction of a nonlinear system. Balanced truncation using the empirical Riccati covariance matrices is demonstrated to result in a closer-to-optimal nonlinear compensator than the previous balanced truncation techniques discussed in the dissertation.PHDNaval Architecture & Marine EngineeringUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttps://deepblue.lib.umich.edu/bitstream/2027.42/140839/1/riboch_1.pd