Interior-point solver for convex separable block-angular problems

Constraints matrices with block-angular structures are pervasive in Optimization. Interior-point methods have shown to be competitive for these structured problems by exploiting the linear algebra. One of these approaches solved the normal equations using sparse Cholesky factorizations for the block constraints, and a preconditioned conjugate gradient (PCG) for the linking constraints. The preconditioner is based on a power series expansion which approximates the inverse of the matrix of the linking constraints system. In this work we present an efficient solver based on this algorithm. Some of its features are: it solves linearly constrained convex separable problems (linear, quadratic or nonlinear); both Newton and second-order predictor-corrector directions can be used, either with the Cholesky+PCG scheme or with a Cholesky factorization of normal equations; the preconditioner may include any number of terms of the power series; for any number of these terms, it estimates the spectral radius of the matrix in the power series (which is instrumental for the quality of the precondi- tioner). The solver has been hooked to SML, a structure-conveying modelling language based on the popular AMPL modeling language. Computational results are reported for some large and/or difficult instances in the literature: (1) multicommodity flow problems; (2) minimum congestion problems; (3) statistical data protection problems using l1 and l2 distances (which are linear and quadratic problems, respectively), and the pseudo-Huber function, a nonlinear approximation to l1 which improves the preconditioner. In the largest instances, of up to 25 millions of variables and 300000 constraints, this approach is from two to three orders of magnitude faster than state-of-the-art linear and quadratic optimization solvers.Preprin

Improving an interior-point algorithm for multicommodity flows by quadratic regularizations

One of the best approaches for some classes of multicommodity flow problems is a specialized interior-point method that solves the normal equations by a combination of Cholesky factorizations and preconditioned conjugate gradient. Its efficiency depends on the spectral radius—in [0,1)—of a certain matrix in the definition of the preconditioner. In a recent work the authors improved this algorithm (i.e., reduced the spectral radius) for general block-angular problems by adding a quadratic regularization to the logarithmic barrier. This barrier was shown to be self-concordant, which guarantees the convergence and polynomial complexity of the algorithm. In this work we focus on linear multicommodity problems, a particular case of primal block-angular ones. General results are tailored for multicommodity flows, allowing a local sensitivity analysis on the effect of the regularization. Extensive computational results on some standard and some difficult instances, testing several regularization strategies, are also provided. These results show that the regularized interior-point algorithm is more efficient than the nonregularized one. From this work it can be concluded that, if interior-point methods based on conjugate gradients are used, linear multicommodity flow problems are most efficiently solved as a sequence of quadratic ones.Preprin

Quadratic regularizations in an interior-point method for primal block-angular problems

One of the most efficient interior-point methods for some classes of primal block-angular problems solves the normal equations by a combination of Cholesky factorizations and preconditioned conjugate gradient for, respectively, the block and linking constraints. Its efficiency depends on the spectral radius—in [0,1)— of a certain matrix in the definition of the preconditioner. Spectral radius close to 1 degrade the performance of the approach. The purpose of this work is twofold. First, to show that a separable quadratic regularization term in the objective reduces the spectral radius, significantly improving the overall performance in some classes of instances. Second, to consider a regularization term which decreases with the barrier function, thus with no need for an extra parameter. Computational experience with some primal block-angular problems confirms the efficiency of the regularized approach. In particular, for some difficult problems, the solution time is reduced by a factor of two to ten by the regularization term, outperforming state-of-the-art commercial solvers.Peer ReviewedPostprint (author’s final draft

Relaxation method for large scale linear programming using decomposition

Cover title. "This paper is based in part on the technical report [17]."Includes bibliographical references.Supported by the National Science Foundation. NSF-ECS-8519058 Supported by the Army Research Office. DAAL03-86-K-0171by Paul Tseng

Lagrangian-based methods for single and multi-layer multicommodity capacitated network design

Le problème de conception de réseau avec coûts fixes et capacités (MCFND) et le problème de conception de réseau multicouches (MLND) sont parmi les problèmes de conception de réseau les plus importants. Dans le problème MCFND monocouche, plusieurs produits doivent être acheminés entre des paires origine-destination différentes d’un réseau potentiel donné. Des liaisons doivent être ouvertes pour acheminer les produits, chaque liaison ayant une capacité donnée. Le problème est de trouver la conception du réseau à coût minimum de sorte que les demandes soient satisfaites et que les capacités soient respectées. Dans le problème MLND, il existe plusieurs réseaux potentiels, chacun correspondant à une couche donnée. Dans chaque couche, les demandes pour un ensemble de produits doivent être satisfaites. Pour ouvrir un lien dans une couche particulière, une chaîne de liens de support dans une autre couche doit être ouverte. Nous abordons le problème de conception de réseau multiproduits multicouches à flot unique avec coûts fixes et capacités (MSMCFND), où les produits doivent être acheminés uniquement dans l’une des couches. Les algorithmes basés sur la relaxation lagrangienne sont l’une des méthodes de résolution les plus efficaces pour résoudre les problèmes de conception de réseau. Nous présentons de nouvelles relaxations à base de noeuds, où le sous-problème résultant se décompose par noeud. Nous montrons que la décomposition lagrangienne améliore significativement les limites des relaxations traditionnelles. Les problèmes de conception du réseau ont été étudiés dans la littérature. Cependant, ces dernières années, des applications intéressantes des problèmes MLND sont apparues, qui ne sont pas couvertes dans ces études. Nous présentons un examen des problèmes de MLND et proposons une formulation générale pour le MLND. Nous proposons également une formulation générale et une méthodologie de relaxation lagrangienne efficace pour le problème MMCFND. La méthode est compétitive avec un logiciel commercial de programmation en nombres entiers, et donne généralement de meilleurs résultats.The multicommodity capacitated fixed-charge network design problem (MCFND) and the multilayer network design problem (MLND) are among the most important network design problems. In the single-layer MCFND problem, several commodities have to be routed between different origin-destination pairs of a given potential network. Appropriate capacitated links have to be opened to route the commodities. The problem is to find the minimum cost design and routing such that the demands are satisfied and the capacities are respected. In the MLND, there are several potential networks, each at a given layer. In each network, the flow requirements for a set of commodities must be satisfied. However, the selection of the links is interdependent. To open a link in a particular layer, a chain of supporting links in another layer has to be opened. We address the multilayer single flow-type multicommodity capacitated fixed-charge network design problem (MSMCFND), where commodities are routed only in one of the layers. Lagrangian-based algorithms are one of the most effective solution methods to solve network design problems. The traditional Lagrangian relaxations for the MCFND problem are the flow and knapsack relaxations, where the resulting Lagrangian subproblems decompose by commodity and by arc, respectively. We present new node-based relaxations, where the resulting subproblem decomposes by node. We show that the Lagrangian dual bound improves significantly upon the bounds of the traditional relaxations. We also propose a Lagrangian-based algorithm to obtain upper bounds. Network design problems have been the object of extensive literature reviews. However, in recent years, interesting applications of multilayer problems have appeared that are not covered in these surveys. We present a review of multilayer problems and propose a general formulation for the MLND. We also propose a general formulation and an efficient Lagrangian-based solution methodology for the MMCFND problem. The method is competitive with (and often significantly better than) a state-of-the-art mixedinteger programming solver on a large set of randomly generated instances

On geometrical properties of preconditioners in IPMs for classes of block-angular problems

J. Castro, S. Nasini, On geometrical properties of preconditioners in IPMs for classes of block-angular problems, Research Report DR 2016/03, Dept. of Statistics and Operations Research, Universitat Politècnica de Catalunya, 2016.One of the most efficient interior-point methods for some classes of block-angular structured problems solves the normal equations by a combination of Cholesky factorizations and preconditioned conjugate gradient for, respectively, the block and linking constraints. In this work we show that the choice of a good preconditioner depends on geometrical properties of the constraints structure. In particular, it is seen that the principal angles between the subspaces generated by the diagonal blocks and the linking constraints can be used to estimate ex-ante the efficiency of the preconditioner. Numerical validation is provided with some generated optimization problems. An application to the solution of multicommodity network flow problems with nodal capacities and equal flows of up to 127 million of variables and up to 7.5 million of constraints is also presentedPreprin