252 research outputs found
A New Preconditioning Approachfor an Interior Point–Proximal Method of Multipliers for Linear and Convex Quadratic Programming
In this paper, we address the efficient numerical solution of linear and
quadratic programming problems, often of large scale. With this aim, we devise
an infeasible interior point method, blended with the proximal method of
multipliers, which in turn results in a primal-dual regularized interior point
method. Application of this method gives rise to a sequence of increasingly
ill-conditioned linear systems which cannot always be solved by factorization
methods, due to memory and CPU time restrictions. We propose a novel
preconditioning strategy which is based on a suitable sparsification of the
normal equations matrix in the linear case, and also constitutes the foundation
of a block-diagonal preconditioner to accelerate MINRES for linear systems
arising from the solution of general quadratic programming problems. Numerical
results for a range of test problems demonstrate the robustness of the proposed
preconditioning strategy, together with its ability to solve linear systems of
very large dimension
A new stopping criterion for Krylov solvers applied in Interior Point Methods
A surprising result is presented in this paper with possible far reaching
consequences for any optimization technique which relies on Krylov subspace
methods employed to solve the underlying linear equation systems. In this paper
the advantages of the new technique are illustrated in the context of Interior
Point Methods (IPMs). When an iterative method is applied to solve the linear
equation system in IPMs, the attention is usually placed on accelerating their
convergence by designing appropriate preconditioners, but the linear solver is
applied as a black box solver with a standard termination criterion which asks
for a sufficient reduction of the residual in the linear system. Such an
approach often leads to an unnecessary 'oversolving' of linear equations. In
this paper a new specialized termination criterion for Krylov methods used in
IPMs is designed. It is derived from a deep understanding of IPM needs and is
demonstrated to preserve the polynomial worst-case complexity of these methods.
The new criterion has been adapted to the Conjugate Gradient (CG) and to the
Minimum Residual method (MINRES) applied in the IPM context. The new criterion
has been tested on a set of linear and quadratic optimization problems
including compressed sensing, image processing and instances with partial
differential equation constraints. Evidence gathered from these computational
experiments shows that the new technique delivers significant improvements in
terms of inner (linear) iterations and those translate into significant savings
of the IPM solution time
A scalable elliptic solver with task-based parallelism for the SpECTRE numerical relativity code
Elliptic partial differential equations must be solved numerically for many
problems in numerical relativity, such as initial data for every simulation of
merging black holes and neutron stars. Existing elliptic solvers can take
multiple days to solve these problems at high resolution and when matter is
involved, because they are either hard to parallelize or require a large amount
of computational resources. Here we present a new solver for linear and
non-linear elliptic problems that is designed to scale with resolution and to
parallelize on computing clusters. To achieve this we employ a discontinuous
Galerkin discretization, an iterative multigrid-Schwarz preconditioned
Newton-Krylov algorithm, and a task-based parallelism paradigm. To accelerate
convergence of the elliptic solver we have developed novel
subdomain-preconditioning techniques. We find that our multigrid-Schwarz
preconditioned elliptic solves achieve iteration counts that are independent of
resolution, and our task-based parallel programs scale over 200 million degrees
of freedom to at least a few thousand cores. Our new code solves a classic
black-hole binary initial-data problem faster than the spectral code SpEC when
distributed to only eight cores, and in a fraction of the time on more cores.
It is publicly accessible in the next-generation SpECTRE numerical relativity
code. Our results pave the way for highly-parallel elliptic solves in numerical
relativity and beyond.Comment: 24 pages, 18 figures. Results are reproducible with the ancillary
input file
Advances in Interior Point Methods for Large-Scale Linear Programming
This research studies two computational techniques that improve the practical performance of existing implementations of interior point methods for linear
programming. Both are based on the concept of symmetric neighbourhood as the
driving tool for the analysis of the good performance of some practical algorithms.
The symmetric neighbourhood adds explicit upper bounds on the complementarity pairs, besides the lower bound already present in the common N−1 neighbourhood. This allows the algorithm to keep under control the spread among
complementarity pairs and reduce it with the barrier parameter μ. We show that
a long-step feasible algorithm based on this neighbourhood is globally convergent
and converges in O(nL) iterations.
The use of the symmetric neighbourhood and the recent theoretical under-
standing of the behaviour of Mehrotra’s corrector direction motivate the introduction of a weighting mechanism that can be applied to any corrector direction,
whether originating from Mehrotra’s predictor–corrector algorithm or as part of
the multiple centrality correctors technique. Such modification in the way a correction is applied aims to ensure that any computed search direction can positively
contribute to a successful iteration by increasing the overall stepsize, thus avoid-
ing the case that a corrector is rejected. The usefulness of the weighting strategy is
documented through complete numerical experiments on various sets of publicly
available test problems. The implementation within the hopdm interior point
code shows remarkable time savings for large-scale linear programming problems.
The second technique develops an efficient way of constructing a starting point
for structured large-scale stochastic linear programs. We generate a computation-
ally viable warm-start point by solving to low accuracy a stochastic problem of
much smaller dimension. The reduced problem is the deterministic equivalent
program corresponding to an event tree composed of a restricted number of scenarios. The solution to the reduced problem is then expanded to the size of the
problem instance, and used to initialise the interior point algorithm. We present
theoretical conditions that the warm-start iterate has to satisfy in order to be
successful. We implemented this technique in both the hopdm and the oops
frameworks, and its performance is verified through a series of tests on problem
instances coming from various stochastic programming sources
Interior-point methods for PDE-constrained optimization
In applied sciences PDEs model an extensive variety of phenomena. Typically the final goal of simulations is a system which is optimal in a certain sense. For instance optimal control problems identify a control to steer a system towards a desired state. Inverse problems seek PDE parameters which are most consistent with measurements. In these optimization problems PDEs appear as equality constraints. PDE-constrained optimization problems are large-scale and often nonconvex. Their numerical solution leads to large ill-conditioned linear systems. In many practical problems inequality constraints implement technical limitations or prior knowledge.
In this thesis interior-point (IP) methods are considered to solve nonconvex large-scale PDE-constrained optimization problems with inequality constraints. To cope with enormous fill-in of direct linear solvers, inexact search directions are allowed in an inexact interior-point (IIP) method. This thesis builds upon the IIP method proposed in [Curtis, Schenk, Wächter, SIAM Journal on Scientific Computing, 2010]. SMART tests cope with the lack of inertia information to control Hessian modification and also specify termination tests for the iterative linear solver.
The original IIP method needs to solve two sparse large-scale linear systems in each optimization step. This is improved to only a single linear system solution in most optimization steps. Within this improved IIP framework, two iterative linear solvers are evaluated: A general purpose algebraic multilevel incomplete L D L^T preconditioned SQMR method is applied to PDE-constrained optimization problems for optimal server room cooling in three space dimensions and to compute an ambient temperature for optimal cooling. The results show robustness and efficiency of the IIP method when compared with the exact IP method.
These advantages are even more evident for a reduced-space preconditioned (RSP) GMRES solver which takes advantage of the linear system's structure. This RSP-IIP method is studied on the basis of distributed and boundary control problems originating from superconductivity and from two-dimensional and three-dimensional parameter estimation problems in groundwater modeling. The numerical results exhibit the improved efficiency especially for multiple PDE constraints.
An inverse medium problem for the Helmholtz equation with pointwise box constraints is solved by IP methods. The ill-posedness of the problem is explored numerically and different regularization strategies are compared. The impact of box constraints and the importance of Hessian modification on the optimization algorithm is demonstrated. A real world seismic imaging problem is solved successfully by the RSP-IIP method
Preconditioners for computing multiple solutions in three-dimensional fluid topology optimization
Topology optimization problems generally support multiple local minima, and
real-world applications are typically three-dimensional. In previous work [I.
P. A. Papadopoulos, P. E. Farrell, and T. M. Surowiec, Computing multiple
solutions of topology optimization problems, SIAM Journal on Scientific
Computing, (2021)], the authors developed the deflated barrier method, an
algorithm that can systematically compute multiple solutions of topology
optimization problems. In this work we develop preconditioners for the linear
systems arising in the application of this method to Stokes flow, making it
practical for use in three dimensions. In particular, we develop a nested block
preconditioning approach which reduces the linear systems to solving two
symmetric positive-definite matrices and an augmented momentum block. An
augmented Lagrangian term is used to control the innermost Schur complement and
we apply a geometric multigrid method with a kernel-capturing relaxation method
for the augmented momentum block. We present multiple solutions in
three-dimensional examples computed using the proposed iterative solver
- …