207 research outputs found
A Fast Algorithm for Parabolic PDE-based Inverse Problems Based on Laplace Transforms and Flexible Krylov Solvers
We consider the problem of estimating parameters in large-scale weakly
nonlinear inverse problems for which the underlying governing equations is a
linear, time-dependent, parabolic partial differential equation. A major
challenge in solving these inverse problems using Newton-type methods is the
computational cost associated with solving the forward problem and with
repeated construction of the Jacobian, which represents the sensitivity of the
measurements to the unknown parameters. Forming the Jacobian can be
prohibitively expensive because it requires repeated solutions of the forward
and adjoint time-dependent parabolic partial differential equations
corresponding to multiple sources and receivers. We propose an efficient method
based on a Laplace transform-based exponential time integrator combined with a
flexible Krylov subspace approach to solve the resulting shifted systems of
equations efficiently. Our proposed solver speeds up the computation of the
forward and adjoint problems, thus yielding significant speedup in total
inversion time. We consider an application from Transient Hydraulic Tomography
(THT), which is an imaging technique to estimate hydraulic parameters related
to the subsurface from pressure measurements obtained by a series of pumping
tests. The algorithms discussed are applied to a synthetic example taken from
THT to demonstrate the resulting computational gains of this proposed method
Recycling BiCGSTAB with an Application to Parametric Model Order Reduction
Krylov subspace recycling is a process for accelerating the convergence of
sequences of linear systems. Based on this technique, the recycling BiCG
algorithm has been developed recently. Here, we now generalize and extend this
recycling theory to BiCGSTAB. Recycling BiCG focuses on efficiently solving
sequences of dual linear systems, while the focus here is on efficiently
solving sequences of single linear systems (assuming non-symmetric matrices for
both recycling BiCG and recycling BiCGSTAB).
As compared with other methods for solving sequences of single linear systems
with non-symmetric matrices (e.g., recycling variants of GMRES), BiCG based
recycling algorithms, like recycling BiCGSTAB, have the advantage that they
involve a short-term recurrence, and hence, do not suffer from storage issues
and are also cheaper with respect to the orthogonalizations.
We modify the BiCGSTAB algorithm to use a recycle space, which is built from
left and right approximate invariant subspaces. Using our algorithm for a
parametric model order reduction example gives good results. We show about 40%
savings in the number of matrix-vector products and about 35% savings in
runtime.Comment: 18 pages, 5 figures, Extended version of Max Planck Institute report
(MPIMD/13-21
Subspace Recycling for Sequences of Shifted Systems with Applications in Image Recovery
For many applications involving a sequence of linear systems with slowly
changing system matrices, subspace recycling, which exploits relationships
among systems and reuses search space information, can achieve huge gains in
iterations across the total number of linear system solves in the sequence.
However, for general (i.e., non-identity) shifted systems with the shift value
varying over a wide range, the properties of the linear systems vary widely as
well, which makes recycling less effective. If such a sequence of systems is
embedded in a nonlinear iteration, the problem is compounded, and special
approaches are needed to use recycling effectively.
In this paper, we develop new, more efficient, Krylov subspace recycling
approaches for large-scale image reconstruction and restoration techniques that
employ a nonlinear iteration to compute a suitable regularization matrix. For
each new regularization matrix, we need to solve regularized linear systems,
, for a sequence of regularization parameters,
, to find the optimally regularized solution that, in turn, will
be used to update the regularization matrix.
In this paper, we analyze system and solution characteristics to choose
appropriate techniques to solve each system rapidly. Specifically, we use an
inner-outer recycling approach with a larger, principal recycle space for each
nonlinear step and smaller recycle spaces for each shift. We propose an
efficient way to obtain good initial guesses from the principle recycle space
and smaller shift-specific recycle spaces that lead to fast convergence. Our
method is substantially reduces the total number of matrix-vector products that
would arise in a naive approach. Our approach is more generally applicable to
sequences of shifted systems where the matrices in the sum are positive
semi-definite
- …