2,083 research outputs found
Projected Newton Method for noise constrained Tikhonov regularization
Tikhonov regularization is a popular approach to obtain a meaningful solution
for ill-conditioned linear least squares problems. A relatively simple way of
choosing a good regularization parameter is given by Morozov's discrepancy
principle. However, most approaches require the solution of the Tikhonov
problem for many different values of the regularization parameter, which is
computationally demanding for large scale problems. We propose a new and
efficient algorithm which simultaneously solves the Tikhonov problem and finds
the corresponding regularization parameter such that the discrepancy principle
is satisfied. We achieve this by formulating the problem as a nonlinear system
of equations and solving this system using a line search method. We obtain a
good search direction by projecting the problem onto a low dimensional Krylov
subspace and computing the Newton direction for the projected problem. This
projected Newton direction, which is significantly less computationally
expensive to calculate than the true Newton direction, is then combined with a
backtracking line search to obtain a globally convergent algorithm, which we
refer to as the Projected Newton method. We prove convergence of the algorithm
and illustrate the improved performance over current state-of-the-art solvers
with some numerical experiments
Regularization matrices determined by matrix nearness problems
This paper is concerned with the solution of large-scale linear discrete
ill-posed problems with error-contaminated data. Tikhonov regularization is a
popular approach to determine meaningful approximate solutions of such
problems. The choice of regularization matrix in Tikhonov regularization may
significantly affect the quality of the computed approximate solution. This
matrix should be chosen to promote the recovery of known important features of
the desired solution, such as smoothness and monotonicity. We describe a novel
approach to determine regularization matrices with desired properties by
solving a matrix nearness problem. The constructed regularization matrix is the
closest matrix in the Frobenius norm with a prescribed null space to a given
matrix. Numerical examples illustrate the performance of the regularization
matrices so obtained
Regularization matrices for discrete ill-posed problems in several space-dimensions
Many applications in science and engineering require the solution of large linear discrete ill-posed problems that are obtained by the discretization of a Fredholm integral equation of the first kind in several space dimensions. The matrix that defines these problems is very ill conditioned and generally numerically singular, and the right-hand side, which represents measured data, is typically contaminated by measurement error. Straightforward solution of these problems is generally not meaningful due to severe error propagation. Tikhonov regularization seeks to alleviate this difficulty by replacing the given linear discrete ill-posed problem by a penalized least-squares problem, whose solution is less sensitive to the error in the right-hand side and to roundoff errors introduced during the computations. This paper discusses the construction of penalty terms that are determined by solving a matrix nearness problem. These penalty terms allow partial transformation to standard form of Tikhonov regularization problems that stem from the discretization of integral equations on a cube in several space dimensions
Embedded techniques for choosing the parameter in Tikhonov regularization
This paper introduces a new strategy for setting the regularization parameter
when solving large-scale discrete ill-posed linear problems by means of the
Arnoldi-Tikhonov method. This new rule is essentially based on the discrepancy
principle, although no initial knowledge of the norm of the error that affects
the right-hand side is assumed; an increasingly more accurate approximation of
this quantity is recovered during the Arnoldi algorithm. Some theoretical
estimates are derived in order to motivate our approach. Many numerical
experiments, performed on classical test problems as well as image deblurring
are presented
- …