440 research outputs found
Solving systems of phaseless equations via Kaczmarz methods: A proof of concept study
We study the Kaczmarz methods for solving systems of quadratic equations,
i.e., the generalized phase retrieval problem. The methods extend the Kaczmarz
methods for solving systems of linear equations by integrating a phase
selection heuristic in each iteration and overall have the same per iteration
computational complexity. Extensive empirical performance comparisons establish
the computational advantages of the Kaczmarz methods over other
state-of-the-art phase retrieval algorithms both in terms of the number of
measurements needed for successful recovery and in terms of computation time.
Preliminary convergence analysis is presented for the randomized Kaczmarz
methods
An Asynchronous Parallel Randomized Kaczmarz Algorithm
We describe an asynchronous parallel variant of the randomized Kaczmarz (RK)
algorithm for solving the linear system . The analysis shows linear
convergence and indicates that nearly linear speedup can be expected if the
number of processors is bounded by a multiple of the number of rows in
Preasymptotic Convergence of Randomized Kaczmarz Method
Kaczmarz method is one popular iterative method for solving inverse problems,
especially in computed tomography. Recently, it was established that a
randomized version of the method enjoys an exponential convergence for
well-posed problems, and the convergence rate is determined by a variant of the
condition number. In this work, we analyze the preasymptotic convergence
behavior of the randomized Kaczmarz method, and show that the low-frequency
error (with respect to the right singular vectors) decays faster during first
iterations than the high-frequency error. Under the assumption that the inverse
solution is smooth (e.g., sourcewise representation), the result explains the
fast empirical convergence behavior, thereby shedding new insights into the
excellent performance of the randomized Kaczmarz method in practice. Further,
we propose a simple strategy to stabilize the asymptotic convergence of the
iteration by means of variance reduction. We provide extensive numerical
experiments to confirm the analysis and to elucidate the behavior of the
algorithms.Comment: 20 page
- …