118,970 research outputs found
A fast semi-direct least squares algorithm for hierarchically block separable matrices
We present a fast algorithm for linear least squares problems governed by
hierarchically block separable (HBS) matrices. Such matrices are generally
dense but data-sparse and can describe many important operators including those
derived from asymptotically smooth radial kernels that are not too oscillatory.
The algorithm is based on a recursive skeletonization procedure that exposes
this sparsity and solves the dense least squares problem as a larger,
equality-constrained, sparse one. It relies on a sparse QR factorization
coupled with iterative weighted least squares methods. In essence, our scheme
consists of a direct component, comprised of matrix compression and
factorization, followed by an iterative component to enforce certain equality
constraints. At most two iterations are typically required for problems that
are not too ill-conditioned. For an HBS matrix with
having bounded off-diagonal block rank, the algorithm has optimal complexity. If the rank increases with the spatial dimension as is
common for operators that are singular at the origin, then this becomes
in 1D, in 2D, and
in 3D. We illustrate the performance of the method on
both over- and underdetermined systems in a variety of settings, with an
emphasis on radial basis function approximation and efficient updating and
downdating.Comment: 24 pages, 8 figures, 6 tables; to appear in SIAM J. Matrix Anal. App
Regularization-free estimation in trace regression with symmetric positive semidefinite matrices
Over the past few years, trace regression models have received considerable
attention in the context of matrix completion, quantum state tomography, and
compressed sensing. Estimation of the underlying matrix from
regularization-based approaches promoting low-rankedness, notably nuclear norm
regularization, have enjoyed great popularity. In the present paper, we argue
that such regularization may no longer be necessary if the underlying matrix is
symmetric positive semidefinite (\textsf{spd}) and the design satisfies certain
conditions. In this situation, simple least squares estimation subject to an
\textsf{spd} constraint may perform as well as regularization-based approaches
with a proper choice of the regularization parameter, which entails knowledge
of the noise level and/or tuning. By contrast, constrained least squares
estimation comes without any tuning parameter and may hence be preferred due to
its simplicity
Blind adaptive constrained reduced-rank parameter estimation based on constant modulus design for CDMA interference suppression
This paper proposes a multistage decomposition for blind adaptive parameter estimation in the Krylov subspace with the code-constrained constant modulus (CCM) design criterion. Based on constrained optimization of the constant modulus cost function and utilizing the Lanczos algorithm and Arnoldi-like iterations, a multistage decomposition is developed for blind parameter estimation. A family of computationally efficient blind adaptive reduced-rank stochastic gradient (SG) and recursive least squares (RLS) type algorithms along with an automatic rank selection procedure are also devised and evaluated against existing methods. An analysis of the convergence properties of the method is carried out and convergence conditions for the reduced-rank adaptive algorithms are established. Simulation results consider the application of the proposed techniques to the suppression of multiaccess and intersymbol interference in DS-CDMA systems
Combining Subgoal Graphs with Reinforcement Learning to Build a Rational Pathfinder
In this paper, we present a hierarchical path planning framework called SG-RL
(subgoal graphs-reinforcement learning), to plan rational paths for agents
maneuvering in continuous and uncertain environments. By "rational", we mean
(1) efficient path planning to eliminate first-move lags; (2) collision-free
and smooth for agents with kinematic constraints satisfied. SG-RL works in a
two-level manner. At the first level, SG-RL uses a geometric path-planning
method, i.e., Simple Subgoal Graphs (SSG), to efficiently find optimal abstract
paths, also called subgoal sequences. At the second level, SG-RL uses an RL
method, i.e., Least-Squares Policy Iteration (LSPI), to learn near-optimal
motion-planning policies which can generate kinematically feasible and
collision-free trajectories between adjacent subgoals. The first advantage of
the proposed method is that SSG can solve the limitations of sparse reward and
local minima trap for RL agents; thus, LSPI can be used to generate paths in
complex environments. The second advantage is that, when the environment
changes slightly (i.e., unexpected obstacles appearing), SG-RL does not need to
reconstruct subgoal graphs and replan subgoal sequences using SSG, since LSPI
can deal with uncertainties by exploiting its generalization ability to handle
changes in environments. Simulation experiments in representative scenarios
demonstrate that, compared with existing methods, SG-RL can work well on
large-scale maps with relatively low action-switching frequencies and shorter
path lengths, and SG-RL can deal with small changes in environments. We further
demonstrate that the design of reward functions and the types of training
environments are important factors for learning feasible policies.Comment: 20 page
Robust approaches to remote calibration of a transmitting array
We consider the problem of estimating the gains and phases of the RF channels of a M-element transmitting array, based on a calibration procedure where M orthogonal signals are sent through M orthogonal beams and received on a single antenna. The received data vector obeys a linear model of the type y ¼ AFg þ n where A is an unknown complex scalar accounting for propagation loss and g is the vector of unknown complex gains. In order to improve the performance of the least-squares (LS) estimator at low signal to noise ratio (SNR), we propose to exploit knowledge of the nominal value of g, viz g. Towards this end, two approaches are presented. First, a Bayesian approach is advocated where A and g are considered as random variables, with a non-informative prior distribution for A and a Gaussian prior distribution for g. The posterior distributions of the unknown random variables are derived and a Gibbs sampling strategy is presented that enables one to generate samples distributed according to these posterior distributions, leading to the minimum mean-square error (MMSE) estimator. A second approach consists in solving a constrained least-squares problem in which h ¼ Ag is constrained to be close to a scaled version of g. This second approach yields a closed-form solution, which amounts to a linear combination of g and the LS estimator. Numerical simulations show that the two new estimators significantly outperform the conventional LS estimator, especially at low SNR
Least Squares Shadowing sensitivity analysis of chaotic limit cycle oscillations
The adjoint method, among other sensitivity analysis methods, can fail in
chaotic dynamical systems. The result from these methods can be too large,
often by orders of magnitude, when the result is the derivative of a long time
averaged quantity. This failure is known to be caused by ill-conditioned
initial value problems. This paper overcomes this failure by replacing the
initial value problem with the well-conditioned "least squares shadowing (LSS)
problem". The LSS problem is then linearized in our sensitivity analysis
algorithm, which computes a derivative that converges to the derivative of the
infinitely long time average. We demonstrate our algorithm in several dynamical
systems exhibiting both periodic and chaotic oscillations.Comment: submitted to JCP in revised for
- …