41,106 research outputs found
Optimization for L1-Norm Error Fitting via Data Aggregation
We propose a data aggregation-based algorithm with monotonic convergence to a
global optimum for a generalized version of the L1-norm error fitting model
with an assumption of the fitting function. The proposed algorithm generalizes
the recent algorithm in the literature, aggregate and iterative disaggregate
(AID), which selectively solves three specific L1-norm error fitting problems.
With the proposed algorithm, any L1-norm error fitting model can be solved
optimally if it follows the form of the L1-norm error fitting problem and if
the fitting function satisfies the assumption. The proposed algorithm can also
solve multi-dimensional fitting problems with arbitrary constraints on the
fitting coefficients matrix. The generalized problem includes popular models
such as regression and the orthogonal Procrustes problem. The results of the
computational experiment show that the proposed algorithms are faster than the
state-of-the-art benchmarks for L1-norm regression subset selection and L1-norm
regression over a sphere. Further, the relative performance of the proposed
algorithm improves as data size increases
Non-linear regression models for Approximate Bayesian Computation
Approximate Bayesian inference on the basis of summary statistics is
well-suited to complex problems for which the likelihood is either
mathematically or computationally intractable. However the methods that use
rejection suffer from the curse of dimensionality when the number of summary
statistics is increased. Here we propose a machine-learning approach to the
estimation of the posterior density by introducing two innovations. The new
method fits a nonlinear conditional heteroscedastic regression of the parameter
on the summary statistics, and then adaptively improves estimation using
importance sampling. The new algorithm is compared to the state-of-the-art
approximate Bayesian methods, and achieves considerable reduction of the
computational burden in two examples of inference in statistical genetics and
in a queueing model.Comment: 4 figures; version 3 minor changes; to appear in Statistics and
Computin
- …