4,557 research outputs found
Sufficient dimension reduction based on an ensemble of minimum average variance estimators
We introduce a class of dimension reduction estimators based on an ensemble
of the minimum average variance estimates of functions that characterize the
central subspace, such as the characteristic functions, the Box--Cox
transformations and wavelet basis. The ensemble estimators exhaustively
estimate the central subspace without imposing restrictive conditions on the
predictors, and have the same convergence rate as the minimum average variance
estimates. They are flexible and easy to implement, and allow repeated use of
the available sample, which enhances accuracy. They are applicable to both
univariate and multivariate responses in a unified form. We establish the
consistency and convergence rate of these estimators, and the consistency of a
cross validation criterion for order determination. We compare the ensemble
estimators with other estimators in a wide variety of models, and establish
their competent performance.Comment: Published in at http://dx.doi.org/10.1214/11-AOS950 the Annals of
Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical
Statistics (http://www.imstat.org
Kernel dimension reduction in regression
We present a new methodology for sufficient dimension reduction (SDR). Our
methodology derives directly from the formulation of SDR in terms of the
conditional independence of the covariate from the response , given the
projection of on the central subspace [cf. J. Amer. Statist. Assoc. 86
(1991) 316--342 and Regression Graphics (1998) Wiley]. We show that this
conditional independence assertion can be characterized in terms of conditional
covariance operators on reproducing kernel Hilbert spaces and we show how this
characterization leads to an -estimator for the central subspace. The
resulting estimator is shown to be consistent under weak conditions; in
particular, we do not have to impose linearity or ellipticity conditions of the
kinds that are generally invoked for SDR methods. We also present empirical
results showing that the new methodology is competitive in practice.Comment: Published in at http://dx.doi.org/10.1214/08-AOS637 the Annals of
Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical
Statistics (http://www.imstat.org
Estimation of the Covariance Matrix of Large Dimensional Data
This paper deals with the problem of estimating the covariance matrix of a
series of independent multivariate observations, in the case where the
dimension of each observation is of the same order as the number of
observations. Although such a regime is of interest for many current
statistical signal processing and wireless communication issues, traditional
methods fail to produce consistent estimators and only recently results relying
on large random matrix theory have been unveiled. In this paper, we develop the
parametric framework proposed by Mestre, and consider a model where the
covariance matrix to be estimated has a (known) finite number of eigenvalues,
each of it with an unknown multiplicity. The main contributions of this work
are essentially threefold with respect to existing results, and in particular
to Mestre's work: To relax the (restrictive) separability assumption, to
provide joint consistent estimates for the eigenvalues and their
multiplicities, and to study the variance error by means of a Central Limit
theorem
itdr: An R package of Integral Transformation Methods to Estimate the SDR Subspaces in Regression
Sufficient dimension reduction (SDR) is a successful tool in regression
models. It is a feasible method to solve and analyze the nonlinear nature of
the regression problems. This paper introduces the itdr R package that provides
several functions based on integral transformation methods to estimate the SDR
subspaces in a comprehensive and user-friendly manner. In particular, the itdr
package includes the Fourier method (FM) and the convolution method (CM) of
estimating the SDR subspaces such as the central mean subspace (CMS) and the
central subspace (CS). In addition, the itdr package facilitates the recovery
of the CMS and the CS by using the iterative Hessian transformation (IHT)
method and the Fourier transformation approach for inverse dimension reduction
method (invFM), respectively. Moreover, the use of the package is illustrated
by three datasets. Furthermore, this is the first package that implements
integral transformation methods to estimate SDR subspaces. Hence, the itdr
package may provide a huge contribution to research in the SDR field.Comment: 17 pages, 1 figur
CS Decomposition Based Bayesian Subspace Estimation
In numerous applications, it is required to estimate the principal subspace of the data, possibly from a very limited number of samples. Additionally, it often occurs that some rough knowledge about this subspace is available and could be used to improve subspace estimation accuracy in this case. This is the problem we address herein and, in order to solve it, a Bayesian approach is proposed. The main idea consists of using the CS decomposition of the semi-orthogonal matrix whose columns span the subspace of interest. This parametrization is intuitively appealing and allows for non informative prior distributions of the matrices involved in the CS decomposition and very mild assumptions about the angles between the actual subspace and the prior subspace. The posterior distributions are derived and a Gibbs sampling scheme is presented to obtain the minimum mean-square distance estimator of the subspace of interest. Numerical simulations and an application to real hyperspectral data assess the validity and the performances of the estimator
- âŠ