Breaking the curse of dimensionality in regression

Models with many signals, high-dimensional models, often impose structures on the signal strengths. The common assumption is that only a few signals are strong and most of the signals are zero or close (collectively) to zero. However, such a requirement might not be valid in many real-life applications. In this article, we are interested in conducting large-scale inference in models that might have signals of mixed strengths. The key challenge is that the signals that are not under testing might be collectively non-negligible (although individually small) and cannot be accurately learned. This article develops a new class of tests that arise from a moment matching formulation. A virtue of these moment-matching statistics is their ability to borrow strength across features, adapt to the sparsity size and exert adjustment for testing growing number of hypothesis. GRoup-level Inference of Parameter, GRIP, test harvests effective sparsity structures with hypothesis formulation for an efficient multiple testing procedure. Simulated data showcase that GRIPs error control is far better than the alternative methods. We develop a minimax theory, demonstrating optimality of GRIP for a broad range of models, including those where the model is a mixture of a sparse and high-dimensional dense signals.Comment: 51 page

Estimation with Numerical Integration on Sparse Grids

For the estimation of many econometric models, integrals without analytical solutions have to be evaluated. Examples include limited dependent variables and nonlinear panel data models. In the case of one-dimensional integrals, Gaussian quadrature is known to work efficiently for a large class of problems. In higher dimensions, similar approaches discussed in the literature are either very specific and hard to implement or suffer from exponentially rising computational costs in the number of dimensions - a problem known as the "curse of dimensionality" of numerical integration. We propose a strategy that shares the advantages of Gaussian quadrature methods, is very general and easily implemented, and does not suffer from the curse of dimensionality. Monte Carlo experiments for the random parameters logit model indicate the superior performance of the proposed method over simulation techniques