The simultaneous estimation of many parameters based on data collected from
corresponding studies is a key research problem that has received renewed
attention in the high-dimensional setting. Many practical situations involve
heterogeneous data where heterogeneity is captured by a nuisance parameter.
Effectively pooling information across samples while correctly accounting for
heterogeneity presents a significant challenge in large-scale estimation
problems. We address this issue by introducing the "Nonparametric Empirical
Bayes Structural Tweedie" (NEST) estimator, which efficiently estimates the
unknown effect sizes and properly adjusts for heterogeneity via a generalized
version of Tweedie's formula. For the normal means problem, NEST simultaneously
handles the two main selection biases introduced by heterogeneity: one, the
selection bias in the mean, which cannot be effectively corrected without also
correcting for, two, selection bias in the variance. Our theoretical results
show that NEST has strong asymptotic properties without requiring explicit
assumptions about the prior. Extensions to other two-parameter members of the
exponential family are discussed. Simulation studies show that NEST outperforms
competing methods, with much efficiency gains in many settings. The proposed
method is demonstrated on estimating the batting averages of baseball players
and Sharpe ratios of mutual fund returns.Comment: 66 pages including 33 pages of main text, 5 pages of bibliography,
and 29 pages of supplementary tex