This paper provides conditions under which subsampling and the bootstrap can
be used to construct estimators of the quantiles of the distribution of a root
that behave well uniformly over a large class of distributions P.
These results are then applied (i) to construct confidence regions that behave
well uniformly over P in the sense that the coverage probability
tends to at least the nominal level uniformly over P and (ii) to
construct tests that behave well uniformly over P in the sense that
the size tends to no greater than the nominal level uniformly over
P. Without these stronger notions of convergence, the asymptotic
approximations to the coverage probability or size may be poor, even in very
large samples. Specific applications include the multivariate mean, testing
moment inequalities, multiple testing, the empirical process and U-statistics.Comment: Published in at http://dx.doi.org/10.1214/12-AOS1051 the Annals of
Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical
Statistics (http://www.imstat.org