191 research outputs found
Multiple Testing for Exploratory Research
Motivated by the practice of exploratory research, we formulate an approach
to multiple testing that reverses the conventional roles of the user and the
multiple testing procedure. Traditionally, the user chooses the error
criterion, and the procedure the resulting rejected set. Instead, we propose to
let the user choose the rejected set freely, and to let the multiple testing
procedure return a confidence statement on the number of false rejections
incurred. In our approach, such confidence statements are simultaneous for all
choices of the rejected set, so that post hoc selection of the rejected set
does not compromise their validity. The proposed reversal of roles requires
nothing more than a review of the familiar closed testing procedure, but with a
focus on the non-consonant rejections that this procedure makes. We suggest
several shortcuts to avoid the computational problems associated with closed
testing.Comment: Published in at http://dx.doi.org/10.1214/11-STS356 the Statistical
Science (http://www.imstat.org/sts/) by the Institute of Mathematical
Statistics (http://www.imstat.org
Analyzing gene expression data in terms of gene sets: methodological issues
Motivation: Many statistical tests have been proposed in recent years for analyzing gene expression data in terms of gene sets, usually from Gene Ontology. These methods are based on widely different methodological assumptions. Some approaches test differential expression of each gene set against differential expression of the rest of the genes, whereas others test each gene set on its own. Also, some methods are based on a model in which the genes are the sampling units, whereas others treat the subjects as the sampling units. This article aims to clarify the assumptions behind different approaches and to indicate a preferential methodology of gene set testing. Results: We identify some crucial assumptions which are needed by the majority of methods. P-values derived from methods that use a model which takes the genes as the sampling unit are easily misinterpreted, as they are based on a statistical model that does not resemble the biological experiment actually performed. Furthermore, because these models are based on a crucial and unrealistic independence assumption between genes, the P-values derived from such methods can be wildly anti-conservative, as a simulation experiment shows. We also argue that methods that competitively test each gene set against the rest of the genes create an unnecessary rift between single gene testing and gene set testing. Contact: [email protected]
Rejoinder to "Multiple Testing for Exploratory Research"
Rejoinder to "Multiple Testing for Exploratory Research" by J. J. Goeman, A.
Solari [arXiv:1208.2841].Comment: Published in at http://dx.doi.org/10.1214/11-STS356REJ the
Statistical Science (http://www.imstat.org/sts/) by the Institute of
Mathematical Statistics (http://www.imstat.org
A Cochran-Armitage-type and a score-free global test for multivariate ordinal data
We propose a Cochran-Armitage-type and a score-free global test that can be used to
assess the presence of an association between a set of ordinally scaled covariates and an outcome variable within the range of generalized linear models. Both tests are developed within the framework of the well-established 'global test' methodology and as such are feasible in high-dimensional data situations under any correlation and enable adjustment for covariates. The Cochran-Armitage-type test, for which an intimate connection with the traditional score-based Cochran-Armitage test is shown, rests upon explicit assumptions on the distances between the covariates' ordered categories. In contrast, the score-free
test parametrizes these distances and thus keeps them flexible, rendering it ideally suited for covariates measured on an ordinal scale. As confirmed by means of simulations,
the Cochran-Armitage-type test focuses its power on set-outcome relationships where
the distances between the covariates' categories are equal or close to those assumed, whereas the score-free test spreads its power over the full range of possible set-outcome relationships, putting more emphasis on monotonic than on non-monotonic ones. Based on the tests' power properties, it is discussed when to favour one or the other, and the practical merits of both of them are illustrated by an application in the field of rehabilitation medicine. Our proposed tests are implemented in the R package globaltest
Robust testing in generalized linear models by sign-flipping score contributions
Generalized linear models are often misspecified due to overdispersion,
heteroscedasticity and ignored nuisance variables. Existing quasi-likelihood
methods for testing in misspecified models often do not provide satisfactory
type-I error rate control. We provide a novel semi-parametric test, based on
sign-flipping individual score contributions. The tested parameter is allowed
to be multi-dimensional and even high-dimensional. Our test is often robust
against the mentioned forms of misspecification and provides better type-I
error control than its competitors. When nuisance parameters are estimated, our
basic test becomes conservative. We show how to take nuisance estimation into
account to obtain an asymptotically exact test. Our proposed test is
asymptotically equivalent to its parametric counterpart.Comment: To appear in Journal of the Royal Statistical Society: Series B
(Methodology). Early view version (2020
- …