678 research outputs found
An exact adaptive test with superior design sensitivity in an observational study of treatments for ovarian cancer
A sensitivity analysis in an observational study determines the magnitude of
bias from nonrandom treatment assignment that would need to be present to alter
the qualitative conclusions of a na\"{\i}ve analysis that presumes all biases
were removed by matching or by other analytic adjustments. The power of a
sensitivity analysis and the design sensitivity anticipate the outcome of a
sensitivity analysis under an assumed model for the generation of the data. It
is known that the power of a sensitivity analysis is affected by the choice of
test statistic, and, in particular, that a statistic with good Pitman
efficiency in a randomized experiment, such as Wilcoxon's signed rank
statistic, may have low power in a sensitivity analysis and low design
sensitivity when compared to other statistics. For instance, for an additive
treatment effect and errors that are Normal or logistic or -distributed with
3 degrees of freedom, Brown's combined quantile average test has Pitman
efficiency close to that of Wilcoxon's test but has higher power in a
sensitivity analysis, while a version of Noether's test has poor Pitman
efficiency in a randomized experiment but much higher design sensitivity so it
is vastly more powerful than Wilcoxon's statistic in a sensitivity analysis if
the sample size is sufficiently large.Comment: Published in at http://dx.doi.org/10.1214/11-AOAS508 the Annals of
Applied Statistics (http://www.imstat.org/aoas/) by the Institute of
Mathematical Statistics (http://www.imstat.org
Error-free milestones in error prone measurements
A predictor variable or dose that is measured with substantial error may
possess an error-free milestone, such that it is known with negligible error
whether the value of the variable is to the left or right of the milestone.
Such a milestone provides a basis for estimating a linear relationship between
the true but unknown value of the error-free predictor and an outcome, because
the milestone creates a strong and valid instrumental variable. The inferences
are nonparametric and robust, and in the simplest cases, they are exact and
distribution free. We also consider multiple milestones for a single predictor
and milestones for several predictors whose partial slopes are estimated
simultaneously. Examples are drawn from the Wisconsin Longitudinal Study, in
which a BA degree acts as a milestone for sixteen years of education, and the
binary indicator of military service acts as a milestone for years of service.Comment: Published in at http://dx.doi.org/10.1214/08-AOAS233 the Annals of
Applied Statistics (http://www.imstat.org/aoas/) by the Institute of
Mathematical Statistics (http://www.imstat.org
Isolation in the construction of natural experiments
A natural experiment is a type of observational study in which treatment
assignment, though not randomized by the investigator, is plausibly close to
random. A process that assigns treatments in a highly nonrandom, inequitable
manner may, in rare and brief moments, assign aspects of treatments at random
or nearly so. Isolating those moments and aspects may extract a natural
experiment from a setting in which treatment assignment is otherwise quite
biased, far from random. Isolation is a tool that focuses on those rare, brief
instances, extracting a small natural experiment from otherwise useless data.
We discuss the theory behind isolation and illustrate its use in a reanalysis
of a well-known study of the effects of fertility on workforce participation.
Whether a woman becomes pregnant at a certain moment in her life and whether
she brings that pregnancy to term may reflect her aspirations for family,
education and career, the degree of control she exerts over her fertility, and
the quality of her relationship with the father; moreover, these aspirations
and relationships are unlikely to be recorded with precision in surveys and
censuses, and they may confound studies of workforce participation. However,
given that a women is pregnant and will bring the pregnancy to term, whether
she will have twins or a single child is, to a large extent, simply luck. Given
that a woman is pregnant at a certain moment, the differential comparison of
two types of pregnancies on workforce participation, twins or a single child,
may be close to randomized, not biased by unmeasured aspirations. In this
comparison, we find in our case study that mothers of twins had more children
but only slightly reduced workforce participation, approximately 5% less time
at work for an additional child.Comment: Published in at http://dx.doi.org/10.1214/14-AOAS770 the Annals of
Applied Statistics (http://www.imstat.org/aoas/) by the Institute of
Mathematical Statistics (http://www.imstat.org
Cross-screening in observational studies that test many hypotheses
We discuss observational studies that test many causal hypotheses, either
hypotheses about many outcomes or many treatments. To be credible an
observational study that tests many causal hypotheses must demonstrate that its
conclusions are neither artifacts of multiple testing nor of small biases from
nonrandom treatment assignment. In a sense that needs to be defined carefully,
hidden within a sensitivity analysis for nonrandom assignment is an enormous
correction for multiple testing: in the absence of bias, it is extremely
improbable that multiple testing alone would create an association insensitive
to moderate biases. We propose a new strategy called "cross-screening",
different from but motivated by recent work of Bogomolov and Heller on
replicability. Cross-screening splits the data in half at random, uses the
first half to plan a study carried out on the second half, then uses the second
half to plan a study carried out on the first half, and reports the more
favorable conclusions of the two studies correcting using the Bonferroni
inequality for having done two studies. If the two studies happen to concur,
then they achieve Bogomolov-Heller replicability; however, importantly,
replicability is not required for strong control of the family-wise error rate,
and either study alone suffices for firm conclusions. In randomized studies
with a few hypotheses, cross-split screening is not an attractive method when
compared with conventional methods of multiplicity control, but it can become
attractive when hundreds or thousands of hypotheses are subjected to
sensitivity analyses in an observational study. We illustrate the technique by
comparing 46 biomarkers in individuals who consume large quantities of fish
versus little or no fish.Comment: 33 pages, 2 figures, 5 table
Comment: The Place of Death in the Quality of Life
Comment on The Place of Death in the Quality of Life [math.ST/0612783]Comment: Published at http://dx.doi.org/10.1214/088342306000000277 in the
Statistical Science (http://www.imstat.org/sts/) by the Institute of
Mathematical Statistics (http://www.imstat.org
Covariance Adjustment in Randomized Experiments and Observational Studies
By slightly reframing the concept of covariance adjustment in randomized experiments, a method of exact permutation inference is derived that is entirely free of distributional assumptions and uses the random assignment of treatments as the reasoned basis for inference.\u27\u27 This method of exact permutation inference may be used with many forms of covariance adjustment, including robust regression and locally weighted smoothers. The method is then generalized to observational studies where treatments were not randomly assigned, so that sensitivity to hidden biases must be examined. Adjustments using an instrumental variable are also discussed. The methods are illustrated using data from two observational studies
Some Counterclaims Undermine Themselves in Observational Studies
Claims based on observational studies that a treatment has certain e§ects are often met with counterclaims asserting that the treatment is entirely without e§ect, that all associations with treatment are produced by biased treatment assignment. Some counterclaims undermine themselves in the following speciÖc sense: presuming the counterclaim to be true may strengthen the support that the original data provide for the original claim, so that the counterclaim fails in its role as a critique of the original claim. In mathematics, a proof by contradiction supposes a proposition to be true en route to proving that the proposition is false. Analogously, the supposition that a particular counterclaim is true may justify an otherwise unjustiÖed statistical analysis, and this added analysis may interpret the original data as providing even stronger support for the original claim. More precisely, the original study is sensitive to unmeasured biases of a particular magnitude, , but an analysis that supposes the counterclaim to be true may be insensitive to much larger unmeasured biases, 0 \u3e . Illustrated using data from the US Fatal Accident Reporting System
Stronger instruments via integer programming in an observational study of late preterm birth outcomes
In an optimal nonbipartite match, a single population is divided into matched
pairs to minimize a total distance within matched pairs. Nonbipartite matching
has been used to strengthen instrumental variables in observational studies of
treatment effects, essentially by forming pairs that are similar in terms of
covariates but very different in the strength of encouragement to accept the
treatment. Optimal nonbipartite matching is typically done using network
optimization techniques that can be quick, running in polynomial time, but
these techniques limit the tools available for matching. Instead, we use
integer programming techniques, thereby obtaining a wealth of new tools not
previously available for nonbipartite matching, including fine and near-fine
balance for several nominal variables, forced near balance on means and optimal
subsetting. We illustrate the methods in our on-going study of outcomes of
late-preterm births in California, that is, births of 34 to 36 weeks of
gestation. Would lengthening the time in the hospital for such births reduce
the frequency of rapid readmissions? A straightforward comparison of babies who
stay for a shorter or longer time would be severely biased, because the
principal reason for a long stay is some serious health problem. We need an
instrument, something inconsequential and haphazard that encourages a shorter
or a longer stay in the hospital. It turns out that babies born at certain
times of day tend to stay overnight once with a shorter length of stay, whereas
babies born at other times of day tend to stay overnight twice with a longer
length of stay, and there is nothing particularly special about a baby who is
born at 11:00 pm.Comment: Published in at http://dx.doi.org/10.1214/12-AOAS582 the Annals of
Applied Statistics (http://www.imstat.org/aoas/) by the Institute of
Mathematical Statistics (http://www.imstat.org
Matching for Balance, Pairing for Heterogeneity in an Observational Study of the Effectiveness of For-Profit and Not-For-Profit High Schools in Chile
Conventionally, the construction of a pair-matched sample selects treated and control units and pairs them in a single step with a view to balancing observed covariates x and reducing the heterogeneity or dispersion of treated-minus-control response differences, Y. In contrast, the method of cardinality matching developed here first selects the maximum number of units subject to covariate balance constraints and, with a balanced sample for x in hand, then separately pairs the units to minimize heterogeneity in Y. Reduced heterogeneity of pair differences in responses Y is known to reduce sensitivity to unmeasured biases, so one might hope that cardinality matching would succeed at both tasks, balancing x, stabilizing Y. We use cardinality matching in an observational study of the effectiveness of for-profit and not-for-profit private high schools in Chile—a controversial subject in Chile—focusing on students who were in government run primary schools in 2004 but then switched to private high schools. By pairing to minimize heterogeneity in a cardinality match that has balanced covariates, a meaningful reduction in sensitivity to unmeasured biases is obtained
- …