Bootstrap and Higher-Order Expansion Validity When Instruments May Be Weak

It is well-known that size-adjustments based on Edgeworth expansions for the t-statistic perform poorly when instruments are weakly correlated with the endogenous explanatory variable. This paper shows, however, that the lack of Edgeworth expansions and bootstrap validity are not tied to the weak instrument framework, but instead depends on which test statistic is examined. In particular, Edgeworth expansions are valid for the score and conditional likelihood ratio approaches, even when the instruments are uncorrelated with the endogenous explanatory variable. Furthermore, there is a belief that the bootstrap method fails when instruments are weak, since it replaces parameters with inconsistent estimators. Contrary to this notion, we provide a theoretical proof that guarantees the validity of the bootstrap for the score test, as well as the validity of the conditional bootstrap for many conditional tests. Monte Carlo simulations show that the bootstrap actually decreases size distortions in both cases.

Bootstrap and Higher-Order Expansion Validity When Instruments May Be Weak

It is well-known that size-adjustments based on Edgeworth expansions for the t-statistic perform poorly when instruments are weakly correlated with the endogenous explanatory variable. This paper shows, however, that the lack of Edgeworth expansions and bootstrap validity are not tied to the weak instrument framework, but instead depends on which test statistic is examined. In particular, Edgeworth expansions are valid for the score and conditional likelihood ratio approaches, even when the instruments are uncorrelated with the endogenous explanatory variable. Furthermore, there is a belief that the bootstrap method fails when instruments are weak, since it replaces parameters with inconsistent estimators. Contrary to this notion, we provide a theoretical proof that guarantees the validity of the bootstrap for the score test, as well as the validity of the conditional bootstrap for many conditional tests. Monte Carlo simulations show that the bootstrap actually decreases size distortions in both cases.

Exact asymptotic distribution of change-point mle for change in the mean of Gaussian sequences

We derive exact computable expressions for the asymptotic distribution of the change-point mle when a change in the mean occurred at an unknown point of a sequence of time-ordered independent Gaussian random variables. The derivation, which assumes that nuisance parameters such as the amount of change and variance are known, is based on ladder heights of Gaussian random walks hitting the half-line. We then show that the exact distribution easily extends to the distribution of the change-point mle when a change occurs in the mean vector of a multivariate Gaussian process. We perform simulations to examine the accuracy of the derived distribution when nuisance parameters have to be estimated as well as robustness of the derived distribution to deviations from Gaussianity. Through simulations, we also compare it with the well-known conditional distribution of the mle, which may be interpreted as a Bayesian solution to the change-point problem. Finally, we apply the derived methodology to monthly averages of water discharges of the Nacetinsky creek, Germany.Comment: Published in at http://dx.doi.org/10.1214/09-AOAS294 the Annals of Applied Statistics (http://www.imstat.org/aoas/) by the Institute of Mathematical Statistics (http://www.imstat.org

Inference with Weak Instruments

This paper reviews recent developments in methods for dealing with weak instruments (IVs) in IV regression models. The focus is more on tests (and confidence intervals derived from tests) than estimators. The paper also presents new testing results under "many weak IV asymptotics," which are relevant when the number of IVs is large and the coefficients on the IVs are relatively small. Asymptotic power envelopes for invariant tests are established. Power comparisons of the conditional likelihood ratio (CLR), Anderson-Rubin, and Lagrange multiplier tests are made. Numerical results show that the CLR test is on the asymptotic power envelope. This holds no matter what the relative magnitude of the IV strength to the number of IVs.Conditional likelihood ratio test, instrumental variables, many instrumental variables, power envelope, weak instruments

"t-Tests in a Structural Equation with Many Instruments"

This paper studies the properties of t-ratios associated with the limited information maximum likelihood (LIML) estimators in a structural form estimation when the number of instrumental variables is large. Asymptotic expansions are made of the distributions of a large K t-ratio statistic under large-Kn asymptotics. A modified t-ratio statistic is proposed from the asymptotic expansion. The power of the large K t-ratio test dominates the AR test, the K-test by Kleibergen (2002), and the conditional LR test by Moreira (2003); and the difference can be substantial when the instruments are weak.

Panel Cointegration Testing in the Presence of a Time Trend

The purpose of this paper is to propose a new likelihood-based panel cointegration test in the presence of a linear time trend in the data generating process. This new test is an extension of the likelihood ratio (LR) test of Saikkonen & Lütkepohl (2000) for trend-adjusted data to the panel data framework, and is called the panel SL test. The idea is first to take the average of the individual LR (trace) statistics over the cross-sections and then to standardize the test statistic with the appropriate asymptotic moments. Under the null hypothesis, this standardized statistic has a limiting normal distribution as the number of time periods (T) and the number of cross-sections (N) tend to infinity sequentially. In addition to the approximation based on asymptotic moments, a second approximation approach involving the moments from a vector autoregressive process of order one is also introduced. By means of a Monte Carlo study the finite sample size and size-adjusted power properties of the test are investigated. The test presents reasonable size with the increase in T and N, and has high power in small samples.Panel Cointegration Test, Likelihood Ratio, Time Trend, Monte Carlo Study

Change-point Problem and Regression: An Annotated Bibliography

The problems of identifying changes at unknown times and of estimating the location of changes in stochastic processes are referred to as the change-point problem or, in the Eastern literature, as disorder . The change-point problem, first introduced in the quality control context, has since developed into a fundamental problem in the areas of statistical control theory, stationarity of a stochastic process, estimation of the current position of a time series, testing and estimation of change in the patterns of a regression model, and most recently in the comparison and matching of DNA sequences in microarray data analysis. Numerous methodological approaches have been implemented in examining change-point models. Maximum-likelihood estimation, Bayesian estimation, isotonic regression, piecewise regression, quasi-likelihood and non-parametric regression are among the methods which have been applied to resolving challenges in change-point problems. Grid-searching approaches have also been used to examine the change-point problem. Statistical analysis of change-point problems depends on the method of data collection. If the data collection is ongoing until some random time, then the appropriate statistical procedure is called sequential. If, however, a large finite set of data is collected with the purpose of determining if at least one change-point occurred, then this may be referred to as non-sequential. Not surprisingly, both the former and the latter have a rich literature with much of the earlier work focusing on sequential methods inspired by applications in quality control for industrial processes. In the regression literature, the change-point model is also referred to as two- or multiple-phase regression, switching regression, segmented regression, two-stage least squares (Shaban, 1980), or broken-line regression. The area of the change-point problem has been the subject of intensive research in the past half-century. The subject has evolved considerably and found applications in many different areas. It seems rather impossible to summarize all of the research carried out over the past 50 years on the change-point problem. We have therefore confined ourselves to those articles on change-point problems which pertain to regression. The important branch of sequential procedures in change-point problems has been left out entirely. We refer the readers to the seminal review papers by Lai (1995, 2001). The so called structural change models, which occupy a considerable portion of the research in the area of change-point, particularly among econometricians, have not been fully considered. We refer the reader to Perron (2005) for an updated review in this area. Articles on change-point in time series are considered only if the methodologies presented in the paper pertain to regression analysis