Level Set Methods for Stochastic Discontinuity Detection in Nonlinear Problems

Stochastic physical problems governed by nonlinear conservation laws are challenging due to solution discontinuities in stochastic and physical space. In this paper, we present a level set method to track discontinuities in stochastic space by solving a Hamilton-Jacobi equation. By introducing a speed function that vanishes at discontinuities, the iso-zero of the level set problem coincide with the discontinuities of the conservation law. The level set problem is solved on a sequence of successively finer grids in stochastic space. The method is adaptive in the sense that costly evaluations of the conservation law of interest are only performed in the vicinity of the discontinuities during the refinement stage. In regions of stochastic space where the solution is smooth, a surrogate method replaces expensive evaluations of the conservation law. The proposed method is tested in conjunction with different sets of localized orthogonal basis functions on simplex elements, as well as frames based on piecewise polynomials conforming to the level set function. The performance of the proposed method is compared to existing adaptive multi-element generalized polynomial chaos methods

Change-point Problem and Regression: An Annotated Bibliography

The problems of identifying changes at unknown times and of estimating the location of changes in stochastic processes are referred to as the change-point problem or, in the Eastern literature, as disorder . The change-point problem, first introduced in the quality control context, has since developed into a fundamental problem in the areas of statistical control theory, stationarity of a stochastic process, estimation of the current position of a time series, testing and estimation of change in the patterns of a regression model, and most recently in the comparison and matching of DNA sequences in microarray data analysis. Numerous methodological approaches have been implemented in examining change-point models. Maximum-likelihood estimation, Bayesian estimation, isotonic regression, piecewise regression, quasi-likelihood and non-parametric regression are among the methods which have been applied to resolving challenges in change-point problems. Grid-searching approaches have also been used to examine the change-point problem. Statistical analysis of change-point problems depends on the method of data collection. If the data collection is ongoing until some random time, then the appropriate statistical procedure is called sequential. If, however, a large finite set of data is collected with the purpose of determining if at least one change-point occurred, then this may be referred to as non-sequential. Not surprisingly, both the former and the latter have a rich literature with much of the earlier work focusing on sequential methods inspired by applications in quality control for industrial processes. In the regression literature, the change-point model is also referred to as two- or multiple-phase regression, switching regression, segmented regression, two-stage least squares (Shaban, 1980), or broken-line regression. The area of the change-point problem has been the subject of intensive research in the past half-century. The subject has evolved considerably and found applications in many different areas. It seems rather impossible to summarize all of the research carried out over the past 50 years on the change-point problem. We have therefore confined ourselves to those articles on change-point problems which pertain to regression. The important branch of sequential procedures in change-point problems has been left out entirely. We refer the readers to the seminal review papers by Lai (1995, 2001). The so called structural change models, which occupy a considerable portion of the research in the area of change-point, particularly among econometricians, have not been fully considered. We refer the reader to Perron (2005) for an updated review in this area. Articles on change-point in time series are considered only if the methodologies presented in the paper pertain to regression analysis

Hypothesis testing of multiple inequalities: the method of constraint chaining

Econometric inequality hypotheses arise in diverse ways. Examples include concavity restrictions on technological and behavioural functions, monotonicity and dominance relations, one-sided constraints on conditional moments in GMM estimation, bounds on parameters which are only partially identified, and orderings of predictive performance measures for competing models. In this paper we set forth four key properties which tests of multiple inequality constraints should ideally satisfy. These are (1) (asymptotic) exactness, (2) (asymptotic)similarity on the boundary, (3) absence of nuisance parameters from the asymptotic null distribution of the test statistic, (4) low computational complexity and boostrapping cost. We observe that the predominant tests currently used in econometrics do not appear to enjoy all these properties simultaneously. We therefore ask the question : Does there exist any nontrivial test which, as a mathematical fact, satisfies the first three properties and, by any reasonable measure, satisfies the fourth ? Remarkably the answer is affirmative. The paper demonstrates this constructively. We introduce a method of test construction called chaining which begins by writing multiple inequalities as a single equality using zero-one indicator functions. We then smooth the indicator functions. The approximate equality thus obtained is the basis of a well-behaved test. This test may be considered as the baseline of a wider class of tests. A full asymptotic theory is provided for the baseline. Simulation results show that the finite-sample performance of the test matches the theory quite well