Bounded Influence Approaches to Constrained Mixed Vector Autoregressive Models

The proliferation of many clinical studies obtaining multiple biophysical signals from several individuals repeatedly in time is increasingly recognized, a recognition generating growth in statistical models that analyze cross-sectional time series data. In general, these statistical models try to answer two questions: (i) intra-individual dynamics of the response and its relation to some covariates; and, (ii) how this dynamics can be aggregated consistently in a group. In response to the first question, we propose a covariate-adjusted constrained Vector Autoregressive model, a technique similar to the STARMAX model (Stoffer, JASA 81, 762-772), to describe serial dependence of observations. In this way, the number of parameters to be estimated is kept minimal while offering flexibility for the model to explore higher order dependence. In response to (ii), we use mixed effects analysis that accommodates modelling of heterogeneity among cross-sections arising from covariate effects that vary from one cross-section to another. Although estimation of the model can proceed using standard maximum likelihood techniques, we believed it is advantageous to use bounded influence procedures in the modelling (such as choosing constraints) and parameter estimation so that the effects of outliers can be controlled. In particular, we use M-estimation with a redescending bounding function because its influence function is always bounded. Furthermore, assuming consistency, this influence function is useful to obtain the limiting distribution of the estimates. However, this distribution may not necessarily yield accurate inference in the presence of contamination as the actual asymptotic distribution might have wider tails. This led us to investigate bootstrap approximation techniques. A sampling scheme based on IID innovations is modified to accommodate the cross-sectional structure of the data. Then the M-estimation is applied to each bootstrap sample naively to obtain the asymptotic distribution of the estimates.We apply these strategies to the extracted BOLD activation from several regions of the brain from a group of individuals to describe joint dynamic behavior between these locations. We used simulated data with both innovation and additive outliers to test whether the estimation procedure is accurate despite contamination

Dynamics and sparsity in latent threshold factor models: A study in multivariate EEG signal processing

We discuss Bayesian analysis of multivariate time series with dynamic factor models that exploit time-adaptive sparsity in model parametrizations via the latent threshold approach. One central focus is on the transfer responses of multiple interrelated series to underlying, dynamic latent factor processes. Structured priors on model hyper-parameters are key to the efficacy of dynamic latent thresholding, and MCMC-based computation enables model fitting and analysis. A detailed case study of electroencephalographic (EEG) data from experimental psychiatry highlights the use of latent threshold extensions of time-varying vector autoregressive and factor models. This study explores a class of dynamic transfer response factor models, extending prior Bayesian modeling of multiple EEG series and highlighting the practical utility of the latent thresholding concept in multivariate, non-stationary time series analysis.Comment: 27 pages, 13 figures, link to external web site for supplementary animated figure

Regularization and Bayesian Learning in Dynamical Systems: Past, Present and Future

Regularization and Bayesian methods for system identification have been repopularized in the recent years, and proved to be competitive w.r.t. classical parametric approaches. In this paper we shall make an attempt to illustrate how the use of regularization in system identification has evolved over the years, starting from the early contributions both in the Automatic Control as well as Econometrics and Statistics literature. In particular we shall discuss some fundamental issues such as compound estimation problems and exchangeability which play and important role in regularization and Bayesian approaches, as also illustrated in early publications in Statistics. The historical and foundational issues will be given more emphasis (and space), at the expense of the more recent developments which are only briefly discussed. The main reason for such a choice is that, while the recent literature is readily available, and surveys have already been published on the subject, in the author's opinion a clear link with past work had not been completely clarified.Comment: Plenary Presentation at the IFAC SYSID 2015. Submitted to Annual Reviews in Contro

Consistent LM-Tests for Linearity Against Compound Smooth Transition Alternatives

We develop LM-tests of linearity that are consistent against a class of Compound Smooth Transition Autoregressive (CoSTAR) models of the conditional mean. Our method is an extension of the sup-test developed by Bierens (1990) and Bierens and Plobeger (1997), provides maximal power against popular STAR alternatives and is consistent against any deviation from the null hypothesis. Moreover, the test method can be extended to consistent tests of number of threshold regimes, flexible parametric forms, conditional homoscedasticity against linear or smooth transition GARCH, and causality tests of out-of-sample predictive accuracy. Of particular note, we improve on Bierens's (1990) test theory by considering vector conditional moments which lead to an LM sup-test statistic that is never degenerate under the alternative of functional mis-specification. Moreover, our test is a true test against smooth transition alternatives, whereas the universally employed polynomial regression test of Teräsvirta (1994) requires the assumption that the true data generating mechanism is STAR. A simulation study demonstrates that the suggested STAR sup-statistic renders a test with superlative empirical size and power attributes, in particular in comparison to the Bierens (1990) test, the neural test by Lee, White and Granger (1993), and specifically the polynomial regression test employed throughout the STAR literature. Finally, we apply the new tests to various macroeconomic processessmooth transition models, consistent tests, nonlinearity, neural networks

The Mathematical description of lactation curves in dairy cattle

This review gives an overview of the mathematical modelling of lactation curves in dairy cattle. Over the last ninety years, the development of this field of study has followed the main requirements of the dairy cattle industry. Non-linear parametric functions have represented the preferred tools for modelling average curves of homogeneous groups of animals, with the main aim of predicting yields for management purposes. The increased availability of records per individual lactations and the genetic evaluation based on test day records has shifted the interest of modellers towards more flexible and general linear functions, as polynomials or splines. Thus the main interest of modelling is no longer the reconstruction of the general pattern of the phenomenon but the fitting of individual deviations from an average curve. Other specific approaches based on the modelling of the correlation structure of test day records within lactation, such as mixed linear models or principal component analysis, have been used to test the statistical significance of fixed effects in dairy experiments or to create new variables expressing main lactation curve traits. The adequacy of a model is not an absolute requisite, because it has to be assessed according to the specific purpose it is used for. Occurrence of extended lactations and of new productive and functional traits to be described and the increase of records coming from automatic milking systems likely will represent some of the future challenges for the mathematical modelling of the lactation curve in dairy cattle

Modeling competition between two pharmaceutical drugs using innovation diffusion models

The study of competition among brands in a common category is an interesting strategic issue for involved firms. Sales monitoring and prediction of competitors' performance represent relevant tools for management. In the pharmaceutical market, the diffusion of product knowledge plays a special role, different from the role it plays in other competing fields. This latent feature naturally affects the evolution of drugs' performances in terms of the number of packages sold. In this paper, we propose an innovation diffusion model that takes the spread of knowledge into account. We are motivated by the need of modeling competition of two antidiabetic drugs in the Italian market.Comment: Published at http://dx.doi.org/10.1214/15-AOAS868 in the Annals of Applied Statistics (http://www.imstat.org/aoas/) by the Institute of Mathematical Statistics (http://www.imstat.org