Monitoring Processes with Changing Variances

Statistical process control (SPC) has evolved beyond its classical applications in manufacturing to monitoring economic and social phenomena. This extension requires consideration of autocorrelated and possibly non-stationary time series. Less attention has been paid to the possibility that the variance of the process may also change over time. In this paper we use the innovations state space modeling framework to develop conditionally heteroscedastic models. We provide examples to show that the incorrect use of homoscedastic models may lead to erroneous decisions about the nature of the process. The framework is extended to include counts data, when we also introduce a new type of chart, the P-value chart, to accommodate the changes in distributional form from one period to the next.control charts, count data, GARCH, heteroscedasticity, innovations, state space, statistical process control

Exponential smoothing and non-negative data

The most common forecasting methods in business are based on exponential smoothing and the most common time series in business are inherently non-negative. Therefore it is of interest to consider the properties of the potential stochastic models underlying exponential smoothing when applied to non-negative data. We explore exponential smoothing state space models for non-negative data under various assumptions about the innovations, or error, process. We first demonstrate that prediction distributions from some commonly used state space models may have an infinite variance beyond a certain forecasting horizon. For multiplicative error models which do not have this flaw, we show that sample paths will converge almost surely to zero even when the error distribution is non-Gaussian. We propose a new model with similar properties to exponential smoothing, but which does not have these problems, and we develop some distributional properties for our new model. We then explore the implications of our results for inference, and compare the short-term forecasting performance of the various models using data on the weekly sales of over three hundred items of costume jewelry. The main findings of the research are that the Gaussian approximation is adequate for estimation and one-step-ahead forecasting. However, as the forecasting horizon increases, the approximate prediction intervals become increasingly problematic. When the model is to be used for simulation purposes, a suitably specified scheme must be employed.forecasting; time series; exponential smoothing; positive-valued processes; seasonality; state space models.

Exponential Smoothing for Inventory Control: Means and Variances of Lead-Time Demand

Exponential smoothing is often used to forecast lead-time demand for inventory control. In this paper, formulae are provided for calculating means and variances of lead-time demand for a wide variety of exponential smoothing methods. A feature of many of the formulae is that variances, as well as the means, depend on trends and seasonal effects. Thus, these formulae provide the opportunity to implement methods that ensure that safety stocks adjust to changes in trend or changes in season.Forecasting; inventory control; lead-time demand; exponential smoothing; forecast variance.

Monitoring Processes with Changing Variances

Statistical process control (SPC) has evolved beyond its classical applications in manufacturing to monitoring economic and social phenomena. This extension requires consideration of autocorrelated and possibly non-stationary time series. Less attention has been paid to the possibility that the variance of the process may also change over time. In this paper we use the innovations state space modeling framework to develop conditionally heteroscedastic models. We provide examples to show that the incorrect use of homoscedastic models may lead to erroneous decisions about the nature of the process. The framework is extended to include counts data, when we also introduce a new type of chart, the P-value chart, to accommodate the changes in distributional form from one period to the next.Control charts, count data, GARCH, heteroscedasticity, innovations, state space, statistical process control

Forecasting Compositional Time Series with Exponential Smoothing Methods

Compositional time series are formed from measurements of proportions that sum to one in each period of time. We might be interested in forecasting the proportion of home loans that have adjustable rates, the proportion of nonagricultural jobs in manufacturing, the proportion of a rock's geochemical composition that is a specific oxide, or the proportion of an election betting market choosing a particular candidate. A problem may involve many related time series of proportions. There could be several categories of nonagricultural jobs or several oxides in the geochemical composition of a rock that are of interest. In this paper we provide a statistical framework for forecasting these special kinds of time series. We build on the innovations state space framework underpinning the widely used methods of exponential smoothing. We couple this with a generalized logistic transformation to convert the measurements from the unit interval to the entire real line. The approach is illustrated with two applications: the proportion of new home loans in the U.S. that have adjustable rates; and four probabilities for specified candidates winning the 2008 democratic presidential nomination.compositional time series, innovations state space models, exponential smoothing, forecasting proportions

Time Series Forecasting: The Case for the Single Source of Error State Space

The state space approach to modelling univariate time series is now widely used both in theory and in applications. However, the very richness of the framework means that quite different model formulations are possible, even when they purport to describe the same phenomena. In this paper, we examine the single source of error [SSOE] scheme, which has perfectly correlated error components. We then proceed to compare SSOE to the more common version of the state space models, for which all the error terms are independent; we refer to this as the multiple source of error [MSOE] scheme. As expected, there are many similarities between the MSOE and SSOE schemes, but also some important differences. Both have ARIMA models as their reduced forms, although the mapping is more transparent for SSOE. Further, SSOE does not require a canonical form to complete its specification. An appealing feature of SSOE is that the estimates of the state variables converge in probability to their true values, thereby leading to a formal inferential structure for the ad-hoc exponential smoothing methods for forecasting. The parameter space for SSOE models may be specified to match that of the corresponding ARIMA scheme, or it may be restricted to meaningful sub-spaces, as for MSOE but with somewhat different outcomes. The SSOE formulation enables straightforward extensions to certain classes of non-linear models, including a linear trend with multiplicative seasonals version that underlies the Holt-Winters forecasting method. Conditionally heteroscedastic models may be developed in a similar manner. Finally we note that smoothing and decomposition, two crucial practical issues, may be performed within the SSOE framework.ARIMA, Dynamic Linear Models, Equivalence, Exponential Smoothing, Forecasting, GARCH, Holt's Method, Holt-Winters Method, Kalman Filter, Prediction Intervals.

Forecasting Time-Series with Correlated Seasonality

A new approach is proposed for forecasting a time series with multiple seasonal patterns. A state space model is developed for the series using the single source of error approach which enables us to develop explicit models for both additive and multiplicative seasonality. Parameter estimates may be obtained using methods adapted from general exponential smoothing, although the Kalman filter may also be used. The proposed model is used to examine hourly and daily patterns in hourly data for both utility loads and traffic flows. Our formulation provides a model for several existing seasonal methods and also provides new options, which result in superior forecasting performance over a range of prediction horizons. The approach is likely to be useful in a wide range of applications involving both high and low frequency data, and it handles missing values in a straightforward manner.Exponential smoothing; Holt-Winters; Seasonality; Structural time series model

Forecasting time-series with correlated seasonality

A new approach to forecasting seasonal data is proposed where seasonal terms can be updated using the most recent relevant information. It was developed to handle features encountered in hourly electricity load data and daily hospital admissions data. The associated state space model is estimated with methods adapted from exponential smoothing, although the Kalman filter may also be used. It nests existing seasonal models and outperforms them over a range of prediction horizons on the data. The approach is likely to be useful in a wide range of applications involving both high and low frequency data