Location of Repository

Predictive density accuracy tests

By Valentina Corradi and Norman R. Swanson

Abstract

This paper outlines a testing procedure for assessing the relative out-of-sample predictive accuracy of multiple conditional distribution models, and surveys existing related methods in the area of predictive density evaluation, including methods based on the probability integral transform and the Kullback-Leibler Information Criterion. The procedure is closely related to Andrews’ (1997) conditional Kolmogorov test and to White’s (2000) reality check approach, and involves comparing square (approximation) errors associated with models i, i = 1, ..., n, by constructing weighted averages over U of E\ud !"\ud Fi(u|Zt, !†i ) − F0(u|Zt, !0)\ud #2\ud $\ud , where F0(·|·) and Fi(·|·) are true and approximate\ud distributions, u # U, and U is a possibly unbounded set on the real line. Appropriate bootstrap procedures for\ud obtaining critical values for tests constructed using this measure of loss in conjunction with predictions obtained\ud via rolling and recursive estimation schemes are developed. We then apply these bootstrap procedures to the case\ud of obtaining critical values for our predictive accuracy test. A Monte Carlo experiment comparing our bootstrap\ud methods with methods that do not include location bias adjustment terms is provided, and results indicate coverage\ud improvement when our proposed bootstrap procedures are used. Finally, an empirical example comparing alternative\ud predictive densities for U.S. inflation is given

Topics: HB
Publisher: Warwick Business School, Financial Econometrics Research Centre
Year: 2004
OAI identifier: oai:wrap.warwick.ac.uk:1784

Suggested articles

Preview

Citations

  1. (2002b), The Block-Block Bootstrap: Improved Asymptotic Refinements, Manuscript, Cowles Foundation in Economics,
  2. (2004). A Comparison of Direct and Iterated AR Methods for Forecasting Macroeconomic Series h-Steps Ahead, Working Paper, doi
  3. (2002). A Consistent Test for Out of Sample Nonlinear Predictive Ability, doi
  4. (2000). A Reality Check for Data Snooping, doi
  5. (2003). A Test For Comparing Multiple Misspecified Conditional Distribution Models, Working Paper, doi
  6. (1988). A Unified Theory of Estimation and Inference for Nonlinear Dynamic Models, doi
  7. (1997). An Overview of Value at Risk, doi
  8. (2001). An Unbiased and Powerful Test for Superior Predictive Ability, Working Paper,
  9. (1996). Asymptotic Inference About Predictive Ability, doi
  10. (2003). Bootstrap Conditional Distribution Tests in the Presence of Dynamic Misspecification, doi
  11. (1996). Bootstrap Critical Values for Tests Based on Generalized Method of Moments Estimators, doi
  12. (2003). Bootstrapping GMM Estimators for Time Series, Mimeo, doi
  13. (2002). Comparing Density Forecasts via Weighted Likelihood Ratio Tests: Asymptotic and Bootstrap Methods, Working Paper, doi
  14. (2001). Comparing Dynamic Equilibrium Models to Data, Working Paper, doi
  15. (1995). Comparing Predictive Accuracy, doi
  16. (1999). Deciding between I(0) and I(1) via FLIL-Based Bounds, doi
  17. (1998). Evaluating Density Forecasts with Applications to Finance and Management, doi
  18. (1998). Evaluating Interval Forecasts,
  19. (2001). Evaluation of Out of Sample Probability Density Forecasts with Applications to S&P 500 Stock Prices, Working Paper,
  20. (2003). Forecast Based Model Selection in the Presence of Structural Breaks, doi
  21. (1997). Higher-Order Improvements of a Computationally Attractive k step Bootstrap for Extremum Estimators, doi
  22. (2003). How Costly is to Ignore Breaks when Forecasting the Direction of a Time Series? doi
  23. (2002). Learning-by-Doing as a Propagation Mechanism, doi
  24. (2000). Loss Function Based Evaluation of DSGE Models,
  25. (2003). Maximum Likelihood and the Bootstrap for Nonlinear Dynamic Models, doi
  26. (1999). Multivariate Density Forecast Evaluation and Calibration in Financial Risk Management: High Frequency Returns on Foreign Exchange, doi
  27. (2003). Nonparametric Specification Testing for Continuous Time Models with Applications to Term Structure Interest Rates, Review of Financial Studies, doi
  28. (1986). On Strong Invariance Principles under Dependence Assumptions, doi
  29. (1998). Regression-Based Tests for Predictive Ability, doi
  30. (2001). Testing and Comparing Value-at-Risk Measures, doi
  31. (2003). Testing Distributional Assumptions: a GMM Approach, Working Paper, doi
  32. (2003). Testing Normality: a GMM Approach, doi
  33. (2003). Testing Parametric Conditional Distributions of Dynamic Models, doi
  34. (2001). Tests of Equal Forecast Accuracy and Encompassing for Nested Models, doi
  35. (2003). The Block Bootstrap for Parameter Estimation Error In Recursive Estimation Schemes, With Applications to Predictive Evaluation, Working Paper,
  36. (1989). The Jackknife and the Bootstrap for General Stationary Observations, doi

To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.