Testable implications of forecast optimality

Evaluation of forecast optimality in economics and finance has almost exclusively been conducted on the assumption of mean squared error loss under which forecasts should be unbiased and forecast errors serially uncorrelated at the single period horizon with increasing variance as the forecast horizon grows. This paper considers properties of optimal forecasts under general loss functions and establishes new testable implications of forecast optimality. These hold when the forecaster’s loss function is unknown but testable restrictions can be imposed on the data generating process, trading off conditions on the data generating process against conditions on the loss function. Finally, we propose flexible parametric estimation of the forecaster’s loss function, and obtain a test of forecast optimality via a test of over-identifying restrictions

Testable Implications of Forecast Optimality

Evaluation of forecast optimality in economics and finance has almost exclusively been conducted on the assumption of mean squared error loss under which forecasts should be unbiased and forecast errors serially uncorrelated at the single period horizon with increasing variance as the forecast horizon grows. This paper considers properties of optimal forecasts under general loss functions and establishes new testable implications of forecast optimality. These hold when the forecaster's loss function is unknown but testable restrictions can be imposed on the data generating process, trading off conditions on the data generating process against conditions on the loss function. Finally, we propose flexible parametric estimation of the forecaster's loss function, and obtain a test of forecast optimality via a test of over-identifying restrictions.forecast evaluation, loss function, rationality tests

Properties of Optimal Forecasts

Evaluation of forecast optimality in economics and finance has almost exclusively been conducted under the assumption of mean squared error loss. Under this loss function optimal forecasts should be unbiased and forecast errors should be serially uncorrelated at the single period horizon with increasing variance as the forecast horizon grows. Using analytical results, we show in this paper that all the standard properties of optimal forecasts can be invalid under asymmetric loss and nonlinear data generating processes and thus may be very misleading as a benchmark for an optimal forecast. Our theoretical results suggest that many of the conclusions in the empirical literature concerning suboptimality of forecasts could be premature. We extend the properties that an optimal forecast should have to a more general setting than previously considered in the literature. We also present results on forecast error properties that may be tested when the forecaster's loss function is unknown, and introduce a change of measure, following which the optimum forecast errors for general loss functions have the same properties as optimum errors under MSE lossforecast evaluation, loss function, rationality, efficient markets

Company news affects the way in which a stock’s returns co-move with those of other firms

The degree of co-movement signals the stock’s systematic risk, write Michela Verardo and Andrew Patto

Generalized Autoregressive Score Trees and Forests

We propose methods to improve the forecasts from generalized autoregressive score (GAS) models (Creal et. al, 2013; Harvey, 2013) by localizing their parameters using decision trees and random forests. These methods avoid the curse of dimensionality faced by kernel-based approaches, and allow one to draw on information from multiple state variables simultaneously. We apply the new models to four distinct empirical analyses, and in all applications the proposed new methods significantly outperform the baseline GAS model. In our applications to stock return volatility and density prediction, the optimal GAS tree model reveals a leverage effect and a variance risk premium effect. Our study of stock-bond dependence finds evidence of a flight-to-quality effect in the optimal GAS forest forecasts, while our analysis of high-frequency trade durations uncovers a volume-volatility effect

IMPACTS OF TRADES IN AN ERROR-CORRECTION MODEL OF QUOTE PRICES

In this paper we analyze and interpret the quote price dynamics of 100 NYSE stocks with varying average trade frequencies. We specify an error-correction model for the log difference of the bid and the ask price, with the spread acting as the error-correction term, and include as regressors the characteristics of the trades occurring between quote observations, if any. We find that short duration and medium volume trades have the largest impacts on quote prices for all one hundred stocks, and that buyer initiated trades primarily move the ask price while seller initiated trades primarily move the bid price. Trades have a greater impact on quotes in both the short and the long run for the infrequently traded stocks than for the more actively traded stocks. Finally, we find strong evidence that the spread is mean reverting

Testing forecast rationality for measures of central tendency

Rational respondents to economic surveys may report as a point forecast any measure of the central tendency of their (possibly latent) predictive distribution, for example the mean, median, mode, or any convex combination thereof. We propose tests of forecast rationality when the measure of central tendency used by the respondent is unknown. We overcome an identification problem that arises when the measures of central tendency are equal or in a local neighborhood of each other, as is the case for (exactly or nearly) symmetric distributions. As a building block, we also present novel tests for the rationality of mode forecasts. We apply our tests to survey forecasts of individual income, Greenbook forecasts of U.S. GDP, and random walk forecasts for exchange rates. We find that the Greenbook and random walk forecasts are best rationalized as mean, or near-meanforecasts, while the income survey forecasts are best rationalized as mode forecasts