Judgmental adjustments of previously adjusted forecasts

Forecasts are important components of information systems. They provide a means for knowledge sharing and thus have significant decision-making impact. In many organizations, it is quite common for forecast users to receive predictions that have previously been adjusted by providers or other users of forecasts. Current work investigates some of the factors that may influence the size and propensity of further adjustments on already-adjusted forecasts. Two studies are reported that focus on the potential effects of adjustment framing (Study 1) and the availability of explanations and/or original forecasts alongside the adjusted forecasts (Study 2). Study 1 provides evidence that the interval forecasts that are labeled as "adjusted" are modified less than the so-called "original/unadjusted" predictions. Study 2 suggests that the provision of original forecasts and the presence of explanations accompanying the adjusted forecasts serve as significant factors shaping the size and propensity of further modifications. Findings of both studies highlight the importance of forecasting format and user perceptions with critical organizational repercussions. © 2008, Decision Sciences Institute

Analysis of judgmental adjustments in the presence of promotions

Sales forecasting is increasingly complex due to many factors, such as product life cycles that have become shorter, more competitive markets and aggressive marketing. Often, forecasts are produced using a Forecasting Support System that integrates univariate statistical forecasts with judgment from experts in the organization. Managers add information to the forecast, like future promotions, potentially improving accuracy. Despite the importance of judgment and promotions, the literature devoted to study their relationship on forecasting performance is scarce. We analyze managerial adjustments accuracy under periods of promotions, based on weekly data from a manufacturing company. Intervention analysis is used to establish whether judgmental adjustments can be replaced by multivariate statistical models when responding to promotional information. We show that judgmental adjustments can enhance baseline forecasts during promotions, but not systematically. Transfer function models based on past promotions information achieved lower overall forecasting errors. Finally, a hybrid model illustrates the fact that human experts still added value to the transfer function models

Judgement and supply chain dynamics

Forecasting demand at the individual stock-keeping-unit (SKU) level often necessitates the use of statistical methods, such as exponential smoothing. In some organizations, however, statistical forecasts will be subject to judgemental adjustments by managers. Although a number of empirical and ‘laboratory’ studies have been performed in this area, no formal OR modelling has been conducted to offer insights into the impact such adjustments may have on supply chain performance and the potential development of mitigation mechanisms. This is because of the associated dynamic complexity and the situation-specific nature of the problem at hand. In conjunction with appropriate stock control rules, demand forecasts help decide how much to order. It is a common practice that replenishment orders may also be subject to judgemental intervention, adding further to the dynamic system complexity and interdependence. The system dynamics (SD) modelling method can help advance knowledge in this area, where mathematical modelling cannot accommodate the associated complexity. This study, which constitutes part of a UK government funded (EPSRC) project, uses SD models to evaluate the effects of forecasting and ordering adjustments for a wide set of scenarios involving: three different inventory policies; seven different (combinations of) points of intervention; and four different (combinations of) types of judgmental intervention (optimistic and pessimistic). The results enable insights to be gained into the performance of the entire supply chain. An agenda for further research concludes the paper

The Influence of Managerial Forces and Users’ Judgements on Forecasting in International Manufacturers: a Grounded Study

Despite the improvements in mathematical forecasting techniques, the increase in forecasting accuracy is not yet significant. Previous research discussed various forecasting issues and techniques without paying attention to users’ forces and behaviours that influence the construction of forecasts. This research investigates this gap through examining the managerial forces that influence the judgements of different users and constructors of forecasts in international pharmaceutical companies. A qualitative research applying Grounded Theory methodology is used to explore the concealed forces in forecasting processes by interviewing different constructors and users of forecasts in international contexts. Using the Coding Matrices, the research identifies the forces which induce users’ judgements, and consequently lead to conflicts. The research adds value by providing assessment criteria of forecasting management in future research

Effects of Structural Characteristics of Explanations on Use of a DSS

Cataloged from PDF version of article.Research in the field of expert systems has shown that providing supporting explanations may influence effective use of system developed advice. However, despite many studies showing the less than optimal use made of DSS prepared advice, almost no research has been undertaken to study if the provision of explanations enhances the users' ability to wisely accept DSS advice. This study outlines an experiment to examine the effects of structural characteristics of explanations provided within a forecasting DSS context. In particular, the effects of explanation length (short vs. long) and the conveyed confidence level (weak vs. strong confidence) are examined. Strongly confident and long explanations are found to be more effective in participants' acceptance of interval forecasts. In addition, explanations with higher information value are more effective than those with low information value and thus are persuasive tools in the presentation of advice to users. (c) 2005 Elsevier B.V. All rights reserved

Forecasting from time series subject to sporadic perturbations : effectiveness of different types of forecasting support

How effective are different approaches for the provision of forecasting support? Forecasts may be either unaided or made with the help of statistical forecasts. In practice, the latter are often crude forecasts that do not take sporadic perturbations into account. Most research considers forecasts based on series that have been cleansed of perturbation effects. This paper considers an experiment in which people made forecasts from time series that were disturbed by promotions. In all conditions, under-forecasting occurred during promotional periods and over-forecasting during normal ones. The relative sizes of these effects depended on the proportions of periods in the data series that contained promotions. The statistical forecasts improved the forecasting accuracy, not because they reduced these biases, but because they decreased the random error (scatter). The performance improvement did not depend on whether the forecasts were based on cleansed series. Thus, the effort invested in producing cleansed time series from which to forecast may not be warranted: companies may benefit from giving their forecasters even crude statistical forecasts. In a second experiment, forecasters received optimal statistical forecasts that took the effects of promotions into account fully. This increased the accuracy because the biases were almost eliminated and the random error was reduced by 20%. Thus, the additional effort required to produce forecasts that take promotional effects into account is worthwhile