The Challenge of Machine Learning in Space Weather Nowcasting and Forecasting

The numerous recent breakthroughs in machine learning (ML) make imperative to carefully ponder how the scientific community can benefit from a technology that, although not necessarily new, is today living its golden age. This Grand Challenge review paper is focused on the present and future role of machine learning in space weather. The purpose is twofold. On one hand, we will discuss previous works that use ML for space weather forecasting, focusing in particular on the few areas that have seen most activity: the forecasting of geomagnetic indices, of relativistic electrons at geosynchronous orbits, of solar flares occurrence, of coronal mass ejection propagation time, and of solar wind speed. On the other hand, this paper serves as a gentle introduction to the field of machine learning tailored to the space weather community and as a pointer to a number of open challenges that we believe the community should undertake in the next decade. The recurring themes throughout the review are the need to shift our forecasting paradigm to a probabilistic approach focused on the reliable assessment of uncertainties, and the combination of physics-based and machine learning approaches, known as gray-box.Comment: under revie

Modularity and the predictive mind

Modular approaches to the architecture of the mind claim that some mental mechanisms, such as sensory input processes, operate in special-purpose subsystems that are functionally independent from the rest of the mind. This assumption of modularity seems to be in tension with recent claims that the mind has a predictive architecture. Predictive approaches propose that both sensory processing and higher-level processing are part of the same Bayesian information-processing hierarchy, with no clear boundary between perception and cognition. Furthermore, it is not clear how any part of the predictive architecture could be functionally independent, given that each level of the hierarchy is influenced by the level above. Both the assumption of continuity across the predictive architecture and the seeming non-isolability of parts of the predictive architecture seem to be at odds with the modular approach. I explore and ultimately reject the predictive approach’s apparent commitments to continuity and non-isolation. I argue that predictive architectures can be modular architectures, and that we should in fact expect predictive architectures to exhibit some form of modularity

Progress on Intelligent Guidance and Control for Wind Shear Encounter

Low altitude wind shear poses a serious threat to air safety. Avoiding severe wind shear challenges the ability of flight crews, as it involves assessing risk from uncertain evidence. A computerized intelligent cockpit aid can increase flight crew awareness of wind shear, improving avoidance decisions. The primary functions of a cockpit advisory expert system for wind shear avoidance are discussed. Also introduced are computational techniques being implemented to enable these primary functions

Toward improved hydrologic prediction with reduced uncertainty using sequential multi-model combination

The contemporary usage of hydrologic models has been to rely on a single model to perform the simulation and predictions. Despite the tremendous progress, efforts and investment put into developing more hydrologic models, there is no convincing claim that any particular model in existence is superior to other models for various applications and under all circumstances. This results to reducing the size of the plausible model space and often leads to predictions that may well-represent some phenomena or events at the expenses of others. Assessment of predictive uncertainty based on a single model is subject to statistical bias and most likely underestimation of uncertainty. This endorses the implementation of multi-model methods for more accurate estimation of uncertainty in hydrologic prediction. In this study, we present two methods for the combination of multiple model predictors using Bayesian Model Averaging (BMA) and Sequential Bayesian Model Combination (SBMC). Both methods are statistical schemes to infer a combined probabilistic prediction that possess more reliability and skill than the original model members produced by several competing models. This paper discusses the features of both methods and explains how the limitation of BMA can be overcome by SBMC. Three hydrologic models are considered and it is shown that multi-model combination can result in higher prediction accuracy than individual models. © 2008 ASCE

Bayesian inference for wind field retrieval

In many problems in spatial statistics it is necessary to infer a global problem solution by combining local models. A principled approach to this problem is to develop a global probabilistic model for the relationships between local variables and to use this as the prior in a Bayesian inference procedure. We show how a Gaussian process with hyper-parameters estimated from Numerical Weather Prediction Models yields meteorologically convincing wind fields. We use neural networks to make local estimates of wind vector probabilities. The resulting inference problem cannot be solved analytically, but Markov Chain Monte Carlo methods allow us to retrieve accurate wind fields