A future for intelligent autonomous ocean observing systems

Ocean scientists have dreamed of and recently started to realize an ocean observing revolution with autonomous observing platforms and sensors. Critical questions to be answered by such autonomous systems are where, when, and what to sample for optimal information, and how to optimally reach the sampling locations. Definitions, concepts, and progress towards answering these questions using quantitative predictions and fundamental principles are presented. Results in reachability and path planning, adaptive sampling, machine learning, and teaming machines with scientists are overviewed. The integrated use of differential equations and theory from varied disciplines is emphasized. The results provide an inference engine and knowledge base for expert autonomous observing systems. They are showcased using a set of recent at-sea campaigns and realistic simulations. Real-time experiments with identical autonomous underwater vehicles (AUVs) in the Buzzards Bay and Vineyard Sound region first show that our predicted time-optimal paths were faster than shortest distance paths. Deterministic and probabilistic reachability and path forecasts issued and validated for gliders and floats in the northern Arabian Sea are then presented. Novel Bayesian adaptive sampling for hypothesis testing and optimal learning are finally shown to forecast the observations most informative to estimate the accuracy of model formulations, the values of ecosystem parameters and dynamic fields, and the presence of Lagrangian Coherent Structures

Combining Stochastic Parameterized Reduced-Order Models with Machine Learning for Data Assimilation and Uncertainty Quantification with Partial Observations

A hybrid data assimilation algorithm is developed for complex dynamical systems with partial observations. The method starts with applying a spectral decomposition to the entire spatiotemporal fields, followed by creating a machine learning model that builds a nonlinear map between the coefficients of observed and unobserved state variables for each spectral mode. A cheap low-order nonlinear stochastic parameterized extended Kalman filter (SPEKF) model is employed as the forecast model in the ensemble Kalman filter to deal with each mode associated with the observed variables. The resulting ensemble members are then fed into the machine learning model to create an ensemble of the corresponding unobserved variables. In addition to the ensemble spread, the training residual in the machine learning-induced nonlinear map is further incorporated into the state estimation that advances the quantification of the posterior uncertainty. The hybrid data assimilation algorithm is applied to a precipitating quasi-geostrophic (PQG) model, which includes the effects of water vapor, clouds, and rainfall beyond the classical two-level QG model. The complicated nonlinearities in the PQG equations prevent traditional methods from building simple and accurate reduced-order forecast models. In contrast, the SPEKF model is skillful in recovering the intermittent observed states, and the machine learning model effectively estimates the chaotic unobserved signals. Utilizing the calibrated SPEKF and machine learning models under a moderate cloud fraction, the resulting hybrid data assimilation remains reasonably accurate when applied to other geophysical scenarios with nearly clear skies or relatively heavy rainfall, implying the robustness of the algorithm for extrapolation

Combining Crop Models and Remote Sensing for Yield Prediction: Concepts, Applications and Challenges for Heterogeneous Smallholder Environments

JRC, CCAFS jointly sponsored the workshop on June 13-14, 2012, at the JRC in Ispra, Italy, to identify avenues for exploiting remote sensing information to improving crop forecasting in smallholder farming environments. The workshop’s objectives were: 1) To advance the state-of-knowledge of data assimilation for crop yield forecasting; 2) To address challenges and needs for successful applications of data assimilation in forecasting crop yields in heterogeneous, smallholder environments; and, 3) To enhance collaboration and exchange of knowledge among data assimilation and crop forecasting groups. The workshop succeeded in bringing together scientists from around the world. This has enabled discussions on research and results and has greatly enhanced collaboration and exchange of knowledge, especially about data assimilation and crop forecasting

A Gaussian Mixture Model Smoother for Continuous Nonlinear Stochastic Dynamical Systems: Theory and Scheme

Retrospective inference through Bayesian smoothing is indispensable in geophysics, with crucial applications in ocean and numerical weather estimation, climate dynamics, and Earth system modeling. However, dealing with the high-dimensionality and nonlinearity of geophysical processes remains a major challenge in the development of Bayesian smoothers. Addressing this issue, a novel subspace smoothing methodology for high-dimensional stochastic fields governed by general nonlinear dynamics is obtained. Building on recent Bayesian filters and classic Kalman smoothers, the fundamental equations and forward-backward algorithms of new Gaussian Mixture Model (GMM) smoothers are derived, for both the full state space and dynamic subspace. For the latter, the stochastic Dynamically Orthogonal (DO) field equations and their time-evolving stochastic subspace are employed to predict the prior subspace probabilities. Bayesian inference, both forward and backward in time, is then analytically carried out in the dominant stochastic subspace, after fitting semiparametric GMMs to joint subspace realizations. The theoretical properties, varied forms, and computational costs of the new GMM smoother equations are presented and discussed.United States. Office of Naval Research (N00014-09-1- 0676)United States. Office of Naval Research (N00014-14-1- 0476)United States. Office of Naval Research (N00014-13-1-0518)United States. Office of Naval Research ( N00014-14-1-0725

Combining Crop Models and Remote Sensing for Yield Prediction: Concepts, Applications and Challenges for Heterogeneous Smallholder Environments

JRC and CCAFS jointly organized a workshop on June 13-14, 2012 in Ispra, Italy with the aim to advance the state-of-knowledge of data assimilation for crop yield forecasting in general, to address challenges and needs for successful applications of data assimilation in forecasting crop yields in heterogeneous, smallholder environments, and to enhance collaboration and exchange of knowledge among data assimilation and crop forecasting groups. The workshop showed that advances made in crop science are widely applicable to crop forecasting. The presentations of the participants approached the challenge from many sides, leading to ideas for improvement that can be implemented in real-time, operational crop yield forecasting. When applied, this knowledge has the potential to benefit the livelihoods of smallholder farmers in the developing world.JRC.H.4-Monitoring Agricultural Resource