6,288 research outputs found
A sequential sampling strategy for extreme event statistics in nonlinear dynamical systems
We develop a method for the evaluation of extreme event statistics associated
with nonlinear dynamical systems, using a small number of samples. From an
initial dataset of design points, we formulate a sequential strategy that
provides the 'next-best' data point (set of parameters) that when evaluated
results in improved estimates of the probability density function (pdf) for a
scalar quantity of interest. The approach utilizes Gaussian process regression
to perform Bayesian inference on the parameter-to-observation map describing
the quantity of interest. We then approximate the desired pdf along with
uncertainty bounds utilizing the posterior distribution of the inferred map.
The 'next-best' design point is sequentially determined through an optimization
procedure that selects the point in parameter space that maximally reduces
uncertainty between the estimated bounds of the pdf prediction. Since the
optimization process utilizes only information from the inferred map it has
minimal computational cost. Moreover, the special form of the metric emphasizes
the tails of the pdf. The method is practical for systems where the
dimensionality of the parameter space is of moderate size, i.e. order O(10). We
apply the method to estimate the extreme event statistics for a very
high-dimensional system with millions of degrees of freedom: an offshore
platform subjected to three-dimensional irregular waves. It is demonstrated
that the developed approach can accurately determine the extreme event
statistics using limited number of samples
Output-Weighted Optimal Sampling for Bayesian Experimental Design and Uncertainty Quantification
We introduce a class of acquisition functions for sample selection that leads
to faster convergence in applications related to Bayesian experimental design
and uncertainty quantification. The approach follows the paradigm of active
learning, whereby existing samples of a black-box function are utilized to
optimize the next most informative sample. The proposed method aims to take
advantage of the fact that some input directions of the black-box function have
a larger impact on the output than others, which is important especially for
systems exhibiting rare and extreme events. The acquisition functions
introduced in this work leverage the properties of the likelihood ratio, a
quantity that acts as a probabilistic sampling weight and guides the
active-learning algorithm towards regions of the input space that are deemed
most relevant. We demonstrate superiority of the proposed approach in the
uncertainty quantification of a hydrological system as well as the
probabilistic quantification of rare events in dynamical systems and the
identification of their precursors
Bayesian Recurrent Neural Network Models for Forecasting and Quantifying Uncertainty in Spatial-Temporal Data
Recurrent neural networks (RNNs) are nonlinear dynamical models commonly used
in the machine learning and dynamical systems literature to represent complex
dynamical or sequential relationships between variables. More recently, as deep
learning models have become more common, RNNs have been used to forecast
increasingly complicated systems. Dynamical spatio-temporal processes represent
a class of complex systems that can potentially benefit from these types of
models. Although the RNN literature is expansive and highly developed,
uncertainty quantification is often ignored. Even when considered, the
uncertainty is generally quantified without the use of a rigorous framework,
such as a fully Bayesian setting. Here we attempt to quantify uncertainty in a
more formal framework while maintaining the forecast accuracy that makes these
models appealing, by presenting a Bayesian RNN model for nonlinear
spatio-temporal forecasting. Additionally, we make simple modifications to the
basic RNN to help accommodate the unique nature of nonlinear spatio-temporal
data. The proposed model is applied to a Lorenz simulation and two real-world
nonlinear spatio-temporal forecasting applications
Metamodel-based importance sampling for structural reliability analysis
Structural reliability methods aim at computing the probability of failure of
systems with respect to some prescribed performance functions. In modern
engineering such functions usually resort to running an expensive-to-evaluate
computational model (e.g. a finite element model). In this respect simulation
methods, which may require runs cannot be used directly. Surrogate
models such as quadratic response surfaces, polynomial chaos expansions or
kriging (which are built from a limited number of runs of the original model)
are then introduced as a substitute of the original model to cope with the
computational cost. In practice it is almost impossible to quantify the error
made by this substitution though. In this paper we propose to use a kriging
surrogate of the performance function as a means to build a quasi-optimal
importance sampling density. The probability of failure is eventually obtained
as the product of an augmented probability computed by substituting the
meta-model for the original performance function and a correction term which
ensures that there is no bias in the estimation even if the meta-model is not
fully accurate. The approach is applied to analytical and finite element
reliability problems and proves efficient up to 100 random variables.Comment: 20 pages, 7 figures, 2 tables. Preprint submitted to Probabilistic
Engineering Mechanic
Getting Started with Particle Metropolis-Hastings for Inference in Nonlinear Dynamical Models
This tutorial provides a gentle introduction to the particle
Metropolis-Hastings (PMH) algorithm for parameter inference in nonlinear
state-space models together with a software implementation in the statistical
programming language R. We employ a step-by-step approach to develop an
implementation of the PMH algorithm (and the particle filter within) together
with the reader. This final implementation is also available as the package
pmhtutorial in the CRAN repository. Throughout the tutorial, we provide some
intuition as to how the algorithm operates and discuss some solutions to
problems that might occur in practice. To illustrate the use of PMH, we
consider parameter inference in a linear Gaussian state-space model with
synthetic data and a nonlinear stochastic volatility model with real-world
data.Comment: 41 pages, 7 figures. In press for Journal of Statistical Software.
Source code for R, Python and MATLAB available at:
https://github.com/compops/pmh-tutoria
Discovering and forecasting extreme events via active learning in neural operators
Extreme events in society and nature, such as pandemic spikes or rogue waves,
can have catastrophic consequences. Characterizing extremes is difficult as
they occur rarely, arise from seemingly benign conditions, and belong to
complex and often unknown infinite-dimensional systems. Such challenges render
attempts at characterizing them as moot. We address each of these difficulties
by combining novel training schemes in Bayesian experimental design (BED) with
an ensemble of deep neural operators (DNOs). This model-agnostic framework
pairs a BED scheme that actively selects data for quantifying extreme events
with an ensemble of DNOs that approximate infinite-dimensional nonlinear
operators. We find that not only does this framework clearly beat Gaussian
processes (GPs) but that 1) shallow ensembles of just two members perform best;
2) extremes are uncovered regardless of the state of initial data (i.e. with or
without extremes); 3) our method eliminates "double-descent" phenomena; 4) the
use of batches of suboptimal acquisition points compared to step-by-step global
optima does not hinder BED performance; and 5) Monte Carlo acquisition
outperforms standard minimizers in high-dimensions. Together these conclusions
form the foundation of an AI-assisted experimental infrastructure that can
efficiently infer and pinpoint critical situations across many domains, from
physical to societal systems.Comment: 19 pages, 7 figures, Submitted to Nature Computational Scienc
- …