1,546 research outputs found
Implicit particle methods and their connection with variational data assimilation
The implicit particle filter is a sequential Monte Carlo method for data
assimilation that guides the particles to the high-probability regions via a
sequence of steps that includes minimizations. We present a new and more
general derivation of this approach and extend the method to particle smoothing
as well as to data assimilation for perfect models. We show that the
minimizations required by implicit particle methods are similar to the ones one
encounters in variational data assimilation and explore the connection of
implicit particle methods with variational data assimilation. In particular, we
argue that existing variational codes can be converted into implicit particle
methods at a low cost, often yielding better estimates, that are also equipped
with quantitative measures of the uncertainty. A detailed example is presented
Evaluating Data Assimilation Algorithms
Data assimilation leads naturally to a Bayesian formulation in which the
posterior probability distribution of the system state, given the observations,
plays a central conceptual role. The aim of this paper is to use this Bayesian
posterior probability distribution as a gold standard against which to evaluate
various commonly used data assimilation algorithms.
A key aspect of geophysical data assimilation is the high dimensionality and
low predictability of the computational model. With this in mind, yet with the
goal of allowing an explicit and accurate computation of the posterior
distribution, we study the 2D Navier-Stokes equations in a periodic geometry.
We compute the posterior probability distribution by state-of-the-art
statistical sampling techniques. The commonly used algorithms that we evaluate
against this accurate gold standard, as quantified by comparing the relative
error in reproducing its moments, are 4DVAR and a variety of sequential
filtering approximations based on 3DVAR and on extended and ensemble Kalman
filters.
The primary conclusions are that: (i) with appropriate parameter choices,
approximate filters can perform well in reproducing the mean of the desired
probability distribution; (ii) however they typically perform poorly when
attempting to reproduce the covariance; (iii) this poor performance is
compounded by the need to modify the covariance, in order to induce stability.
Thus, whilst filters can be a useful tool in predicting mean behavior, they
should be viewed with caution as predictors of uncertainty. These conclusions
are intrinsic to the algorithms and will not change if the model complexity is
increased, for example by employing a smaller viscosity, or by using a detailed
NWP model
Controlling overestimation of error covariance in ensemble Kalman filters with sparse observations: A variance limiting Kalman filter
We consider the problem of an ensemble Kalman filter when only partial
observations are available. In particular we consider the situation where the
observational space consists of variables which are directly observable with
known observational error, and of variables of which only their climatic
variance and mean are given. To limit the variance of the latter poorly
resolved variables we derive a variance limiting Kalman filter (VLKF) in a
variational setting. We analyze the variance limiting Kalman filter for a
simple linear toy model and determine its range of optimal performance. We
explore the variance limiting Kalman filter in an ensemble transform setting
for the Lorenz-96 system, and show that incorporating the information of the
variance of some un-observable variables can improve the skill and also
increase the stability of the data assimilation procedure.Comment: 32 pages, 11 figure
Revision of TR-09-25: A Hybrid Variational/Ensemble Filter Approach to Data Assimilation
Two families of methods are widely used in data assimilation: the
four dimensional variational (4D-Var) approach, and the ensemble Kalman filter
(EnKF) approach. The two families have been developed largely through parallel
research efforts. Each method has its advantages and disadvantages. It is of
interest to develop hybrid data assimilation
algorithms that can combine the relative strengths of the two approaches.
This paper proposes a subspace approach to investigate the theoretical equivalence between the suboptimal
4D-Var method (where only a small number of optimization iterations are
performed) and the practical EnKF method (where only a small number of ensemble
members are used) in a linear Gaussian setting. The analysis motivates a new
hybrid algorithm: the optimization directions obtained from a short window
4D-Var run are used to construct the EnKF initial ensemble.
The proposed hybrid method is computationally less expensive than a full
4D-Var, as only short assimilation windows are considered. The hybrid method has the potential to
perform better than the regular EnKF due to its look-ahead property.
Numerical results
show that the proposed hybrid ensemble filter method performs better than the
regular EnKF method for both linear and nonlinear test problems
A 4D-Var Method with Flow-Dependent Background Covariances for the Shallow-Water Equations
The 4D-Var method for filtering partially observed nonlinear chaotic
dynamical systems consists of finding the maximum a-posteriori (MAP) estimator
of the initial condition of the system given observations over a time window,
and propagating it forward to the current time via the model dynamics. This
method forms the basis of most currently operational weather forecasting
systems. In practice the optimization becomes infeasible if the time window is
too long due to the non-convexity of the cost function, the effect of model
errors, and the limited precision of the ODE solvers. Hence the window has to
be kept sufficiently short, and the observations in the previous windows can be
taken into account via a Gaussian background (prior) distribution. The choice
of the background covariance matrix is an important question that has received
much attention in the literature. In this paper, we define the background
covariances in a principled manner, based on observations in the previous
assimilation windows, for a parameter . The method is at most times
more computationally expensive than using fixed background covariances,
requires little tuning, and greatly improves the accuracy of 4D-Var. As a
concrete example, we focus on the shallow-water equations. The proposed method
is compared against state-of-the-art approaches in data assimilation and is
shown to perform favourably on simulated data. We also illustrate our approach
on data from the recent tsunami of 2011 in Fukushima, Japan.Comment: 32 pages, 5 figure
- …