374 research outputs found
Koopman invariant subspaces and finite linear representations of nonlinear dynamical systems for control
In this work, we explore finite-dimensional linear representations of
nonlinear dynamical systems by restricting the Koopman operator to an invariant
subspace. The Koopman operator is an infinite-dimensional linear operator that
evolves observable functions of the state-space of a dynamical system [Koopman
1931, PNAS]. Dominant terms in the Koopman expansion are typically computed
using dynamic mode decomposition (DMD). DMD uses linear measurements of the
state variables, and it has recently been shown that this may be too
restrictive for nonlinear systems [Williams et al. 2015, JNLS]. Choosing
nonlinear observable functions to form an invariant subspace where it is
possible to obtain linear models, especially those that are useful for control,
is an open challenge.
Here, we investigate the choice of observable functions for Koopman analysis
that enable the use of optimal linear control techniques on nonlinear problems.
First, to include a cost on the state of the system, as in linear quadratic
regulator (LQR) control, it is helpful to include these states in the
observable subspace, as in DMD. However, we find that this is only possible
when there is a single isolated fixed point, as systems with multiple fixed
points or more complicated attractors are not globally topologically conjugate
to a finite-dimensional linear system, and cannot be represented by a
finite-dimensional linear Koopman subspace that includes the state. We then
present a data-driven strategy to identify relevant observable functions for
Koopman analysis using a new algorithm to determine terms in a dynamical system
by sparse regression of the data in a nonlinear function space [Brunton et al.
2015, arxiv]; we show how this algorithm is related to DMD. Finally, we
demonstrate how to design optimal control laws for nonlinear systems using
techniques from linear optimal control on Koopman invariant subspaces.Comment: 20 pages, 5 figures, 2 code
Variational approach for learning Markov processes from time series data
Inference, prediction and control of complex dynamical systems from time
series is important in many areas, including financial markets, power grid
management, climate and weather modeling, or molecular dynamics. The analysis
of such highly nonlinear dynamical systems is facilitated by the fact that we
can often find a (generally nonlinear) transformation of the system coordinates
to features in which the dynamics can be excellently approximated by a linear
Markovian model. Moreover, the large number of system variables often change
collectively on large time- and length-scales, facilitating a low-dimensional
analysis in feature space. In this paper, we introduce a variational approach
for Markov processes (VAMP) that allows us to find optimal feature mappings and
optimal Markovian models of the dynamics from given time series data. The key
insight is that the best linear model can be obtained from the top singular
components of the Koopman operator. This leads to the definition of a family of
score functions called VAMP-r which can be calculated from data, and can be
employed to optimize a Markovian model. In addition, based on the relationship
between the variational scores and approximation errors of Koopman operators,
we propose a new VAMP-E score, which can be applied to cross-validation for
hyper-parameter optimization and model selection in VAMP. VAMP is valid for
both reversible and nonreversible processes and for stationary and
non-stationary processes or realizations
- …