Reduced order modeling of fluid flows: Machine learning, Kolmogorov barrier, closure modeling, and partitioning

In this paper, we put forth a long short-term memory (LSTM) nudging framework for the enhancement of reduced order models (ROMs) of fluid flows utilizing noisy measurements. We build on the fact that in a realistic application, there are uncertainties in initial conditions, boundary conditions, model parameters, and/or field measurements. Moreover, conventional nonlinear ROMs based on Galerkin projection (GROMs) suffer from imperfection and solution instabilities due to the modal truncation, especially for advection-dominated flows with slow decay in the Kolmogorov width. In the presented LSTM-Nudge approach, we fuse forecasts from a combination of imperfect GROM and uncertain state estimates, with sparse Eulerian sensor measurements to provide more reliable predictions in a dynamical data assimilation framework. We illustrate the idea with the viscous Burgers problem, as a benchmark test bed with quadratic nonlinearity and Laplacian dissipation. We investigate the effects of measurements noise and state estimate uncertainty on the performance of the LSTM-Nudge behavior. We also demonstrate that it can sufficiently handle different levels of temporal and spatial measurement sparsity. This first step in our assessment of the proposed model shows that the LSTM nudging could represent a viable realtime predictive tool in emerging digital twin systems

Data-Driven Forecasting of High-Dimensional Chaotic Systems with Long Short-Term Memory Networks

We introduce a data-driven forecasting method for high-dimensional chaotic systems using long short-term memory (LSTM) recurrent neural networks. The proposed LSTM neural networks perform inference of high-dimensional dynamical systems in their reduced order space and are shown to be an effective set of nonlinear approximators of their attractor. We demonstrate the forecasting performance of the LSTM and compare it with Gaussian processes (GPs) in time series obtained from the Lorenz 96 system, the Kuramoto-Sivashinsky equation and a prototype climate model. The LSTM networks outperform the GPs in short-term forecasting accuracy in all applications considered. A hybrid architecture, extending the LSTM with a mean stochastic model (MSM-LSTM), is proposed to ensure convergence to the invariant measure. This novel hybrid method is fully data-driven and extends the forecasting capabilities of LSTM networks.Comment: 31 page

What can systems and control theory do for agricultural science?

Abstract: While many professionals with a background in agricultural and bio-resource sciences work with models, only few have been exposed to systems and control theory. The purpose of this paper is to elucidate a selection of methods from systems theory that can be beneficial to quantitative agricultural science. The state space representation of a dynamical system is the corner stone in the mainstream of systems theory. It is not well known in agro-modelling that linearization followed by evaluation of eigenvalues and eigenvectors of the system matrix is useful to obtain dominant time constants and dominant directions in state space, and offers opportunities for science-based model reduction. The continuous state space description is also useful in deriving truly equivalent discrete time models, and clearly shows that parameters obtained with discrete models must be interpreted with care when transferred to another model code environment. Sensitivity analysis of dynamic models reveals that sensitivity is time and input dependent. Identifiability and sensitivity are essential notions in the design of informative experiments, and the idea of persistent excitation, leading to dynamic experiments rather than the usual static experiments can be very beneficial. A special branch of systems theory is control theory. Obviously, control plays an important part in agricultural and bio-systems engineering, but it is argued that also agronomists can profit from notions from the world of control, even if practical control options are restricted to alleviating growth limiting conditions, rather than true crop control. The most important is the idea of reducing uncertainty via feed-back. On the other hand, the systems and control community is challenged to do more to address the problems of real life, such as spatial variability, measurement delays, lacking data, environmental stochasticity, parameter variability, unavoidable model uncertainty, discrete phenomena, variable system structures, the interaction of technical ad living systems, and, indeed, the study of the functioning of life itself

Nonlinear Systems

Open Mathematics is a challenging notion for theoretical modeling, technical analysis, and numerical simulation in physics and mathematics, as well as in many other fields, as highly correlated nonlinear phenomena, evolving over a large range of time scales and length scales, control the underlying systems and processes in their spatiotemporal evolution. Indeed, available data, be they physical, biological, or financial, and technologically complex systems and stochastic systems, such as mechanical or electronic devices, can be managed from the same conceptual approach, both analytically and through computer simulation, using effective nonlinear dynamics methods. The aim of this Special Issue is to highlight papers that show the dynamics, control, optimization and applications of nonlinear systems. This has recently become an increasingly popular subject, with impressive growth concerning applications in engineering, economics, biology, and medicine, and can be considered a veritable contribution to the literature. Original papers relating to the objective presented above are especially welcome subjects. Potential topics include, but are not limited to: Stability analysis of discrete and continuous dynamical systems; Nonlinear dynamics in biological complex systems; Stability and stabilization of stochastic systems; Mathematical models in statistics and probability; Synchronization of oscillators and chaotic systems; Optimization methods of complex systems; Reliability modeling and system optimization; Computation and control over networked systems

A Review of Fault Diagnosing Methods in Power Transmission Systems

Transient stability is important in power systems. Disturbances like faults need to be segregated to restore transient stability. A comprehensive review of fault diagnosing methods in the power transmission system is presented in this paper. Typically, voltage and current samples are deployed for analysis. Three tasks/topics; fault detection, classification, and location are presented separately to convey a more logical and comprehensive understanding of the concepts. Feature extractions, transformations with dimensionality reduction methods are discussed. Fault classification and location techniques largely use artificial intelligence (AI) and signal processing methods. After the discussion of overall methods and concepts, advancements and future aspects are discussed. Generalized strengths and weaknesses of different AI and machine learning-based algorithms are assessed. A comparison of different fault detection, classification, and location methods is also presented considering features, inputs, complexity, system used and results. This paper may serve as a guideline for the researchers to understand different methods and techniques in this field

Measurements, Models, Systems and Design

531 s.

Towards fully automated high-dimensional parameterized macromodeling

This paper presents a fully automated algorithm for the extraction of parameterized macromodels from frequency responses. The reference framework is based on a frequency-domain rational approximation combined with a parameter-space expansion into Gaussian Radial Basis Functions (RBF). An iterative least-squares fitting with positivity constraints is used to optimize model coefficients, with a guarantee of uniform stability over the parameter space. The main novel contribution of this work is a set of algorithms, supported by strong theoretical arguments with associated proofs, for the automated determination of all the hyper-parameters that define model orders, placement and width of RBFs. With respect to standard approaches, which tune these parameters using time-consuming tentative model extractions following a trial-and-error strategy, the presented technique allows much faster tuning of the model structure. The numerical results show that models with up to ten independent parameters are easily extracted in few minutes