Identification of physical processes via data driven methods

Extracting governing equations from data can be viewed as reverse engineering of Nature- using data to identify the physical laws/models. This approach is crucial for fields where data is abundant ( such as geophysical flows, finance, and neuroscience) but the physical laws based on the first principles are not available. In recent years, the use of machine learning (ML) methods complemented the need for formulating mathematical models through the application of data analysis algorithms that allow accurate estimation of observed dynamics by learning automatically from the given observations. The neural networks and symbolic regression (SR) based approaches are the most popular ML frameworks used to learn the underlying physical process by only the observing data. While neural network approaches have shown great promise, its black-box nature makes it difficult to interpret the learned models. On the other hand, symbolic regression algorithms are capable of learning/finding an analytically tractable function in symbolic form. Hence to address the functional expressibility, a key limitation of the black-box machine learning methods, this study has explored the use of symbolic regression approaches for identifying relations and operators that accurately represent the underlying physical processes. This study demonstrates the use of an evolutionary algorithm called gene expression programming (GEP) and a sparse optimization algorithm called sequential threshold ridge regression (STRidge) in discovering physical models. The effectiveness of these algorithms is demonstrated on four different applications: (1) partial differential equation (PDE) discovery, (2) truncation error analysis, (3) hidden physics discovery and (4 ) discovering subgrid-scale closure models. This study shows the GEP and STRidge algorithms are able to distill various linear/nonlinear PDEs, truncation error terms and unknown source terms of 1D and 2D PDEs. Furthermore, the classical Smagorinsky model is identified for subgrid-scale (SGS) closure from an array of tailored features in solving the 2D Kraichnan turbulence problem. Our results demonstrate the huge potential of these techniques in distilling complex nonlinear physics models from only observing the data. Furthermore, this study reveals the importance of feature selection/feature engineering and embedding the prior knowledge about the unknown dynamical system in terms of invariances for identifying models

New Challenges Arising in Engineering Problems with Fractional and Integer Order

Mathematical models have been frequently studied in recent decades, in order to obtain the deeper properties of real-world problems. In particular, if these problems, such as finance, soliton theory and health problems, as well as problems arising in applied science and so on, affect humans from all over the world, studying such problems is inevitable. In this sense, the first step in understanding such problems is the mathematical forms. This comes from modeling events observed in various fields of science, such as physics, chemistry, mechanics, electricity, biology, economy, mathematical applications, and control theory. Moreover, research done involving fractional ordinary or partial differential equations and other relevant topics relating to integer order have attracted the attention of experts from all over the world. Various methods have been presented and developed to solve such models numerically and analytically. Extracted results are generally in the form of numerical solutions, analytical solutions, approximate solutions and periodic properties. With the help of newly developed computational systems, experts have investigated and modeled such problems. Moreover, their graphical simulations have also been presented in the literature. Their graphical simulations, such as 2D, 3D and contour figures, have also been investigated to obtain more and deeper properties of the real world problem

Nonlinear Analysis and Optimization with Applications

Nonlinear analysis has wide and significant applications in many areas of mathematics, including functional analysis, variational analysis, nonlinear optimization, convex analysis, nonlinear ordinary and partial differential equations, dynamical system theory, mathematical economics, game theory, signal processing, control theory, data mining, and so forth. Optimization problems have been intensively investigated, and various feasible methods in analyzing convergence of algorithms have been developed over the last half century. In this Special Issue, we will focus on the connection between nonlinear analysis and optimization as well as their applications to integrate basic science into the real world

Wavelet Methods for the Solutions of Partial and Fractional Differential Equations Arising in Physical Problems

The subject of fractional calculus has gained considerable popularity and importance during the past three decades or so, mainly due to its demonstrated applications in numerous seemingly diverse and widespread fields of science and engineering. It deals with derivatives and integrals of arbitrary orders. The fractional derivative has been occurring in many physical problems, such as frequency-dependent damping behavior of materials, motion of a large thin plate in a Newtonian fluid, creep and relaxation functions for viscoelastic materials, the PI D controller for the control of dynamical systems etc. Phenomena in electromagnetics, acoustics, viscoelasticity, electrochemistry, control theory, neutron point kinetic model, anomalous diffusion, Brownian motion, signal and image processing, fluid dynamics and material science are well described by differential equations of fractional order. Generally, nonlinear partial differential equations of fractional order are difficult to solve. So for the last few decades, a great deal of attention has been directed towards the solution (both exact and numerical) of these problems. The aim of this dissertation is to present an extensive study of different wavelet methods for obtaining numerical solutions of mathematical problems occurring in disciplines of science and engineering. This present work also provides a comprehensive foundation of different wavelet methods comprising Haar wavelet method, Legendre wavelet method, Legendre multi-wavelet methods, Chebyshev wavelet method, Hermite wavelet method and Petrov-Galerkin method. The intension is to examine the accuracy of various wavelet methods and their efficiency for solving nonlinear fractional differential equations. With the widespread applications of wavelet methods for solving difficult problems in diverse fields of science and engineering such as wave propagation, data compression, image processing, pattern recognition, computer graphics and in medical technology, these methods have been implemented to develop accurate and fast algorithms for solving integral, differential and integro-differential equations, especially those whose solutions are highly localized in position and scale. The main feature of wavelets is its ability to convert the given differential and integral equations to a system of linear or nonlinear algebraic equations, which can be solved by numerical methods. Therefore, our main focus in the present work is to analyze the application of wavelet based transform methods for solving the problem of fractional order partial differential equations. The introductory concept of wavelet, wavelet transform and multi-resolution analysis (MRA) have been discussed in the preliminary chapter. The basic idea of various analytical and numerical methods viz. Variational Iteration Method (VIM), Homotopy Perturbation Method (HPM), Homotopy Analysis Method (HAM), First Integral Method (FIM), Optimal Homotopy Asymptotic Method (OHAM), Haar Wavelet Method, Legendre Wavelet Method, Chebyshev Wavelet Method and Hermite Wavelet Method have been presented in chapter 1. In chapter 2, we have considered both analytical and numerical approach for solving some particular nonlinear partial differential equations like Burgers’ equation, modified Burgers’ equation, Huxley equation, Burgers-Huxley equation and modified KdV equation, which have a wide variety of applications in physical models. Variational Iteration Method and Haar wavelet Method are applied to obtain the analytical and numerical approximate solution of Huxley and Burgers-Huxley equations. Comparisons between analytical solution and numerical solution have been cited in tables and also graphically. The Haar wavelet method has also been applied to solve Burgers’, modified Burgers’, and modified KdV equations numerically. The results thus obtained are compared with exact solutions as well as solutions available in open literature. Error of collocation method has been presented in this chapter. Methods like Homotopy Perturbation Method (HPM) and Optimal Homotopy Asymptotic Method (OHAM) are very powerful and efficient techniques for solving nonlinear PDEs. Using these methods, many functional equations such as ordinary, partial differential equations and integral equations have been solved. We have implemented HPM and OHAM in chapter 3, in order to obtain the analytical approximate solutions of system of nonlinear partial differential equation viz. the Boussinesq-Burgers’ equations. Also, the Haar wavelet method has been applied to obtain the numerical solution of BoussinesqBurgers’ equations. Also, the convergence of HPM and OHAM has been discussed in this chapter. The mathematical modeling and simulation of systems and processes, based on the description of their properties in terms of fractional derivatives, naturally leads to differential equations of fractional order and the necessity to solve such equations. The mathematical preliminaries of fractional calculus, definitions and theorems have been presented in chapter 4. Next, in this chapter, the Haar wavelet method has been analyzed for solving fractional differential equations. The time-fractional Burgers-Fisher, generalized Fisher type equations, nonlinear time- and space-fractional Fokker-Planck equations have been solved by using two-dimensional Haar wavelet method. The obtained results are compared with the Optimal Homotopy Asymptotic Method (OHAM), the exact solutions and the results available in open literature. Comparison of obtained results with OHAM, Adomian Decomposition Method (ADM), VIM and Operational Tau Method (OTM) has been demonstrated in order to justify the accuracy and efficiency of the proposed schemes. The convergence of two-dimensional Haar wavelet technique has been provided at the end of this chapter. In chapter 5, the fractional differential equations such as KdV-Burger-Kuramoto (KBK) equation, seventh order KdV (sKdV) equation and Kaup-Kupershmidt (KK) equation have been solved by using two-dimensional Legendre wavelet and Legendre multi-wavelet methods. The main focus of this chapter is the application of two-dimensional Legendre wavelet technique for solving nonlinear fractional differential equations like timefractional KBK equation, time-fractional sKdV equation in order to demonstrate the efficiency and accuracy of the proposed wavelet method. Similarly in chapter 6, twodimensional Chebyshev wavelet method has been implemented to obtain the numerical solutions of the time-fractional Sawada-Kotera equation, fractional order Camassa-Holm equation and Riesz space-fractional sine-Gordon equations. The convergence analysis has been done for these wavelet methods. In chapter 7, the solitary wave solution of fractional modified Fornberg-Whitham equation has been attained by using first integral method and also the approximate solutions obtained by optimal homotopy asymptotic method (OHAM) are compared with the exact solutions acquired by first integral method. Also, the Hermite wavelet method has been implemented to obtain approximate solutions of fractional modified Fornberg-Whitham equation. The Hermite wavelet method is implemented to system of nonlinear fractional differential equations viz. the fractional Jaulent-Miodek equations. Convergence of this wavelet methods has been discussed in this chapter. Chapter 8 emphasizes on the application of Petrov-Galerkin method for solving the fractional differential equations such as the fractional KdV-Burgers’ (KdVB) equation and the fractional Sharma-TassoOlver equation with a view to exhibit the capabilities of this method in handling nonlinear equation. The main objective of this chapter is to establish the efficiency and accuracy of Petrov-Galerkin method in solving fractional differential equtaions numerically by implementing a linear hat function as the trial function and a quintic B-spline function as the test function. Various wavelet methods have been successfully employed to numerous partial and fractional differential equations in order to demonstrate the validity and accuracy of these procedures. Analyzing the numerical results, it can be concluded that the wavelet methods provide worthy numerical solutions for both classical and fractional order partial differential equations. Finally, it is worthwhile to mention that the proposed wavelet methods are promising and powerful methods for solving fractional differential equations in mathematical physics. This work also aimed at, to make this subject popular and acceptable to engineering and science community to appreciate the universe of wonderful mathematics, which is in between classical integer order differentiation and integration, which till now is not much acknowledged, and is hidden from scientists and engineers. Therefore, our goal is to encourage the reader to appreciate the beauty as well as the usefulness of these numerical wavelet based techniques in the study of nonlinear physical system

The development of a predictive procedure for localised three dimensional river flows

This thesis contains the formulation, development and initial tests of a computer model for the prediction of fully three dimensional turbulent free surface flows typically found at localised areas of river systems. It is the intention that the model will be used to predict flow situations which are fully three dimensional. The model is, therefore, tested against a fully three dimensional test case of flow in a two-stage meandering channel. However, the model is not intended simply to be for computing flows in meandering river channels. Rather the model is intended to be used in a variety of problems which are outlined in the thesis. The Reynolds Averaged Navier-Stokes equations form the basis of the physical system. The Reynolds stresses are represented by two different stress-strain relationships: (1) a linear relationship and (2) a non-linear relationship. These relationships rely on an eddy viscosity and a turbulence time-scale which are calculated from two characterising turbulence quantities, a velocity squared scale, k, and an inverse length scale, . These quantities are computed from differential transport equations. Non-linear stress-strain relationships are relatively new and, it has been argued by their originators, require application to several different problems to fully ascertain their potential for future use. The author addresses this demand by applying them to two new problems. These are flow in a plenum chamber and open channel flow over a backward facing step. The equations are solved by an operator splitting method which, it is argued, allows for an accurate and realistic treatment of the troublesome advection terms at low spatial resolutions. This is thought to be essential since for three dimensional problems owing to computer time limitations achieving grid independent solutions with low order schemes is at present very difficult. The advantage of the present approach is demonstrated with reference to a simple one dimensional analogue

Discovering Causal Relations and Equations from Data

Physics is a field of science that has traditionally used the scientific method to answer questions about why natural phenomena occur and to make testable models that explain the phenomena. Discovering equations, laws and principles that are invariant, robust and causal explanations of the world has been fundamental in physical sciences throughout the centuries. Discoveries emerge from observing the world and, when possible, performing interventional studies in the system under study. With the advent of big data and the use of data-driven methods, causal and equation discovery fields have grown and made progress in computer science, physics, statistics, philosophy, and many applied fields. All these domains are intertwined and can be used to discover causal relations, physical laws, and equations from observational data. This paper reviews the concepts, methods, and relevant works on causal and equation discovery in the broad field of Physics and outlines the most important challenges and promising future lines of research. We also provide a taxonomy for observational causal and equation discovery, point out connections, and showcase a complete set of case studies in Earth and climate sciences, fluid dynamics and mechanics, and the neurosciences. This review demonstrates that discovering fundamental laws and causal relations by observing natural phenomena is being revolutionised with the efficient exploitation of observational data, modern machine learning algorithms and the interaction with domain knowledge. Exciting times are ahead with many challenges and opportunities to improve our understanding of complex systems.Comment: 137 page

Acoustic Waves

The concept of acoustic wave is a pervasive one, which emerges in any type of medium, from solids to plasmas, at length and time scales ranging from sub-micrometric layers in microdevices to seismic waves in the Sun's interior. This book presents several aspects of the active research ongoing in this field. Theoretical efforts are leading to a deeper understanding of phenomena, also in complicated environments like the solar surface boundary. Acoustic waves are a flexible probe to investigate the properties of very different systems, from thin inorganic layers to ripening cheese to biological systems. Acoustic waves are also a tool to manipulate matter, from the delicate evaporation of biomolecules to be analysed, to the phase transitions induced by intense shock waves. And a whole class of widespread microdevices, including filters and sensors, is based on the behaviour of acoustic waves propagating in thin layers. The search for better performances is driving to new materials for these devices, and to more refined tools for their analysis