Neural Networks: Training and Application to Nonlinear System Identification and Control

This dissertation investigates training neural networks for system identification and classification. The research contains two main contributions as follow:1. Reducing number of hidden layer nodes using a feedforward componentThis research reduces the number of hidden layer nodes and training time of neural networks to make them more suited to online identification and control applications by adding a parallel feedforward component. Implementing the feedforward component with a wavelet neural network and an echo state network provides good models for nonlinear systems.The wavelet neural network with feedforward component along with model predictive controller can reliably identify and control a seismically isolated structure during earthquake. The network model provides the predictions for model predictive control. Simulations of a 5-story seismically isolated structure with conventional lead-rubber bearings showed significant reductions of all response amplitudes for both near-field (pulse) and far-field ground motions, including reduced deformations along with corresponding reduction in acceleration response. The controller effectively regulated the apparent stiffness at the isolation level. The approach is also applied to the online identification and control of an unmanned vehicle. Lyapunov theory is used to prove the stability of the wavelet neural network and the model predictive controller. 2. Training neural networks using trajectory based optimization approachesTraining neural networks is a nonlinear non-convex optimization problem to determine the weights of the neural network. Traditional training algorithms can be inefficient and can get trapped in local minima. Two global optimization approaches are adapted to train neural networks and avoid the local minima problem. Lyapunov theory is used to prove the stability of the proposed methodology and its convergence in the presence of measurement errors. The first approach transforms the constraint satisfaction problem into unconstrained optimization. The constraints define a quotient gradient system (QGS) whose stable equilibrium points are local minima of the unconstrained optimization. The QGS is integrated to determine local minima and the local minimum with the best generalization performance is chosen as the optimal solution. The second approach uses the QGS together with a projected gradient system (PGS). The PGS is a nonlinear dynamical system, defined based on the optimization problem that searches the components of the feasible region for solutions. Lyapunov theory is used to prove the stability of PGS and QGS and their stability under presence of measurement noise

Discrete Time Systems

Discrete-Time Systems comprehend an important and broad research field. The consolidation of digital-based computational means in the present, pushes a technological tool into the field with a tremendous impact in areas like Control, Signal Processing, Communications, System Modelling and related Applications. This book attempts to give a scope in the wide area of Discrete-Time Systems. Their contents are grouped conveniently in sections according to significant areas, namely Filtering, Fixed and Adaptive Control Systems, Stability Problems and Miscellaneous Applications. We think that the contribution of the book enlarges the field of the Discrete-Time Systems with signification in the present state-of-the-art. Despite the vertiginous advance in the field, we also believe that the topics described here allow us also to look through some main tendencies in the next years in the research area

Development of U-model enhansed nonlinear systems

Nonlinear control system design has been widely recognised as a challenging issue where the key objective is to develop a general model prototype with conciseness, flexibility and manipulability, so that the designed control system can best match the required performance or specifications. As a generic systematic approach, U-model concept appeared in Prof. Quanmin Zhu’s Doctoral thesis, and U-model approach was firstly published in the journal paper titled with ‘U-model based pole placement for nonlinear plants’ in 2002.The U-model polynomial prototype precisely describes a wide range of smooth nonlinear polynomial models, defined as a controller output u(t-1) based time-varying polynomial models converted from the original nonlinear model. Within this equivalent U-model expression, the first study of U-model based pole placement controller design for nonlinear plants is a simple mapping exercise from ordinary linear and nonlinear difference equations to time-varying polynomials in terms of the plant input u(t-1). The U-model framework realised the concise and applicable design for nonlinear control system by using such linear polynomial control system design approaches.Since the first publication, the U-model methodology has progressed and evolved over the course of a decade. By using the U-model technique, researchers have proposed many different linear algorithms for the design of control systems for the nonlinear polynomial model including; adaptive control, internal control, sliding mode control, predictive control and neural network control. However, limited research has been concerned with the design and analysis of robust stability and performance of U-model based control systems.This project firstly proposes a suitable method to analyse the robust stability of the developed U-model based pole placement control systems against uncertainty. The parameter variation is bounded, thus the robust stability margin of the closed loop system can be determined by using LMI (Linear Matrix Inequality) based robust stability analysis procedure. U-block model is defined as an input output linear closed loop model with pole assignor converted from the U-model based control system. With the bridge of U-model approach, it connects the linear state space design approach with the nonlinear polynomial model. Therefore, LMI based linear robust controller design approaches are able to design enhanced robust control system within the U-block model structure.With such development, the first stage U-model methodology provides concise and flexible solutions for complex problems, where linear controller design methodologies are directly applied to nonlinear polynomial plant-based control system design. The next milestone work expands the U-model technique into state space control systems to establish the new framework, defined as the U-state space model, providing a generic prototype for the simplification of nonlinear state space design approaches.The U-state space model is first described as a controller output u(t-1) based time-varying state equations, which is equivalent to the original linear/nonlinear state space models after conversion. Then, a basic idea of corresponding U-state feedback control system design method is proposed based on the U-model principle. The linear state space feedback control design approach is employed to nonlinear plants described in state space realisation under U-state space structure. The desired state vectors defined as xd(t), are determined by closed loop performance (such as pole placement) or designer specifications (such as LQR). Then the desired state vectors substitute the desired state vectors into original state space equations (regarded as next time state variable xd(t) = x(t) ). Therefore, the controller output u(t-1) can be obtained from one of the roots of a root-solving iterative algorithm.A quad-rotor rotorcraft dynamic model and inverted pendulum system are introduced to verify the U-state space control system design approach for MIMO/SIMO system. The linear design approach is used to determine the closed loop state equation, then the controller output can be obtained from root solver. Numerical examples and case studies are employed in this study to demonstrate the effectiveness of the proposed methods

New Approaches in Automation and Robotics

The book New Approaches in Automation and Robotics offers in 22 chapters a collection of recent developments in automation, robotics as well as control theory. It is dedicated to researchers in science and industry, students, and practicing engineers, who wish to update and enhance their knowledge on modern methods and innovative applications. The authors and editor of this book wish to motivate people, especially under-graduate students, to get involved with the interesting field of robotics and mechatronics. We hope that the ideas and concepts presented in this book are useful for your own work and could contribute to problem solving in similar applications as well. It is clear, however, that the wide area of automation and robotics can only be highlighted at several spots but not completely covered by a single book

Chaotic price dynamics of agricultural commodities

Traditionally, commodity prices have been analyzed and modeled in the context of linear generating processes. The purpose of this dissertation is to address the adequacy of this work through examination of the critical assumption of independence in the residual process of linearly specified models. As an alternative, a test procedure is developed and utilized to demonstrate the appropriateness of applying generalized conditional heteroscedastic time series models (GARCH) to agricultural commodity prices. In addition, a distinction is made between testing for independence and testing for chaos in commodity prices. The price series of interest derive from the major international agricultural commodity markets, sampled monthly over the period 1960--1994. The results of the present analysis suggest that for bananas, beef, coffee, soybeans, wool and wheat seasonally adjusted growth rates, ARCH-GARCH models account for some of the non-linear dependence in these commodity price series. As an alternative to the ARCH-GARCH models, several neural network models were estimated and in some cases outperformed the ARCH family of models in terms of forecast ability. This further demonstrated the nonlinearity present in these time series. Although, further examination is needed, all prices were found to be non-linearly dependent. It was determined by use of different statistical measures for testing for deterministic chaos that wheat prices may be an example of such behavior. Therefore, their may be something to be gained in terms of short-run forecast accuracy by using semi-parametric modeling approaches as applied to wheat prices

CEAS/AIAA/ICASE/NASA Langley International Forum on Aeroelasticity and Structural Dynamics 1999

These proceedings represent a collection of the latest advances in aeroelasticity and structural dynamics from the world community. Research in the areas of unsteady aerodynamics and aeroelasticity, structural modeling and optimization, active control and adaptive structures, landing dynamics, certification and qualification, and validation testing are highlighted in the collection of papers. The wide range of results will lead to advances in the prediction and control of the structural response of aircraft and spacecraft

Cyber-Physical Threat Intelligence for Critical Infrastructures Security

Modern critical infrastructures can be considered as large scale Cyber Physical Systems (CPS). Therefore, when designing, implementing, and operating systems for Critical Infrastructure Protection (CIP), the boundaries between physical security and cybersecurity are blurred. Emerging systems for Critical Infrastructures Security and Protection must therefore consider integrated approaches that emphasize the interplay between cybersecurity and physical security techniques. Hence, there is a need for a new type of integrated security intelligence i.e., Cyber-Physical Threat Intelligence (CPTI). This book presents novel solutions for integrated Cyber-Physical Threat Intelligence for infrastructures in various sectors, such as Industrial Sites and Plants, Air Transport, Gas, Healthcare, and Finance. The solutions rely on novel methods and technologies, such as integrated modelling for cyber-physical systems, novel reliance indicators, and data driven approaches including BigData analytics and Artificial Intelligence (AI). Some of the presented approaches are sector agnostic i.e., applicable to different sectors with a fair customization effort. Nevertheless, the book presents also peculiar challenges of specific sectors and how they can be addressed. The presented solutions consider the European policy context for Security, Cyber security, and Critical Infrastructure protection, as laid out by the European Commission (EC) to support its Member States to protect and ensure the resilience of their critical infrastructures. Most of the co-authors and contributors are from European Research and Technology Organizations, as well as from European Critical Infrastructure Operators. Hence, the presented solutions respect the European approach to CIP, as reflected in the pillars of the European policy framework. The latter includes for example the Directive on security of network and information systems (NIS Directive), the Directive on protecting European Critical Infrastructures, the General Data Protection Regulation (GDPR), and the Cybersecurity Act Regulation. The sector specific solutions that are described in the book have been developed and validated in the scope of several European Commission (EC) co-funded projects on Critical Infrastructure Protection (CIP), which focus on the listed sectors. Overall, the book illustrates a rich set of systems, technologies, and applications that critical infrastructure operators could consult to shape their future strategies. It also provides a catalogue of CPTI case studies in different sectors, which could be useful for security consultants and practitioners as well

Cyber-Physical Threat Intelligence for Critical Infrastructures Security

Modern critical infrastructures can be considered as large scale Cyber Physical Systems (CPS). Therefore, when designing, implementing, and operating systems for Critical Infrastructure Protection (CIP), the boundaries between physical security and cybersecurity are blurred. Emerging systems for Critical Infrastructures Security and Protection must therefore consider integrated approaches that emphasize the interplay between cybersecurity and physical security techniques. Hence, there is a need for a new type of integrated security intelligence i.e., Cyber-Physical Threat Intelligence (CPTI). This book presents novel solutions for integrated Cyber-Physical Threat Intelligence for infrastructures in various sectors, such as Industrial Sites and Plants, Air Transport, Gas, Healthcare, and Finance. The solutions rely on novel methods and technologies, such as integrated modelling for cyber-physical systems, novel reliance indicators, and data driven approaches including BigData analytics and Artificial Intelligence (AI). Some of the presented approaches are sector agnostic i.e., applicable to different sectors with a fair customization effort. Nevertheless, the book presents also peculiar challenges of specific sectors and how they can be addressed. The presented solutions consider the European policy context for Security, Cyber security, and Critical Infrastructure protection, as laid out by the European Commission (EC) to support its Member States to protect and ensure the resilience of their critical infrastructures. Most of the co-authors and contributors are from European Research and Technology Organizations, as well as from European Critical Infrastructure Operators. Hence, the presented solutions respect the European approach to CIP, as reflected in the pillars of the European policy framework. The latter includes for example the Directive on security of network and information systems (NIS Directive), the Directive on protecting European Critical Infrastructures, the General Data Protection Regulation (GDPR), and the Cybersecurity Act Regulation. The sector specific solutions that are described in the book have been developed and validated in the scope of several European Commission (EC) co-funded projects on Critical Infrastructure Protection (CIP), which focus on the listed sectors. Overall, the book illustrates a rich set of systems, technologies, and applications that critical infrastructure operators could consult to shape their future strategies. It also provides a catalogue of CPTI case studies in different sectors, which could be useful for security consultants and practitioners as well

Computational methodology for modelling the dynamics of statistical arbitrage

Recent years have seen the emergence of a multi-disciplinary research area known as "Computational Finance". In many cases the data generating processes of financial and other economic time-series are at best imperfectly understood. By allowing restrictive assumptions about price dynamics to be relaxed, recent advances in computational modelling techniques offer the possibility to discover new "patterns" in market activity. This thesis describes an integrated "statistical arbitrage" framework for identifying, modelling and exploiting small but consistent regularities in asset price dynamics. The methodology developed in the thesis combines the flexibility of emerging techniques such as neural networks and genetic algorithms with the rigour and diagnostic techniques which are provided by established modelling tools from the fields of statistics, econometrics and time-series forecasting. The modelling methodology which is described in the thesis consists of three main parts. The first part is concerned with constructing combinations of time-series which contain a significant predictable component, and is a generalisation of the econometric concept of cointegration. The second part of the methodology is concerned with building predictive models of the mispricing dynamics and consists of low-bias estimation procedures which combine elements of neural and statistical modelling. The third part of the methodology controls the risks posed by model selection and performance instability through actively encouraging diversification across a "portfolio of models". A novel population-based algorithm for joint optimisation of a set of trading strategies is presented, which is inspired both by genetic and evolutionary algorithms and by modern portfolio theory. Throughout the thesis the performance and properties of the algorithms are validated by means of experimental evaluation on synthetic data sets with known characteristics. The effectiveness of the methodology is demonstrated by extensive empirical analysis of real data sets, in particular daily closing prices of FTSE 100 stocks and international equity indices