Development of Advanced Verification and Validation Procedures and Tools for the Certification of Learning Systems in Aerospace Applications

Adaptive control technologies that incorporate learning algorithms have been proposed to enable automatic flight control and vehicle recovery, autonomous flight, and to maintain vehicle performance in the face of unknown, changing, or poorly defined operating environments. In order for adaptive control systems to be used in safety-critical aerospace applications, they must be proven to be highly safe and reliable. Rigorous methods for adaptive software verification and validation must be developed to ensure that control system software failures will not occur. Of central importance in this regard is the need to establish reliable methods that guarantee convergent learning, rapid convergence (learning) rate, and algorithm stability. This paper presents the major problems of adaptive control systems that use learning to improve performance. The paper then presents the major procedures and tools presently developed or currently being developed to enable the verification, validation, and ultimate certification of these adaptive control systems. These technologies include the application of automated program analysis methods, techniques to improve the learning process, analytical methods to verify stability, methods to automatically synthesize code, simulation and test methods, and tools to provide on-line software assurance

A Vector Matrix Real Time Backpropagation Algorithm for Recurrent neural networks That Approximate Multi-valued Periodic Functions

Unlike feedforward neural networks (FFNN) which can act as universal function approximators, recursive, or recurrent, neural networks can act as universal approximators for multi-valued functions. In this paper, a real time recursive backpropagation (RTRBP) algorithm in a vector matrix form is developed for a two-layer globally recursive neural network that has multiple delays in its feedback path. This algorithm has been evaluated on two GRNNs that approximate both an analytic and nonanalytic periodic multi-valued function that a feedforward neural network is not capable of approximating

Artificial neural network algorithms for active noise control applications

6 pages, 5 figures.-- PACS nr.: 43.50 Ki.-- Communication presented at: Forum Acusticum Sevilla 2002 (Sevilla, Spain, 16-20 Sep 2002), comprising: 3rd European Congress on Acoustics; XXXIII Spanish Congress on Acoustics (TecniAcústica 2002); European and Japanese Symposium on Acoustics; 3rd Iberian Congress on Acoustics.-- Special issue of the journal Revista de Acústica, Vol. XXXIII, year 2002.This paper shows the use of several methods commonly applied to training Artificial Neural Networks (ANN) in Active Noise Control (ANC) systems. Although ANN are usually focused on off-line training, real-time systems can take advantage of modern microprocessors in order to use these techniques. A theoretical study of which of these methods suit best in ANC systems is presented. The results of several simulations will show their effectiveness.This work has been supported by the Comisión Interministerial de Ciencia y Tecnología (CICYT) under the project DPI2001-1613-C02-01.Peer reviewe

Neural network modeling of the dynamics of autonomous underwater vehicles for Kalman filtering and improved localization

Autonomous Underwater Vehicles (AUVs) and Remotely Operated Vehicles are used for a variety of underwater operations and deep-sea explorations. One of the major challenges faced by these vehicles is localization i.e., the ability of these vehicles to identify their location with respect to a reference point. The kinematic Extended Kalman filters have been used in localization in a method known as dead reckoning. The accuracy of the localization systems can be improved if a dynamic model is used instead of the kinematic model. The previously derived dynamic model was implemented in real time in UUVSim, a simulation environment. The dynamic model was tested against the kinematic model on various test courses and it was found that the dynamic model was more stable and accurate than the kinematic model. One of the major drawbacks of the dynamic model was that it required the use of numerous coefficients. The process of determining these coefficients was extensive, requiring significant experimentation time. This research explores the use of a Neural Network architecture to replace these dynamic equations. Initial experiments have showed promising results for the Neural Network although modifications will be required before the controller can be made universally applicable

Adaptive neural network cascade control system with entropy-based design

A neural network (NN) based cascade control system is developed, in which the primary PID controller is constructed by NN. A new entropy-based measure, named the centred error entropy (CEE) index, which is a weighted combination of the error cross correntropy (ECC) criterion and the error entropy criterion (EEC), is proposed to tune the NN-PID controller. The purpose of introducing CEE in controller design is to ensure that the uncertainty in the tracking error is minimised and also the peak value of the error probability density function (PDF) being controlled towards zero. The NN-controller design based on this new performance function is developed and the convergent conditions are. During the control process, the CEE index is estimated by a Gaussian kernel function. Adaptive rules are developed to update the kernel size in order to achieve more accurate estimation of the CEE index. This NN cascade control approach is applied to superheated steam temperature control of a simulated power plant system, from which the effectiveness and strength of the proposed strategy are discussed by comparison with NN-PID controllers tuned with EEC and ECC criterions

Adaptive Control

Adaptive control has been a remarkable field for industrial and academic research since 1950s. Since more and more adaptive algorithms are applied in various control applications, it is becoming very important for practical implementation. As it can be confirmed from the increasing number of conferences and journals on adaptive control topics, it is certain that the adaptive control is a significant guidance for technology development.The authors the chapters in this book are professionals in their areas and their recent research results are presented in this book which will also provide new ideas for improved performance of various control application problems

Sparse Wide-Area Control of Power Systems using Data-driven Reinforcement Learning

In this paper we present an online wide-area oscillation damping control (WAC) design for uncertain models of power systems using ideas from reinforcement learning. We assume that the exact small-signal model of the power system at the onset of a contingency is not known to the operator and use the nominal model and online measurements of the generator states and control inputs to rapidly converge to a state-feedback controller that minimizes a given quadratic energy cost. However, unlike conventional linear quadratic regulators (LQR), we intend our controller to be sparse, so its implementation reduces the communication costs. We, therefore, employ the gradient support pursuit (GraSP) optimization algorithm to impose sparsity constraints on the control gain matrix during learning. The sparse controller is thereafter implemented using distributed communication. Using the IEEE 39-bus power system model with 1149 unknown parameters, it is demonstrated that the proposed learning method provides reliable LQR performance while the controller matched to the nominal model becomes unstable for severely uncertain systems.Comment: Submitted to IEEE ACC 2019. 8 pages, 4 figure

Training Recurrent Neural Networks With the Levenberg-Marquardt Algorithm for Optimal Control of a Grid-Connected Converter

This paper investigates how to train a recurrent neural network (RNN) using the Levenberg-Marquardt (LM) algorithm as well as how to implement optimal control of a grid-connected converter (GCC) using an RNN. To successfully and efficiently train an RNN using the LM algorithm, a new forward accumulation through time (FATT) algorithm is proposed to calculate the Jacobian matrix required by the LM algorithm. This paper explores how to incorporate FATT into the LM algorithm. The results show that the combination of the LM and FATT algorithms trains RNNs better than the conventional backpropagation through time algorithm. This paper presents an analytical study on the optimal control of GCCs, including theoretically ideal optimal and suboptimal controllers. To overcome the inapplicability of the optimal GCC controller under practical conditions, a new RNN controller with an improved input structure is proposed to approximate the ideal optimal controller. The performance of an ideal optimal controller and a well-trained RNN controller was compared in close to real-life power converter switching environments, demonstrating that the proposed RNN controller can achieve close to ideal optimal control performance even under low sampling rate conditions. The excellent performance of the proposed RNN controller under challenging and distorted system conditions further indicates the feasibility of using an RNN to approximate optimal control in practical applications

Improving total nitrogen removal using a neural network ammonia-based aeration control in activated sludge process

Aeration control is a way to have a wastewater treatment plant (WWTP) that uses less energy and produces higher effluent quality to meet state and federal regulations. The goal of this research is to develop a neural network (NN) ammonia-based aeration control (ABAC) that focuses on reducing total nitrogen and ammonia concentration violations by regulating dissolved oxygen (DO) concentration based on the ammonia concentration in the final tank, rather than maintaining the DO concentration at a set elevated value, as most studies do. Simulation platform used in this study is Benchmark Simulation Model No. 1, and the NN ABAC is compared to the Proportional-Integral (PI) ABAC and PI controller. In comparison to the PI controller, the simulation results showed that the proposed controller has a significant improvement in reducing the AECI up to 23.86%, improving the EQCI up to 1.94%, and reducing the overall OCI up to 4.61%. The results of the study show that the NN ABAC can be utilized to improve the performance of a WWTP’s activated sludge system