Fisher information estimation using neural networks

In estimation theory, the Fisher information matrix (FIM) is a fundamental concept from which we can infer the well-known Cramér-Rao bound. A closed-form expression of the FIM is often intractable due to the lack or sophistication of statistical models. In this paper, we propose a Fisher Information Neural Estimator (FINE) based on neural networks and a relation between the f-divergence and the Fisher information. The proposed method produces an estimate of the FIM directly from observed data. It does not require knowledge or an estimate of the probability density function (pdf), and is therefore universally applicable. The proposed FINE is applicable for not only deterministic parameters but also random parameters. We show via numerical results that the proposed FINE can provide a highly-accurate FIM estimate with a low-computational complexity. Furthermore, we also propose an accelerated FINE version which can be used for scenarios with a high parameter dimension. Finally, we develop an algorithm to choose an appropriate size of the employed neural networks

Adaptive Discontinuous Control for Homogeneous Systems Approximated by Neural Networks

International audienceThis study is devoted to the design of an adaptive discontinuous control based on differential neural networks (DNNs) for a class of uncertain homogeneous systems. The control is based on the universal approximation properties of artificial neural networks (ANNs) applied on a certain class of homogeneous nonlinear functions. The adaptation laws for the DNNs parameters are obtained with the application of the Lyapunov stability theory and the homogeneity properties of the approximated nonlinear system. The stability analysis of the closed loop system with the proposed controller is presented. The estimation error in the approximation of the uncertain homogeneous functions is considered in the stability analysis. The performance of the controller is illustrated by means of a numerical simulation of a homogeneous model

Model Parameter Calibration in Power Systems

In power systems, accurate device modeling is crucial for grid reliability, availability, and resiliency. Many critical tasks such as planning or even realtime operation decisions rely on accurate modeling. This research presents an approach for model parameter calibration in power system models using deep learning. Existing calibration methods are based on mathematical approaches that suffer from being ill-posed and thus may have multiple solutions. We are trying to solve this problem by applying a deep learning architecture that is trained to estimate model parameters from simulated Phasor Measurement Unit (PMU) data. The data recorded after system disturbances proved to have valuable information to verify power system devices. A quantitative evaluation of the system results is provided. Results showed high accuracy in estimating model parameters of 0.017 MSE on the testing dataset. We also provide that the proposed system has scalability under the same topology. We consider these promising results to be the basis for further exploration and development of additional tools for parameter calibration

Non-parametric Identification of Homogeneous Dynamical Systems

International audienceThe aim of this study is to design a non-parametric identifier for homogeneous systems based on a class of artificial neural networks with continuous dynamics. The identification algorithm is developed for input-affine systems with uncertain gains and diverse degrees of homogeneity. One of the main contributions of this study is the extension of the universal approximation property of neural networks for continuous homogeneous systems. Another contribution is the development of a differential non-parametric identifier based on the novel concept of homogeneous neural networks. The adjustment laws for the weights are obtained from a Lyapunov stability analysis taking homogeneity properties of the system into account. The ultimate boundedness of the origin for the identification error is demonstrated using the persistent excitation condition. The effectiveness of the proposed identifier is verified by the simulation of the three-tank homogeneous model. In this example, the proposed identification scheme is compared with a classical ANN identifier, and we present a statistical analysis of such comparison. It is shown in simulations that the identification error of the proposed homogeneous algorithm has faster convergence and less oscillations

Differential Neural Network Identification for Homogeneous Dynamical Systems ⋆

International audienceIn this paper, a non parametric identifier for homogeneous nonlinear systems affine in the input is proposed. The identification algorithm is based on the neural networks using sigmoidal activation functions. The learning algorithm is derived by means of Lyapunov function method and homogeneity theory. A numerical example demonstrates the performance of the proposed identifier

Adaptive Control

Adaptive control has been a remarkable field for industrial and academic research since 1950s. Since more and more adaptive algorithms are applied in various control applications, it is becoming very important for practical implementation. As it can be confirmed from the increasing number of conferences and journals on adaptive control topics, it is certain that the adaptive control is a significant guidance for technology development.The authors the chapters in this book are professionals in their areas and their recent research results are presented in this book which will also provide new ideas for improved performance of various control application problems

Hybrid functional networks for oil reservoir PVT characterisation

Predicting pressure-volume-temperature (PVT) properties of black oil is one of the key processes required in a successful oil exploration. As crude oils from different regions have different properties, some researchers have used API gravity, which is used to classify crude oils, to develop different empirical correlations for different classes of black oils. However, this manual grouping may not necessarily result in correlations that appropriately capture the uncertainties in the black oils. This paper proposes intelligent clustering to group black oils before passing the clusters as inputs to the functional networks for prediction. This hybrid process gives better performance than the empirical correlations, standalone functional networks and neural network predictions

Principles of Neuromorphic Photonics

In an age overrun with information, the ability to process reams of data has become crucial. The demand for data will continue to grow as smart gadgets multiply and become increasingly integrated into our daily lives. Next-generation industries in artificial intelligence services and high-performance computing are so far supported by microelectronic platforms. These data-intensive enterprises rely on continual improvements in hardware. Their prospects are running up against a stark reality: conventional one-size-fits-all solutions offered by digital electronics can no longer satisfy this need, as Moore's law (exponential hardware scaling), interconnection density, and the von Neumann architecture reach their limits. With its superior speed and reconfigurability, analog photonics can provide some relief to these problems; however, complex applications of analog photonics have remained largely unexplored due to the absence of a robust photonic integration industry. Recently, the landscape for commercially-manufacturable photonic chips has been changing rapidly and now promises to achieve economies of scale previously enjoyed solely by microelectronics. The scientific community has set out to build bridges between the domains of photonic device physics and neural networks, giving rise to the field of \emph{neuromorphic photonics}. This article reviews the recent progress in integrated neuromorphic photonics. We provide an overview of neuromorphic computing, discuss the associated technology (microelectronic and photonic) platforms and compare their metric performance. We discuss photonic neural network approaches and challenges for integrated neuromorphic photonic processors while providing an in-depth description of photonic neurons and a candidate interconnection architecture. We conclude with a future outlook of neuro-inspired photonic processing.Comment: 28 pages, 19 figure

AI based Robot Safe Learning and Control

Introduction This open access book mainly focuses on the safe control of robot manipulators. The control schemes are mainly developed based on dynamic neural network, which is an important theoretical branch of deep reinforcement learning. In order to enhance the safety performance of robot systems, the control strategies include adaptive tracking control for robots with model uncertainties, compliance control in uncertain environments, obstacle avoidance in dynamic workspace. The idea for this book on solving safe control of robot arms was conceived during the industrial applications and the research discussion in the laboratory. Most of the materials in this book are derived from the authors’ papers published in journals, such as IEEE Transactions on Industrial Electronics, neurocomputing, etc. This book can be used as a reference book for researcher and designer of the robotic systems and AI based controllers, and can also be used as a reference book for senior undergraduate and graduate students in colleges and universities

Dynamic fluctuations in ascending heart-to-brain communication under mental stress

Dynamical information exchange between central and autonomic nervous systems, as referred to functional brain-heart interplay, occurs during emotional and physical arousal. It is well documented that physical and mental stress lead to sympathetic activation. Nevertheless, the role of autonomic inputs in nervous system-wise communication under mental stress is yet unknown. In this study, we estimated the causal and bidirectional neural modulations between electroencephalogram (EEG) oscillations and peripheral sympathetic and parasympathetic activities using a recently proposed computational framework for a functional brain-heart interplay assessment, namely the sympathovagal synthetic data generation model. Mental stress was elicited in 37 healthy volunteers by increasing their cognitive demands throughout three tasks associated with increased stress levels. Stress elicitation induced an increased variability in sympathovagal markers, as well as increased variability in the directional brain-heart interplay. The observed heart-to-brain interplay was primarily from sympathetic activity targeting a wide range of EEG oscillations, whereas variability in the efferent direction seemed mainly related to EEG oscillations in the c band. These findings extend current knowledge on stress physiology, which mainly referred to top-down neural dynamics. Our results suggest that mental stress may not cause an increase in sympathetic activity exclusively as it initiates a dynamic fluctuation within brain-body networks including bidirectional interactions at a brain-heart level. We conclude that directional brain-heart interplay measurements may provide suitable biomarkers for a quantitative stress assessment and bodily feedback may modulate the perceived stress caused by increased cognitive demand