Connections Between Adaptive Control and Optimization in Machine Learning

This paper demonstrates many immediate connections between adaptive control and optimization methods commonly employed in machine learning. Starting from common output error formulations, similarities in update law modifications are examined. Concepts in stability, performance, and learning, common to both fields are then discussed. Building on the similarities in update laws and common concepts, new intersections and opportunities for improved algorithm analysis are provided. In particular, a specific problem related to higher order learning is solved through insights obtained from these intersections.Comment: 18 page

Adaptive Synchronization of Nonlinearly Parameterized Complex Dynamical Networks with Unknown Time-Varying Parameters

A new adaptive learning control approach is proposed for a class of nonlinearly parameterized complex dynamical networks with unknown time-varying parameters. By using the parameter separation and reparameterization technique, the adaptive learning laws of periodically time-varying and constant parameters and an adaptive control strategy are designed to ensure the asymptotic convergence of the synchronization error in the sense of square error norm. Then, a sufficient condition of the synchronization is given by constructing a composite energy function. Finally, an example of the complex network is used to verify the effectiveness of proposed approach

Structure Learning in Coupled Dynamical Systems and Dynamic Causal Modelling

Identifying a coupled dynamical system out of many plausible candidates, each of which could serve as the underlying generator of some observed measurements, is a profoundly ill posed problem that commonly arises when modelling real world phenomena. In this review, we detail a set of statistical procedures for inferring the structure of nonlinear coupled dynamical systems (structure learning), which has proved useful in neuroscience research. A key focus here is the comparison of competing models of (ie, hypotheses about) network architectures and implicit coupling functions in terms of their Bayesian model evidence. These methods are collectively referred to as dynamical casual modelling (DCM). We focus on a relatively new approach that is proving remarkably useful; namely, Bayesian model reduction (BMR), which enables rapid evaluation and comparison of models that differ in their network architecture. We illustrate the usefulness of these techniques through modelling neurovascular coupling (cellular pathways linking neuronal and vascular systems), whose function is an active focus of research in neurobiology and the imaging of coupled neuronal systems

Approximate Gaussian conjugacy: parametric recursive filtering under nonlinearity, multimodality, uncertainty, and constraint, and beyond

Since the landmark work of R. E. Kalman in the 1960s, considerable efforts have been devoted to time series state space models for a large variety of dynamic estimation problems. In particular, parametric filters that seek analytical estimates based on a closed-form Markov–Bayes recursion, e.g., recursion from a Gaussian or Gaussian mixture (GM) prior to a Gaussian/GM posterior (termed ‘Gaussian conjugacy’ in this paper), form the backbone for a general time series filter design. Due to challenges arising from nonlinearity, multimodality (including target maneuver), intractable uncertainties (such as unknown inputs and/or non-Gaussian noises) and constraints (including circular quantities), etc., new theories, algorithms, and technologies have been developed continuously to maintain such a conjugacy, or to approximate it as close as possible. They had contributed in large part to the prospective developments of time series parametric filters in the last six decades. In this paper, we review the state of the art in distinctive categories and highlight some insights that may otherwise be easily overlooked. In particular, specific attention is paid to nonlinear systems with an informative observation, multimodal systems including Gaussian mixture posterior and maneuvers, and intractable unknown inputs and constraints, to fill some gaps in existing reviews and surveys. In addition, we provide some new thoughts on alternatives to the first-order Markov transition model and on filter evaluation with regard to computing complexity

Neural network-based parametric system identification: a review

Parametric system identification, which is the process of uncovering the inherent dynamics of a system based on the model built with the observed inputs and outputs data, has been intensively studied in the past few decades. Recent years have seen a surge in the use of neural networks (NNs) in system identification, owing to their high approximation capability, less reliance on prior knowledge, and the growth of computational power. However, there is a lack of review on neural network modelling in the paradigm of parametric system identification, particularly in the time domain. This article discussed the connection in principle between conventional parametric models and three types of NNs including Feedforward Neural Networks, Recurrent Neural Networks and Encoder-Decoder. Then it reviewed the advantages and limitations of related research in addressing two major challenges of parametric system identification, including the model interpretability and modelling with nonstationary realisations. Finally, new challenges and future trends in neural network-based parametric system identification are presented in this article

Advanced discrete-time controller design with application to motion control

Ph.DDOCTOR OF PHILOSOPH

Virtualized Welding Based Learning of Human Welder Behaviors for Intelligent Robotic Welding

Combining human welder (with intelligence and sensing versatility) and automated welding robots (with precision and consistency) can lead to next generation intelligent welding systems. In this dissertation intelligent welding robots are developed by process modeling / control method and learning the human welder behavior. Weld penetration and 3D weld pool surface are first accurately controlled for an automated Gas Tungsten Arc Welding (GTAW) machine. Closed-form model predictive control (MPC) algorithm is derived for real-time welding applications. Skilled welder response to 3D weld pool surface by adjusting the welding current is then modeled using Adaptive Neuro-Fuzzy Inference System (ANFIS), and compared to the novice welder. Automated welding experiments confirm the effectiveness of the proposed human response model. A virtualized welding system is then developed that enables transferring the human knowledge into a welding robot. The learning of human welder movement (i.e., welding speed) is first realized with Virtual Reality (VR) enhancement using iterative K-means based local ANFIS modeling. As a separate effort, the learning is performed without VR enhancement utilizing a fuzzy classifier to rank the data and only preserve the high ranking “correct” response. The trained supervised ANFIS model is transferred to the welding robot and the performance of the controller is examined. A fuzzy weighting based data fusion approach to combine multiple machine and human intelligent models is proposed. The data fusion model can outperform individual machine-based control algorithm and welder intelligence-based models (with and without VR enhancement). Finally a data-driven approach is proposed to model human welder adjustments in 3D (including welding speed, arc length, and torch orientations). Teleoperated training experiments are conducted in which a human welder tries to adjust the torch movements in 3D based on his observation on the real-time weld pool image feedback. The data is off-line rated by the welder and a welder rating system is synthesized. ANFIS model is then proposed to correlate the 3D weld pool characteristic parameters and welder’s torch movements. A foundation is thus established to rapidly extract human intelligence and transfer such intelligence into welding robots

A control-theoretical fault prognostics and accommodation framework for a class of nonlinear discrete-time systems

Fault diagnostics and prognostics schemes (FDP) are necessary for complex industrial systems to prevent unscheduled downtime resulting from component failures. Existing schemes in continuous-time are useful for diagnosing complex industrial systems and no work has been done for prognostics. Therefore, in this dissertation, a systematic design methodology for model-based fault prognostics and accommodation is undertaken for a class of nonlinear discrete-time systems. This design methodology, which does not require any failure data, is introduced in six papers. In Paper I, a fault detection and prediction (FDP) scheme is developed for a class of nonlinear system with state faults by assuming that all the states are measurable. A novel estimator is utilized for detecting a fault. Upon detection, an online approximator in discrete-time (OLAD) and a robust adaptive term are activated online in the estimator wherein the OLAD learns the unknown fault dynamics while the robust adaptive term ensures asymptotic performance guarantee. A novel update law is proposed for tuning the OLAD parameters. Additionally, by using the parameter update law, time to reach an a priori selected failure threshold is derived for prognostics. Subsequently, the FDP scheme is used to estimate the states and detect faults in nonlinear input-output systems in Paper II and to nonlinear discrete-time systems with both state and sensor faults in Paper III. Upon detection, a novel fault isolation estimator is used to identify the faults in Paper IV. It was shown that certain faults can be accommodated via controller reconfiguration in Paper V. Finally, the performance of the FDP framework is demonstrated via Lyapunov stability analysis and experimentally on the Caterpillar hydraulics test-bed in Paper VI by using an artificial immune system as an OLAD --Abstract, page iv