Adaptive control: Myths and realities

It was found that all currently existing globally stable adaptive algorithms have three basic properties in common: positive realness of the error equation, square-integrability of the parameter adjustment law and, need for sufficient excitation for asymptotic parameter convergence. Of the three, the first property is of primary importance since it satisfies a sufficient condition for stabillity of the overall system, which is a baseline design objective. The second property has been instrumental in the proof of asymptotic error convergence to zero, while the third addresses the issue of parameter convergence. Positive-real error dynamics can be generated only if the relative degree (excess of poles over zeroes) of the process to be controlled is known exactly; this, in turn, implies perfect modeling. This and other assumptions, such as absence of nonminimum phase plant zeros on which the mathematical arguments are based, do not necessarily reflect properties of real systems. As a result, it is natural to inquire what happens to the designs under less than ideal assumptions. The issues arising from violation of the exact modeling assumption which is extremely restrictive in practice and impacts the most important system property, stability, are discussed

Adaptive Control By Regulation-Triggered Batch Least-Squares Estimation of Non-Observable Parameters

The paper extends a recently proposed indirect, certainty-equivalence, event-triggered adaptive control scheme to the case of non-observable parameters. The extension is achieved by using a novel Batch Least-Squares Identifier (BaLSI), which is activated at the times of the events. The BaLSI guarantees the finite-time asymptotic constancy of the parameter estimates and the fact that the trajectories of the closed-loop system follow the trajectories of the nominal closed-loop system ("nominal" in the sense of the asymptotic parameter estimate, not in the sense of the true unknown parameter). Thus, if the nominal feedback guarantees global asymptotic stability and local exponential stability, then unlike conventional adaptive control, the newly proposed event-triggered adaptive scheme guarantees global asymptotic regulation with a uniform exponential convergence rate. The developed adaptive scheme is tested to a well-known control problem: the state regulation of the wing-rock model. Comparisons with other adaptive schemes are provided for this particular problem.Comment: 29 pages, 12 figure

Connections Between Adaptive Control and Optimization in Machine Learning

This paper demonstrates many immediate connections between adaptive control and optimization methods commonly employed in machine learning. Starting from common output error formulations, similarities in update law modifications are examined. Concepts in stability, performance, and learning, common to both fields are then discussed. Building on the similarities in update laws and common concepts, new intersections and opportunities for improved algorithm analysis are provided. In particular, a specific problem related to higher order learning is solved through insights obtained from these intersections.Comment: 18 page

Generalized recursive least squares: Stability, robustness, and excitation

We study a class of recursive least-squares estimators in an errors-in-variables setting where disturbances affect both the regressor and the regressand variables. We prove the existence and stability of an optimal steady state and robustness with respect to the disturbances in form of input-to-state and input–output stability relative to the unperturbed steady-state trajectories. Depending on the choice of some design parameters, different specific estimators can be realized within the considered class, each of which is associated with a different underlying optimization problem and with different excitation requirements for the unperturbed regressor. As expected, we find that persistence of excitation is associated with uniform, in fact exponential, convergence. In addition, we also show that choices of the design parameters are possible for which convergence and robustness hold without persistence of excitation and with the same asymptotic gain, the only difference being a loss of uniformity in the convergence rate

A globally exponentially stable position observer for interior permanent magnet synchronous motors

The design of a position observer for the interior permanent magnet synchronous motor is a challenging problem that, in spite of many research efforts, remained open for a long time. In this paper we present the first globally exponentially convergent solution to it, assuming that the saliency is not too large. As expected in all observer tasks, a persistency of excitation condition is imposed. Conditions on the operation of the motor, under which it is verified, are given. In particular, it is shown that at rotor standstill---when the system is not observable---it is possible to inject a probing signal to enforce the persistent excitation condition. {The high performance of the proposed observer, in standstill and high speed regions, is verified by extensive series of test-runs on an experimental setup

Population-scale organization of cerebellar granule neuron signaling during a visuomotor behavior.

Granule cells at the input layer of the cerebellum comprise over half the neurons in the human brain and are thought to be critical for learning. However, little is known about granule neuron signaling at the population scale during behavior. We used calcium imaging in awake zebrafish during optokinetic behavior to record transgenically identified granule neurons throughout a cerebellar population. A significant fraction of the population was responsive at any given time. In contrast to core precerebellar populations, granule neuron responses were relatively heterogeneous, with variation in the degree of rectification and the balance of positive versus negative changes in activity. Functional correlations were strongest for nearby cells, with weak spatial gradients in the degree of rectification and the average sign of response. These data open a new window upon cerebellar function and suggest granule layer signals represent elementary building blocks under-represented in core sensorimotor pathways, thereby enabling the construction of novel patterns of activity for learning

Complete atrial-specific knockout of sodium-calcium exchange eliminates sinoatrial node pacemaker activity.

The origin of sinoatrial node (SAN) pacemaker activity in the heart is controversial. The leading candidates are diastolic depolarization by "funny" current (If) through HCN4 channels (the "Membrane Clock" hypothesis), depolarization by cardiac Na-Ca exchange (NCX1) in response to intracellular Ca cycling (the "Calcium Clock" hypothesis), and a combination of the two ("Coupled Clock"). To address this controversy, we used Cre/loxP technology to generate atrial-specific NCX1 KO mice. NCX1 protein was undetectable in KO atrial tissue, including the SAN. Surface ECG and intracardiac electrograms showed no atrial depolarization and a slow junctional escape rhythm in KO that responded appropriately to β-adrenergic and muscarinic stimulation. Although KO atria were quiescent they could be stimulated by external pacing suggesting that electrical coupling between cells remained intact. Despite normal electrophysiological properties of If in isolated patch clamped KO SAN cells, pacemaker activity was absent. Recurring Ca sparks were present in all KO SAN cells, suggesting that Ca cycling persists but is uncoupled from the sarcolemma. We conclude that NCX1 is required for normal pacemaker activity in murine SAN

Episodic Learning with Control Lyapunov Functions for Uncertain Robotic Systems

Many modern nonlinear control methods aim to endow systems with guaranteed properties, such as stability or safety, and have been successfully applied to the domain of robotics. However, model uncertainty remains a persistent challenge, weakening theoretical guarantees and causing implementation failures on physical systems. This paper develops a machine learning framework centered around Control Lyapunov Functions (CLFs) to adapt to parametric uncertainty and unmodeled dynamics in general robotic systems. Our proposed method proceeds by iteratively updating estimates of Lyapunov function derivatives and improving controllers, ultimately yielding a stabilizing quadratic program model-based controller. We validate our approach on a planar Segway simulation, demonstrating substantial performance improvements by iteratively refining on a base model-free controller

Metabotropic Glutamate Receptor Activation in Cerebelar Purkinje Cells as Substrate for Adaptive Timing of the Classicaly Conditioned Eye Blink Response

To understand how the cerebellum adaptively times the classically conditioned nictitating membrane response (NMR), a model of the metabotropic glutamate receptor (mGluR) second messenger system in cerebellar Purkinje cells is constructed. In the model slow responses, generated postsynaptically by mGluR-mediated phosphoinositide hydrolysis, and calcium release from intracellular stores, bridge the interstimulus interval (ISI) between the onset of parallel fiber activity associated with the conditioned stimulus (CS) and climbing fiber activity associated with unconditioned stimulus (US) onset. Temporal correlation of metabotropic responses and climbing fiber signals produces persistent phosphorylation of both AMPA receptors and Ca2+-dependent K+ channels. This is responsible for long-term depression (LTD) of AMPA receptors. The phosphorylation of Ca2+-dependent K+ channels leads to a reduction in baseline membrane potential and a reduction of Purkinje cell population firing during the CS-US interval. The Purkinje cell firing decrease disinhibits cerebellar nuclear cells which then produce an excitatory response corresponding to the learned movement. Purkinje cell learning times the response, while nuclear cell learning can calibrate it. The model reproduces key features of the conditioned rabbit NMR: Purkinje cell population response is properly timed, delay conditioning occurs for ISIs of up to four seconds while trace conditioning occurs only at shorter ISIs, mixed training at two different ISis produces a double-peaked response, and ISIs of 200-400ms produce maximal responding. Biochemical similarities between timed cerebellar learning and photoreceptor transduction, and circuit similarities between the timed cerebellar circuit and a timed dentate-CA3 hippocampal circuit, are noted.Office of Naval Research (N00014- 92-J-4015, N00014-92-J-1309, N00014-95-1-0409); Air Force Office of Scientific Research (F49620-92-J-0225);National Science Foundation (IRI-90-24877