7,655 research outputs found
Composite Learning Control With Application to Inverted Pendulums
Composite adaptive control (CAC) that integrates direct and indirect adaptive
control techniques can achieve smaller tracking errors and faster parameter
convergence compared with direct and indirect adaptive control techniques.
However, the condition of persistent excitation (PE) still has to be satisfied
to guarantee parameter convergence in CAC. This paper proposes a novel model
reference composite learning control (MRCLC) strategy for a class of affine
nonlinear systems with parametric uncertainties to guarantee parameter
convergence without the PE condition. In the composite learning, an integral
during a moving-time window is utilized to construct a prediction error, a
linear filter is applied to alleviate the derivation of plant states, and both
the tracking error and the prediction error are applied to update parametric
estimates. It is proven that the closed-loop system achieves global
exponential-like stability under interval excitation rather than PE of
regression functions. The effectiveness of the proposed MRCLC has been verified
by the application to an inverted pendulum control problem.Comment: 5 pages, 6 figures, conference submissio
Active Sampling-based Binary Verification of Dynamical Systems
Nonlinear, adaptive, or otherwise complex control techniques are increasingly
relied upon to ensure the safety of systems operating in uncertain
environments. However, the nonlinearity of the resulting closed-loop system
complicates verification that the system does in fact satisfy those
requirements at all possible operating conditions. While analytical proof-based
techniques and finite abstractions can be used to provably verify the
closed-loop system's response at different operating conditions, they often
produce conservative approximations due to restrictive assumptions and are
difficult to construct in many applications. In contrast, popular statistical
verification techniques relax the restrictions and instead rely upon
simulations to construct statistical or probabilistic guarantees. This work
presents a data-driven statistical verification procedure that instead
constructs statistical learning models from simulated training data to separate
the set of possible perturbations into "safe" and "unsafe" subsets. Binary
evaluations of closed-loop system requirement satisfaction at various
realizations of the uncertainties are obtained through temporal logic
robustness metrics, which are then used to construct predictive models of
requirement satisfaction over the full set of possible uncertainties. As the
accuracy of these predictive statistical models is inherently coupled to the
quality of the training data, an active learning algorithm selects additional
sample points in order to maximize the expected change in the data-driven model
and thus, indirectly, minimize the prediction error. Various case studies
demonstrate the closed-loop verification procedure and highlight improvements
in prediction error over both existing analytical and statistical verification
techniques.Comment: 23 page
Concurrent learning-based approximate optimal regulation
In deterministic systems, reinforcement learning-based online approximate
optimal control methods typically require a restrictive persistence of
excitation (PE) condition for convergence. This paper presents a concurrent
learning-based solution to the online approximate optimal regulation problem
that eliminates the need for PE. The development is based on the observation
that given a model of the system, the Bellman error, which quantifies the
deviation of the system Hamiltonian from the optimal Hamiltonian, can be
evaluated at any point in the state space. Further, a concurrent learning-based
parameter identifier is developed to compensate for parametric uncertainty in
the plant dynamics. Uniformly ultimately bounded (UUB) convergence of the
system states to the origin, and UUB convergence of the developed policy to the
optimal policy are established using a Lyapunov-based analysis, and simulations
are performed to demonstrate the performance of the developed controller
On-the-fly adaptivity for nonlinear twoscale simulations using artificial neural networks and reduced order modeling
A multi-fidelity surrogate model for highly nonlinear multiscale problems is
proposed. It is based on the introduction of two different surrogate models and
an adaptive on-the-fly switching. The two concurrent surrogates are built
incrementally starting from a moderate set of evaluations of the full order
model. Therefore, a reduced order model (ROM) is generated. Using a hybrid
ROM-preconditioned FE solver, additional effective stress-strain data is
simulated while the number of samples is kept to a moderate level by using a
dedicated and physics-guided sampling technique. Machine learning (ML) is
subsequently used to build the second surrogate by means of artificial neural
networks (ANN). Different ANN architectures are explored and the features used
as inputs of the ANN are fine tuned in order to improve the overall quality of
the ML model. Additional ANN surrogates for the stress errors are generated.
Therefore, conservative design guidelines for error surrogates are presented by
adapting the loss functions of the ANN training in pure regression or pure
classification settings. The error surrogates can be used as quality indicators
in order to adaptively select the appropriate -- i.e. efficient yet accurate --
surrogate. Two strategies for the on-the-fly switching are investigated and a
practicable and robust algorithm is proposed that eliminates relevant technical
difficulties attributed to model switching. The provided algorithms and ANN
design guidelines can easily be adopted for different problem settings and,
thereby, they enable generalization of the used machine learning techniques for
a wide range of applications. The resulting hybrid surrogate is employed in
challenging multilevel FE simulations for a three-phase composite with
pseudo-plastic micro-constituents. Numerical examples highlight the performance
of the proposed approach
Neural Networks for Modeling and Control of Particle Accelerators
We describe some of the challenges of particle accelerator control, highlight
recent advances in neural network techniques, discuss some promising avenues
for incorporating neural networks into particle accelerator control systems,
and describe a neural network-based control system that is being developed for
resonance control of an RF electron gun at the Fermilab Accelerator Science and
Technology (FAST) facility, including initial experimental results from a
benchmark controller.Comment: 21 p
- …