70,592 research outputs found
Mitigating the Curse of Dimensionality: Sparse Grid Characteristics Method for Optimal Feedback Control and HJB Equations
We address finding the semi-global solutions to optimal feedback control and
the Hamilton--Jacobi--Bellman (HJB) equation. Using the solution of an HJB
equation, a feedback optimal control law can be implemented in real-time with
minimum computational load. However, except for systems with two or three state
variables, using traditional techniques for numerically finding a semi-global
solution to an HJB equation for general nonlinear systems is infeasible due to
the curse of dimensionality. Here we present a new computational method for
finding feedback optimal control and solving HJB equations which is able to
mitigate the curse of dimensionality. We do not discretize the HJB equation
directly, instead we introduce a sparse grid in the state space and use the
Pontryagin's maximum principle to derive a set of necessary conditions in the
form of a boundary value problem, also known as the characteristic equations,
for each grid point. Using this approach, the method is spatially causality
free, which enjoys the advantage of perfect parallelism on a sparse grid.
Compared with dense grids, a sparse grid has a significantly reduced size which
is feasible for systems with relatively high dimensions, such as the -D
system shown in the examples. Once the solution obtained at each grid point,
high-order accurate polynomial interpolation is used to approximate the
feedback control at arbitrary points. We prove an upper bound for the
approximation error and approximate it numerically. This sparse grid
characteristics method is demonstrated with two examples of rigid body attitude
control using momentum wheels
Optimal Stabilization using Lyapunov Measures
Numerical solutions for the optimal feedback stabilization of discrete time
dynamical systems is the focus of this paper. Set-theoretic notion of almost
everywhere stability introduced by the Lyapunov measure, weaker than
conventional Lyapunov function-based stabilization methods, is used for optimal
stabilization. The linear Perron-Frobenius transfer operator is used to pose
the optimal stabilization problem as an infinite dimensional linear program.
Set-oriented numerical methods are used to obtain the finite dimensional
approximation of the linear program. We provide conditions for the existence of
stabilizing feedback controls and show the optimal stabilizing feedback control
can be obtained as a solution of a finite dimensional linear program. The
approach is demonstrated on stabilization of period two orbit in a controlled
standard map
Supervised Quantum Learning without Measurements
We propose a quantum machine learning algorithm for efficiently solving a
class of problems encoded in quantum controlled unitary operations. The central
physical mechanism of the protocol is the iteration of a quantum time-delayed
equation that introduces feedback in the dynamics and eliminates the necessity
of intermediate measurements. The performance of the quantum algorithm is
analyzed by comparing the results obtained in numerical simulations with the
outcome of classical machine learning methods for the same problem. The use of
time-delayed equations enhances the toolbox of the field of quantum machine
learning, which may enable unprecedented applications in quantum technologies
Optimality of feedback control for qubit purification under inefficient measurement
A quantum system may be purified, i.e., projected into a pure state, faster if one applies feedback operations during the measurement process. However, the existing results suggest that such an enhancement is only possible when the measurement efficiency exceeds 0.5, which is difficult to achieve experimentally. We address the task of finding the global optimal feedback control for purifying a single qubit in the presence of measurement inefficiency. We use the Bloch vector length, a more physical and practical quantity than purity, to assess the quality of the state, and employ a backward-iteration algorithm to find the globally optimal strategy. Our results show that a speedup is available for quantum efficiencies well below 0.5, which opens the possibility of experimental implementation in existing systems
A Fast Algorithm for Sparse Controller Design
We consider the task of designing sparse control laws for large-scale systems
by directly minimizing an infinite horizon quadratic cost with an
penalty on the feedback controller gains. Our focus is on an improved algorithm
that allows us to scale to large systems (i.e. those where sparsity is most
useful) with convergence times that are several orders of magnitude faster than
existing algorithms. In particular, we develop an efficient proximal Newton
method which minimizes per-iteration cost with a coordinate descent active set
approach and fast numerical solutions to the Lyapunov equations. Experimentally
we demonstrate the appeal of this approach on synthetic examples and real power
networks significantly larger than those previously considered in the
literature
- …