8,568 research outputs found
A maximum principle for infinite horizon delay equations
We prove a maximum principle of optimal control of stochastic delay equations
on infinite horizon. We establish first and second sufficient stochastic
maximum principles as well as necessary conditions for that problem. We
illustrate our results by an application to the optimal consumption rate from
an economic quantity
Optimal Energy Allocation for Kalman Filtering over Packet Dropping Links with Imperfect Acknowledgments and Energy Harvesting Constraints
This paper presents a design methodology for optimal transmission energy
allocation at a sensor equipped with energy harvesting technology for remote
state estimation of linear stochastic dynamical systems. In this framework, the
sensor measurements as noisy versions of the system states are sent to the
receiver over a packet dropping communication channel. The packet dropout
probabilities of the channel depend on both the sensor's transmission energies
and time varying wireless fading channel gains. The sensor has access to an
energy harvesting source which is an everlasting but unreliable energy source
compared to conventional batteries with fixed energy storages. The receiver
performs optimal state estimation with random packet dropouts to minimize the
estimation error covariances based on received measurements. The receiver also
sends packet receipt acknowledgments to the sensor via an erroneous feedback
communication channel which is itself packet dropping.
The objective is to design optimal transmission energy allocation at the
energy harvesting sensor to minimize either a finite-time horizon sum or a long
term average (infinite-time horizon) of the trace of the expected estimation
error covariance of the receiver's Kalman filter. These problems are formulated
as Markov decision processes with imperfect state information. The optimal
transmission energy allocation policies are obtained by the use of dynamic
programming techniques. Using the concept of submodularity, the structure of
the optimal transmission energy policies are studied. Suboptimal solutions are
also discussed which are far less computationally intensive than optimal
solutions. Numerical simulation results are presented illustrating the
performance of the energy allocation algorithms.Comment: Submitted to IEEE Transactions on Automatic Control. arXiv admin
note: text overlap with arXiv:1402.663
Galerkin approximations for the optimal control of nonlinear delay differential equations
Optimal control problems of nonlinear delay differential equations (DDEs) are
considered for which we propose a general Galerkin approximation scheme built
from Koornwinder polynomials. Error estimates for the resulting
Galerkin-Koornwinder approximations to the optimal control and the value
function, are derived for a broad class of cost functionals and nonlinear DDEs.
The approach is illustrated on a delayed logistic equation set not far away
from its Hopf bifurcation point in the parameter space. In this case, we show
that low-dimensional controls for a standard quadratic cost functional can be
efficiently computed from Galerkin-Koornwinder approximations to reduce at a
nearly optimal cost the oscillation amplitude displayed by the DDE's solution.
Optimal controls computed from the Pontryagin's maximum principle (PMP) and the
Hamilton-Jacobi-Bellman equation (HJB) associated with the corresponding ODE
systems, are shown to provide numerical solutions in good agreement. It is
finally argued that the value function computed from the corresponding reduced
HJB equation provides a good approximation of that obtained from the full HJB
equation.Comment: 29 pages. This is a sequel of the arXiv preprint arXiv:1704.0042
- …