9,849 research outputs found
An Extended Mean Field Game for Storage in Smart Grids
We consider a stylized model for a power network with distributed local power
generation and storage. This system is modeled as network connection a large
number of nodes, where each node is characterized by a local electricity
consumption, has a local electricity production (e.g. photovoltaic panels), and
manages a local storage device. Depending on its instantaneous consumption and
production rates as well as its storage management decision, each node may
either buy or sell electricity, impacting the electricity spot price. The
objective at each node is to minimize energy and storage costs by optimally
controlling the storage device. In a non-cooperative game setting, we are led
to the analysis of a non-zero sum stochastic game with players where the
interaction takes place through the spot price mechanism. For an infinite
number of agents, our model corresponds to an Extended Mean-Field Game (EMFG).
In a linear quadratic setting, we obtain and explicit solution to the EMFG, we
show that it provides an approximate Nash-equilibrium for -player game, and
we compare this solution to the optimal strategy of a central planner.Comment: 27 pages, 5 figures. arXiv admin note: text overlap with
arXiv:1607.02130 by other author
Subjective Equilibria under Beliefs of Exogenous Uncertainty
We present a subjective equilibrium notion (called "subjective equilibrium
under beliefs of exogenous uncertainty (SEBEU)" for stochastic dynamic games in
which each player chooses its decisions under the (incorrect) belief that a
stochastic environment process driving the system is exogenous whereas in
actuality this process is a solution of closed-loop dynamics affected by each
individual player. Players observe past realizations of the environment
variables and their local information. At equilibrium, if players are given the
full distribution of the stochastic environment process as if it were an
exogenous process, they would have no incentive to unilaterally deviate from
their strategies. This notion thus generalizes what is known as the
price-taking equilibrium in prior literature to a stochastic and dynamic setup.
We establish existence of SEBEU, study various properties and present explicit
solutions. We obtain the -Nash equilibrium property of SEBEU when
there are many players
Certainty equivalence and model uncertainty
Simon’s and Theil’s certainty equivalence property justifies a convenient algorithm for solving dynamic programming problems with quadratic objectives and linear transition laws: first, optimize under perfect foresight, then substitute optimal forecasts for unknown future values. A similar decomposition into separate optimization and forecasting steps prevails when a decision maker wants a decision rule that is robust to model misspecification. Concerns about model misspecification leave the first step of the algorithm intact and affect only the second step of forecasting the future. The decision maker attains robustness by making forecasts with a distorted model that twists probabilities relative to his approximating model. The appropriate twisting emerges from a two-player zero-sum dynamic game.
Decentralized Convergence to Nash Equilibria in Constrained Deterministic Mean Field Control
This paper considers decentralized control and optimization methodologies for
large populations of systems, consisting of several agents with different
individual behaviors, constraints and interests, and affected by the aggregate
behavior of the overall population. For such large-scale systems, the theory of
aggregative and mean field games has been established and successfully applied
in various scientific disciplines. While the existing literature addresses the
case of unconstrained agents, we formulate deterministic mean field control
problems in the presence of heterogeneous convex constraints for the individual
agents, for instance arising from agents with linear dynamics subject to convex
state and control constraints. We propose several model-free feedback
iterations to compute in a decentralized fashion a mean field Nash equilibrium
in the limit of infinite population size. We apply our methods to the
constrained linear quadratic deterministic mean field control problem and to
the constrained mean field charging control problem for large populations of
plug-in electric vehicles.Comment: IEEE Trans. on Automatic Control (cond. accepted
- …