2,904 research outputs found
Distributed Learning for Stochastic Generalized Nash Equilibrium Problems
This work examines a stochastic formulation of the generalized Nash
equilibrium problem (GNEP) where agents are subject to randomness in the
environment of unknown statistical distribution. We focus on fully-distributed
online learning by agents and employ penalized individual cost functions to
deal with coupled constraints. Three stochastic gradient strategies are
developed with constant step-sizes. We allow the agents to use heterogeneous
step-sizes and show that the penalty solution is able to approach the Nash
equilibrium in a stable manner within , for small step-size
value and sufficiently large penalty parameters. The operation
of the algorithm is illustrated by considering the network Cournot competition
problem
Recommended from our members
On the Performance and Linear Convergence of Decentralized Primal-Dual Methods
This dissertation studies the performance and linear convergence properties of primal-dual methods for the solution of decentralized multi-agent optimization problems. Decentralized multi-agent optimization is a powerful paradigm that finds applications in diverse fields in learning and engineering design. In these setups, a network of agents is connected through some topology and agents are allowed to share information only locally. Their overall goal is to seek the minimizer of a global optimization problem through localized interactions. In decentralized consensus problems, the agents are coupled through a common consensus variable that they need to agree upon. While in decentralized resource allocation problems, the agents are coupled through global affine constraints. Various decentralized consensus optimization algorithms already exist in the literature. Some methods are derived from a primal-dual perspective, while other methods are derived as gradient tracking mechanisms meant to track the average of local gradients. Among the gradient tracking methods are the adapt-then-combine implementations motivated by diffusion strategies, which have been observed to perform better than other implementations. In this dissertation, we develop a novel adapt-then-combine primal-dual algorithmic framework that captures most state-of-the-art gradient based methods as special cases including all the variations of the gradient-tracking methods. We also develop a concise and novel analysis technique that establishes the linear convergence of this general framework under strongly-convex objectives. Due to our unified framework, the analysis reveals important characteristics for these methods such as their convergence rates and step-size stability ranges. Moreover, the analysis reveals how the augmented Lagrangian penalty term, which is utilized in most of these methods, affects the performance of decentralized algorithms. Another important question that we answer is whether decentralized proximal gradient methods can achieve global linear convergence for non-smooth composite optimization. For centralized algorithms, linear convergence has been established in the presence of a non-smooth composite term. In this dissertation, we close the gap between centralized and decentralized proximal gradient algorithms and show that decentralized proximal algorithms can also achieve linear convergence in the presence of a non-smooth term. Furthermore, we show that when each agent possesses a different local non-smooth term then global linear convergence cannot be established in the worst case. Most works that study decentralized optimization problems assume that all agents are involved in computing all variables. However, in many applications the coupling across agents is sparse in the sense that only a few agents are involved in computing certain variables. We show how to design decentralized algorithms in sparsely coupled consensus and resource allocation problems. More importantly, we establish analytically the importance of exploiting the sparsity structure in coupled large-scale networks
Distributed Coupled Multi-Agent Stochastic Optimization
This work develops effective distributed strategies for the solution of
constrained multi-agent stochastic optimization problems with coupled
parameters across the agents. In this formulation, each agent is influenced by
only a subset of the entries of a global parameter vector or model, and is
subject to convex constraints that are only known locally. Problems of this
type arise in several applications, most notably in disease propagation models,
minimum-cost flow problems, distributed control formulations, and distributed
power system monitoring. This work focuses on stochastic settings, where a
stochastic risk function is associated with each agent and the objective is to
seek the minimizer of the aggregate sum of all risks subject to a set of
constraints. Agents are not aware of the statistical distribution of the data
and, therefore, can only rely on stochastic approximations in their learning
strategies. We derive an effective distributed learning strategy that is able
to track drifts in the underlying parameter model. A detailed performance and
stability analysis is carried out showing that the resulting coupled diffusion
strategy converges at a linear rate to an neighborhood of the true
penalized optimizer
Domain Decomposition for Stochastic Optimal Control
This work proposes a method for solving linear stochastic optimal control
(SOC) problems using sum of squares and semidefinite programming. Previous work
had used polynomial optimization to approximate the value function, requiring a
high polynomial degree to capture local phenomena. To improve the scalability
of the method to problems of interest, a domain decomposition scheme is
presented. By using local approximations, lower degree polynomials become
sufficient, and both local and global properties of the value function are
captured. The domain of the problem is split into a non-overlapping partition,
with added constraints ensuring continuity. The Alternating Direction
Method of Multipliers (ADMM) is used to optimize over each domain in parallel
and ensure convergence on the boundaries of the partitions. This results in
improved conditioning of the problem and allows for much larger and more
complex problems to be addressed with improved performance.Comment: 8 pages. Accepted to CDC 201
Decentralized optimization with affine constraints over time-varying networks
The decentralized optimization paradigm assumes that each term of a
finite-sum objective is privately stored by the corresponding agent. Agents are
only allowed to communicate with their neighbors in the communication graph. We
consider the case when the agents additionally have local affine constraints
and the communication graph can change over time. We provide the first linearly
convergent decentralized algorithm for time-varying networks by generalizing
the optimal decentralized algorithm ADOM to the case of affine constraints. We
show that its rate of convergence is optimal for first-order methods by
providing the lower bounds for the number of communications and oracle calls
Recommended from our members
A robust scalable demand-side management based on diffusion-ADMM strategy for smart grid
Demand-side management (DSM) involves a group of programs, initiatives, and technologies designed to encourage consumers to modify their level and pattern of electricity usage. This is performed following methods such as financial incentives and behavioral change through education. While the objective of the DSM is to achieve a balance between energy production and demand, effective and efficient implementation of the program rests within effective use of emerging Internet of things (IoT) concept for online interactions. Here, a novel DSM framework based on diffusion and alternating direction method of multipliers (ADMM) strategies, repeated under a model predictive control (MPC) protocol, is proposed. On the demand side, the customers autonomously and by cooperation with their immediate neighbors estimate the baseline price in real time. Based on the estimated price signal, the customers schedule their energy consumption using the ADMM cost-sharing strategy to minimize their incommodity level. On the supply side, the utility company determines the price parameters based on the customers real-time behavior to make a profit and prevent the infrastructure overload. The proposed mechanism is capable of tracking drifts in the optimal solution resulting from the changes in supply/demand sides. Moreover, it considers all classes of appliances by formulating the DSM problem as a mixed-integer programming (MIP) problem. Numerical examples are provided to show the effectiveness of the proposed framework
- …