196,567 research outputs found
Exploiting Anonymity in Approximate Linear Programming: Scaling to Large Multiagent MDPs (Extended Version)
Many exact and approximate solution methods for Markov Decision Processes
(MDPs) attempt to exploit structure in the problem and are based on
factorization of the value function. Especially multiagent settings, however,
are known to suffer from an exponential increase in value component sizes as
interactions become denser, meaning that approximation architectures are
restricted in the problem sizes and types they can handle. We present an
approach to mitigate this limitation for certain types of multiagent systems,
exploiting a property that can be thought of as "anonymous influence" in the
factored MDP. Anonymous influence summarizes joint variable effects efficiently
whenever the explicit representation of variable identity in the problem can be
avoided. We show how representational benefits from anonymity translate into
computational efficiencies, both for general variable elimination in a factor
graph but in particular also for the approximate linear programming solution to
factored MDPs. The latter allows to scale linear programming to factored MDPs
that were previously unsolvable. Our results are shown for the control of a
stochastic disease process over a densely connected graph with 50 nodes and 25
agents.Comment: Extended version of AAAI 2016 pape
Complex Networks and Symmetry I: A Review
In this review we establish various connections between complex networks and
symmetry. While special types of symmetries (e.g., automorphisms) are studied
in detail within discrete mathematics for particular classes of deterministic
graphs, the analysis of more general symmetries in real complex networks is far
less developed. We argue that real networks, as any entity characterized by
imperfections or errors, necessarily require a stochastic notion of invariance.
We therefore propose a definition of stochastic symmetry based on graph
ensembles and use it to review the main results of network theory from an
unusual perspective. The results discussed here and in a companion paper show
that stochastic symmetry highlights the most informative topological properties
of real networks, even in noisy situations unaccessible to exact techniques.Comment: Final accepted versio
- …