4,942 research outputs found
Pure Nash Equilibria in Concurrent Deterministic Games
We study pure-strategy Nash equilibria in multi-player concurrent
deterministic games, for a variety of preference relations. We provide a novel
construction, called the suspect game, which transforms a multi-player
concurrent game into a two-player turn-based game which turns Nash equilibria
into winning strategies (for some objective that depends on the preference
relations of the players in the original game). We use that transformation to
design algorithms for computing Nash equilibria in finite games, which in most
cases have optimal worst-case complexity, for large classes of preference
relations. This includes the purely qualitative framework, where each player
has a single omega-regular objective that she wants to satisfy, but also the
larger class of semi-quantitative objectives, where each player has several
omega-regular objectives equipped with a preorder (for instance, a player may
want to satisfy all her objectives, or to maximise the number of objectives
that she achieves.)Comment: 72 page
Equilibria-based Probabilistic Model Checking for Concurrent Stochastic Games
Probabilistic model checking for stochastic games enables formal verification
of systems that comprise competing or collaborating entities operating in a
stochastic environment. Despite good progress in the area, existing approaches
focus on zero-sum goals and cannot reason about scenarios where entities are
endowed with different objectives. In this paper, we propose probabilistic
model checking techniques for concurrent stochastic games based on Nash
equilibria. We extend the temporal logic rPATL (probabilistic alternating-time
temporal logic with rewards) to allow reasoning about players with distinct
quantitative goals, which capture either the probability of an event occurring
or a reward measure. We present algorithms to synthesise strategies that are
subgame perfect social welfare optimal Nash equilibria, i.e., where there is no
incentive for any players to unilaterally change their strategy in any state of
the game, whilst the combined probabilities or rewards are maximised. We
implement our techniques in the PRISM-games tool and apply them to several case
studies, including network protocols and robot navigation, showing the benefits
compared to existing approaches
Automatic Verification of Concurrent Stochastic Systems
Automated verification techniques for stochastic games allow formal reasoning
about systems that feature competitive or collaborative behaviour among
rational agents in uncertain or probabilistic settings. Existing tools and
techniques focus on turn-based games, where each state of the game is
controlled by a single player, and on zero-sum properties, where two players or
coalitions have directly opposing objectives. In this paper, we present
automated verification techniques for concurrent stochastic games (CSGs), which
provide a more natural model of concurrent decision making and interaction. We
also consider (social welfare) Nash equilibria, to formally identify scenarios
where two players or coalitions with distinct goals can collaborate to optimise
their joint performance. We propose an extension of the temporal logic rPATL
for specifying quantitative properties in this setting and present
corresponding algorithms for verification and strategy synthesis for a variant
of stopping games. For finite-horizon properties the computation is exact,
while for infinite-horizon it is approximate using value iteration. For
zero-sum properties it requires solving matrix games via linear programming,
and for equilibria-based properties we find social welfare or social cost Nash
equilibria of bimatrix games via the method of labelled polytopes through an
SMT encoding. We implement this approach in PRISM-games, which required
extending the tool's modelling language for CSGs, and apply it to case studies
from domains including robotics, computer security and computer networks,
explicitly demonstrating the benefits of both CSGs and equilibria-based
properties
Efficient Energy Distribution in a Smart Grid using Multi-Player Games
Algorithms and models based on game theory have nowadays become prominent
techniques for the design of digital controllers for critical systems. Indeed,
such techniques enable automatic synthesis: given a model of the environment
and a property that the controller must enforce, those techniques automatically
produce a correct controller, when it exists. In the present paper, we consider
a class of concurrent, weighted, multi-player games that are well-suited to
model and study the interactions of several agents who are competing for some
measurable resources like energy. We prove that a subclass of those games
always admit a Nash equilibrium, i.e. a situation in which all players play in
such a way that they have no incentive to deviate. Moreover, the strategies
yielding those Nash equilibria have a special structure: when one of the agents
deviate from the equilibrium, all the others form a coalition that will enforce
a retaliation mechanism that punishes the deviant agent. We apply those results
to a real-life case study in which several smart houses that produce their own
energy with solar panels, and can share this energy among them in micro-grid,
must distribute the use of this energy along the day in order to avoid
consuming electricity that must be bought from the global grid. We demonstrate
that our theory allows one to synthesise an efficient controller for these
houses: using penalties to be paid in the utility bill as an incentive, we
force the houses to follow a pre-computed schedule that maximises the
proportion of the locally produced energy that is consumed.Comment: In Proceedings Cassting'16/SynCoP'16, arXiv:1608.0017
Multiplayer Cost Games with Simple Nash Equilibria
Multiplayer games with selfish agents naturally occur in the design of
distributed and embedded systems. As the goals of selfish agents are usually
neither equivalent nor antagonistic to each other, such games are non zero-sum
games. We study such games and show that a large class of these games,
including games where the individual objectives are mean- or discounted-payoff,
or quantitative reachability, and show that they do not only have a solution,
but a simple solution. We establish the existence of Nash equilibria that are
composed of k memoryless strategies for each agent in a setting with k agents,
one main and k-1 minor strategies. The main strategy describes what happens
when all agents comply, whereas the minor strategies ensure that all other
agents immediately start to co-operate against the agent who first deviates
from the plan. This simplicity is important, as rational agents are an
idealisation. Realistically, agents have to decide on their moves with very
limited resources, and complicated strategies that require exponential--or even
non-elementary--implementations cannot realistically be implemented. The
existence of simple strategies that we prove in this paper therefore holds a
promise of implementability.Comment: 23 page
On (Subgame Perfect) Secure Equilibrium in Quantitative Reachability Games
We study turn-based quantitative multiplayer non zero-sum games played on
finite graphs with reachability objectives. In such games, each player aims at
reaching his own goal set of states as soon as possible. A previous work on
this model showed that Nash equilibria (resp. secure equilibria) are guaranteed
to exist in the multiplayer (resp. two-player) case. The existence of secure
equilibria in the multiplayer case remained and is still an open problem. In
this paper, we focus our study on the concept of subgame perfect equilibrium, a
refinement of Nash equilibrium well-suited in the framework of games played on
graphs. We also introduce the new concept of subgame perfect secure
equilibrium. We prove the existence of subgame perfect equilibria (resp.
subgame perfect secure equilibria) in multiplayer (resp. two-player)
quantitative reachability games. Moreover, we provide an algorithm deciding the
existence of secure equilibria in the multiplayer case.Comment: 32 pages. Full version of the FoSSaCS 2012 proceedings pape
Equilibria-based probabilistic model checking for concurrent stochastic games
Probabilistic model checking for stochastic games enables formal verification of systems that comprise competing or collaborating entities operating in a stochastic environment. Despite good progress in the area, existing approaches focus on zero-sum goals and cannot reason about scenarios where entities are endowed with different objectives. In this paper, we propose probabilistic model checking techniques for concurrent stochastic games based on Nash equilibria. We extend the temporal logic rPATL (probabilistic alternating-time temporal logic with rewards) to allow reasoning about players with distinct quantitative goals, which capture either the probability of an event occurring or a reward measure. We present algorithms to synthesise strategies that are subgame perfect social welfare optimal Nash equilibria, i.e., where there is no incentive for any players to unilaterally change their strategy in any state of the game, whilst the combined probabilities or rewards are maximised. We implement our techniques in the PRISM-games tool and apply them to several case studies, including network protocols and robot navigation, showing the benefits compared to existing approaches
Games on graphs with a public signal monitoring
We study pure Nash equilibria in games on graphs with an imperfect monitoring
based on a public signal. In such games, deviations and players responsible for
those deviations can be hard to detect and track. We propose a generic
epistemic game abstraction, which conveniently allows to represent the
knowledge of the players about these deviations, and give a characterization of
Nash equilibria in terms of winning strategies in the abstraction. We then use
the abstraction to develop algorithms for some payoff functions.Comment: 28 page
- …