3,753 research outputs found
Markov Decision Processes with Applications in Wireless Sensor Networks: A Survey
Wireless sensor networks (WSNs) consist of autonomous and resource-limited
devices. The devices cooperate to monitor one or more physical phenomena within
an area of interest. WSNs operate as stochastic systems because of randomness
in the monitored environments. For long service time and low maintenance cost,
WSNs require adaptive and robust methods to address data exchange, topology
formulation, resource and power optimization, sensing coverage and object
detection, and security challenges. In these problems, sensor nodes are to make
optimized decisions from a set of accessible strategies to achieve design
goals. This survey reviews numerous applications of the Markov decision process
(MDP) framework, a powerful decision-making tool to develop adaptive algorithms
and protocols for WSNs. Furthermore, various solution methods are discussed and
compared to serve as a guide for using MDPs in WSNs
Mean-Field-Type Games in Engineering
A mean-field-type game is a game in which the instantaneous payoffs and/or
the state dynamics functions involve not only the state and the action profile
but also the joint distributions of state-action pairs. This article presents
some engineering applications of mean-field-type games including road traffic
networks, multi-level building evacuation, millimeter wave wireless
communications, distributed power networks, virus spread over networks, virtual
machine resource management in cloud networks, synchronization of oscillators,
energy-efficient buildings, online meeting and mobile crowdsensing.Comment: 84 pages, 24 figures, 183 references. to appear in AIMS 201
Strategic Engineering Gaming for Improved Design and Interoperation of Infrastructure Systems
Large physical networks of interrelated infrastructure components support modern societies as a collaborative system with significant technical and social complexity. Design and evolution of infrastructure systems seeks to reduce wasted resources and maximize lifecycle value. Interdependencies between constituent systems call for an integrative approach to improve interoperation but many existing techniques rely on centralized development and emphasize technical aspects of design. This paper presents a simulation gaming approach to collaborative infrastructure system design leveraging the technical strengths of simulation models and the social strengths of multi-player engagement in a game execution. In a strategic engineering game, models representing each constituent infrastructure system share a common graph-theoretic modeling framework and are integrated using the HLA-Evolved standard for interoperable federated simulations. A prototype game instantiation based on a space-based resource economy supporting future space exploration is discussed with the objective of identifying how factors of game play influence insights to collaborative system design. Future work seeks to develop, execute, and evaluate the prototype game to further research the use of simulation games in supporting collaborative system design
Multi-Layer Cyber-Physical Security and Resilience for Smart Grid
The smart grid is a large-scale complex system that integrates communication
technologies with the physical layer operation of the energy systems. Security
and resilience mechanisms by design are important to provide guarantee
operations for the system. This chapter provides a layered perspective of the
smart grid security and discusses game and decision theory as a tool to model
the interactions among system components and the interaction between attackers
and the system. We discuss game-theoretic applications and challenges in the
design of cross-layer robust and resilient controller, secure network routing
protocol at the data communication and networking layers, and the challenges of
the information security at the management layer of the grid. The chapter will
discuss the future directions of using game-theoretic tools in addressing
multi-layer security issues in the smart grid.Comment: 16 page
- …