Markov Decision Processes with Applications in Wireless Sensor Networks: A Survey

Wireless sensor networks (WSNs) consist of autonomous and resource-limited devices. The devices cooperate to monitor one or more physical phenomena within an area of interest. WSNs operate as stochastic systems because of randomness in the monitored environments. For long service time and low maintenance cost, WSNs require adaptive and robust methods to address data exchange, topology formulation, resource and power optimization, sensing coverage and object detection, and security challenges. In these problems, sensor nodes are to make optimized decisions from a set of accessible strategies to achieve design goals. This survey reviews numerous applications of the Markov decision process (MDP) framework, a powerful decision-making tool to develop adaptive algorithms and protocols for WSNs. Furthermore, various solution methods are discussed and compared to serve as a guide for using MDPs in WSNs

IETF standardization in the field of the Internet of Things (IoT): a survey

Smart embedded objects will become an important part of what is called the Internet of Things. However, the integration of embedded devices into the Internet introduces several challenges, since many of the existing Internet technologies and protocols were not designed for this class of devices. In the past few years, there have been many efforts to enable the extension of Internet technologies to constrained devices. Initially, this resulted in proprietary protocols and architectures. Later, the integration of constrained devices into the Internet was embraced by IETF, moving towards standardized IP-based protocols. In this paper, we will briefly review the history of integrating constrained devices into the Internet, followed by an extensive overview of IETF standardization work in the 6LoWPAN, ROLL and CoRE working groups. This is complemented with a broad overview of related research results that illustrate how this work can be extended or used to tackle other problems and with a discussion on open issues and challenges. As such the aim of this paper is twofold: apart from giving readers solid insights in IETF standardization work on the Internet of Things, it also aims to encourage readers to further explore the world of Internet-connected objects, pointing to future research opportunities

Using RAW as control plane for wireless deterministic networks: challenges ahead

MobiHoc '23: Proceedings of the Twenty-fourth International Symposium on Theory, Algorithmic Foundations, and Protocol Design for Mobile Networks and Mobile Computing, 23-26 October 2023, Washington DC, USA.This paper provides an extensive analysis of Reliable and Available Wireless (RAW) enhancements and solutions needed to manage industrial environments more effectively. Starting from the description of a representative industrial use case, an analysis of gaps and promising new extensions is performed. Namely, the need to (i) support multi-domain operation, at both technology and administrative levels; (ii) integrate RAW with edge architectures; and, (iii) increase the mobility support in RAW networks. The identified gaps are indeed not yet tackled by the relevant standardization development organizations, mainly the Internet Engineering Task Force (IETF), and are thus object of our future work.This work has been partially funded by the European Commission Horizon Europe SNS JU PREDICT-6G (GA 101095890) Project and the Spanish Ministry of Economic Affairs and Digital Transformation and the European Union-NextGenerationEU through the UNICO 5G I+D 6G-EDGEDT and 6G-DATADRIVEN

Using RAW as Control Plane for Wireless Deterministic Networks: Challenges Ahead

This paper provides extensive analysis of RAW (Reliable and Available Wireless) enhancements and solutions needed to manage industrial environments more effectively. Starting from the description of the industrial use case, an analysis of gaps and potential new extensions is performed. Namely, the need to (i) support multi-domain operation, at both technology and administrative levels; (ii) integrate RAW with edge architectures; and, (iii) the support for mobility support in RAW networks, are analysed. The identified gaps are indeed not yet tackled by the relevant standardisation development organisations, mainly the Internet Engineering Task Force, and are thus object of our future wor