Adaptive Dynamic Programming for Energy-Efficient Base Station Cell Switching

Energy saving in wireless networks is growing in importance due to increasing demand for evolving new-gen cellular networks, environmental and regulatory concerns, and potential energy crises arising from geopolitical tensions. In this work, we propose an approximate dynamic programming (ADP)-based method coupled with online optimization to switch on/off the cells of base stations to reduce network power consumption while maintaining adequate Quality of Service (QoS) metrics. We use a multilayer perceptron (MLP) given each state-action pair to predict the power consumption to approximate the value function in ADP for selecting the action with optimal expected power saved. To save the largest possible power consumption without deteriorating QoS, we include another MLP to predict QoS and a long short-term memory (LSTM) for predicting handovers, incorporated into an online optimization algorithm producing an adaptive QoS threshold for filtering cell switching actions based on the overall QoS history. The performance of the method is evaluated using a practical network simulator with various real-world scenarios with dynamic traffic patterns

Delay and energy efficiency optimizations in smart grid neighbourhood area networks

Smart grids play a significant role in addressing climate change and growing energy demand. The role of smart grids includes reducing greenhouse gas emission reduction by providing alternative energy resources to the traditional grid. Smart grids exploit renewable energy resources into the power grid and provide effective two-way communications between smart grid domains for efficient grid control. The smart grid communication plays a pivotal role in coordinating energy generation, energy transmission, and energy distribution. Cellular technology with long term evolution (LTE)-based standards has been a preference for smart grid communication networks. However, integrating the cellular technology and the smart grid communication network puts forth a significant challenge for the LTE because LTE was initially invented for human centric broadband purpose. Delay and energy efficiency are two critical parameters in smart grid communication networks. Some data in smart grids are real-time delay-sensitive data which is crucial in ensuring stability of the grid. On the other hand, when abnormal events occur, most communication devices in smart grids are powered by local energy sources with limited power supply, therefore energy-efficient communications are required. This thesis studies energy-efficient and delay-optimization schemes in smart grid communication networks to make the grid more efficient and reliable. A joint power control and mode selection in device-to-device communications underlying cellular networks is proposed for energy management in the Future Renewable Electric Energy Delivery and Managements system. Moreover, a joint resource allocation and power control in heterogeneous cellular networks is proposed for phasor measurement units to achieve efficient grid control. Simulation results are presented to show the effectiveness of the proposed schemes

Optimization Modeling and Machine Learning Techniques Towards Smarter Systems and Processes

The continued penetration of technology in our daily lives has led to the emergence of the concept of Internet-of-Things (IoT) systems and networks. An increasing number of enterprises and businesses are adopting IoT-based initiatives expecting that it will result in higher return on investment (ROI) [1]. However, adopting such technologies poses many challenges. One challenge is improving the performance and efficiency of such systems by properly allocating the available and scarce resources [2, 3]. A second challenge is making use of the massive amount of data generated to help make smarter and more informed decisions [4]. A third challenge is protecting such devices and systems given the surge in security breaches and attacks in recent times [5]. To that end, this thesis proposes the use of various optimization modeling and machine learning techniques in three different systems; namely wireless communication systems, learning management systems (LMSs), and computer network systems. In par- ticular, the first part of the thesis posits optimization modeling techniques to improve the aggregate throughput and power efficiency of a wireless communication network. On the other hand, the second part of the thesis proposes the use of unsupervised machine learning clustering techniques to be integrated into LMSs to identify unengaged students based on their engagement with material in an e-learning environment. Lastly, the third part of the thesis suggests the use of exploratory data analytics, unsupervised machine learning clustering, and supervised machine learning classification techniques to identify malicious/suspicious domain names in a computer network setting. The main contributions of this thesis can be divided into three broad parts. The first is developing optimal and heuristic scheduling algorithms that improve the performance of wireless systems in terms of throughput and power by combining wireless resource virtualization with device-to-device and machine-to-machine communications. The second is using unsupervised machine learning clustering and association algorithms to determine an appropriate engagement level model for blended e-learning environments and study the relationship between engagement and academic performance in such environments. The third is developing a supervised ensemble learning classifier to detect malicious/suspicious domain names that achieves high accuracy and precision

High-Performance Modelling and Simulation for Big Data Applications

This open access book was prepared as a Final Publication of the COST Action IC1406 “High-Performance Modelling and Simulation for Big Data Applications (cHiPSet)“ project. Long considered important pillars of the scientific method, Modelling and Simulation have evolved from traditional discrete numerical methods to complex data-intensive continuous analytical optimisations. Resolution, scale, and accuracy have become essential to predict and analyse natural and complex systems in science and engineering. When their level of abstraction raises to have a better discernment of the domain at hand, their representation gets increasingly demanding for computational and data resources. On the other hand, High Performance Computing typically entails the effective use of parallel and distributed processing units coupled with efficient storage, communication and visualisation systems to underpin complex data-intensive applications in distinct scientific and technical domains. It is then arguably required to have a seamless interaction of High Performance Computing with Modelling and Simulation in order to store, compute, analyse, and visualise large data sets in science and engineering. Funded by the European Commission, cHiPSet has provided a dynamic trans-European forum for their members and distinguished guests to openly discuss novel perspectives and topics of interests for these two communities. This cHiPSet compendium presents a set of selected case studies related to healthcare, biological data, computational advertising, multimedia, finance, bioinformatics, and telecommunications

High-Performance Modelling and Simulation for Big Data Applications

This open access book was prepared as a Final Publication of the COST Action IC1406 “High-Performance Modelling and Simulation for Big Data Applications (cHiPSet)“ project. Long considered important pillars of the scientific method, Modelling and Simulation have evolved from traditional discrete numerical methods to complex data-intensive continuous analytical optimisations. Resolution, scale, and accuracy have become essential to predict and analyse natural and complex systems in science and engineering. When their level of abstraction raises to have a better discernment of the domain at hand, their representation gets increasingly demanding for computational and data resources. On the other hand, High Performance Computing typically entails the effective use of parallel and distributed processing units coupled with efficient storage, communication and visualisation systems to underpin complex data-intensive applications in distinct scientific and technical domains. It is then arguably required to have a seamless interaction of High Performance Computing with Modelling and Simulation in order to store, compute, analyse, and visualise large data sets in science and engineering. Funded by the European Commission, cHiPSet has provided a dynamic trans-European forum for their members and distinguished guests to openly discuss novel perspectives and topics of interests for these two communities. This cHiPSet compendium presents a set of selected case studies related to healthcare, biological data, computational advertising, multimedia, finance, bioinformatics, and telecommunications

Potentzia domeinuko NOMA 5G sareetarako eta haratago

Tesis inglés 268 p. -- Tesis euskera 274 p.During the last decade, the amount of data carried over wireless networks has grown exponentially. Several reasons have led to this situation, but the most influential ones are the massive deployment of devices connected to the network and the constant evolution in the services offered. In this context, 5G targets the correct implementation of every application integrated into the use cases. Nevertheless, the biggest challenge to make ITU-R defined cases (eMBB, URLLC and mMTC) a reality is the improvement in spectral efficiency. Therefore, in this thesis, a combination of two mechanisms is proposed to improve spectral efficiency: Non-Orthogonal Multiple Access (NOMA) techniques and Radio Resource Management (RRM) schemes. Specifically, NOMA transmits simultaneously several layered data flows so that the whole bandwidth is used throughout the entire time to deliver more than one service simultaneously. Then, RRM schemes provide efficient management and distribution of radio resources among network users. Although NOMA techniques and RRM schemes can be very advantageous in all use cases, this thesis focuses on making contributions in eMBB and URLLC environments and proposing solutions to communications that are expected to be relevant in 6G

Contribution to the integration, performance improvement, and smart management of data and resources in the Internet of Things

[SPA] Esta tesis doctoral se presenta bajo la modalidad de compendio de publicaciones.[ENG] This doctoral dissertation has been presented in the form of thesis by publication. The IoT has seen a tremendous growth in the last few years. Not only due to its potential to transform societies, but also as an enabling technology for many other technological advances. Unfortunately, the IoT is a relatively recent paradigm that lacks the maturity of other well-established (not so recent) revolutions like the internet itself or Wireless Sensor Networks; upon which the IoT is built. The presented Thesis contributes to this maturation process by researching on the underlying communication mechanisms that enable a truly ubiquitous and effective IoT. As a Thesis by compilation, 5 relevant articles are introduced and discussed. Each of such articles delve into different key aspects that, in their own way, help closing the gap between what the IoT is expected to bring and what the IoT actually brings. As thoroughly commented throughout the main text, the comprehensive approach taken in this Thesis ensures that multiple angles of the same plane --the communication plane-- are analyzed and studied. From the mathematical analysis of how electromagnetic waves propagate through complex environments to the utilization of recent Machine Learning techniques, this Thesis explore a wide range of scientific and researching tools that are shown to improve the final performance of the IoT. In the first three chapters of this document, the reader will be introduced to the current context and state-of-the-art of the IoT while, at the same time, the formal objectives of this Thesis are outlined and set into such a global context. In the next five chapters, the five corresponding articles are presented and commented. For each and every of these articles: a brief abstract, a methodology summary, a highlight on the results and contributions and final conclusions are also added. Lastly, in the two last chapters, the final conclusions and future lines of this Thesis are commented.Los artículos que componen la tesis son los siguientes: 1. R. M. Sandoval, A.-J. J. Garcia-Sanchez, F. Garcia-Sanchez, and J. Garcia-Haro, \Evaluating the More Suitable ISM Frequency Band for IoT-Based Smart Grids: A Quantitative Study of 915 MHz vs. 2400 MHz," Sensors, vol. 17, no. 1, p. 76, Dec. 2016. 2. R. M. Sandoval, A.-J. J. Garcia-Sanchez, J.-M. M. Molina-Garcia-Pardo, F. Garcia-Sanchez, and J. Garcia-Haro, \Radio-Channel Characterization of Smart Grid Substations in the 2.4-GHz ISM Band," IEEE Trans. Wirel. Commun., vol. 16, no. 2, pp. 1294{1307, Feb. 2017. 3. R. M. Sandoval, A. J. Garcia-Sanchez, and J. Garcia-Haro, \Improving RSSI-based path-loss models accuracy for critical infrastructures: A smart grid substation case-study," IEEE Trans. Ind. Informatics, vol. 14, no. 5, pp. 2230{2240, 2018. 4. R. M. Sandoval, A.-J. Garcia-Sanchez, J. Garcia-Haro, and T. M. Chen, \Optimal policy derivation for Transmission Duty-Cycle constrained LPWAN," IEEE Internet Things J., vol. 5, no. 4, pp. 1{1, Aug. 2018. 5. R. M. Sandoval, S. Canovas-Carrasco, A. Garcia-Sanchez, and J. Garcia-Haro, \Smart Usage of Multiple RAT in IoT-oriented 5G Networks: A Reinforcement Learning Approach," in 2018 ITU Kaleidoscope: Machine Learning for a 5G Future (ITU K), 2018, pp. 1-8.Escuela Internacional de Doctorado de la Universidad Politécnica de CartagenaUniversidad Politécnica de CartagenaPrograma de Doctorado en Tecnologías de la Información y las Comunicaciones por la Universidad Politécnica de Cartagen

Online learning for self-optimization in heterogeneous networks

[SPA] Esta tesis doctoral se presenta bajo la modalidad de compendio de publicaciones. [ENG] This doctoral dissertation has been presented in the form of thesis by publication. These problems have been addressed by means of interference coordination (IC) and energy saving (ES) mechanisms. Although the configuration of these two mechanisms has been addressed separately so far, we show in this thesis that they are highly coupled. Moreover, the configuration of IC and ES is commonly addressed using network models, which presents several limitations. In this thesis, we consider the self-optimization functionality within the Self-Organizing Networks (SON) paradigm, which is intended to address these problems by allowing the network to autonomously configure its parameters while it is operating. To implement the self-optimization functionality, we propose the use of online learning algorithms, which learn efficient network configurations from experience without explicitly knowing the accurate mathematical model of the network beforehand. The first part of this thesis addresses the configuration of the IC mechanism in HetNets. We propose several online learning model-free solutions based on different techniques such as Response Surface Method (RSM) and Multi-Armed Bandit (MAB) algorithms. We also consider stochastic constraints in the learning process. In the second part, we address the joint problem of IC and ES in HetNets proposing several solutions based on Dynamic Programming, Contextual Multi-Armed Bandit algorithms, and Machine Learning tools such as Neural Networks and Gaussian processes.Los artículos que componen la tesis son los siguientes: 1. Jose A. Ayala-Romero, J. J. Alcaraz, J. Vales-Alonso, and E. Egea-López,“Online learning for interference coordination in heterogeneous networks”. IEEE International Conference on Communications (ICC). Paris (France), May 2017, pp. 1-6. DOI: 10.1109/ICC.2017.7996441. 2. Jose A. Ayala-Romero, J. J. Alcaraz, J. Vales-Alonso, and E. Egea-López, “Online Optimization of Interference Coordination Parameters in Small Cell Networks,” IEEE Transactions on Wireless Communications, vol. 16, no. 10, pp. 6635-6647, July 2017. DOI: 10.1109/TWC.2017.2727483. 3. Jose A. Ayala-Romero, J. J. Alcaraz, and J. Vales-Alonso, “Data-driven configuration of interference coordination parameters in HetNets,” IEEE Transactions on Vehicular Technology, vol. 67, no. 6, pp. 5174-5187, 2018. DOI: 10.1109/TVT.2018.2825606. 4. J. A. Ayala-Romero, J. J. Alcaraz, and J. Vales-Alonso, “Energy Saving and Interference Coordination in HetNets Using Dynamic Programming and CEC,” IEEE Access, vol. 6, pp. 71 110-71 121, 2018. DOI: 10.1109/ACCESS.2018.2881073. 5. Jose A. Ayala-Romero, J. J. Alcaraz, A. Zanella, and M. Zorzi, “Contextual bandit approach for energy saving and interference coordination in HetNets,” in IEEE International Conference on Communications (ICC) 2018. Kansas City (USA), May 2018, pp. 1-6. DOI: 10.1109/ICC.2018.8422872. 6. Jose A. Ayala-Romero, J. J. Alcaraz, A. Zanella, and M. Zorzi, “Online learning for energy saving and interference coordination in HetNets,” IEEE Journal on Selected Areas in Communications, vol. 37, no. 6, pp. 1374-1388, 2019. DOI: 10.1109/JSAC.2019.2904362.Escuela Internacional de Doctorado de la Universidad Politécnica de CartagenaUniversidad Politécnica de CartagenaPrograma de Doctorado en Tecnologías de la Información y las Comunicaciones por la Universidad Politécnica de Cartagen