Optimization and Learning in Energy Efficient Cognitive Radio System

Energy efficiency and spectrum efficiency are two biggest concerns for wireless communication. The constrained power supply is always a bottleneck to the modern mobility communication system. Meanwhile, spectrum resource is extremely limited but seriously underutilized. Cognitive radio (CR) as a promising approach could alleviate the spectrum underutilization and increase the quality of service. In contrast to traditional wireless communication systems, a distinguishing feature of cognitive radio systems is that the cognitive radios, which are typically equipped with powerful computation machinery, are capable of sensing the spectrum environment and making intelligent decisions. Moreover, the cognitive radio systems differ from traditional wireless systems that they can adapt their operating parameters, i.e. transmission power, channel, modulation according to the surrounding radio environment to explore the opportunity. In this dissertation, the study is focused on the optimization and learning of energy efficiency in the cognitive radio system, which can be considered to better utilize both the energy and spectrum resources. Firstly, drowsy transmission, which produces optimized idle period patterns and selects the best sleep mode for each idle period between two packet transmissions through joint power management and transmission power control/rate selection, is introduced to cognitive radio transmitter. Both the optimal solution by dynamic programming and flexible solution by reinforcement learning are provided. Secondly, when cognitive radio system is benefited from the theoretically infinite but unsteady harvested energy, an innovative and flexible control framework mainly based on model predictive control is designed. The solution to combat the problems, such as the inaccurate model and myopic control policy introduced by MPC, is given. Last, after study the optimization problem for point-to-point communication, multi-objective reinforcement learning is applied to the cognitive radio network, an adaptable routing algorithm is proposed and implemented. Epidemic propagation is studied to further understand the learning process in the cognitive radio network

Semantic reasoning in cognitive networks for heterogeneous wireless mesh systems

The next generation of wireless networks is expected to provide not only higher bandwidths anywhere and at any time but also ubiquitous communication using different network types. However, several important issues including routing, self-configuration, device management, and context awareness have to be considered before this vision becomes reality. This paper proposes a novel cognitive network framework for heterogeneous wireless mesh systems to abstract the network control system from the infrastructure by introducing a layer that separates the management of different radio access networks from the data transmission. This approach simplifies the process of managing and optimizing the networks by using extendable smart middleware that automatically manages, configures, and optimizes the network performance. The proposed cognitive network framework, called FuzzOnto, is based on a novel approach that employs ontologies and fuzzy reasoning to facilitate the dynamic addition of new network types to the heterogeneous network. The novelty is in using semantic reasoning with cross-layer parameters from heterogeneous network architectures to manage and optimize the performance of the networks. The concept is demonstrated through the use of three network architectures: 1) wireless mesh network; 2) long-term evolution (LTE) cellular network; and 3) vehicular ad hoc network (VANET). These networks utilize nonoverlapped frequency bands and can operate simultaneously with no interference. The proposed heterogeneous network was evaluated using ns-3 network simulation software. The simulation results were compared with those produced by other networks that utilize multiple transmission devices. The results showed that the heterogeneous network outperformed the benchmark networks in both urban and VANET scenarios by up to 70% of the network throughput, even when the LTE network utilized a high bandwidth

Application of reinforcement learning for security enhancement in cognitive radio networks

Cognitive radio network (CRN) enables unlicensed users (or secondary users, SUs) to sense for and opportunistically operate in underutilized licensed channels, which are owned by the licensed users (or primary users, PUs). Cognitive radio network (CRN) has been regarded as the next-generation wireless network centered on the application of artificial intelligence, which helps the SUs to learn about, as well as to adaptively and dynamically reconfigure its operating parameters, including the sensing and transmission channels, for network performance enhancement. This motivates the use of artificial intelligence to enhance security schemes for CRNs. Provisioning security in CRNs is challenging since existing techniques, such as entity authentication, are not feasible in the dynamic environment that CRN presents since they require pre-registration. In addition these techniques cannot prevent an authenticated node from acting maliciously. In this article, we advocate the use of reinforcement learning (RL) to achieve optimal or near-optimal solutions for security enhancement through the detection of various malicious nodes and their attacks in CRNs. RL, which is an artificial intelligence technique, has the ability to learn new attacks and to detect previously learned ones. RL has been perceived as a promising approach to enhance the overall security aspect of CRNs. RL, which has been applied to address the dynamic aspect of security schemes in other wireless networks, such as wireless sensor networks and wireless mesh networks can be leveraged to design security schemes in CRNs. We believe that these RL solutions will complement and enhance existing security solutions applied to CRN To the best of our knowledge, this is the first survey article that focuses on the use of RL-based techniques for security enhancement in CRNs