Cognitive Spectrum Management in Dynamic Cellular Environments: : A Case-Based Q-Learning Approach

This paper examines how novel cellular system architectures and intelligent spectrum management techniques can be used to play a key role in accommodating the exponentially increasing demand for mobile data capacity in the near future. A significant challenge faced by the artificial intelligence methods applied to such flexible wireless communication systems is their dynamic nature, e.g. network topologies that change over time. This paper proposes an intelligent case-based Q-learning method for dynamic spectrum access (DSA) which improves and stabilises the performance of cognitive cellular systems with dynamic topologies. The proposed approach is the combination of classical distributed Q-learning and a novel implementation of case-based reasoning which aims to facilitate a number of learning processes running in parallel. Large scale simulations of a stadium small cell network show that the proposed case-based Q-learning approach achieves a consistent improvement in the system quality of service (QoS) under dynamic and asymmetric network topology and traffic load conditions. Simulations of a secondary spectrum sharing scenario show that the cognitive cellular system that employs the proposed case-based Q-learning DSA scheme is able to accommodate a 28-fold increase in the total primary and secondary system throughput, but with no need for additional spectrum and with no degradation in the primary user QoS

A Game-theoretic Model for Regulating Freeriding in Subsidy-Based Pervasive Spectrum Sharing Markets

Cellular spectrum is a limited natural resource becoming scarcer at a worrisome rate. To satisfy users\u27 expectation from wireless data services, researchers and practitioners recognized the necessity of more utilization and pervasive sharing of the spectrum. Though scarce, spectrum is underutilized in some areas or within certain operating hours due to the lack of appropriate regulatory policies, static allocation and emerging business challenges. Thus, finding ways to improve the utilization of this resource to make sharing more pervasive is of great importance. There already exists a number of solutions to increase spectrum utilization via increased sharing. Dynamic Spectrum Access (DSA) enables a cellular operator to participate in spectrum sharing in many ways, such as geological database and cognitive radios, but these systems perform spectrum sharing at the secondary level (i.e., the bands are shared if and only if the primary/licensed user is idle) and it is questionable if they will be sufficient to meet the future expectations of the spectral efficiency. Along with the secondary sharing, spectrum sharing among primary users is emerging as a new domain of future mode of pervasive sharing. We call this type of spectrum sharing among primary users as pervasive spectrum sharing (PSS) . However, such spectrum sharing among primary users requires strong incentives to share and ensuring a freeriding-free cellular market. Freeriding in pervasively shared spectrum markets (be it via government subsidies/regulations or self-motivated coalitions among cellular operators) is a real techno-economic challenge to be addressed. In a PSS market, operators will share their resources with primary users of other operators and may sometimes have to block their own primary users in order to attain sharing goals. Small operators with lower quality service may freeride on large operators\u27 infrastructure in such pervasively shared markets. Even worse, since small operators\u27 users may perceive higher-than-expected service quality for a lower fee, this can cause customer loss to the large operators and motivate small operators to continue freeriding with additional earnings from the stolen customers. Thus, freeriding can drive a shared spectrum market to an unhealthy and unstable equilibrium. In this work, we model the freeriding by small operators in shared spectrum markets via a game-theoretic framework. We focus on a performance-based government incentivize scheme and aim to minimize the freeriding issue emerging in such PSS markets. We present insights from the model and discuss policy and regulatory challenges

Spectrum Trading: An Abstracted Bibliography

This document contains a bibliographic list of major papers on spectrum trading and their abstracts. The aim of the list is to offer researchers entering this field a fast panorama of the current literature. The list is continually updated on the webpage \url{http://www.disp.uniroma2.it/users/naldi/Ricspt.html}. Omissions and papers suggested for inclusion may be pointed out to the authors through e-mail (\textit{[email protected]})

Information reuse in dynamic spectrum access

Dynamic spectrum access (DSA), where the permission to use slices of radio spectrum is dynamically shifted (in time an in different geographical areas) across various communications services and applications, has been an area of interest from technical and public policy perspectives over the last decade. The underlying belief is that this will increase spectrum utilization, especially since many spectrum bands are relatively unused, ultimately leading to the creation of new and innovative services that exploit the increase in spectrum availability. Determining whether a slice of spectrum, allocated or licensed to a primary user, is available for use by a secondary user at a certain time and in a certain geographic area is a challenging task. This requires 'context information' which is critical to the operation of DSA. Such context information can be obtained in several ways, with different costs, and different quality/usefulness of the information. In this paper, we describe the challenges in obtaining this context information, the potential for the integration of various sources of context information, and the potential for reuse of such information for related and unrelated purposes such as localization and enforcement of spectrum sharing. Since some of the infrastructure for obtaining finegrained context information is likely to be expensive, the reuse of this infrastructure/information and integration of information from less expensive sources are likely to be essential for the economical and technological viability of DSA. © 2013 IEEE

Survey of Spectrum Sharing for Inter-Technology Coexistence

Increasing capacity demands in emerging wireless technologies are expected to be met by network densification and spectrum bands open to multiple technologies. These will, in turn, increase the level of interference and also result in more complex inter-technology interactions, which will need to be managed through spectrum sharing mechanisms. Consequently, novel spectrum sharing mechanisms should be designed to allow spectrum access for multiple technologies, while efficiently utilizing the spectrum resources overall. Importantly, it is not trivial to design such efficient mechanisms, not only due to technical aspects, but also due to regulatory and business model constraints. In this survey we address spectrum sharing mechanisms for wireless inter-technology coexistence by means of a technology circle that incorporates in a unified, system-level view the technical and non-technical aspects. We thus systematically explore the spectrum sharing design space consisting of parameters at different layers. Using this framework, we present a literature review on inter-technology coexistence with a focus on wireless technologies with equal spectrum access rights, i.e. (i) primary/primary, (ii) secondary/secondary, and (iii) technologies operating in a spectrum commons. Moreover, we reflect on our literature review to identify possible spectrum sharing design solutions and performance evaluation approaches useful for future coexistence cases. Finally, we discuss spectrum sharing design challenges and suggest future research directions