34,157 research outputs found
A Belief-Based Decision-Making Framework for Spectrum Selection in Cognitive Radio Networks
This paper presents a comprehensive cognitive management framework for spectrum selection in cognitive radio (CR) networks. The framework uses a belief vector concept as a means to predict the interference affecting the different spectrum blocks (SBs) and relies on a smart analysis of the scenario dynamicity to properly determine an adequate observation strategy to balance the tradeoff between achievable performance and measurement requirements. In this respect, the paper shows that the interference dynamics in a given SB can be properly characterized through the second highest eigenvalue of the interference state transition matrix. Therefore, this indicator is retained in the proposed framework as a relevant parameter to drive the selection of both the observation strategy and spectrum selection decision-making criterion. This paper evaluates the proposed framework to illustrate the capability to properly choose among a set of possible observation strategies under different scenario conditions. Furthermore, a comparison against other state-of-the-art solutions is presented
Thirty Years of Machine Learning: The Road to Pareto-Optimal Wireless Networks
Future wireless networks have a substantial potential in terms of supporting
a broad range of complex compelling applications both in military and civilian
fields, where the users are able to enjoy high-rate, low-latency, low-cost and
reliable information services. Achieving this ambitious goal requires new radio
techniques for adaptive learning and intelligent decision making because of the
complex heterogeneous nature of the network structures and wireless services.
Machine learning (ML) algorithms have great success in supporting big data
analytics, efficient parameter estimation and interactive decision making.
Hence, in this article, we review the thirty-year history of ML by elaborating
on supervised learning, unsupervised learning, reinforcement learning and deep
learning. Furthermore, we investigate their employment in the compelling
applications of wireless networks, including heterogeneous networks (HetNets),
cognitive radios (CR), Internet of things (IoT), machine to machine networks
(M2M), and so on. This article aims for assisting the readers in clarifying the
motivation and methodology of the various ML algorithms, so as to invoke them
for hitherto unexplored services as well as scenarios of future wireless
networks.Comment: 46 pages, 22 fig
Cooperation and Underlay Mode Selection in Cognitive Radio Network
In this research, we proposes a new method for cooperation and underlay mode
selection in cognitive radio networks. We characterize the maximum achievable
throughput of our proposed method of hybrid spectrum sharing. Hybrid spectrum
sharing is assumed where the Secondary User (SU) can access the Primary User
(PU) channel in two modes, underlay mode or cooperative mode with admission
control. In addition to access the channel in the overlay mode, secondary user
is allowed to occupy the channel currently occupied by the primary user but
with small transmission power. Adding the underlay access modes attains more
opportunities to the secondary user to transmit data. It is proposed that the
secondary user can only exploits the underlay access when the channel of the
primary user direct link is good or predicted to be in non-outage state.
Therefore, the secondary user could switch between underlay spectrum sharing
and cooperation with the primary user. Hybrid access is regulated through
monitoring the state of the primary link. By observing the simulation results,
the proposed model attains noticeable improvement in the system performance in
terms of maximum secondary user throughput than the conventional cooperation
and non-cooperation schemes
Markov Decision Processes with Applications in Wireless Sensor Networks: A Survey
Wireless sensor networks (WSNs) consist of autonomous and resource-limited
devices. The devices cooperate to monitor one or more physical phenomena within
an area of interest. WSNs operate as stochastic systems because of randomness
in the monitored environments. For long service time and low maintenance cost,
WSNs require adaptive and robust methods to address data exchange, topology
formulation, resource and power optimization, sensing coverage and object
detection, and security challenges. In these problems, sensor nodes are to make
optimized decisions from a set of accessible strategies to achieve design
goals. This survey reviews numerous applications of the Markov decision process
(MDP) framework, a powerful decision-making tool to develop adaptive algorithms
and protocols for WSNs. Furthermore, various solution methods are discussed and
compared to serve as a guide for using MDPs in WSNs
Joint Design and Separation Principle for Opportunistic Spectrum Access in the Presence of Sensing Errors
We address the design of opportunistic spectrum access (OSA) strategies that
allow secondary users to independently search for and exploit instantaneous
spectrum availability. Integrated in the joint design are three basic
components: a spectrum sensor that identifies spectrum opportunities, a sensing
strategy that determines which channels in the spectrum to sense, and an access
strategy that decides whether to access based on imperfect sensing outcomes.
We formulate the joint PHY-MAC design of OSA as a constrained partially
observable Markov decision process (POMDP). Constrained POMDPs generally
require randomized policies to achieve optimality, which are often intractable.
By exploiting the rich structure of the underlying problem, we establish a
separation principle for the joint design of OSA. This separation principle
reveals the optimality of myopic policies for the design of the spectrum sensor
and the access strategy, leading to closed-form optimal solutions. Furthermore,
decoupling the design of the sensing strategy from that of the spectrum sensor
and the access strategy, the separation principle reduces the constrained POMDP
to an unconstrained one, which admits deterministic optimal policies. Numerical
examples are provided to study the design tradeoffs, the interaction between
the spectrum sensor and the sensing and access strategies, and the robustness
of the ensuing design to model mismatch.Comment: 43 pages, 10 figures, submitted to IEEE Transactions on Information
Theory in Feb. 200
- …