7,343 research outputs found
Power vs. Spectrum 2-D Sensing in Energy Harvesting Cognitive Radio Networks
Energy harvester based cognitive radio is a promising solution to address the
shortage of both spectrum and energy. Since the spectrum access and power
consumption patterns are interdependent, and the power value harvested from
certain environmental sources are spatially correlated, the new power dimension
could provide additional information to enhance the spectrum sensing accuracy.
In this paper, the Markovian behavior of the primary users is considered, based
on which we adopt a hidden input Markov model to specify the primary vs.
secondary dynamics in the system. Accordingly, we propose a 2-D spectrum and
power (harvested) sensing scheme to improve the primary user detection
performance, which is also capable of estimating the primary transmit power
level. Theoretical and simulated results demonstrate the effectiveness of the
proposed scheme, in term of the performance gain achieved by considering the
new power dimension. To the best of our knowledge, this is the first work to
jointly consider the spectrum and power dimensions for the cognitive primary
user detection problem
Active Classification for POMDPs: a Kalman-like State Estimator
The problem of state tracking with active observation control is considered
for a system modeled by a discrete-time, finite-state Markov chain observed
through conditionally Gaussian measurement vectors. The measurement model
statistics are shaped by the underlying state and an exogenous control input,
which influence the observations' quality. Exploiting an innovations approach,
an approximate minimum mean-squared error (MMSE) filter is derived to estimate
the Markov chain system state. To optimize the control strategy, the associated
mean-squared error is used as an optimization criterion in a partially
observable Markov decision process formulation. A stochastic dynamic
programming algorithm is proposed to solve for the optimal solution. To enhance
the quality of system state estimates, approximate MMSE smoothing estimators
are also derived. Finally, the performance of the proposed framework is
illustrated on the problem of physical activity detection in wireless body
sensing networks. The power of the proposed framework lies within its ability
to accommodate a broad spectrum of active classification applications including
sensor management for object classification and tracking, estimation of sparse
signals and radar scheduling.Comment: 38 pages, 6 figure
Hidden Markov model technique for dynamic spectrum access
Dynamic spectrum access is a paradigm used to access the spectrum dynamically. A hidden Markov model (HMM) is one in which you observe a sequence of emissions, but do not know the sequence of states the model went through to generate the emissions. Analysis of hidden Markov models seeks to recover the sequence of states from the observed data. In this paper, we estimate the occupancy state of channels using hidden Markov process. Using Viterbi algorithm, we generate the most likely states and compare it with the channel states. We generated two HMMs, one slowly changing and another more dynamic and compare their performance. Using the Baum-Welch algorithm and maximum likelihood algorithm we calculated the estimated transition and emission matrix, and then we compare the estimated states prediction performance of both the methods using stationary distribution of average estimated transition matrix calculated by both the methods
Markov Decision Processes with Applications in Wireless Sensor Networks: A Survey
Wireless sensor networks (WSNs) consist of autonomous and resource-limited
devices. The devices cooperate to monitor one or more physical phenomena within
an area of interest. WSNs operate as stochastic systems because of randomness
in the monitored environments. For long service time and low maintenance cost,
WSNs require adaptive and robust methods to address data exchange, topology
formulation, resource and power optimization, sensing coverage and object
detection, and security challenges. In these problems, sensor nodes are to make
optimized decisions from a set of accessible strategies to achieve design
goals. This survey reviews numerous applications of the Markov decision process
(MDP) framework, a powerful decision-making tool to develop adaptive algorithms
and protocols for WSNs. Furthermore, various solution methods are discussed and
compared to serve as a guide for using MDPs in WSNs
- …