Location of Repository

A restless bandit formulation of opportunistic access: Indexablity and index policy

By Keqin Liu and Qing Zhao

Abstract

Abstract—We focus on an opportunistic communication system consisting of multiple independent channels with time-varying states. With limited sensing, a user can only sense and access a subset of channels and accrue rewards determined by the state of the sensed channels. We formulate the problem of optimal sequential channel probing as a restless multi-armed bandit process, for which a powerful index policy–Whittle’s index policy–can be implemented based on the indexability of the system. Exploiting the underlying structure of the multi-channel opportunistic access problem, we establish the indexability and obtain the Whittle’s index in closed-form, which leads to a direct implementation of Whittle’s index policy with little complexity. Furthermore, we show that Whittle’s index policy is equivalent to the myopic policy when channels are statistically identical. Index Terms—Opportunistic access, optimal channel probing, restless multi-armed bandit, Whittle’s index policy, indexability. I

Year: 2008
OAI identifier: oai:CiteSeerX.psu:10.1.1.190.7763
Provided by: CiteSeerX
Download PDF:
Sorry, we are unable to provide the full text but you may find it at the following location(s):
  • http://citeseerx.ist.psu.edu/v... (external link)
  • http://www.ece.ucdavis.edu/%7E... (external link)
  • Suggested articles


    To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.