Skip to main content
Article thumbnail
Location of Repository

Synchronization and optimality for multi-armed bandit problems in continuous time

By Nicole El Karoui and Ioannis Karatzas

Abstract

We provide a complete solution to a general, continuous-time dynamic allocation (multi-armed bandit) problem with arms that are not necessarily independent or Markovian, using notions and results from time-changes, optimal stopping, and multi-parameter martingale theory. The independence assumption is replaced by the condition (F.4) of Cairoli & Walsh. We also introduce a synchronization identity for allocation strategies, which i

Year: 1996
OAI identifier: oai:CiteSeerX.psu:10.1.1.134.2067
Provided by: CiteSeerX
Download PDF:
Sorry, we are unable to provide the full text but you may find it at the following location(s):
  • http://citeseerx.ist.psu.edu/v... (external link)
  • http://www.cs.ualberta.ca/~sze... (external link)
  • Suggested articles


    To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.