Article thumbnail

Decision Roll and Horizon Roll Processes in Infinite Horizon Discounted Markov Decision Processes

By D. J. White


In this paper we look at some aspects of infinite horizon Markov decision processes in which information regarding parameter values is restricted to a finite time horizon, and in which decisions are based upon the finite horizon data but are recomputed as we move forward in time and gain knowledge of later parametric values. A general framework is given. Bounds on the loss of optimality arising from two planning horizon decision processes are given, and the choice of decision process and planning horizon is examined.decision roll, horizon roll, Markov decision process, parameter uncertainty

DOI identifier: 10.1287/mnsc.42.1.37
OAI identifier:
Download PDF:
Sorry, we are unable to provide the full text but you may find it at the following location(s):
  • (external link)

  • To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.

    Suggested articles