Blackwell Optimality in the Class of Markov Policies for Continuous-Time Controlled Markov Chains

Author: Prieto-Rumeau, Tomás

Source: Acta Applicandae Mathematicae, Volume 92, Number 1, May 2006 , pp. 77-96(20)

Publisher: Springer

Buy & download fulltext article:

Price: $47.00 plus tax (Refund Policy)

Abstract:

This paper deals with Blackwell optimality for continuous-time controlled Markov chains with compact Borel action space, and possibly unbounded reward (or cost) rates and unbounded transition rates. We prove the existence of a deterministic stationary policy which is Blackwell optimal in the class of all admissible (nonstationary) Markov policies, thus extending previous results that analyzed Blackwell optimality in the class of stationary policies. We compare our assumptions to the corresponding ones for discrete-time Markov controlled processes.

Keywords: 93E20; 90C40; 60J27; continuous-time controlled Markov chains (or Marko; Blackwell optimality; sensitive discount optimality

Document Type: Research article

DOI: http://dx.doi.org/10.1007/s10440-006-9060-3

Affiliations: 1: Email: tprieto@ccia.uned.es

Publication date: 2006-05-01