Awi Federgruen

A new specification of the multichain policy iteration algorithm in undiscounted Markov renewal programs

Coauthor(s): D. Spreen.

Download:

Adobe Acrobat PDF

Abstract:
We consider the Policy Iteration Algorithm for undiscounted Markov Renewal Programs. Previous specifications of the policy evaluation part of this algorithm all required the analysis of the chain structure for each policy generated. The purpose of this paper is to provide a unique specification of the value sectors as well as an anticycling rule which avoids parsing the transition probability matrices into their subchains.

Close Window