Awi Federgruen

Successive approximation methods for solving nested functional equations in Markov decision problems

Coauthor(s): Paul Schweitzer.

Download:

Adobe Acrobat PDF

Abstract:

This paper presents a successive approximation method for solving systems of nested functional equations which arise, e.g., when considering Markov renewal programs in which policies that are maximal gain or optimal under more selective discount — and average overtaking optimality criteria are to be found. In particular, a successive approximation method is given to find the optimal bias vector and bias-optimal policies. Applications with respect to a number of additional stochastic control models are pointed out.

Our method is based on systems of simultaneously generated (single-equation) value-iteration schemes.

Source: Mathematics of Operations Research
Exact Citation:
Federgruen, Awi, and P. J. Schweitzer. "Successive approximation methods for solving nested functional equations in Markov decision problems." Mathematics of Operations Research 9, no. 3 (August 1984): 319-344.
Volume: 9
Number: 3
Pages: 319-344
Date: 8 1984