## Awi Federgruen

*Successive approximation methods for solving nested functional equations in Markov decision problems*

Coauthor(s): Paul Schweitzer.

#### Download:

Adobe Acrobat PDF

**Abstract:**

This paper presents a successive approximation method for solving systems of nested functional equations which arise, e.g., when considering Markov renewal programs in which policies that are maximal gain or optimal under more selective discount — and average overtaking optimality criteria are to be found. In particular, a successive approximation method is given to find the optimal bias vector and bias-optimal policies. Applications with respect to a number of additional stochastic control models are pointed out.

Our method is based on systems of simultaneously generated (single-equation) value-iteration schemes.

**Source:** *Mathematics of Operations Research*

**Exact Citation:**

Federgruen, Awi, and P. J. Schweitzer. "Successive approximation methods for solving nested functional equations in Markov decision problems." *Mathematics of Operations Research* 9, no. 3 (August 1984): 319-344.

**Volume:** 9

**Number:** 3

**Pages:** 319-344

**Date:**
8
1984