Ciamac Moallemi

“Distributed optimization in adaptive networks”

Coauthor(s): Benjamin Van Roy.

Editors: Sebastian Thrun, Lawrence K. Saul, Bernhard Scholkopf


Adobe Acrobat PDF


We develop a protocol for optimizing dynamic behavior of a network of simple electronic components, such as a sensor network, an ad hoc network of mobile devices, or a network of communication switches. This protocol requires only local communication and simple computations which are distributed among devices. The protocol is scalable to large networks. As a motivating example, we discuss a problem involving optimization of power consumption, delay, and buffer overflow in a sensor network.

Our approach builds on policy gradient methods for optimization of Markov decision processes. The protocol can be viewed as an extension of policy gradient methods to a context involving a team of agents optimizing aggregate performance through asynchronous distributed communication and computation. We establish that the dynamics of the protocol approximate the solution to an ordinary differential equation that follows the gradient of the performance objective.

Exact Citation:
Moallemi, Ciamac, and Benjamin Van Roy. "Distributed optimization in adaptive networks." In Advances in Neural Information Processing Systems 16, 887-894. Ed. Sebastian Thrun, Lawrence K. Saul, Bernhard Scholkopf. Cambridge, MA: MIT Press, 2004.
Pages: 887-894
Place: Cambridge, MA
Date: 2004