Uncertainty in Artificial Intelligence
First Name   Last Name   Password   Forgot Password   Log in!
    Proceedings         Authors   Author's Info   Article details         Search    
Optimizing Memory-Bounded Controllers for Decentralized POMDPs
Christopher Amato, Daniel Bernstein, Shlomo Zilberstein
Abstract:
We present a memory-bounded optimization approach for solving infinite-horizon decentralized POMDPs. Policies for each agent are represented by stochastic finite state controllers. We formulate the problem of optimizing these policies as a nonlinear program, leveraging powerful existing nonlinear optimization techniques for solving the problem. While existing solvers only guarantee locally optimal solutions, we show that our formulation produces higher quality controllers than the state-of-the-art approach. We also incorporate a shared source of randomness in the form of a correlation device to further increase solution quality with only a limited increase in space and time. Our experimental results show that nonlinear optimization can be used to provide high quality, concise solutions to decentralized decision problems under uncertainty.
Keywords:
Pages: 1-8
PS Link:
PDF Link: /papers/07/p1-amato.pdf
BibTex:
@INPROCEEDINGS{Amato07,
AUTHOR = "Christopher Amato and Daniel Bernstein and Shlomo Zilberstein",
TITLE = "Optimizing Memory-Bounded Controllers for Decentralized POMDPs",
BOOKTITLE = "Proceedings of the Twenty-Third Conference Annual Conference on Uncertainty in Artificial Intelligence (UAI-07)",
PUBLISHER = "AUAI Press",
ADDRESS = "Corvallis, Oregon",
YEAR = "2007",
PAGES = "1--8"
}


hosted by DSL   •   site info   •   help