Uncertainty in Artificial Intelligence
First Name   Last Name   Password   Forgot Password   Log in!
    Proceedings   Proceeding details   Article details         Authors         Search    
An Approximate Solution Method for Large Risk-Averse Markov Decision Processes
Marek Petrik, Dharmashankar Subramanian
Abstract:
Stochastic domains often involve risk-averse decision makers. While recent work has focused on how to model risk in Markov decision processes using risk measures, it has not addressed the problem of solving large risk-averse formulations. In this paper, we propose and analyze a new method for solving large risk-averse MDPs with hybrid continuous-discrete state spaces and continuous action spaces. The proposed method iteratively improves a bound on the value function using a linearity structure of the MDP. We demonstrate the utility and properties of the method on a portfolio optimization problem.
Keywords:
Pages: 805-814
PS Link:
PDF Link: /papers/12/p805-petrik.pdf
BibTex:
@INPROCEEDINGS{Petrik12,
AUTHOR = "Marek Petrik and Dharmashankar Subramanian",
TITLE = "An Approximate Solution Method for Large Risk-Averse Markov Decision Processes",
BOOKTITLE = "Proceedings of the Twenty-Eighth Conference Annual Conference on Uncertainty in Artificial Intelligence (UAI-12)",
PUBLISHER = "AUAI Press",
ADDRESS = "Corvallis, Oregon",
YEAR = "2012",
PAGES = "805--814"
}


hosted by DSL   •   site info   •   help