Uncertainty in Artificial Intelligence
First Name   Last Name   Password   Forgot Password   Log in!
    Proceedings         Authors   Author's Info   Article details         Search    
Hilbert Space Embeddings of POMDPs
Yu Nishiyama, Abdeslam Boularias, Arthur Gretton, Kenji Fukumizu
A nonparametric approach for policy learning for POMDPs is proposed. The approach represents distributions over the states, observations, and actions as embeddings in feature spaces, which are reproducing kernel Hilbert spaces. Distributions over states given the observations are obtained by applying the kernel Bayes' rule to these distribution embeddings. Policies and value functions are defined on the feature space over states, which leads to a feature space expression for the Bellman equation. Value iteration may then be used to estimate the optimal value function and associated policy. Experimental results confirm that the correct policy is learned using the feature space representation.
Pages: 644-653
PS Link:
PDF Link: /papers/12/p644-nishiyama.pdf
AUTHOR = "Yu Nishiyama and Abdeslam Boularias and Arthur Gretton and Kenji Fukumizu",
TITLE = "Hilbert Space Embeddings of POMDPs",
BOOKTITLE = "Proceedings of the Twenty-Eighth Conference Annual Conference on Uncertainty in Artificial Intelligence (UAI-12)",
ADDRESS = "Corvallis, Oregon",
YEAR = "2012",
PAGES = "644--653"

hosted by DSL   •   site info   •   help