Uncertainty in Artificial Intelligence
First Name   Last Name   Password   Forgot Password   Log in!
    Proceedings         Authors   Author's Info   Article details         Search    
Predictive State Representations: A New Theory for Modeling Dynamical Systems
Satinder Singh, Michael James, Matthew Rudary
Abstract:
Modeling dynamical systems, both for control purposes and to make predictions about their behavior, is ubiquitous in science and engineering. Predictive state representations (PSRs) are a recently introduced class of models for discrete-time dynamical systems. The key idea behind PSRs and the closely related OOMs (Jaeger's observable operator models) is to represent the state of the system as a set of predictions of observable outcomes of experiments one can do in the system. This makes PSRs rather different from history-based models such as nth-order Markov models and hidden-state-based models such as HMMs and POMDPs. We introduce an interesting construct, the systemdynamics matrix, and show how PSRs can be derived simply from it. We also use this construct to show formally that PSRs are more general than both nth-order Markov models and HMMs/POMDPs. Finally, we discuss the main difference between PSRs and OOMs and conclude with directions for future work.
Keywords: null
Pages: 512-519
PS Link:
PDF Link: /papers/04/p512-singh.pdf
BibTex:
@INPROCEEDINGS{Singh04,
AUTHOR = "Satinder Singh and Michael James and Matthew Rudary",
TITLE = "Predictive State Representations: A New Theory for Modeling Dynamical Systems",
BOOKTITLE = "Proceedings of the Twentieth Conference Annual Conference on Uncertainty in Artificial Intelligence (UAI-04)",
PUBLISHER = "AUAI Press",
ADDRESS = "Arlington, Virginia",
YEAR = "2004",
PAGES = "512--519"
}


hosted by DSL   •   site info   •   help