Uncertainty in Artificial Intelligence
First Name   Last Name   Password   Forgot Password   Log in!
    Proceedings   Proceeding details   Article details         Authors         Search    
Models and Selection Criteria for Regression and Classification
David Heckerman, Christopher Meek
Abstract:
When performing regression or classification, we are interested in the conditional probability distribution for an outcome or class variable Y given a set of explanatoryor input variables X. We consider Bayesian models for this task. In particular, we examine a special class of models, which we call Bayesian regression/classification (BRC) models, that can be factored into independent conditional (y|x) and input (x) models. These models are convenient, because the conditional model (the portion of the full model that we care about) can be analyzed by itself. We examine the practice of transforming arbitrary Bayesian models to BRC models, and argue that this practice is often inappropriate because it ignores prior knowledge that may be important for learning. In addition, we examine Bayesian methods for learning models from data. We discuss two criteria for Bayesian model selection that are appropriate for repression/classification: one described by Spiegelhalter et al. (1993), and another by Buntine (1993). We contrast these two criteria using the prequential framework of Dawid (1984), and give sufficient conditions under which the criteria agree.
Keywords: Bayesian networks, regression, classification, model averaging, model selection, pre
Pages: 223-228
PS Link: ftp://ftp.research.microsoft.com/pub/tr/tr-97-08.ps
PDF Link: /papers/97/p223-heckerman.pdf
BibTex:
@INPROCEEDINGS{Heckerman97,
AUTHOR = "David Heckerman and Christopher Meek",
TITLE = "Models and Selection Criteria for Regression and Classification",
BOOKTITLE = "Proceedings of the Thirteenth Conference Annual Conference on Uncertainty in Artificial Intelligence (UAI-97)",
PUBLISHER = "Morgan Kaufmann",
ADDRESS = "San Francisco, CA",
YEAR = "1997",
PAGES = "223--228"
}


hosted by DSL   •   site info   •   help