Uncertainty in Artificial Intelligence
First Name   Last Name   Password   Forgot Password   Log in!
    Proceedings         Authors   Author's Info   Article details         Search    
Inferring latent structures via information inequalities
Rafael Chaves, Lukas Luft, Thiago Maciel, David Gross, Dominik Janzing, Bernhard Schoelkopf
Abstract:
One of the goals of probabilistic inference is to decide whether an empirically observed distribution is compatible with a candidate Bayesian network. However, Bayesian net- works with hidden variables give rise to highly non-trivial constraints on the ob- served distribution. Here, we propose an information-theoretic approach, based on the insight that conditions on entropies of Bayesian networks take the form of simple linear inequalities. We describe an algorithm for deriving entropic tests for latent struc- tures. The well-known conditional indepen- dence tests appear as a special case. While the approach applies for generic Bayesian networks, we presently adopt the causal view, and show the versatility of the framework by treating several relevant problems from that domain: detecting common ancestors, quan- tifying the strength of causal influence, and inferring the direction of causation from two- variable marginals.
Keywords:
Pages: 112-121
PS Link:
PDF Link: /papers/14/p112-chaves.pdf
BibTex:
@INPROCEEDINGS{Chaves14,
AUTHOR = "Rafael Chaves and Lukas Luft and Thiago Maciel and David Gross and Dominik Janzing and Bernhard Schoelkopf",
TITLE = "Inferring latent structures via information inequalities",
BOOKTITLE = "Proceedings of the Thirtieth Conference Annual Conference on Uncertainty in Artificial Intelligence (UAI-14)",
PUBLISHER = "AUAI Press",
ADDRESS = "Corvallis, Oregon",
YEAR = "2014",
PAGES = "112--121"
}


hosted by DSL   •   site info   •   help