Learning in graphical models

Radford M Neal, Geoffrey E Hinton, MI Jordan

1998-01-01

Abstract:

What problem does this paper attempt to address?

Learning Gaussian Networks

Dan Geiger,David Heckerman

DOI: https://doi.org/10.48550/arXiv.1302.6808

2021-06-28

Abstract:We describe algorithms for learning Bayesian networks from a combination of user knowledge and statistical data. The algorithms have two components: a scoring metric and a search procedure. The scoring metric takes a network structure, statistical data, and a user's prior knowledge, and returns a score proportional to the posterior probability of the network structure given the data. The search procedure generates networks for evaluation by the scoring metric. Previous work has concentrated on metrics for domains containing only discrete variables, under the assumption that data represents a multinomial sample. In this paper, we extend this work, developing scoring metrics for domains containing all continuous variables or a mixture of discrete and continuous variables, under the assumption that continuous data is sampled from a multivariate normal distribution. Our work extends traditional statistical approaches for identifying vanishing regression coefficients in that we identify two important assumptions, called event equivalence and parameter modularity, that when combined allow the construction of prior distributions for multivariate normal parameters from a single prior Bayesian network specified by a user.

Artificial Intelligence,Machine Learning
Operations for Learning with Graphical Models

W. L. Buntine

DOI: https://doi.org/10.48550/arXiv.cs/9412102

1994-12-01

Abstract:This paper is a multidisciplinary review of empirical, statistical learning from a graphical model perspective. Well-known examples of graphical models include Bayesian networks, directed graphs representing a Markov chain, and undirected networks representing a Markov field. These graphical models are extended to model data analysis and empirical learning using the notation of plates. Graphical operations for simplifying and manipulating a problem are provided including decomposition, differentiation, and the manipulation of probability models from the exponential family. Two standard algorithm schemas for learning are reviewed in a graphical framework: Gibbs sampling and the expectation maximization algorithm. Using these operations and schemas, some popular algorithms can be synthesized from their graphical specification. This includes versions of linear regression, techniques for feed-forward networks, and learning Gaussian and discrete Bayesian networks from data. The paper concludes by sketching some implications for data analysis and summarizing how some popular algorithms fall within the framework presented. The main original contributions here are the decomposition techniques and the demonstration that graphical models provide a framework for understanding and developing complex learning algorithms.

Artificial Intelligence
Graphical models: Foundations of neural computation

Michael Irwin Jordan, Terrence Joseph Sejnowski

2001-01-01

Abstract:This book exemplifies the interplay between the general formal framework of graphical models and the exploration of new algorithm and architectures. The selections range from foundational papers of historical importance to results at the cutting edge of research. Graphical models use graphs to represent and manipulate joint probability distributions. They have their roots in artificial intelligence, statistics, and neural networks. The clean mathematical formalism of the graphical models framework makes it possible to understand a wide variety of network-based approaches to computation, and in particular to understand many neural network algorithms and architectures as instances of a broader probabilistic methodology. It also makes it possible to identify novel features of neural network algorithms and architectures and to extend them to more general graphical models. This book exemplifies the interplay between the general formal framework of graphical models and the exploration of new algorithms and architectures. The selections range from foundational papers of historical importance to results at the cutting edge of research. Contributors H. Attias, CM Bishop, BJ Frey, Z. Ghahramani, D. Heckerman, GE Hinton, R. Hofmann, RA Jacobs, Michael I. Jordan, HJ Kappen, A. Krogh, R. Neal, SK Riis, FB Rodríguez, LK Saul, Terrence J. Sejnowski, P. Smyth, ME Tipping, V. Tresp, Y. Weiss
Graphical models: Probabilistic inference

Michael I Jordan, Yair Weiss

2002-01-01

Abstract:A" graphical model" is a type of probabilistic network that has roots in several different research communities, including artificial intelligence (Pearl, 1988), statistics (Lauritzen & Spiegelhalter, 1988), error-control coding (Gallager, 1963), and neural networks. The graphical models framework provides a clean mathematical formalism that has made it possible to understand the relationships among a wide variety of network-based approaches to computation, and in particular to understand many neural network algorithms and architectures as instances of a broader probabilistic methodology. Graphical models use graphs to represent and manipulate joint probability distributions. The graph underlying a graphical model may be directed, in which case the model is often referred to as a belief network or a Bayesian network (see BAYESIAN NETWORKS), or the graph may be undirected, in which case the model is generally referred to as a Markov random field. A graphical model has both a structural component—encoded by the pattern of edges in the graph—and a parametric component—encoded by numerical" potentials" associated with sets of edges in the graph. The relationship between these components underlies the computational machinery associated with graphical models. In particular, general inference algorithms allow statistical quantities (such as likelihoods and conditional probabilities) and information-theoretic quantities (such as mutual information and conditional entropies) to be computed efficiently. These algorithms are the subject of the current article. Learning algorithms build on these inference algorithms and allow parameters …
Variational Learning for Switching State-Space Models

Zoubin Ghahramani,Geoffrey E. Hinton

DOI: https://doi.org/10.7551/mitpress/3349.003.0016

IF: 1.094

2001-01-01

Graphical Models

Abstract:This book exemplifies the interplay between the general formal framework of graphical models and the exploration of new algorithm and architectures. The selections range from foundational papers of historical importance to results at the cutting edge of research. Graphical models use graphs to represent and manipulate joint probability distributions. They have their roots in artificial intelligence, statistics, and neural networks. The clean mathematical formalism of the graphical models framework makes it possible to understand a wide variety of network-based approaches to computation, and in particular to understand many neural network algorithms and architectures as instances of a broader probabilistic methodology. It also makes it possible to identify novel features of neural network algorithms and architectures and to extend them to more general graphical models.This book exemplifies the interplay between the general formal framework of graphical models and the exploration of new algorithms and architectures. The selections range from foundational papers of historical importance to results at the cutting edge of research. Contributors H. Attias, C. M. Bishop, B. J. Frey, Z. Ghahramani, D. Heckerman, G. E. Hinton, R. Hofmann, R. A. Jacobs, Michael I. Jordan, H. J. Kappen, A. Krogh, R. Neal, S. K. Riis, F. B. Rodríguez, L. K. Saul, Terrence J. Sejnowski, P. Smyth, M. E. Tipping, V. Tresp, Y. Weiss Bradford Books imprint

computer science, software engineering
Graphical models

Michael I Jordan

2004-02-01

Abstract:Statistical applications in fields such as bioinformatics, information retrieval, speech processing, image processing and communications often involve large-scale models in which thousands or millions of random variables are linked in complex ways. Graphical models provide a general methodology for approaching these problems, and indeed many of the models developed by researchers in these applied fields are instances of the general graphical model formalism. We review some of the basic ideas underlying graphical models, including the algorithmic ideas that allow graphical models to be deployed in large-scale data analysis problems. We also present examples of graphical models in bioinformatics, error-control coding and language processing.
Learning Latent Variable Gaussian Graphical Models

Zhaoshi Meng,Brian Eriksson,Alfred O. Hero III

DOI: https://doi.org/10.48550/arXiv.1406.2721

2014-06-11

Abstract:Gaussian graphical models (GGM) have been widely used in many high-dimensional applications ranging from biological and financial data to recommender systems. Sparsity in GGM plays a central role both statistically and computationally. Unfortunately, real-world data often does not fit well to sparse graphical models. In this paper, we focus on a family of latent variable Gaussian graphical models (LVGGM), where the model is conditionally sparse given latent variables, but marginally non-sparse. In LVGGM, the inverse covariance matrix has a low-rank plus sparse structure, and can be learned in a regularized maximum likelihood framework. We derive novel parameter estimation error bounds for LVGGM under mild conditions in the high-dimensional setting. These results complement the existing theory on the structural learning, and open up new possibilities of using LVGGM for statistical inference.

Machine Learning,Statistics Theory
Learning Graphical Models From the Glauber Dynamics

Guy Bresler,David Gamarnik,Devavrat Shah

DOI: https://doi.org/10.1109/tit.2017.2713828

IF: 2.5

2018-06-01

IEEE Transactions on Information Theory

Abstract:In this paper, we consider the problem of learning undirected graphical models from data generated according to the Glauber dynamics (also known as the Gibbs sampler). The Glauber dynamics is a Markov chain that sequentially updates individual nodes (variables) in a graphical model and it is frequently used to sample from the stationary distribution (to which it converges given sufficient time). Additionally, the Glauber dynamics is a natural dynamical model in a variety of settings. This paper deviates from the standard formulation of graphical model learning in the literature, where one assumes access to independent identically distributed samples from the distribution. Much of the research on graphical model learning has been directed toward finding algorithms with low computational cost. As the main result of this paper, we establish that the problem of reconstructing binary pairwise graphical models is computationally tractable when we observe the Glauber dynamics. Specifically, we show that a binary pairwise graphical model on $p$ nodes with maximum degree $d$ can be learned in time $f(d)p^{2}\log p$ , for a function $f(d)$ defined explicitly in this paper, using nearly the information-theoretic minimum number of samples.

computer science, information systems,engineering, electrical & electronic
Efficient Learning of Discrete Graphical Models

Marc Vuffray,Sidhant Misra,Andrey Y. Lokhov

DOI: https://doi.org/10.48550/arXiv.1902.00600

2021-11-17

Abstract:Graphical models are useful tools for describing structured high-dimensional probability distributions. Development of efficient algorithms for learning graphical models with least amount of data remains an active research topic. Reconstruction of graphical models that describe the statistics of discrete variables is a particularly challenging problem, for which the maximum likelihood approach is intractable. In this work, we provide the first sample-efficient method based on the Interaction Screening framework that allows one to provably learn fully general discrete factor models with node-specific discrete alphabets and multi-body interactions, specified in an arbitrary basis. We identify a single condition related to model parametrization that leads to rigorous guarantees on the recovery of model structure and parameters in any error norm, and is readily verifiable for a large class of models. Importantly, our bounds make explicit distinction between parameters that are proper to the model and priors used as an input to the algorithm. Finally, we show that the Interaction Screening framework includes all models previously considered in the literature as special cases, and for which our analysis shows a systematic improvement in sample complexity.

Machine Learning,Information Theory,Statistics Theory
Learning graphical models for stationary time series

Francis R Bach, Michael I Jordan

2004-07-19

Abstract:Probabilistic graphical models can be extended to time series by considering probabilistic dependencies between entire time series. For stationary Gaussian time series, the graphical model semantics can be expressed naturally in the frequency domain, leading to interesting families of structured time series models that are complementary to families defined in the time domain. In this paper, we present an algorithm to learn the structure from data for directed graphical models for stationary Gaussian time series. We describe an algorithm for efficient forecasting for stationary Gaussian time series whose spectral densities factorize in a graphical model. We also explore the relationships between graphical model structure and sparsity, comparing and contrasting the notions of sparsity in the time domain and the frequency domain. Finally, we show how to make use of Mercer kernels in this setting, allowing our ideas to …
Learning to Infer Graphics Programs from Hand-Drawn Images

Kevin Ellis,Daniel Ritchie,Armando Solar-Lezama,Joshua B. Tenenbaum

DOI: https://doi.org/10.48550/arXiv.1707.09627

IF: 14.4

2017-07-30

Artificial Intelligence

Abstract:We introduce a model that learns to convert simple hand drawings into graphics programs written in a subset of \LaTeX. The model combines techniques from deep learning and program synthesis. We learn a convolutional neural network that proposes plausible drawing primitives that explain an image. These drawing primitives are like a trace of the set of primitive commands issued by a graphics program. We learn a model that uses program synthesis techniques to recover a graphics program from that trace. These programs have constructs like variable bindings, iterative loops, or simple kinds of conditionals. With a graphics program in hand, we can correct errors made by the deep network, measure similarity between drawings by use of similar high-level geometric structures, and extrapolate drawings. Taken together these results are a step towards agents that induce useful, human-readable programs from perceptual input.
Active learning with statistical models

David Cohn, Zoubin Ghahramani, Michael Jordan

1994-01-01

Abstract:For many types of learners one can compute the statistically" op (cid: 173) timal" way to select data. We review how these techniques have been used with feedforward neural networks [MacKay, 1992; Cohn, 1994]. We then show how the same principles may be used to select data for two alternative, statistically-based learning architectures: mixtures of Gaussians and locally weighted regression. While the techniques for neural networks are expensive and approximate, the techniques for mixtures of Gaussians and locally weighted regres (cid: 173) sion are both efficient and accurate.
An introduction to variational methods for graphical models

Michael I Jordan, Zoubin Ghahramani, Tommi S Jaakkola, Lawrence K Saul

1999-11-01

Abstract:This paper presents a tutorial introduction to the use of variational methods for inference and learning in graphical models (Bayesian networks and Markov random fields). We present a number of examples of graphical models, including the QMR-DT database, the sigmoid belief network, the Boltzmann machine, and several variants of hidden Markov models, in which it is infeasible to run exact inference algorithms. We then introduce variational methods, which exploit laws of large numbers to transform the original graphical model into a simplified graphical model in which inference is efficient. Inference in the simpified model provides bounds on probabilities of interest in the original model. We describe a general framework for generating variational transformations based on convex duality. Finally we return to the examples and demonstrate how variational algorithms can be formulated in each case.
Joint Maximum Margin and Maximum Entropy Learning of Graphical Models

Jun Zhu

2010-01-01

Abstract:INFERRING structured predictions based on correlated covariates remains a central problem in many fields, including NLP, computer vision, and computational biology. Typically, both the input covariates and output prediction s can be high-dimensional, multi-modal, noisy, partially obser vable, and bearing latent structures, each of these characteristi cs adds a degree of complexity to the task of learning structured input/output (I/O) models. Several recent approache s to structured I/O learning are based on learning discriminati ve probabilistic graphical models. By defining composite feat ures that explicitly exploit the structured dependencies among input elements (e.g., words in a sentence) and among the interpretational outputs (e.g., part-of-speech tags), su ch models can produce semantically consistent predictions from comp lex inputs. However, how to train such models properly remains a highly contested issue. The two dominant paradigms for training such models are the maximum (conditional) likelih ood estimation (MLE) [6], which leads to the well-known CRF, and the max-margin learning [9], [10], which leads to the M N. While both methods have enjoyed remarkable success and are widely used, they have a number of deficiencies, as we will discuss below. In this project, we introduce a new paradigm for learning structured I/O models, and graphical models in general, that conjoins and extends the merits of MLE and maxmargin learning while avoiding their shortcomings.
Apprentissage d’un modele graphique non orienté hybride parcimonieux par utilisation du gradient proximal stochastique

Romain Laby, Alexandre Gramfort, François Roueff, Cyrille Enderli, Alain Larroque

Abstract:Cet article présente une méthode d’apprentissage de modèle graphique hybride non orienté parcimonieux à partir d’un jeu de données, lorsque la structure du modèle n’est pas connue. Le modèle hybride proposé est construit à partir d’un modèle d’Ising pour les variables catégorielles et d’un modèle gaussien pour les variables continues. L’apprentissage est réalisé à l’aide d’une version stochastique de l’algorithme du gradient proximal, dans lequel le gradient de la vraisemblance n’est pas calculable et est estimé par des simulations de type Markov Chain Monte Carlo.Abstract–This article proposes a method for learning from data undirected sparse hybrid graphical models when the structure is not known. The hybrid model we propose is based on an Ising model for categoriacal variables and a Gaussian model for continuous variables. The learning part is done using a stochastic version of the proximal gradient algorithm. As the gradient of the likelihood is not tractable, we propose to estimate it with a Markov Chain Monte Carlo method.
Learning General Latent-Variable Graphical Models with Predictive Belief Propagation

Borui Wang,Geoffrey Gordon

DOI: https://doi.org/10.48550/arXiv.1712.02046

2019-11-28

Abstract:Learning general latent-variable probabilistic graphical models is a key theoretical challenge in machine learning and artificial intelligence. All previous methods, including the EM algorithm and the spectral algorithms, face severe limitations that largely restrict their applicability and affect their performance. In order to overcome these limitations, in this paper we introduce a novel formulation of message-passing inference over junction trees named predictive belief propagation, and propose a new learning and inference algorithm for general latent-variable graphical models based on this formulation. Our proposed algorithm reduces the hard parameter learning problem into a sequence of supervised learning problems, and unifies the learning of different kinds of latent graphical models into a single learning framework, which is local-optima-free and statistically consistent. We then give a proof of the correctness of our algorithm and show in experiments on both synthetic and real datasets that our algorithm significantly outperforms both the EM algorithm and the spectral algorithm while also being orders of magnitude faster to compute.

Machine Learning,Artificial Intelligence
Empirical Bayesian Learning in AR Graphical Models

Mattia Zorzi

DOI: https://doi.org/10.48550/arXiv.1907.03829

2019-07-09

Abstract:We address the problem of learning graphical models which correspond to high dimensional autoregressive stationary stochastic processes. A graphical model describes the conditional dependence relations among the components of a stochastic process and represents an important tool in many fields. We propose an empirical Bayes estimator of sparse autoregressive graphical models and latent-variable autoregressive graphical models. Numerical experiments show the benefit to take this Bayesian perspective for learning these types of graphical models.

Optimization and Control,Methodology
Learning Cognitive Models using Neural Networks

Devendra Singh Chaplot,Christopher MacLellan,Ruslan Salakhutdinov,Kenneth Koedinger

DOI: https://doi.org/10.48550/arXiv.1806.08065

2018-06-21

Abstract:A cognitive model of human learning provides information about skills a learner must acquire to perform accurately in a task domain. Cognitive models of learning are not only of scientific interest, but are also valuable in adaptive online tutoring systems. A more accurate model yields more effective tutoring through better instructional decisions. Prior methods of automated cognitive model discovery have typically focused on well-structured domains, relied on student performance data or involved substantial human knowledge engineering. In this paper, we propose Cognitive Representation Learner (CogRL), a novel framework to learn accurate cognitive models in ill-structured domains with no data and little to no human knowledge engineering. Our contribution is two-fold: firstly, we show that representations learnt using CogRL can be used for accurate automatic cognitive model discovery without using any student performance data in several ill-structured domains: Rumble Blocks, Chinese Character, and Article Selection. This is especially effective and useful in domains where an accurate human-authored cognitive model is unavailable or authoring a cognitive model is difficult. Secondly, for domains where a cognitive model is available, we show that representations learned through CogRL can be used to get accurate estimates of skill difficulty and learning rate parameters without using any student performance data. These estimates are shown to highly correlate with estimates using student performance data on an Article Selection dataset.

Machine Learning,Artificial Intelligence
Learning Spatiotemporal Graphical Models From Incomplete Observations

Amirhossein Javaheri,Arash Amini,Farokh Marvasti,Daniel P. Palomar

DOI: https://doi.org/10.1109/tsp.2024.3354572

IF: 4.875

2024-03-22

IEEE Transactions on Signal Processing

Abstract:This paper investigates the problem of learning a graphical model from incomplete spatio-temporal measurements. Our purpose is to analyze a time-varying graph signal represented by an incomplete data matrix, the rows and columns of which correspond to spatial and temporal features/measurements of the signal, respectively. In contrast to the conventional approaches which utilize either a directed or an undirected graphical model for data analysis, we propose a compound multi-relational model exploiting both directed and undirected structures. Our approach is based on statistical inference in which a spatio-temporal signal is considered as a random graph process to which we can apply maximum-a-posteriori estimation methods for model identification. We incorporate the Gaussian-Markov random field (GMRF) and the vector auto-regressive (VAR) models to capture both the (undirected) spatial correlations and the (directed) temporal dependencies. We propose an algorithm for joint estimation of the signal and the graphical models, from incomplete measurements. For this purpose, we formulate an optimization problem that we solve using the block successive upperbound minimization (BSUM) method. Our simulation results confirm the efficiency of the proposed method for signal recovery and graph learning.

engineering, electrical & electronic
Bayesian Learning in Undirected Graphical Models: Approximate MCMC algorithms

Iain Murray,Zoubin Ghahramani

DOI: https://doi.org/10.48550/arXiv.1207.4134

2012-07-11

Abstract:Bayesian learning in undirected graphical models|computing posterior distributions over parameters and predictive quantities is exceptionally difficult. We conjecture that for general undirected models, there are no tractable MCMC (Markov Chain Monte Carlo) schemes giving the correct equilibrium distribution over parameters. While this intractability, due to the partition function, is familiar to those performing parameter optimisation, Bayesian learning of posterior distributions over undirected model parameters has been unexplored and poses novel challenges. we propose several approximate MCMC schemes and test on fully observed binary models (Boltzmann machines) for a small coronary heart disease data set and larger artificial systems. While approximations must perform well on the model, their interaction with the sampling scheme is also important. Samplers based on variational mean- field approximations generally performed poorly, more advanced methods using loopy propagation, brief sampling and stochastic dynamics lead to acceptable parameter posteriors. Finally, we demonstrate these techniques on a Markov random field with hidden variables.

Machine Learning

Learning in graphical models

Learning Gaussian Networks

Operations for Learning with Graphical Models

Graphical models: Foundations of neural computation

Graphical models: Probabilistic inference

Variational Learning for Switching State-Space Models

Graphical models

Learning Latent Variable Gaussian Graphical Models

Learning Graphical Models From the Glauber Dynamics

Efficient Learning of Discrete Graphical Models

Learning graphical models for stationary time series

Learning to Infer Graphics Programs from Hand-Drawn Images

Active learning with statistical models

An introduction to variational methods for graphical models

Joint Maximum Margin and Maximum Entropy Learning of Graphical Models

Apprentissage d’un modele graphique non orienté hybride parcimonieux par utilisation du gradient proximal stochastique

Learning General Latent-Variable Graphical Models with Predictive Belief Propagation

Empirical Bayesian Learning in AR Graphical Models

Learning Cognitive Models using Neural Networks

Learning Spatiotemporal Graphical Models From Incomplete Observations

Bayesian Learning in Undirected Graphical Models: Approximate MCMC algorithms