Abstract:<div>The formalism of probabilistic graphical models provides a unifying framework for capturing complex dependencies among random variables, and building large-scale multivariate statistical models. Graphical models have become a focus of research in many statistical, computational and mathematical fields, including bioinformatics, communication theory, statistical physics, combinatorial optimization, signal and image processing, information retrieval and statistical machine learning. Many problems that arise in specific instances — including the key problems of computing marginals and modes of probability distributions — are best studied in the general setting. Working with exponential family representations, and exploiting the conjugate duality between the cumulant function and the entropy for exponential families, we develop general variational representations of the problems of computing likelihoods, marginal probabilities and most probable configurations. We describe how a wide variety of algorithms — among them sum-product, cluster variational methods, expectation-propagation, mean field methods, max-product and linear programming relaxation, as well as conic programming relaxations — can all be understood in terms of exact or approximate forms of these variational representations. The variational approach provides a complementary alternative to Markov chain Monte Carlo as a general source of approximation methods for inference in large-scale statistical models.<h3>Suggested Citation</h3>Martin J. Wainwright and Michael I. Jordan (2008), "Graphical Models, Exponential Families, and Variational Inference", Foundations and Trends® in Machine Learning: Vol. 1: No. 1–2, pp 1-305. http://dx.doi.org/10.1561/2200000001</div>

Probabilistic Graphical Model for Continuous Variables

Process Monitoring Using Probabilistic Graphical Models Via Nonparametric Density Estimation

Nonparametric Density Estimation of Hierarchical Probabilistic Graph Models for Assumption-Free Monitoring

Structured Sequential Gaussian Graphical Models for Monitoring Time-Varying Process

Functional Graphical Models for Manufacturing Process Modeling

Dynamic Probabilistic Latent Variable Model for Process Data Modeling and Regression Application

Research Progress of Probabilistic Graphical Models: A Survey

Continuous Graph Flow

High-dimensional Mixed Graphical Models

Variational Inference over Graph: Knowledge Representation for Deep Process Data Analytics

Continuously indexed graphical models

Nonlinear Probabilistic Monitoring Based on the Gaussian Process Latent Variable Model

Stochastic Deep Gaussian Processes over Graphs

Structure Learning of Probabilistic Graphical Models: A Comprehensive Survey

Probabilistic graphs using coupled random variables

Continuous time Gaussian process dynamical models in gene regulatory network inference

Graphical models for nonstationary time series

Learning bayesian networks structure with continuous variables

Graphical Models, Exponential Families, and Variational Inference