Abstract:<div>The formalism of probabilistic graphical models provides a unifying framework for capturing complex dependencies among random variables, and building large-scale multivariate statistical models. Graphical models have become a focus of research in many statistical, computational and mathematical fields, including bioinformatics, communication theory, statistical physics, combinatorial optimization, signal and image processing, information retrieval and statistical machine learning. Many problems that arise in specific instances — including the key problems of computing marginals and modes of probability distributions — are best studied in the general setting. Working with exponential family representations, and exploiting the conjugate duality between the cumulant function and the entropy for exponential families, we develop general variational representations of the problems of computing likelihoods, marginal probabilities and most probable configurations. We describe how a wide variety of algorithms — among them sum-product, cluster variational methods, expectation-propagation, mean field methods, max-product and linear programming relaxation, as well as conic programming relaxations — can all be understood in terms of exact or approximate forms of these variational representations. The variational approach provides a complementary alternative to Markov chain Monte Carlo as a general source of approximation methods for inference in large-scale statistical models.<h3>Suggested Citation</h3>Martin J. Wainwright and Michael I. Jordan (2008), "Graphical Models, Exponential Families, and Variational Inference", Foundations and Trends® in Machine Learning: Vol. 1: No. 1–2, pp 1-305. http://dx.doi.org/10.1561/2200000001</div>

A Survey on the Representation Theory of Probabilistic Graphical Models

Research Progress of Probabilistic Graphical Models: A Survey

Structure Learning of Probabilistic Graphical Models: A Comprehensive Survey

An introduction to probabilistic graphical models

Uncertainty Quantification on Graph Learning: A Survey

Incorporating Probabilistic Knowledge into Topic Models.

Process Monitoring Using Probabilistic Graphical Models Via Nonparametric Density Estimation

Graphical Models, Exponential Families, and Variational Inference

Graphical models: Probabilistic inference

Tutorial and Survey on Probabilistic Graphical Model and Variational Inference in Deep Reinforcement Learning

A comparison of algorithms for inference and learning in probabilistic graphical models

Inference in Probabilistic Graphical Models by Graph Neural Networks

A state of art survey of probabilistically quantitative logic

Connecting actuarial judgment to probabilistic learning techniques with graph theory

Constructing Probabilistic Graphical Model from Predicate Formulas for Fusing Logical and Probabilistic Knowledge.

Graph Representation Learning Meets Computer Vision: A Survey

概率图模型研究进展综述

Probabilistic Graphical Model for Continuous Variables

Hyper Markov Law in Undirected Graphical Models with Its Applications

Probabilistic Graphical Model and Its Application in Image and Video Information Processing