Abstract:<div>The formalism of probabilistic graphical models provides a unifying framework for capturing complex dependencies among random variables, and building large-scale multivariate statistical models. Graphical models have become a focus of research in many statistical, computational and mathematical fields, including bioinformatics, communication theory, statistical physics, combinatorial optimization, signal and image processing, information retrieval and statistical machine learning. Many problems that arise in specific instances — including the key problems of computing marginals and modes of probability distributions — are best studied in the general setting. Working with exponential family representations, and exploiting the conjugate duality between the cumulant function and the entropy for exponential families, we develop general variational representations of the problems of computing likelihoods, marginal probabilities and most probable configurations. We describe how a wide variety of algorithms — among them sum-product, cluster variational methods, expectation-propagation, mean field methods, max-product and linear programming relaxation, as well as conic programming relaxations — can all be understood in terms of exact or approximate forms of these variational representations. The variational approach provides a complementary alternative to Markov chain Monte Carlo as a general source of approximation methods for inference in large-scale statistical models.<h3>Suggested Citation</h3>Martin J. Wainwright and Michael I. Jordan (2008), "Graphical Models, Exponential Families, and Variational Inference", Foundations and Trends® in Machine Learning: Vol. 1: No. 1–2, pp 1-305. http://dx.doi.org/10.1561/2200000001</div>

Algebraic statistical models

The algebra and machine representation of statistical models

Algebraic Problems in Structural Equation Modeling

The Case for Algebraic Biology: from Research to Education

Applications of Structural Statistics: Geometric Inference in Exponential Families

Algebraic Model Management: A Survey

New directions in algebraic statistics: Three challenges from 2023

LP Approach to Statistical Modeling

Algebraic model selection and experimental design in biological data science

A matrix algebra for graphical statistical models

The algebraic method in experimental design

Graphical Models, Exponential Families, and Variational Inference

Numerical algebraic geometry for model selection and its application to the life sciences

Real birational implicitization for statistical models

On the feasibility of semi-algebraic sets in Poisson regression

Likelihood Correspondence of Statistical Models

Algebraic Reasoning over Relational Structures

A Heavy-Tailed Algebra for Probabilistic Programming

Software Engineering and Complexity in Effective Algebraic Geometry

Algebraic Dynamical Systems in Machine Learning