Abstract:<div>The formalism of probabilistic graphical models provides a unifying framework for capturing complex dependencies among random variables, and building large-scale multivariate statistical models. Graphical models have become a focus of research in many statistical, computational and mathematical fields, including bioinformatics, communication theory, statistical physics, combinatorial optimization, signal and image processing, information retrieval and statistical machine learning. Many problems that arise in specific instances — including the key problems of computing marginals and modes of probability distributions — are best studied in the general setting. Working with exponential family representations, and exploiting the conjugate duality between the cumulant function and the entropy for exponential families, we develop general variational representations of the problems of computing likelihoods, marginal probabilities and most probable configurations. We describe how a wide variety of algorithms — among them sum-product, cluster variational methods, expectation-propagation, mean field methods, max-product and linear programming relaxation, as well as conic programming relaxations — can all be understood in terms of exact or approximate forms of these variational representations. The variational approach provides a complementary alternative to Markov chain Monte Carlo as a general source of approximation methods for inference in large-scale statistical models.<h3>Suggested Citation</h3>Martin J. Wainwright and Michael I. Jordan (2008), "Graphical Models, Exponential Families, and Variational Inference", Foundations and Trends® in Machine Learning: Vol. 1: No. 1–2, pp 1-305. http://dx.doi.org/10.1561/2200000001</div>

Graph Mode-Based Statistical Modeling for Complex Problem

Graph Theory-Based Multi-Layer State Space Modeling Method of Complex System and Its Application

Mixed Graphical Models for Causal Analysis of Multi-modal Variables

Functional Graphical Models for Manufacturing Process Modeling

Towards Human-like Perception: Learning Structural Causal Model in Heterogeneous Graph

Graphical Model Sketch.

Graphical model for mixed data types

Parametric Modelling of Multivariate Count Data Using Probabilistic Graphical Models

Structural learning of graphical models and its applications to traditional chinese medicine

Introduction to Graphical Modelling

MultiFun-DAG: Multivariate Functional Directed Acyclic Graph

Review of Causal Discovery Methods Based on Graphical Models

Graphical Models for Relations - Modeling Relational Context

Graph Visualization: Alternative Models Inspired by Bioinformatics

Causal-StoNet: Causal Inference for High-Dimensional Complex Data

A survey on visualization approaches for exploring association relationships in graph data

High-Dimensional Undirected Graphical Models for Arbitrary Mixed Data

Structure Learning of Probabilistic Graphical Models: A Comprehensive Survey

Graphical Models, Exponential Families, and Variational Inference

Probabilistic graphs using coupled random variables

Statistical Inference on High Dimensional Gaussian Graphical Regression Models