Abstract:The cumulative distribution network (CDN) is a recently developed class of probabilistic graphical models (PGMs) permitting a copula factorization, in which the CDF, rather than the density, is factored. Despite there being much recent interest within the machine learning community about copula representations, there has been scarce research into the CDN, its amalgamation with copula theory, and no evaluation of its performance. Algorithms for inference, sampling, and learning in these models are underdeveloped compared those of other PGMs, hindering widerspread use. One advantage of the CDN is that it allows the factors to be parameterized as copulae, combining the benefits of graphical models with those of copula theory. In brief, the use of a copula parameterization enables greater modelling flexibility by separating representation of the marginals from the dependence structure, permitting more efficient and robust learning. Another advantage is that the CDN permits the representation of implicit latent variables, whose parameterization and connectivity are not required to be specified. Unfortunately, that the model can encode only latent relationships between variables severely limits its utility. In this thesis, we present inference, learning, and sampling for CDNs, and further the state-of-the-art. First, we explain the basics of copula theory and the representation of copula CDNs. Then, we discuss inference in the models, and develop the first sampling algorithm. We explain standard learning methods, propose an algorithm for learning from data missing completely at random (MCAR), and develop a novel algorithm for learning models of arbitrary treewidth and size. Properties of the models and algorithms are investigated through Monte Carlo simulations. We conclude with further discussion of the advantages and limitations of CDNs, and suggest future work.

A New Inference Framework For Dependency Networks

Deep Dependency Networks and Advanced Inference Schemes for Multi-Label Classification

HSDN: A High-Order Structural Semantic Disentangled Neural Network

Exploiting the Implicit Independence Assumption for Learning Directed Graphical Models.

DDN2.0: R and Python packages for differential dependency network analysis of biological systems

Fast and scalable learning of sparse changes in high-dimensional graphical model structure

Inference, Sampling, and Learning in Copula Cumulative Distribution Networks

Cross-Dependency Inference in Multi-Layered Networks: A Collaborative Filtering Perspective

gCoda: Conditional Dependence Network Inference for Compositional Data.

A modeling framework for detecting and leveraging node-level information in Bayesian network inference

Collaborative Inference of Coexisting Information Diffusions

Disentangling Direct from Indirect Relationships in Association Networks.

Knowledge-fused differential dependency network models for detecting significant rewiring in biological networks

Latent Dependency Forest Models

Full Conditional Free Energy Based Inference

DDN3.0: determining significant rewiring of biological network structure with differential dependency networks

Extended Fiducial Inference: Toward an Automated Process of Statistical Inference

Scalable Continuous-time Diffusion Framework for Network Inference and Influence Estimation

Russian Doll Network: Learning Nested Networks for Sample-Adaptive Dynamic Inference.

A Full Bayesian Approach to Sparse Network Inference Using Heterogeneous Datasets

Structure Inference of Networked System with the Synergy of Deep Residual Network and Fully Connected Layer Network