Abstract:To simplify modeling procedures, traditional statistical machine learning methods always assume that the instances are independent and identically distributed (i.i.d.). However, it is not uncommon for some real-world data, such as web pages and research papers, to contain relationships (links) between the instances. Different instances in such data are correlated (linked) with each other, which implies that the common i.i.d. assumption is unreasonable for such relational data. Hence, naively applying traditional statistical learning methods to relational data may lead to misleading conclusions about the data. Statistical relational learning (SRL), which attempts to perform learning and inference in domains with complex relational structures, has become an emerging research area because relational data widely exist in a large variety of application areas, such as web mining, social network analysis, bioinformatics, economics and marketing. The existing mainstream SRL models extend traditional graphical models, such as Bayesian networks and Markov networks, by eliminating their underlying i.i.d. assumption. Some typical examples of such SRL models include relational Bayesian networks, relational Markov networks, and Markov logic networks. Because the dependency structure in relational data is typically very complex, structure learning for these relational graphical models is often very time-consuming. Hence, it might be impractical to apply these models to large-scale relational data sets. In this thesis, we propose a series of novel SRL models, called relational factor models (RFMs), by extending traditional latent factor models from i.i.d. domains to relational domains. These proposed RFMs provide a toolbox for different learning settings: some of them are well suited for transductive inference while others can be used for inductive inference; some of them are parametric while others are nonparametric; some of them can be used to model data with undirected relationships while others can be used for data with directed relationships. One promising advantage of our RFMs is that there is no need for time-consuming structure learning and the time complexity of most of them is linear to the number of observed links in the data. This implies that our RFMs can be used to model large-scale data sets. Experimental results show that our models can achieve state-of-the-art performance in many real-world applications such as linked-document classification and social network analysis.

A goodness of fit framework for relational event models

Goodness of fit of relational event models

Fast Meta-Analytic Approximations for Relational Event Models: Applications to Data Streams and Multilevel Data

Simulating Relational Event Histories -- Why and How

Reliability of relational event model estimates under sampling: how to fit a relational event model to 360 million dyadic events

Reasoning about Attribute Value Equivalence in Relational Data.

A Goodness-of-Fit Test for Statistical Models

Scaling Choice Models of Relational Social Data

Latent factor models for statistical relational learning

All that Glitters is not Gold: Relational Events Models with Spurious Events

CID Models on Real-world Social Networks and Goodness of Fit Measurements

Infinite Hidden Relational Models

Relational hyperevent models for the coevolution of coauthoring and citation networks

On goodness-of-fit tests for arbitrary multivariate models

REM beyond dyads: relational hyperevent models for multi-actor interaction networks

A Latent Variable Model for Relational Events with Multiple Receivers

Goodness‐of‐fit testing based on graph functionals for homogeneous Erdös–Rényi graphs

Discriminative Relational Topic Models.

Improvement of the GFI and AGFI indexes in structural equation models by the covariance between repetitions in the observed variables

Structural Equation Models in a Redundancy Analysis Framework With Covariates

Exponential-family Random Graph Models for Rank-order Relational Data