Abstract:At least two, different approaches to define and solve statistical models for the analysis of economic systems exist: the typical, econometric one, interpreting the Gravity Model specification as the expected link weight of an arbitrary probability distribution, and the one rooted into statistical physics, constructing maximum-entropy distributions constrained to satisfy certain network properties. In a couple of recent, companion papers they have been successfully integrated within the framework induced by the constrained minimisation of the Kullback-Leibler divergence: specifically, two, broad classes of models have been devised, i.e. the integrated and the conditional ones, defined by different, probabilistic rules to place links, load them with weights and turn them into proper, econometric prescriptions. Still, the recipes adopted by the two approaches to estimate the parameters entering into the definition of each model differ. In econometrics, a likelihood that decouples the binary and weighted parts of a model, treating a network as deterministic, is typically maximised; to restore its random character, two alternatives exist: either solving the likelihood maximisation on each configuration of the ensemble and taking the average of the parameters afterwards or taking the average of the likelihood function and maximising the latter one. The difference between these approaches lies in the order in which the operations of averaging and maximisation are taken - a difference that is reminiscent of the quenched and annealed ways of averaging out the disorder in spin glasses. The results of the present contribution, devoted to comparing these recipes in the case of continuous, conditional network models, indicate that the annealed estimation recipe represents the best alternative to the deterministic one.

A Simple Algorithm for Scalable Monte Carlo Inference

Bayesian Analysis for Exponential Random Graph Models Using the Adaptive Exchange Sampler.

Scalable Influence Estimation Without Sampling

Fast and scalable likelihood maximization for Exponential Random Graph Models with local constraints

A Full Bayesian Approach to Sparse Network Inference Using Heterogeneous Datasets

Ensuring Reliable Monte Carlo Estimates of Network Properties

Efficient stochastic optimisation by unadjusted Langevin Monte Carlo. Application to maximum marginal likelihood and empirical Bayesian estimation

Pseudo-likelihood-based $M$-estimation of random graphs with dependent edges and parameter vectors of increasing dimension

Scalable inference for stochastic block models

A Bayesian multilevel model for populations of networks using exponential-family random graphs

Parameter Estimation Procedures for Exponential-Family Random Graph Models on Count-Valued Networks: A Comparative Simulation Study

Single-ensemble multilevel Monte Carlo for discrete interacting-particle methods

A SIMPLE Approach to Provably Reconstruct Ising Model with Global Optimality

Hastings-Metropolis algorithm on Markov chains for small-probability estimation

Planar Ising-Spin Models in Probabilistic Machine Learning

Scalable Monte Carlo for Bayesian Learning

Deterministic, quenched and annealed parameter estimation for heterogeneous network models

Learning maximum entropy models from finite-size data sets: A fast data-driven algorithm allows sampling from the posterior distribution

A Multiscale Perspective on Maximum Marginal Likelihood Estimation

Scalability of Metropolis-within-Gibbs schemes for high-dimensional Bayesian models

Convergence of Dirichlet Forms for MCMC Optimal Scaling with Dependent Target Distributions on Large Graphs