Abstract:The traditional expectation maximization (EM) algorithm for the mixture model can explore the structural regularities of a network efficiently. But it always traps into local maxima. A deterministic annealing EM (DAEM) algorithm is put forward to solve this problem. However, it brings about the problem of convergence speed. A deterministic anti-annealing expectation maximization (DAAEM) algorithm not only prevents poor local optima, but also improves the convergence speed. Thus, the DAAEM algorithm is used to estimate parameters of the mixture model. This algorithm always sets its initial parameter β0 by experience, which maybe get trapped into meaningless results due to too small β0, or converge to local maxima more frequently due to too large β0. A parameter selection method for β0 is designed. In our method, the convergence rate of the DAAEM algorithm for mixture model is first derived from Jacobian matrix of the posterior probabilities. Then the theoretical lower bound of β0 is computed based on the convergence rate at meaningless points. In our experiments we select β0 by rounding up the lower bound to the nearest tenth. Experiments on real and synthetic networks demonstrate that the parameter selection method is valid, and the performance of the DAAEM algorithm beginning from the selected parameter is better than the EM and DAEM algorithms for mixture model. In addition, we find that the convergence rate of the DAAEM algorithm is affected by assortative mixing by degree of a network.

On Semi-Supervised Learning Genetic-Based And Deterministic Annealing Em Algorithm For Dirichlet Mixture Models

A Novel Split and Merge EM Algorithm for Gaussian Mixture Model

On Convergence and Parameter Selection of the EM and DA-EM Algorithms for Gaussian Mixtures

A Parameter Selection Method of the Deterministic Anti-Annealing Algorithm for Network Exploring

The BYY annealing learning algorithm for Gaussian mixture with automated model selection

An Annealing Approach to Byy Harmony Learning on Gaussian Mixture with Automated Model Selection

A Daem Algorithm For Mixtures Of Gaussian Process Functional Regressions

The Competitive EM Algorithm for Gaussian Mixtures with BYY Harmony Criterion

A Mixed Evolutionary Algorithm to Solve the O-D Matrix Estimation Problem

A Greedy Merge Learning Algorithm for Gaussian Mixture Model

A BYY Scale-Incremental EM Algorithm for Gaussian Mixture Learning

A <formula Formulatype="inline"><tex>$q$</tex></formula>-Parameterized Deterministic Annealing EM Algorithm Based on Nonextensive Statistical Mechanics

Gaussian mixture modelling by exploiting competitive stop EM algorithm

Adaptive Learning Algorithm Based on Mixture Gaussian Background

Estimation for the Number of Components in a Mixture Model Using Stepwise Split-and-merge EM Algorithm

A Continuous Optimization Algorithm Based-on Progressive Estimation of Guassian Mixture Model

Big Learning Expectation Maximization

Unsupervised learning of finite mixtures using entropy regularization and its application to image segmentation

An adaptive simulated annealing EM algorithm for inference on non-homogeneous hidden Markov models

An Mcmc Based Em Algorithm For Mixtures Of Gaussian Processes

Network EM Algorithm for Gaussian Mixture Model in Decentralized Federated Learning