Abstract:Distributed clustering based on the Gaussian mixture model (GMM) has exhibited excellent clustering capabilities in peer-to-peer (P2P) networks. However, more iterative numbers and communication overhead are required to achieve the consensus in existing distributed GMM clustering algorithms. In addition, the truth that it cannot find a closed form for the update of parameters in GMM causes the imprecise clustering accuracy. To solve these issues, by utilizing the transfer learning technique, a general transfer distributed GMM clustering framework is exploited to promote the clustering performance and accelerate the clustering convergence. In this work, each node is treated as both the source domain and the target domain, and these nodes can learn from each other to complete the clustering task in distributed P2P networks. Based on this framework, the transfer distributed expectation-maximization algorithm with the fixed learning rate is first presented for data clustering. Then, an improved version is designed to obtain the stable clustering accuracy, in which an adaptive transfer learning strategy is adopted to adjust the learning rate automatically instead of a fixed value. To demonstrate the extensibility of the proposed framework, a representative GMM clustering method, the entropy-type classification maximum-likelihood algorithm, is further extended to the transfer distributed counterpart. Experimental results verify the effectiveness of the presented algorithms in contrast with the existing GMM clustering approaches.

Adaptive Parameter Estimation of GMM and Its Application in Clustering

Parameter Estimation of Gaussian Mixture Model Based on Variational Bayesian Learning

Steady-state and Transient Operation Discrimination by Variational Bayesian Gaussian Mixture Models

Parameter Estimation of Gaussian Mixture Model and Its Application in Multimode Process Monitoring

Learning GMM Using Elliptically Contoured Distributions

Bayesian mixtures of common factor analyzers: Model, variational inference, and applications

A General Transfer Learning-based Gaussian Mixture Model for Clustering

Parameter Estimation for Gaussian Mixture Processes Based on Expectation-Maximization Method

A gentle tutorial of the em algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models

Transfer-Learning-Based Gaussian Mixture Model for Distributed Clustering

EGMM: an Evidential Version of the Gaussian Mixture Model for Clustering

Parameter Optimization of Trajectory Imitation Learning Characterization Based on Gaussian Mixture Model

Adaptive Variable Clustering in Gaussian Graphical Models.

On Convergence and Parameter Selection of the EM and DA-EM Algorithms for Gaussian Mixtures

An Efficient EM Algorithm for Two-Layer Mixture Model of Gaussian Process Functional Regressions

Deep Clustering by Gaussian Mixture Variational Autoencoders With Graph Embedding

Dirichlet Process Parsimonious Mixtures for clustering

Transformation-Based GMM with Improved Cluster Algorithm for Speaker Identification

A Parameter Selection Method of the Deterministic Anti-Annealing Algorithm for Network Exploring

Gaussian mixture model training method based on genetic algorithms and fuzzy approach