Abstract:Clustering based on vibration responses, such as transmissibility functions (TFs), is promising in structural anomaly detection, but most existing approaches struggle with determining the optimal cluster number and handling high-dimensional streaming data, while their shallow structures also make them sensitive to manually-engineered feature quality. To bridge this gap, this work proposes the Dirichlet process-deep generative model-integrated incremental learning (DPGIIL) for clustering by combining the advantages of deep generative models (DGMs) in representation learning and the Dirichlet process mixture model (DPMM) in identifying distinct patterns in observed data. By introducing a DPMM prior into the latent space of DGMs, DPGIIL automatically captures dissimilarities in extracted latent representations, enabling both generative modeling and clustering. Within the context of variational Bayesian inference, a lower bound on the log marginal likelihood of DPGIIL, tighter than the evidence lower bound given sufficient training data, is derived analytically, which enables the joint optimization of DGM and DPMM parameters, thereby allowing the DPMM to regularize the DGM's feature extraction process. Additionally, a greedy split-merge scheme-based coordinate ascent variational inference method is devised to accelerate the optimization. The summary statistics of the DPMM, along with the network parameters, are used to retain information about previous data for incremental learning. Notably, this study uses variational autoencoder (VAE) within DPGIIL as an illustrative example, while this framework is adaptable to other DGMs. Two case studies show that the proposed method outperforms some state-of-the-art approaches in structural anomaly detection and clustering, while also dynamically generating new clusters to indicate the emergence of new structural conditions for online monitoring.

A Model-Based Approach for Text Clustering with Outlier Detection

X-DMM: Fast and Scalable Model Based Text Clustering

Short Text Clustering Based on Pitman-Yor Process Mixture Model

A Text Clustering Algorithm Using an Online Clustering Scheme for Initialization

An Adaptive Dirichlet Multinomial Mixture Model for Short Text Streaming Clustering

A Practical Algorithm for Solving the Sparseness Problem of Short Text Clustering

Joint unsupervised contrastive learning and robust GMM for text clustering

Clustering Method Using Hypergraph Models Based on Set Pair Analysis

Grouped Text Clustering Using Non-Parametric Gaussian Mixture Experts

Model-based Clustering of Short Text Streams

A New Text Clustering Method Using Hidden Markov Model

Finding Outliers in Gaussian Model-based Clustering

A Nonparametric Model for Multi-Manifold Clustering with Mixture of Gaussians and Graph Consistency

Inference and evaluation of the multinomial mixture model for text clustering

DPGIIL: Dirichlet Process-Deep Generative Model-Integrated Incremental Learning for Clustering in Transmissibility-based Online Structural Anomaly Detection

A Multi-View Clustering Algorithm for Short Text

Scalable Clustering: Large Scale Unsupervised Learning of Gaussian Mixture Models with Outliers

Gaussian Mixture Model Clustering with Incomplete Data

Robust and Stochastic Sparse Subspace Clustering

Cascade Subspace Clustering for Outlier Detection

An Algorithm for Clustering Evolving Text Data Stream with Outliers