Abstract:Deep clustering has shown its promising capability in joint representation learning and clustering via deep neural networks. Despite the significant progress, the existing deep clustering works mostly utilize some distribution-based clustering loss, lacking the ability to unify representation learning and multi-scale structure learning. To address this, this paper presents a new deep clustering approach termed I mage c luster i ng with c ontrastive le arning and multi-scale G raph C onvolutional N etworks (IcicleGCN), which bridges the gap between convolutional neural network (CNN) and graph convolutional network (GCN) as well as the gap between contrastive learning and multi-scale structure learning for the deep clustering task. Our framework consists of four main modules, namely, the CNN-based backbone, the Instance Similarity Module (ISM), the Joint Cluster Structure Learning and Instance reconstruction Module (JC-SLIM), and the Multi-scale GCN module (M-GCN). Specifically, the backbone network with two weight-sharing views is utilized to learn the representations for the two augmented samples (from each image). The learned representations are then fed to ISM and JC-SLIM for joint instance-level and cluster-level contrastive learning, respectively, during which an auto-encoder in JC-SLIM is also pretrained to serve as a bridge to the M-GCN module. Further, to enforce multi-scale neighborhood structure learning, two streams of GCNs and the auto-encoder are simultaneously trained via (i) the layer-wise interaction with representation fusion and (ii) the joint self-adaptive learning. Experiments on multiple image datasets demonstrate the superior clustering performance of IcicleGCN over the state-of-the-art. The code is available at https://github.com/xuyuankun631/IcicleGCN .

Hybrid Unsupervised Clustering for Pretext Distribution Learning in IC Image Analysis

Unsupervised Graph-Based Image Clustering for Pretext Distribution Learning in IC Assurance

A Hierarchical Multiclassifier System for Automated Analysis of Delayered IC Images

Delayered IC Image Analysis with Template-Based Tanimoto Convolution and Morphological Decision.

IC Image Segmentation Using Eigenvalue Clustering

Domain-Integrated Machine Learning for IC Image Analysis

Deep image clustering: A survey

Image Clustering Algorithm Based on Self-Supervised Pretrained Models and Latent Feature Distribution Optimization

Hybrid ${K}$ -Means Clustering and Support Vector Machine Method for Via and Metal Line Detections in Delayered IC Images

Mejigclu: more effective jigsaw clustering for unsupervised visual representation learning

Unsupervised Domain Adaptation with Histogram-gated Image Translation for Delayered IC Image Analysis

Deep Learning for Automatic IC Image Analysis.

Interpretable unsupervised learning enables accurate clustering with high-throughput imaging flow cytometry

Graph-Based Semi-Supervised Deep Image Clustering With Adaptive Adjacency Matrix

Hybridformer: an efficient and robust new hybrid network for chip image segmentation

Mine Local Homogeneous Representation by Interaction Information Clustering with Unsupervised Learning in Histopathology Images

Industrial Image Anomaly Localization Based on Gaussian Clustering of Pretrained Feature

Deep Learning-Based Image Analysis Framework for Hardware Assurance of Digital Integrated Circuits

Unsupervised discriminative feature learning via finding a clustering-friendly embedding space

Deep image clustering with contrastive learning and multi-scale graph convolutional networks

Image Clustering via the Principle of Rate Reduction in the Age of Pretrained Models