Abstract:Contrastive deep graph clustering, which aims to divide nodes into disjoint groups via contrastive mechanisms, is a challenging research spot. Among the recent works, hard sample mining-based algorithms have achieved great attention for their promising performance. However, we find that the existing hard sample mining methods have two problems as follows. 1) In the hardness measurement, the important structural information is overlooked for similarity calculation, degrading the representativeness of the selected hard negative samples. 2) Previous works merely focus on the hard negative sample pairs while neglecting the hard positive sample pairs. Nevertheless, samples within the same cluster but with low similarity should also be carefully learned. To solve the problems, we propose a novel contrastive deep graph clustering method dubbed Hard Sample Aware Network (HSAN) by introducing a comprehensive similarity measure criterion and a general dynamic sample weighing strategy. Concretely, in our algorithm, the similarities between samples are calculated by considering both the attribute embeddings and the structure embeddings, better revealing sample relationships and assisting hardness measurement. Moreover, under the guidance of the carefully collected high-confidence clustering information, our proposed weight modulating function will first recognize the positive and negative samples and then dynamically up-weight the hard sample pairs while down-weighting the easy ones. In this way, our method can mine not only the hard negative samples but also the hard positive sample, thus improving the discriminative capability of the samples further. Extensive experiments and analyses demonstrate the superiority and effectiveness of our proposed method.

Assignment Problem Based Deep Embedding

Dual Path Structural Contrastive Embeddings for Learning Novel Objects

Hard-Aware Deeply Cascaded Embedding

Learning Deep Optimal Embeddings with Sinkhorn Divergences

Deep Neural Networks for Linear Sum Assignment Problems.

Bridging the Semantic Latent Space Between Brain and Machine: Similarity is All You Need

Deep embedding learning with adaptive large margin N-pair loss for image retrieval and clustering

Efficiently Identifying Binary Similarity Based on Deep Hashing and Contrastive Learning

Improved Embeddings with Easy Positive Triplet Mining

Deep Embedding Learning with Discriminative Sampling Policy

Structural Deep Embedding for Hyper-Networks

Hard Sample Aware Network for Contrastive Deep Graph Clustering

Unsupervised Deep Pairwise Hashing

Embedding Deep Metric for Person Re-identication A Study Against Large Variations

Deep Randomized Ensembles for Metric Learning

Contrastive Bayesian Analysis for Deep Metric Learning

The General Pair-based Weighting Loss for Deep Metric Learning

Improve Deep Unsupervised Hashing Via Structural and Intrinsic Similarity Learning

Deep Clustering with Sample-Assignment Invariance Prior.

Learning Effective Word Embedding Using Morphological Word Similarity

Deep Unsupervised Learning of Visual Similarities