Abstract:The application of contrastive learning in image clustering in the field of unsupervised learning has attracted much attention due to its ability to effectively improve clustering performance. Extracting features for face-oriented clustering using deep learning networks has also become one of the key challenges in this field. Some current research focuses on learning valuable semantic features using contrastive learning strategies to accomplish cluster allocation in the feature space. However, some studies decoupled the two phases of feature extraction and clustering are prone to error transfer, on the other hand, features learned in the feature extraction phase of multi-stage training are not guaranteed to be suitable for the clustering task. To address these challenges, We propose an end-to-end multi-branch feature fusion comparison deep clustering method (SwEAC), which incorporates a multi-branch feature extraction strategy in the representation learning phase, this method completes the clustering center comparison between multiple views and then assigns clusters to the extracted features. In order to extract higher-level semantic features, a multi-branch structure is used to learn multi-dimensional spatial channel dimension information and weighted receptive-field spatial features, achieving cross-dimensional information exchange of multi-branch sub-features. Meanwhile, we jointly optimize unsupervised contrastive representation learning and clustering in an end-to-end architecture to obtain semantic features for clustering that are more suitable for clustering tasks. Experimental results show that our model achieves good clustering performance on three popular image datasets evaluated by three unsupervised evaluation metrics, which proves the effectiveness of end-to-end multi-branch feature fusion comparison deep clustering methods.

Structured Image Clustering Based on Fusion of Visual and Semantic Features

Research of improving semantic image segmentation based on a feature fusion model

Web Image Clustering by Consistent Utilization of Visual Features and Surrounding Texts.

An image fusion algorithm based on image clustering theory

Multiple Level Visual Semantic Fusion Method for Image Re-Ranking.

Bridging the Semantic Gap Between Image Contents and Tags

Image Annotations Based on Semi-supervised Clustering with Semantic Soft Constraints.

Infrared and visible image fusion algorithm based on spatial domain and image features

Supervised Clustering-Algorithm-based Visual Information Features Classification

A data-driven study of image feature extraction and fusion

An End-to-End, Multi-Branch, Feature Fusion-Comparison Deep Clustering Method

Rank-Aware Graph Fusion With Contextual Dissimilarity Measurement For Image Retrieval

A Semantic-Aware and Multi-Guided Network for Infrared-Visible Image Fusion

Visual and textual fusion for semantically supervised region-based retrieval

ICIF: Image fusion via information clustering and image features

Beyond global fusion: A group-aware fusion approach for multi-view image clustering.

Query Adaptive Fusion for Graph-Based Visual Reranking.

Normalized Similarity Measurement And Query Adaptive Fusion For Graph Based Visual Reranking

A Novel Pixel-Level and Feature-Level Combined Multisensor Image Fusion Scheme

SSPFusion: A Semantic Structure-Preserving Approach for Infrared and Visible Image Fusion

SIFusion: Lightweight infrared and visible image fusion based on semantic injection