Abstract:Multi-modal image clustering focuses on exploring and exploiting related information across various modals of input images to obtain clear image cluster patterns. Recent multi-modal/view clustering methods have shown promising performance in solving the image clustering problem. However, most existing methods fail to properly deal with the multi-modal image data with massive number of clusters and high dimensionality of features in real-world applications, such as image retrieval, multi-modal autonomous driving perception and industrial automation. We call this problem "Big Clusters and Features" for short just as "Big Data" for large number of samples. To fix this challenging problem, we in this article design a general multi-modal image clustering framework which integrates cluster-wise weight learning, feature learning, and clustering structure learning. Under this framework, we further propose a new Cluster-weighted Multi-modal Information Bottleneck Co-clustering (CMIBC) method, and it could effectively measure image cluster importance information and discriminative features of each modal for obtaining satisfactory image clustering performance. Unlike existing cluster weight learning methods only considering intra-cluster similarity or cross-cluster dissimilarity, we design a novel cluster-wise weight learning strategy by jointly considering and enjoying the best of both worlds. Many carefully designed experiments on various multi-modal image datasets with big clusters and features reveal the competitive advantages of the CMIBC algorithm over lots of compared single/multi-modal clustering methods, particularly the notable improvement of 3.12% and 5.28% on the Leaves Plant Species dataset in terms of accuracy and normalized mutual information. Owing to the promising performance, the proposed CMIBC may be extended to many other practical applications, e.g., multi-modal medical analysis and video recognition.

Image Indexing Method Based on Clustering Via Info-Kmeans under Pair Constraints

Image Classification Method by Combining Multi-features and Sparse Coding

Parallel Hierarchical K-means Clustering-Based Image Index Construction Method

Computer Image Content Retrieval Considering K-Means Clustering Algorithm

Texture Clustering Combining Complex Wavelet Features and Local Binary Pattern

Image Texture Clustering Based on Locality Preserving Projection

Nice to meet images with Big Clusters and Features: A cluster-weighted multi-modal co-clustering method

Multi-View Data Fusion Oriented Clustering via Nuclear Norm Minimization

Center-adaptive weighted binary K-means for image clustering

Unsupervised Deep K-Means Hashing for Efficient Image Retrieval and Clustering

Image Matching Optimization Based on Taguchi Method and Adaptive Spatial Clustering with SIFT Features.

Pairwise Constrained Clustering with Group Similarity-Based Patterns

Efficient Multi-View K-Means for Image Clustering

Interval type-2 possibilistic fuzzy clustering noisy image segmentation algorithm with adaptive spatial constraints and local feature weighting & clustering weighting

Supervised Clustering-Algorithm-based Visual Information Features Classification

K-way Min-Max Cut for Image Clustering and Junk Images Filtering from Google Images.

Web Image Clustering by Consistent Utilization of Visual Features and Surrounding Texts.

Deep neighborhood structure driven interval type-2 kernel fuzzy c-means clustering with local versus non-local information

A New Filtering Method Based on Spatial Clustering

Hierarchical indexing scheme for fast search in a large-scale image database

Hierarchical Indexing Scheme for Fast Search in Large-Scale Image Database