Abstract:Multi-modal image clustering focuses on exploring and exploiting related information across various modals of input images to obtain clear image cluster patterns. Recent multi-modal/view clustering methods have shown promising performance in solving the image clustering problem. However, most existing methods fail to properly deal with the multi-modal image data with massive number of clusters and high dimensionality of features in real-world applications, such as image retrieval, multi-modal autonomous driving perception and industrial automation. We call this problem "Big Clusters and Features" for short just as "Big Data" for large number of samples. To fix this challenging problem, we in this article design a general multi-modal image clustering framework which integrates cluster-wise weight learning, feature learning, and clustering structure learning. Under this framework, we further propose a new Cluster-weighted Multi-modal Information Bottleneck Co-clustering (CMIBC) method, and it could effectively measure image cluster importance information and discriminative features of each modal for obtaining satisfactory image clustering performance. Unlike existing cluster weight learning methods only considering intra-cluster similarity or cross-cluster dissimilarity, we design a novel cluster-wise weight learning strategy by jointly considering and enjoying the best of both worlds. Many carefully designed experiments on various multi-modal image datasets with big clusters and features reveal the competitive advantages of the CMIBC algorithm over lots of compared single/multi-modal clustering methods, particularly the notable improvement of 3.12% and 5.28% on the Leaves Plant Species dataset in terms of accuracy and normalized mutual information. Owing to the promising performance, the proposed CMIBC may be extended to many other practical applications, e.g., multi-modal medical analysis and video recognition.

Multimodal Co-clustering Analysis of Big Data Based on Matrix and Tensor Decomposition

Tensor Multi-Clustering Parallel Intelligent Computing Method Based on Tensor Chain Decomposition

Multiscale Analysis for Higher-order Tensors

A General Framework for Fast Co-clustering on Large Datasets Using Matrix Decomposition

Discovering Multiple Co-Clusterings With Matrix Factorization

Penalized Nonnegative Nonnegative Matrix Tri-Factorization For Co-Clustering

Multi-modal Multi-view Clustering based on Non-negative Matrix Factorization

Multidimensional Data Processing With Bayesian Inference via Structural Block Decomposition

Co-Clustering With Manifold And Double Sparse Representation

Tensor Sparse and Low-Rank based Submodule Clustering Method for Multi-way Data

Single multiplicatively updated matrix factorization for co-clustering.

Tensor Decompositions for Signal Processing Applications: From two-way to multiway component analysis

Nice to meet images with Big Clusters and Features: A cluster-weighted multi-modal co-clustering method

CRD: Fast Co-Clustering on Large Datasets Utilizing Sampling-Based Matrix Decomposition

Community Evolution Based on Tensor Decomposition

Cluster Structure Augmented Deep Nonnegative Matrix Factorization with Low-rank Tensor Learning

A Co-analysis Framework for Exploring Multivariate Scientific Data

Era of Big Data Processing: A New Approach via Tensor Networks and Tensor Decompositions

Two-Dimensional Data Partitioning for Non-negative Matrix Tri-Factorization

Scalable Nonparametric Multiway Data Analysis.

Hyper-Laplacian Regularized Concept Factorization in Low-rank Tensor Space for Multi-view Clustering