Abstract:The fast growth of Internet and modern technologies has brought data involving objects of multiple types that are related to each other, called as Multi-Type Relational data. Traditional clustering methods for single-type data rarely work well on them, which calls for new clustering techniques, called as high-order co-clustering (HOCC), to deal with the multiple types of data at the same time. A major challenge in developing HOCC methods is how to effectively make use of all available information contained in a multi-type relational data set, including both inter-type and intra-type relationships. Meanwhile, because many real world data sets are often of large sizes, clustering methods with computationally efficient solution algorithms are of great practical interest. In this paper, we first present a general HOCC framework, named as Orthogonal Nonnegative Matrix Tri-factorization (O-NMTF), for simultaneous clustering of multi-type relational data. The proposed O-NMTF approach employs Nonnegative Matrix Tri-Factorization (NMTF) to simultaneously cluster different types of data using the inter-type relationships, and incorporate intra-type information through manifold regularization, where, different from existing works, we emphasize the importance of the orthogonal ties of the factor matrices of NMTF. Based on O-NMTF, we further develop a novel Fast Nonnegative Matrix Tri-Factorization (F-NMTF) approach to deal with large-scale data. Instead of constraining the factor matrices of NMTF to be nonnegative as in existing methods, F-NMTF constrains them to be cluster indicator matrices, a special type of nonnegative matrices. As a result, the optimization problem of the proposed method can be decoupled, which results in sub problems of much smaller sizes requiring much less matrix multiplications, such that our new algorithm scales well to real world data of large sizes. Extensive experimental evaluations have demonstrated the effectiveness of our new approaches.

A General Framework for Fast Co-clustering on Large Datasets Using Matrix Decomposition

CRD: Fast Co-Clustering on Large Datasets Utilizing Sampling-Based Matrix Decomposition

Scalable Co-Clustering for Large-Scale Data through Dynamic Partitioning and Hierarchical Merging

Fast Nonnegative Matrix Tri-Factorization for Large-Scale Data Co-Clustering.

Multimodal Co-clustering Analysis of Big Data Based on Matrix and Tensor Decomposition

Co-ClusterD: A Distributed Framework for Data Co-Clustering with Sequential Updates

Co-clustering by block value decomposition

Scalable Ensemble Information-Theoretic Co-Clustering for Massive Data

Fast Clustering with Co-Clustering Via Discrete Non-Negative Matrix Factorization for Image Identification.

An Easy-to-Implement Framework of Fast Subspace Clustering for Big Data Sets.

A framework for simultaneous co-clustering and learning from complex data

Distributed Bayesian Matrix Decomposition for Big Data Mining and Clustering

Discovering Multiple Co-Clusterings With Matrix Factorization

Single multiplicatively updated matrix factorization for co-clustering.

Deterministic Column-Based Matrix Decomposition

Distributed structural clustering on large graph

Parallel Non-negative Matrix Tri-Factorization for Text Data Co-clustering

A Fast K-Means Clustering Algorithm Based on Grid Data Reduction

Sparse Embedded K-Means Clustering.

Nonnegative Matrix Tri-factorization Based High-Order Co-clustering and Its Fast Implementation

Data matrix compression by using co-clustering