Abstract:The fast growth of Internet and modern technologies has brought data involving objects of multiple types that are related to each other, called as Multi-Type Relational data. Traditional clustering methods for single-type data rarely work well on them, which calls for new clustering techniques, called as high-order co-clustering (HOCC), to deal with the multiple types of data at the same time. A major challenge in developing HOCC methods is how to effectively make use of all available information contained in a multi-type relational data set, including both inter-type and intra-type relationships. Meanwhile, because many real world data sets are often of large sizes, clustering methods with computationally efficient solution algorithms are of great practical interest. In this paper, we first present a general HOCC framework, named as Orthogonal Nonnegative Matrix Tri-factorization (O-NMTF), for simultaneous clustering of multi-type relational data. The proposed O-NMTF approach employs Nonnegative Matrix Tri-Factorization (NMTF) to simultaneously cluster different types of data using the inter-type relationships, and incorporate intra-type information through manifold regularization, where, different from existing works, we emphasize the importance of the orthogonal ties of the factor matrices of NMTF. Based on O-NMTF, we further develop a novel Fast Nonnegative Matrix Tri-Factorization (F-NMTF) approach to deal with large-scale data. Instead of constraining the factor matrices of NMTF to be nonnegative as in existing methods, F-NMTF constrains them to be cluster indicator matrices, a special type of nonnegative matrices. As a result, the optimization problem of the proposed method can be decoupled, which results in sub problems of much smaller sizes requiring much less matrix multiplications, such that our new algorithm scales well to real world data of large sizes. Extensive experimental evaluations have demonstrated the effectiveness of our new approaches.

Fast orthogonal nonnegative matrix tri-factorization for simultaneous clustering

Fast Nonnegative Matrix Tri-Factorization for Large-Scale Data Co-Clustering.

Fast Multi-View Clustering via Nonnegative and Orthogonal Factorization

Efficient Orthogonal Non-negative Matrix Factorization over Stiefel Manifold

Nonnegative Matrix Tri-factorization Based High-Order Co-clustering and Its Fast Implementation

Penalized Nonnegative Nonnegative Matrix Tri-Factorization For Co-Clustering

Parallel Non-negative Matrix Tri-Factorization for Text Data Co-clustering

Nonnegative Matrix Factorization on Orthogonal Subspace

Two-Dimensional Data Partitioning for Non-negative Matrix Tri-Factorization

Two algorithms for orthogonal nonnegative matrix factorization with application to clustering

Randomized Algorithms for Orthogonal Nonnegative Matrix Factorization

Two Fast Vector-Wise Update Algorithms for Orthogonal Nonnegative Matrix Factorization with Sparsity Constraint

Robust Orthogonal Nonnegative Matrix Tri-Factorization for Data Representation

Approximation Algorithms for Orthogonal Non-negative Matrix Factorization

Non-negative Tri-factor Tensor Decomposition with Applications

An Ordered Subsets Orthogonal Nonnegative Matrix Factorization Framework with Application to Image Clustering

Orthogonal Graph Regularized Nonnegative Matrix Factorization for Image Clustering

Orthogonal Nonnegative Matrix Factorization with the Kullback-Leibler divergence

Orthogonal Dual Graph-Regularized Nonnegative Matrix Factorization for Co-Clustering

Single multiplicatively updated matrix factorization for co-clustering.

Two Efficient Algorithms for Approximately Orthogonal Nonnegative Matrix Factorization