Abstract:Passenger clustering based on travel records is essential for transportation operators. However, existing methods cannot easily cluster the passengers due to the hierarchical structure of the passenger trip information, namely: each passenger has multiple trips, and each trip contains multi-dimensional multi-mode information. Furthermore, existing approaches rely on an accurate specification of the clustering number to start, which is difficult when millions of commuters are using the transport systems on a daily basis. In this paper, we propose a novel Tensor Dirichlet Process Multinomial Mixture model (Tensor-DPMM), which is designed to preserve the multi-mode and hierarchical structure of the multi-dimensional trip information via tensor, and cluster them in a unified one-step manner. The model also has the ability to determine the number of clusters automatically by using the Dirichlet Process to decide the probabilities for a passenger to be either assigned in an existing cluster or to create a new cluster: This allows our model to grow the clusters as needed in a dynamic manner. Finally, existing methods do not consider spatial semantic graphs such as geographical proximity and functional similarity between the locations, which may cause inaccurate clustering. To this end, we further propose a variant of our model, namely the Tensor-DPMM with Graph. For the algorithm, we propose a tensor Collapsed Gibbs Sampling method, with an innovative step of "disband and relocating", which disbands clusters with too small amount of members and relocates them to the remaining clustering. This avoids uncontrollable growing amounts of clusters. A case study based on Hong Kong metro passenger data is conducted to demonstrate the automatic process of learning the number of clusters, and the learned clusters are better in within-cluster compactness and cross-cluster separateness.

Tensor Train-Based Multiple Clusterings for Big Data in Cyber-Physical-Social Systems and Its Efficient Implementations

Tensor Multi-Clustering Parallel Intelligent Computing Method Based on Tensor Chain Decomposition

A Non-Local Grouping Tensor Train Decomposition Model for Travel Demand Analysis Concerning Categorical Independent Variables

A Novel Parallel Algorithm for Sparse Tensor Matrix Chain Multiplication via TCU-Acceleration

Era of Big Data Processing: A New Approach via Tensor Networks and Tensor Decompositions

Parallel Massive Clustering of Discrete Distributions

Parallel Non-negative Matrix Tri-Factorization for Text Data Co-clustering

Tensor multi-view clustering method for natural image segmentation

Distributed memory parallel adaptive tensor-train cross approximation

Low-Rank Robust Subspace Tensor Clustering for Metro Passenger Flow Modeling

High-Performance Tensor-Train Primitives Using GPU Tensor Cores

Essential Tensor Learning for Multi-View Spectral Clustering

TensorAnalyzer: Identification of Urban Patterns in Big Cities using Non-Negative Tensor Factorization

Heteroskedastic Tensor Clustering

TEC: Tensor Ensemble Classifier for Big Data

Distributed Non-Negative Tensor Train Decomposition

Tensor-Based Viterbi Algorithms for Collaborative Cloud-Edge Cyber-Physical-Social Activity Prediction

Tensor Dirichlet Process Multinomial Mixture Model for Passenger Trajectory Clustering

Multiway clustering via tensor block models

Generalized latent multi-view clustering with tensorized bipartite graph

Two-Dimensional Data Partitioning for Non-negative Matrix Tri-Factorization