Abstract:We study the problem of modeling human mobility from semantic trace data, wherein each GPS record in a trace is associated with a text message that describes the user's activity. Existing methods fall short in unveiling human movement regularities, because they either do not model the text data at all or suffer from text sparsity severely. We propose SHMM, a multi-modal spherical hidden Markov model for semantics-rich human mobility modeling. Under the hidden Markov assumption, SHMM models the generation process of a given trace by jointly considering the observed location, time, and text at each step of the trace. The distinguishing characteristic of SHMM is the text modeling part. We use fixed-size vector representations to encode the semantics of the text messages, and model the generation of the l2-normalized text embeddings on a unit sphere with the von Mises-Fisher (vMF) distribution. Compared with other alternatives like multi-variate Gaussian, our choice of the vMF distribution not only incurs much fewer parameters, but also better leverages the discriminative power of text embeddings in a directional metric space. The parameter inference for the vMF distribution is non-trivial since it involves functional inversion of ratios of Bessel functions. We theoretically prove that: 1) the classical Expectation-Maximization algorithm can work with vMF distributions; and 2) while closed-form solutions are hard to be obtained for the M-step, Newton's method is guaranteed to converge to the optimal solution with quadratic convergence rate. We have performed extensive experiments on both synthetic and real-life data. The results on synthetic data verify our theoretical analysis; while the results on real-life data demonstrate that SHMM learns meaningful semantics-rich mobility models, outperforms state-of-the-art mobility models for next location prediction, and incurs lower training cost.

Text Classification by Markov Random Walks with Reward.

A Random Walks Method for Text Classification

RW.KNN: a proposed random walk KNN algorithm for multi-label classification.

Using random walks for multi-label classification.

Description Based Text Classification with Reinforcement Learning

Multigraph Random Walk for Joint Learning of Multiview Clustering and Semisupervised Classification

Topic-Level Random Walk through Probabilistic Model

Discriminative Deep Random Walk for Network Classification.

Revisiting Random Walks for Learning on Graphs

Mobility Prediction Using a Weighted Markov Model Based on Mobile User Classification

Finding decision jumps in text classification

A Spherical Hidden Markov Model for Semantics-Rich Human Mobility Modeling

A New Text Clustering Method Using Hidden Markov Model

Text-Guided Mixup Towards Long-Tailed Image Categorization

A Markov Chain Approach to the Problem of Runs and Patterns

Classification with Label Noise: a Markov Chain Sampling Framework.

Attentional Markov Model for Human Mobility Prediction

Random Walk Models for Top- N Recommendation Task

Microblog Sentiment Classiﬁcation Via Recurrent Random Walk Network Learning

Text Classification with Novelty Detection

Short Text Classification via Term Graph