Abstract:Mobile health applications, including those that track activities such as exercise, sleep, and diet, are becoming widely used. Accurately predicting human actions is essential for targeted recommendations that could improve our health and for personalization of these applications. However, making such predictions is extremely difficult due to the complexities of human behavior, which consists of a large number of potential actions that vary over time, depend on each other, and are periodic. Previous work has not jointly modeled these dynamics and has largely focused on item consumption patterns instead of broader types of behaviors such as eating, commuting or exercising. In this work, we develop a novel statistical model for Time-varying, Interdependent, and Periodic Action Sequences. Our approach is based on personalized, multivariate temporal point processes that model time-varying action propensities through a mixture of Gaussian intensities. Our model captures short-term and long-term periodic interdependencies between actions through Hawkes process-based self-excitations. We evaluate our approach on two activity logging datasets comprising 12 million actions taken by 20 thousand users over 17 months. We demonstrate that our approach allows us to make successful predictions of future user actions and their timing. Specifically, our model improves predictions of actions, and their timing, over existing methods across multiple datasets by up to 156%, and up to 37%, respectively. Performance improvements are particularly large for relatively rare and periodic actions such as walking and biking, improving over baselines by up to 256%. This demonstrates that explicit modeling of dependencies and periodicities in real-world behavior enables successful predictions of future actions, with implications for modeling human behavior, app personalization, and targeting of health interventions.

Bayesian nonparametric modeling of user activities

Sensor-Based Human Activity Mining Using Dirichlet Process Mixtures of Directional Statistical Models

Discovery and Recognition of Emerging Human Activities Using a Hierarchical Mixture of Directional Statistical Models.

Bi-View Semi-Supervised Learning Based Semantic Human Activity Recognition Using Accelerometers.

Multi-User Activity Recognition In A Smart Home

Privacy-preserving Activity Recognition Using Multimodal Sensors in Smart Office

Semantics-Driven Multi-user Concurrent Activity Recognition.

Bayesian Hierarchical Modeling and Analysis for Actigraph Data from Wearable Devices

Sensor-Based Human Activity Recognition in a Multi-user Scenario

Discovery and Recognition of Unknown Activities.

Bayesian Approximations to Hidden Semi-Markov Models for Telemetric Monitoring of Physical Activity

Recognizing Multi-User Activities Using Wearable Sensors in a Smart Home

An Activity Management System for Office Workers Using Multimodal Data

Bayesian Method for Intent Prediction in Pervasive Computing Environments

A Probabilistic Semi-Supervised Approach to Multi-Task Human Activity Modeling

Modeling Interdependent and Periodic Real-World Action Sequences

Human Activity Recognition with HMM-DNN Model.

Sensor-based Human Activity Recognition System with a Multilayered Model Using Time Series Shapelets

Mining sequential activity–travel patterns for individual‐level human activity prediction using Bayesian networks

An event-based approach to multi-modal activity modeling and recognition

Human Activity Recognition based on Dynamic Spatio-Temporal Relations