Abstract:Background Affective states are important aspects of healthy functioning; as such, monitoring and understanding affect is necessary for the assessment and treatment of mood-based disorders. Recent advancements in wearable technologies have increased the use of such tools in detecting and accurately estimating mental states (eg, affect, mood, and stress), offering comprehensive and continuous monitoring of individuals over time. Objective Previous attempts to model an individual’s mental state relied on subjective measurements or the inclusion of only a few objective monitoring modalities (eg, smartphones). This study aims to investigate the capacity of monitoring affect using fully objective measurements. We conducted a comparatively long-term (12-month) study with a holistic sampling of participants’ moods, including 20 affective states. Methods Longitudinal physiological data (eg, sleep and heart rate), as well as daily assessments of affect, were collected using 3 modalities (ie, smartphone, watch, and ring) from 20 college students over a year. We examined the difference between the distributions of data collected from each modality along with the differences between their rates of missingness. Out of the 20 participants, 7 provided us with 200 or more days’ worth of data, and we used this for our predictive modeling setup. Distributions of positive affect (PA) and negative affect (NA) among the 7 selected participants were observed. For predictive modeling, we assessed the performance of different machine learning models, including random forests (RFs), support vector machines (SVMs), multilayer perceptron (MLP), and K-nearest neighbor (KNN). We also investigated the capability of each modality in predicting mood and the most important features of PA and NA RF models. Results RF was the best-performing model in our analysis and performed mood and stress (nervousness) prediction with ~81% and ~72% accuracy, respectively. PA models resulted in better performance compared to NA. The order of the most important modalities in predicting PA and NA was the smart ring, phone, and watch, respectively. SHAP (Shapley Additive Explanations) analysis showed that sleep and activity-related features were the most impactful in predicting PA and NA. Conclusions Generic machine learning–based affect prediction models, trained with population data, outperform existing methods, which use the individual’s historical information. Our findings indicated that our mood prediction method outperformed the existing methods. Additionally, we found that sleep and activity level were the most important features for predicting next-day PA and NA, respectively.

Unsupervised Machine Learning Identifies Latent Ultradian States in Multi-Modal Wearable Sensor Signals

A Wearable Health Monitoring System with Multi-Parameters

Hidden Markov models for monitoring circadian rhythmicity in telemetric activity data

Circadian Rhythm Analysis Using Wearable Device Data: Novel Penalized Machine Learning Approach

SmartEAR: Smartwatch-based Unsupervised Learning for Multi-modal Signal Analysis in Opportunistic Sensing Framework

Self-supervised transfer learning of physiological representations from free-living wearable data

Digital Health: Tracking Physiomes and Activity Using Wearable Biosensors Reveals Useful Health-Related Information

Detection of sedentary time and bouts using consumer-grade wrist-worn devices: a hidden semi-Markov model

Learning Individualized Cardiovascular Responses from Large-scale Wearable Sensors Data

An Adaptive Hidden Markov Model for Activity Recognition Based on a Wearable Multi-Sensor Device

Latent Temporal Flows for Multivariate Analysis of Wearables Data

Recognizing Multi-User Activities Using Wearable Sensors in a Smart Home

Seamless Monitoring of Stress Levels Leveraging a Universal Model for Time Sequences

Longitudinal Analysis of Heart Rate and Physical Activity Collected from Smartwatches

Efficient assessment of real-world dynamics of circadian rhythms in heart rate and body temperature from wearable data

Objective Prediction of Next-Day’s Affect Using Multimodal Physiological and Behavioral Data: Algorithm Development and Validation Study

0280 Unlocking the Potential of Consumer Wearables for Predicting Sleep in Children: A Device-Agnostic Machine Learning Approach

Past, Present, and Future of Multisensory Wearable Technology to Monitor Sleep and Circadian Rhythms

Annotating sleep states in children from wrist-worn accelerometer data using Machine Learning

Daily Life Event Segmentation for Lifestyle Evaluation Based on Multi-Sensor Data Recorded by a Wearable Device

Large-scale Training of Foundation Models for Wearable Biosignals