Abstract:We present RelCon, a novel self-supervised \textit{Rel}ative \textit{Con}trastive learning approach that uses a learnable distance measure in combination with a softened contrastive loss for training an motion foundation model from wearable sensors. The learnable distance measure captures motif similarity and domain-specific semantic information such as rotation invariance. The learned distance provides a measurement of semantic similarity between a pair of accelerometer time-series segments, which is used to measure the distance between an anchor and various other sampled candidate segments. The self-supervised model is trained on 1 billion segments from 87,376 participants from a large wearables dataset. The model achieves strong performance across multiple downstream tasks, encompassing both classification and regression. To our knowledge, we are the first to show the generalizability of a self-supervised learning model with motion data from wearables across distinct evaluation tasks.

What problem does this paper attempt to address?

### What problems does this paper attempt to solve? This paper aims to solve the self - supervised learning problem of accelerometer data generated by wearable devices (such as smart watches) in various downstream tasks. Specifically, the author proposes a new self - supervised learning method - RelCon (Relative Contrastive Learning) to train a motion foundation model. The following are the main goals and problems of this research: 1. **Construct an effective self - supervised learning model**: - Most current self - supervised learning methods perform poorly on time - series data (especially accelerometer data from wearable devices). The author hopes to develop a new contrastive learning method that can effectively capture semantic information and motion similarity in accelerometer data. 2. **Improve multi - task generalization ability**: - Existing self - supervised learning models usually perform well only on specific tasks and cannot generalize well to other different types of downstream tasks. The author hopes that through the RelCon method, the model can perform well in multiple different downstream tasks (such as activity classification, gait assessment, etc.) without fine - tuning. 3. **Handle large - scale datasets**: - The author uses a large wearable device dataset containing 87,376 participants for pre - training. They hope to verify the feasibility and effectiveness of this method on large - scale datasets and show its potential in practical applications. 4. **Introduce a learnable distance metric**: - In order to better capture semantic similarity in accelerometer data, the author proposes a learnable distance metric method, which can identify the similarity between time - series segments of the same user and is invariant to changes in sensor position and orientation. 5. **Improve the contrastive loss function**: - Traditional contrastive loss functions usually divide samples into absolute positive and negative samples, which may lead to the model's sensitivity to false positives and false negatives. The author introduces a relative contrastive loss function (Relative Contrastive Loss) to improve this by considering the relative distances between candidate samples, thereby improving the model's robustness and accuracy. ### Summary The main contribution of this paper is to propose a new self - supervised learning method - RelCon, which can effectively handle large - scale accelerometer data and perform well in multiple downstream tasks. By introducing a learnable distance metric and a relative contrastive loss function, the author has solved the limitations of existing methods on time - series data and shown its broad application prospects in mobile health signal analysis.

RelCon: Relative Contrastive Learning for a Motion Foundation Model for Wearable Data

Contrastive Left-Right Wearable Sensors (IMUs) Consistency Matching for HAR

Modality Consistency-Guided Contrastive Learning for Wearable-Based Human Activity Recognition

Scaling Wearable Foundation Models

What Makes Good Contrastive Learning on Small-Scale Wearable-based Tasks?

Self-supervised Representation Learning Framework for Remote Physiological Measurement Using Spatiotemporal Augmentation Loss

SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Video

Motion-Focused Contrastive Learning of Video Representations*

Motion Sensitive Contrastive Learning for Self-supervised Video Representation

Balancing Continual Learning and Fine-tuning for Human Activity Recognition

Contrast-Phys+: Unsupervised and Weakly-supervised Video-based Remote Physiological Measurement via Spatiotemporal Contrast

ContrastMotion: Self-supervised Scene Motion Learning for Large-Scale LiDAR Point Clouds

Contrast-Phys: Unsupervised Video-based Remote Physiological Measurement via Spatiotemporal Contrast

Weakly Supervised Human Activity Recognition from Wearable Sensors by Recurrent Attention Learning

Timestamp-Supervised Wearable-Based Activity Segmentation and Recognition With Contrastive Learning and Order-Preserving Optimal Transport

Learning on the Rings: Self-Supervised 3D Finger Motion Tracking UsingWearable Sensors

Proprioception-Driven Wearer Pose Estimation for Egocentric Video

Advancing Location-Invariant and Device-Agnostic Motion Activity Recognition on Wearable Devices

Limitations in Employing Natural Language Supervision for Sensor-Based Human Activity Recognition -- And Ways to Overcome Them

Large-scale Training of Foundation Models for Wearable Biosignals