Abstract:Medical time series are sequential data collected over time that measures health-related signals, such as electroencephalography (EEG), electrocardiography (ECG), and intensive care unit (ICU) readings. Analyzing medical time series and identifying the latent patterns and trends that lead to uncovering highly valuable insights for enhancing diagnosis, treatment, risk assessment, and disease progression. However, data mining in medical time series is heavily limited by the sample annotation which is time-consuming and labor-intensive, and expert-depending. To mitigate this challenge, the emerging self-supervised contrastive learning, which has shown great success since 2020, is a promising solution. Contrastive learning aims to learn representative embeddings by contrasting positive and negative samples without the requirement for explicit labels. Here, we conducted a systematic review of how contrastive learning alleviates the label scarcity in medical time series based on PRISMA standards. We searched the studies in five scientific databases (IEEE, ACM, Scopus, Google Scholar, and PubMed) and retrieved 1908 papers based on the inclusion criteria. After applying excluding criteria, and screening at title, abstract, and full text levels, we carefully reviewed 43 papers in this area. Specifically, this paper outlines the pipeline of contrastive learning, including pre-training, fine-tuning, and testing. We provide a comprehensive summary of the various augmentations applied to medical time series data, the architectures of pre-training encoders, the types of fine-tuning classifiers and clusters, and the popular contrastive loss functions. Moreover, we present an overview of the different data types used in medical time series, highlight the medical applications of interest, and provide a comprehensive table of 51 public datasets that have been utilized in this field. In addition, this paper will provide a discussion on the promising future scopes such as providing guidance for effective augmentation design, developing a unified framework for analyzing hierarchical time series, and investigating methods for processing multimodal data. Despite being in its early stages, self-supervised contrastive learning has shown great potential in overcoming the need for expert-created annotations in the research of medical time series.

Semi-supervised Contrastive Regression for Pharmaceutical Processes

Semi-Supervised Relational Contrastive Learning

Multi-view Self-Supervised Contrastive Learning for Multivariate Time Series

Semi-supervised regression based on Representation Learning for fermentation processes

Semi-Supervised Hybrid Local Kernel Regression for Soft Sensor Modelling of Rubber-Mixing Process

Contrastive Neural Processes for Self-Supervised Learning

Semi-supervised contrastive learning with decomposition-based data augmentation for time series classification

Self-Supervised Contrastive Representation Learning for Semi-Supervised Time-Series Classification

Semi-Supervised Contrastive Learning for Deep Regression with Ordinal Rankings from Spectral Seriation

Self-Supervised Contrastive Learning for Medical Time Series: A Systematic Review

Self-supervised Learning for Label Sparsity in Computational Drug Repositioning

TimeCLR: A self-supervised contrastive learning framework for univariate time series representation

Deep semi-supervised learning with contrastive learning and partial label propagation for image data

Semi-Supervised End-To-End Contrastive Learning For Time Series Classification

Mixing Up Contrastive Learning: Self-Supervised Representation Learning for Time Series

Contrastive learning based self-supervised time-series analysis

Semi-Supervising Learning, Transfer Learning, and Knowledge Distillation with SimCLR

Label Propagation and Contrastive Regularization for Semisupervised Semantic Segmentation of Remote Sensing Images

Investigating Contrastive Pair Learning's Frontiers in Supervised, Semisupervised, and Self-Supervised Learning