Abstract:Background: Digital clinical measures collected via various digital sensing technologies such as smartphones, smartwatches, wearables, and ingestible and implantable sensors are increasingly used by individuals and clinicians to capture the health outcomes or behavioral and physiological characteristics of individuals. Time series classification (TSC) is very commonly used for modeling digital clinical measures. While deep learning models for TSC are very common and powerful, there exist some fundamental challenges. This review presents the non-deep learning models that are commonly used for time series classification in biomedical applications that can achieve high performance. Objective: We performed a systematic review to characterize the techniques that are used in time series classification of digital clinical measures throughout all the stages of data processing and model building. Methods: We conducted a literature search on PubMed, as well as the Institute of Electrical and Electronics Engineers (IEEE), Web of Science, and SCOPUS databases using a range of search terms to retrieve peer-reviewed articles that report on the academic research about digital clinical measures from a five-year period between June 2016 and June 2021. We identified and categorized the research studies based on the types of classification algorithms and sensor input types. Results: We found 452 papers in total from four different databases: PubMed, IEEE, Web of Science Database, and SCOPUS. After removing duplicates and irrelevant papers, 135 articles remained for detailed review and data extraction. Among these, engineered features using time series methods that were subsequently fed into widely used machine learning classifiers were the most commonly used technique, and also most frequently achieved the best performance metrics (77 out of 135 articles). Statistical modeling (24 out of 135 articles) algorithms were the second most common and also the second-best classification technique. Conclusions: In this review paper, summaries of the time series classification models and interpretation methods for biomedical applications are summarized and categorized. While high time series classification performance has been achieved in digital clinical, physiological, or biomedical measures, no standard benchmark datasets, modeling methods, or reporting methodology exist. There is no single widely used method for time series model development or feature interpretation, however many different methods have proven successful.

Early Classification of Time Series is Meaningful

Approaches and Applications of Early Classification of Time Series: A Review

A Systematic Review of Time Series Classification Techniques Used in Biomedical Applications

Early Classification of Time Series: Taxonomy and Benchmark

Multivariate Time Series Early Classification Across Channel and Time Dimensions

Automatic Feature Engineering for Time Series Classification: Evaluation and Discussion

How to evaluate your medical time series classification?

On Using Temporal Features to Create More Accurate Human-Activity Classifiers

A Ranking-Based Cross-Entropy Loss for Early Classification of Time Series.

Uncertain Time Series Classification

Stop&Hop: Early Classification of Irregular Time Series

Explainable AI for Time Series Classification: A Review, Taxonomy and Research Directions

TEASER: Early and Accurate Time Series Classification

Machine Learning Algorithms for Time Series Analysis and Forecasting

The great time series classification bake off: a review and experimental evaluation of recent algorithmic advances

Should we Reload Time Series Classification Performance Evaluation ? (a position paper)

Eigen-entropy based time series signatures to support multivariate time series classification

Self-Supervised Pre-training for Time Series Classification

Leveraging Patient Similarity and Time Series Data in Healthcare Predictive Models

Highly Comparative Feature-Based Time-Series Classification

Classification of High-dimensional Time Series in Spectral Domain using Explainable Features