Abstract:Multivariate Time Series Classification (MTSC) is a ubiquitous problem in science and engineering, particularly in neuroscience, where most data acquisition modalities involve the simultaneous time-dependent recording of brain activity in multiple brain regions. In recent years, Random Convolutional Kernel models such as ROCKET and MiniRocket have emerged as highly effective time series classification algorithms, capable of achieving state-of-the-art accuracy results with low computational load. Despite their success, these types of models face two major challenges when employed in neuroscience: 1) they struggle to deal with high-dimensional data such as EEG and MEG, and 2) they are difficult to interpret. In this work, we present a novel ROCKET-based algorithm, named Detach-Rocket Ensemble, that is specifically designed to address these two problems in MTSC. Our algorithm leverages pruning to provide an integrated estimation of channel importance, and ensembles to achieve better accuracy and provide a label probability. Using a synthetic multivariate time series classification dataset in which we control the amount of information carried by each of the channels, we first show that our algorithm is able to correctly recover the channel importance for classification. Then, using two real-world datasets, a MEG dataset and an EEG dataset, we show that Detach-Rocket Ensemble is able to provide both interpretable channel relevance and competitive classification accuracy, even when applied directly to the raw brain data, without the need for feature engineering.

What problem does this paper attempt to address?

The paper aims to address two main challenges in Multivariate Time Series Classification (MTSC): handling high-dimensional data (especially for data like EEG and MEG) and model interpretability. To tackle these challenges, the authors propose a new algorithm called Detach-Rocket Ensemble. This algorithm is an improvement based on the ROCKET algorithm and incorporates the following features: 1. **Handling high-dimensional data**: It addresses the issue ROCKET faces with a large number of channels by limiting the number of channels each convolutional kernel mixes. 2. **Improving interpretability**: It enhances accuracy and provides class probability estimates by integrating multiple streamlined Detach-MiniRocket models; it uses a feature pruning process to assess the importance of each channel for the classification task. To validate the effectiveness of the proposed model, the researchers first constructed a synthetic multivariate time series classification dataset where the amount of information carried by each channel can be controlled. Experimental results show that Detach-Rocket Ensemble can accurately identify which channels are crucial for the classification task and correctly assess the relative importance of these channels. Subsequently, the researchers applied the model to two real-world datasets: 1. **MEG dataset**: Used for a face recognition task. The experimental results demonstrated that the model not only outperformed previous ROCKET-related models in terms of accuracy but also identified brain regions relevant to the task, consistent with findings reported in neuroscience literature. 2. **EEG dataset**: Used for Alzheimer's disease classification. The study showed that the model outperformed state-of-the-art models designed for such tasks on raw EEG data without feature engineering and achieved performance close to models optimized with specific feature engineering. In summary, the paper addresses the limitations of the existing ROCKET algorithm in handling high-dimensional data and model interpretability by proposing the Detach-Rocket Ensemble and demonstrates its effectiveness and superiority in real-world applications through experiments.

Classification of Raw MEG/EEG Data with Detach-Rocket Ensemble: An Improved ROCKET Algorithm for Multivariate Time Series Analysis

Neural fingerprinting on MEG time series using MiniRocket

Detach-ROCKET: Sequential feature selection for time series classification with random convolutional kernels

Random Convolution Kernels with Multi-Scale Decomposition for Preterm EEG Inter-burst Detection

MultiRocket: multiple pooling operators and transformations for fast and effective time series classification

HDC-MiniROCKET: Explicit Time Encoding in Time Series Classification with Hyperdimensional Computing

Efficient EEG Feature Learning Model Combining Random Convolutional Kernel with Wavelet Scattering for Seizure Detection

ROCKET: exceptionally fast and accurate time series classification using random convolutional kernels

MiniRocket: A Very Fast (Almost) Deterministic Transform for Time Series Classification

Real-time robust signal space separation for magnetoencephalography

Multivariate Convolutional Sparse Coding for Electromagnetic Brain Signals

Minirocket Kullanarak Güçlendirilmiş ve Verimli Atriyal Fibrilasyon Tespiti

Time CNN and Graph Convolution Network for Epileptic Spike Detection in MEG Data

Time series classification with random convolution kernels based transforms: pooling operators and input representations matter

Learning EEG topographical representation for classification via convolutional neural network

Random Convolutional Kernel Transform with Empirical Mode Decomposition for Classification of Insulators from Power Grid

Enhancing EEG Signal Classification With a Novel Random Subset Channel Selection Approach: Applications in Taste, Odor, and Motor Imagery Analysis

Brain EEG Time Series Selection: A Novel Graph-Based Approach for Classification

Automated Classification of Cognitive Visual Objects Using Multivariate Swarm Sparse Decomposition From Multichannel EEG-MEG Signals

A novel AI-driven EEG generalized classification model for cross-subject and cross-scene analysis