Few-shot Learning using Data Augmentation and Time-Frequency Transformation for Time Series Classification

Hao Zhang,Zhendong Pang,Jiangpeng Wang,Teng Li

2023-11-06

Abstract:Deep neural networks (DNNs) that tackle the time series classification (TSC) task have provided a promising framework in signal processing. In real-world applications, as a data-driven model, DNNs are suffered from insufficient data. Few-shot learning has been studied to deal with this limitation. In this paper, we propose a novel few-shot learning framework through data augmentation, which involves transformation through the time-frequency domain and the generation of synthetic images through random erasing. Additionally, we develop a sequence-spectrogram neural network (SSNN). This neural network model composes of two sub-networks: one utilizing 1D residual blocks to extract features from the input sequence while the other one employing 2D residual blocks to extract features from the spectrogram representation. In the experiments, comparison studies of different existing DNN models with/without data augmentation are conducted on an amyotrophic lateral sclerosis (ALS) dataset and a wind turbine fault (WTF) dataset. The experimental results manifest that our proposed method achieves 93.75% F1 score and 93.33% accuracy on the ALS datasets while 95.48% F1 score and 95.59% accuracy on the WTF datasets. Our methodology demonstrates its applicability of addressing the few-shot problems for time series classification.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

### Problems Addressed by the Paper

The paper primarily addresses the issue of small sample learning in time series classification (TSC). Specifically, the authors propose a new small sample learning framework that handles the insufficiency of time series data through data augmentation. The main contributions of the paper are as follows:

1. **Data Augmentation Method**:
- A method is proposed to address the issue of insufficient data in small sample learning by performing time-frequency domain conversion through Short-Time Fourier Transform (STFT) and generating synthetic images combined with random erasure.

2. **New Model SSNN**:
- A new model named Sequence-Spectrogram Neural Network (SSNN) is proposed, which includes two sub-networks: one that extracts input sequence features using 1D residual blocks, and another that extracts features from spectrograms using 2D residual blocks.

3. **Experimental Validation**:
- Experiments were conducted on the Amyotrophic Lateral Sclerosis (ALS) dataset and the Wind Turbine Fault (WTF) dataset to validate the effectiveness of the proposed method. On the ALS dataset, the method achieved an F1 score of 93.75% and an accuracy of 93.33%; on the WTF dataset, it achieved an F1 score of 95.48% and an accuracy of 95.59%.

In summary, the paper aims to solve the problem of small sample learning in time series classification through data augmentation and multimodal fusion methods, demonstrating its effectiveness in practical applications.