Deconvolution-and-convolution Networks

Yimin Yang,Wandong Zhang,Jonathan Wu,Will Zhao,Ao Chen

DOI: https://doi.org/10.48550/arXiv.2103.11887

2021-03-22

Abstract:2D Convolutional neural network (CNN) has arguably become the de facto standard for computer vision tasks. Recent findings, however, suggest that CNN may not be the best option for 1D pattern recognition, especially for datasets with over 1 M training samples, e.g., existing CNN-based methods for 1D signals are highly reliant on human pre-processing. Common practices include utilizing discrete Fourier transform (DFT) to reconstruct 1D signal into 2D array. To add to extant knowledge, in this paper, a novel 1D data processing algorithm is proposed for 1D big data analysis through learning a deep deconvolutional-convolutional network. Rather than resorting to human-based techniques, we employed deconvolution layers to convert 1 D signals into 2D data. On top of the deconvolution model, the data was identified by a 2D CNN. Compared with the existing 1D signal processing algorithms, DCNet boasts the advantages of less human-made inference and higher generalization performance. Our experimental results from a varying number of training patterns (50 K to 11 M) from classification and regression demonstrate the desirability of our new approach.

Computer Vision and Pattern Recognition,Artificial Intelligence

What problem does this paper attempt to address?

The main problem that this paper attempts to solve is the limitations of existing 1D signal processing algorithms on large - scale datasets. Specifically:

1. **Difficulties in large - scale data processing**: Existing 1D signal processing methods face challenges when dealing with large - scale datasets, especially requiring a large amount of manual pre - processing. For example, on the HEPMASS dataset, it is very inefficient to use the discrete Fourier transform (DFT) to convert 10 million 1D signals into 2D patterns.

2. **Lack of end - to - end training**: Existing reshaping methods are usually divided into two stages: 2D signal representation and final pattern classification. This separation increases the amount of manual design work and may affect the generalization performance of the model. Research shows that end - to - end learning from raw data to final output can significantly improve the generalization ability of the model.

To solve these problems, the paper proposes a new 1D data processing algorithm - DCNet (Deconvolution - and - Convolution Networks). DCNet solves the above problems in the following ways:

- **Automatically convert 1D signals into 2D data**: Use deconvolution layers to automatically convert 1D signals into 2D data, avoiding the need for manual pre - processing.
- **End - to - end deep learning framework**: By combining deconvolution layers and convolution layers, achieve end - to - end learning from 1D input to 2D representation and then to final classification or regression, reducing manual intervention.

Experimental results show that DCNet performs excellently in classification and regression tasks on multiple large - scale datasets, significantly outperforming existing 1D signal processing algorithms.