Abstract:The combination of multi-temporal images and deep learning is an efficient way to obtain accurate crop distributions and so has drawn increasing attention. However, few studies have compared deep learning models with different architectures, so it remains unclear how a deep learning model should be selected for multi-temporal crop classification, and the best possible accuracy is. To address this issue, the present work compares and analyzes a crop classification application based on deep learning models and different time-series data to exploit the possibility of improving crop classification accuracy. Using Multi-temporal Sentinel-2 images as source data, time-series classification datasets are constructed based on vegetation indexes (VIs) and spectral stacking, respectively, following which we compare and evaluate the crop classification application based on time-series datasets and five deep learning architectures: (1) one-dimensional convolutional neural networks (1D-CNNs), (2) long short-term memory (LSTM), (3) two-dimensional-CNNs (2D-CNNs), (4) three-dimensional-CNNs (3D-CNNs), and (5) two-dimensional convolutional LSTM (ConvLSTM2D). The results show that the accuracy of both 1D-CNN (92.5%) and LSTM (93.25%) is higher than that of random forest (~ 91%) when using a single temporal feature as input. The 2D-CNN model integrates temporal and spatial information and is slightly more accurate (94.76%), but fails to fully utilize its multi-spectral features. The accuracy of 1D-CNN and LSTM models integrated with temporal and multi-spectral features is 96.94% and 96.84%, respectively. However, neither model can extract spatial information. The accuracy of 3D-CNN and ConvLSTM2D models is 97.43% and 97.25%, respectively. The experimental results show limited accuracy for crop classification based on single temporal features, whereas the combination of temporal features with multi-spectral or spatial information significantly improves classification accuracy. The 3D-CNN and ConvLSTM2D models are thus the best deep learning architectures for multi-temporal crop classification. However, the ConvLSTM architecture combining recurrent neural networks and CNNs should be further developed for multi-temporal image crop classification.

Semi-Supervised Convolutional Long Short-Term Memory Neural Networks for Time Series Land Cover Classification

A lightweight and stochastic depth residual attention network for remote sensing scene classification

Using Long Short-Term Memory Recurrent Neural Network in Land Cover Classification on Landsat and Cropland Data Layer Time Series

Land Cover Classification via Multi-temporal Spatial Data by Recurrent Neural Networks

Superpixel-Based Long-Range Dependent Network for High-Resolution Remote-Sensing Image Classification

Time-series land cover change detection using deep learning-based temporal semantic segmentation

Semi-Supervised Deep learning via Transformation Consistency Regularization for Remote Sensing Image Semantic Segmentation

Land-cover classification with high-resolution remote sensing images using transferable deep models

Temporal Convolutional Neural Network for the Classification of Satellite Image Time Series

Semisupervised Scene Classification for Remote Sensing Images: A Method Based on Convolutional Neural Networks and Ensemble Learning

Deep Neural Networks for automatic extraction of features in time series satellite images

Land cover classification from remote sensing images based on multi-scale fully convolutional network

Large-Area Land-Cover Changes Monitoring With Time-Series Remote Sensing Images Using Transferable Deep Models

Classification of Very-High-Spatial-Resolution Aerial Images Based on Multiscale Features with Limited Semantic Information

Developing Long Time Series 1-km Land Cover Maps From 5-km AVHRR Data Using a Super-Resolution Method

Time Series Remote Sensing Image Classification Using Feature Relationship Learning

Channel Attention-Based Temporal Convolutional Network for Satellite Image Time Series Classification

Thick Clouds Removing From Multitemporal Landsat Images Using Spatiotemporal Neural Networks

Remote Sensing Time Series Classification Based on Self-Attention Mechanism and Time Sequence Enhancement

A deep inverse convolutional neural network-based semantic classification method for land cover remote sensing images

Deep Learning Application for Crop Classification Via Multi-Temporal Remote Sensing Images