Vegetation classification in a subtropical region with Sentinel-2 time series data and deep learning

Ming Zhang,Dengqiu Li,Guiying Li,Dengsheng Lu

DOI: https://doi.org/10.1080/10095020.2024.2336604

IF: 4.278

2024-05-02

Geo-spatial Information Science

Abstract:Preparing regular time series optical remote sensing data is a difficult task due to the influences of frequently cloudy and rainy days. The irregular data and their forms severely limit the data's ability to be analyzed and modeled for vegetation classification. However, how irregular time series data affect vegetation classification in deep learning models is poorly understood. To address these questions, this research preprocessed the 2019–2021 time series of Sentinel-2 in both unequal and equal intervals, and transformed them into an image through recurrence plot for each pixel. The initial one-dimension time series (1DTS) and recurrence plot data were then used as input data for three deep learning methods (i.e. Conv1D model based on one-dimensional convolution, GoogLeNet model based on two-dimensional convolution, and CGNet model which fused Conv1D and GoogLeNet) for vegetation classification, respectively. The class separability of the features generated by each model was evaluated and the importance of spectral and temporal features was further examined through gradient backpropagation. The equal-interval time series data significantly improved the classification accuracy with 0.04, 0.13, and 0.09 for Conv1D, GoogLeNet, and CGNet, respectively. The CGNet achieved the highest classification accuracy, indicating that the information from 1DTS and recurrence plot can be a good complementary for vegetation classification. The importance of spectral bands and time showed that the Sentinel-2 red edge-1 spectral band played a critical role in the identification of eucalyptus, loquat, and honey pomelo, but the importance order of bands varied in different vegetation types in GoogLeNet. The time importance varied across different vegetation types but is similar in these deep learning models. This study quantified the impacts of organizational form (1DTS and recurrence plot) of time series data on different models. This research is valuable for us to choose appropriate data structures and efficient deep learning models for vegetation classification.

remote sensing

What problem does this paper attempt to address?

This paper discusses the use of Sentinel-2 time series data and deep learning for vegetation classification in subtropical regions. Obtaining regular time series optical remote sensing data is challenging due to frequent cloudy and rainy days, which limits the ability for data analysis and vegetation classification. In this study, the authors processed Sentinel-2 data from 2019 to 2021 at irregular and regular intervals and transformed the time series data into images using recurrence plots. Then, three deep learning methods (Conv1D model based on one-dimensional convolution, GoogLeNet model based on two-dimensional convolution, and CGNet model combining Conv1D and GoogLeNet) were used for vegetation classification. The study found that regular interval time series significantly improved classification accuracy, especially the CGNet model performed the best, indicating the complementarity of 1DTS and recurrence plot information for vegetation classification. Furthermore, the study emphasized the key role of Sentinel-2 red-edge-1 spectral band in identifying different vegetation types and analyzed the importance of spectral and temporal features in different deep learning models. This study quantifies the impact of time series data organization on different models and provides guidance for selecting appropriate data structures and efficient deep learning models.