Abstract:Accurate crop distribution mapping is required for crop yield prediction and field management. Due to rapid progress in remote sensing technology, fine spatial resolution (FSR) remotely sensed imagery now offers great opportunities for mapping crop types in great detail. However, within-class variance can hamper attempts to discriminate crop classes at fine resolutions. Multi-temporal FSR remotely sensed imagery provides a means of increasing crop classification from FSR imagery, although current methods do not exploit the available information fully. In this research, a novel Temporal Sequence Object-based Convolutional Neural Network (TS-OCNN) was proposed to classify agricultural crop type from FSR image time-series. An object-based CNN (OCNN) model was adopted in the TS-OCNN to classify images at the object level (i.e., segmented objects or crop parcels), thus, maintaining the precise boundary information of crop parcels. The combination of image time-series was first utilized as the input to the OCNN model to produce an ‘original’ or baseline classification. Then the single-date images were fed automatically into the deep learning model scene-by-scene in order of image acquisition date to increase successively the crop classification accuracy. By doing so, the joint information in the FSR multi-temporal observations and the unique individual information from the single-date images were exploited comprehensively for crop classification. The effectiveness of the proposed approach was investigated using multitemporal SAR and optical imagery, respectively, over two heterogeneous agricultural areas. The experimental results demonstrated that the newly proposed TS-OCNN approach consistently increased crop classification accuracy, and achieved the greatest accuracies (82.68% and 87.40%) in comparison with state-of-the-art benchmark methods, including the object-based CNN (OCNN) (81.63% and 85.88%), object-based image analysis (OBIA) (78.21% and 84.83%), and standard pixel-wise CNN (79.18% and 82.90%). The proposed approach is the first known attempt to explore simultaneously the joint information from image time-series with the unique information from single-date images for crop classification using a deep learning framework. The TS-OCNN, therefore, represents a new approach for agricultural landscape classification from multi-temporal FSR imagery. Besides, it is readily generalizable to other landscapes (e.g., forest landscapes), with a wide application prospect.

3D Fully Convolutional Neural Networks with Intersection over Union Loss for Crop Mapping from Multi-Temporal Satellite Images

Deep Learning-Based Crop Mapping in the Cloudy Season Using One-Shot Hyperspectral Satellite Imagery.

Cropnet: Deep Spatial-Temporal-Spectral Feature Learning Network for Crop Classification from Time-Series Multi-Spectral Images

TFSF: Topological and Feature Space Fusion with Spatio-Temporal Modeling for Crop Yield Prediction.

Mapping Irrigated Croplands from Sentinel-2 Images Using Deep Convolutional Neural Networks

AUTOMATIC CORN AND SOYBEAN MAPPING BASED ON DEEP LEARNING METHODS (CASE STUDY: HAMILTON, HARDIN, BOONE, STORY, DALLAS, POLK, AND JUSPER COUNTIES IN LOWA STATE)

DOCC: Deep One-Class Crop Classification Via Positive and Unlabeled Learning for Multi-Modal Satellite Imagery

CACPU-Net: Channel attention U-net constrained by point features for crop type mapping

3D-CTM: Unsupervised Crop Type Mapping Based on 3-D Convolutional Autoencoder and Satellite Image Time Series

Enhanced crop classification through integrated optical and SAR data: a deep learning approach for multi-source image fusion

Crop Mapping Using the Historical Crop Data Layer and Deep Neural Networks: A Case Study in Jilin Province, China

Multi-Temporal SAR Data Large-Scale Crop Mapping Based on U-Net Model

Fully Automated Classification Method for Crops Based on Spatiotemporal Deep-Learning Fusion Technology

Multimodal Crop Type Classification Fusing Multi-Spectral Satellite Time Series with Farmers Crop Rotations and Local Crop Distribution

Temporal Sequence Object-based CNN (TS-OCNN) for crop classification from fine resolution remote sensing image time-series

Integrating Optical and SAR Time Series Images for Unsupervised Domain Adaptive Crop Mapping

Multi-Stage Feature Fusion of Multispectral and SAR Satellite Images for Seasonal Crop-Type Mapping at Regional Scale Using an Adapted 3D U-Net Model

An unsupervised domain adaptation deep learning method for spatial and temporal transferable crop type mapping using Sentinel-2 imagery

Remote Sensing Crop Recognition by Coupling Phenological Features and Off-Center Bayesian Deep Learning

A image fusion and U-Net approach to improving crop planting structure multi-category classification in irrigated area

Crop Mapping Based on Sentinel-2 Images Using Semantic Segmentation Model of Attention Mechanism