End-to-End CNN-CRFs for Multi-date Crop Classification Using Multitemporal Remote Sensing Image Sequences

Dario Augusto Borges Oliveira,L. E. L. Rosa,R. Feitosa
Abstract:Accurate crop type identification from remote sensing data in tropical regions is a challenging task. The more favorable weather conditions permit more flexible agricultural practices, which creates complex crop dynamics. Synthetic Aperture Radar (SAR) systems provide high-resolution images independent of daylight, cloud coverage, and climate conditions, turning into a cost-effective tool for crop mapping in tropical regions. Conditional random fields (CRFs) models have been used with great success to exploit spatial and temporal contexts in crop type classification. Even if such approaches deliver high accuracy, they often rely on manually designed features requiring domain-specific knowledge. In this context, deep learning methods such as convolutional neural networks (CNNs) proved to be an appealing alternative for feature learning in the context of remote sensing image classification. This work introduces an end-to-end model that combines CNNs and CRFs for crop recognition in areas characterized by complex spatio-temporal dynamics, typical of tropical regions. The proposed framework consists of two modules: the first implements a CNN that models spatial and temporal contexts from the input data, and the second implements a CRF module that models temporal dynamics considering label dependencies. Experiments are presented for an agricultural region in Brazil using multi-temporal SAR images sequences. The experiments showed significant improvements in the F1 score against a baseline model that does not include temporal dependencies in the learning process.
Computer Science,Environmental Science,Agricultural and Food Sciences
What problem does this paper attempt to address?