Deep Transfer Learning for Land Use and Land Cover Classification: A Comparative Study

Raoof Naushad,Tarunpreet Kaur,Ebrahim Ghaderpour

DOI: https://doi.org/10.3390/s21238083

2021-11-25

Abstract:Efficiently implementing remote sensing image classification with high spatial resolution imagery can provide a significant value in Land Use and Land Cover (LULC) classification. The new advances in remote sensing and deep learning technologies have facilitated the extraction of spatiotemporal information for LULC classification. Moreover, the diverse disciplines of science, including remote sensing, have utilised tremendous improvements in image classification by Convolutional Neural Networks (CNNs) with transfer learning. In this study, instead of training CNNs from scratch, the transfer learning is applied to fine-tune pre-trained networks Visual Geometry Group (VGG16) and Wide Residual Networks (WRNs), by replacing the final layer with additional layers, for LULC classification using the red-green-blue version of the EuroSAT dataset. Moreover, the performance and computational time are compared and optimised with techniques, such as early stopping, gradient clipping, adaptive learning rates, and data augmentation. The proposed approaches have addressed the limited-data problem, and very good accuracies are achieved. The results show that the proposed method based on the WRNs performs better than the previous best-stated results in terms of the computational efficiency and accuracy from 98.57% to 99.17%.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the challenges in land use and land cover (LULC) classification. Specifically, the paper focuses on how to use deep transfer learning techniques to improve the accuracy of LULC classification. With the development of remote sensing technology and deep learning, the ability to extract spatio - temporal information from high - resolution remote sensing images for LULC classification has been significantly enhanced. However, due to the limited size of the data set and the complex spatial distribution of different land cover types, LULC classification remains a challenging task. For this reason, the paper adopts the transfer learning method, fine - tunes pre - trained convolutional neural networks (such as VGG16 and Wide Residual Networks, WRNs), and conducts experiments on the EuroSAT data set. The research aims to compare the performance of different models on the LULC classification task and explore how to optimize model performance through techniques such as data augmentation, early stopping, gradient clipping and adaptive learning rate. The main contributions of the paper include: 1. Using two transfer learning architectures (VGG16 and Wide ResNet - 50) to perform LULC classification on the RGB version of the EuroSAT data set. 2. Experimentally evaluating the impact of data augmentation on model performance. 3. Improving model performance and computational efficiency through model enhancement techniques. 4. Conducting benchmark tests on the RGB version of the EuroSAT data set. Through these methods, the paper not only improves the accuracy of LULC classification, but also provides valuable references for future related research. In particular, using the Wide ResNet - 50 model achieves a maximum accuracy of 99.17% on RGB data, exceeding the previous best result. This indicates that transfer learning and model optimization techniques have significant advantages in the LULC classification task.

Deep Transfer Learning for Land Use and Land Cover Classification: A Comparative Study

Land-Cover Classification Using Deep Learning with High-Resolution Remote-Sensing Imagery

Deep Learning Methods for Land Cover and Land Use Classification in Remote Sensing: A Review

Multiclass Classification of Remote Sensing Images Using Deep Learning Techniques

Advancing Remote Sensing: A Unified Deep Learning Approach with Pretrained and Custom Architectures for High-Precision Classification

Large-scale Land Use/land Cover Extraction from Landsat Imagery Using Feature Relationships Matrix Based Deep-Shallow Learning

Classification of Large-Scale High-Resolution SAR Images with Deep Transfer Learning

How Well Do Deep Learning-Based Methods for Land Cover Classification and Object Detection Perform on High Resolution Remote Sensing Imagery?

Mapping of Land Use and Land Cover (LULC) using EuroSAT and Transfer Learning

Comparison of Land Use Classification Based on Convolutional Neural Network

Land Cover Image Classification

Cascaded Deep Learning Model for Accurate Land Use and Land Cover Classification

Satellite-Net: Automatic Extraction of Land Cover Indicators from Satellite Imagery by Deep Learning

Evaluation of a Deep-Learning Model for Multispectral Remote Sensing of Land Use and Crop Classification

Urban Land-Use Mapping Using a Deep Convolutional Neural Network with High Spatial Resolution Multispectral Remote Sensing Imagery

Land use land cover classification of remote sensing images based on the deep learning approaches: a statistical analysis and review

Leveraging Pre-trained Deep Learning Models for Remote Sensing Image Classification: A Case Study with ResNet50 and EfficientNet

Enhancing land cover classification in remote sensing imagery using an optimal deep learning model

Cognitive Land Cover Mapping: A Three-Layer Deep Learning Architecture for Remote Sensing Data Classification

Land Use and Land Cover Classification Meets Deep Learning: A Review

Land Use Classification Method of Remote Sensing Images for Urban and Rural Planning Monitoring Using Deep Learning