Advanced Machine Learning and Deep Learning Approaches for Remote Sensing II

Gwanggil Jeon

DOI: https://doi.org/10.3390/rs16081353

IF: 5

2024-04-13

Remote Sensing

Abstract:This Special Issue marks the third edition of "Advanced Machine Learning and Deep Learning Approaches for Remote Sensing" [...]

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary

What problem does this paper attempt to address?

A Comprehensive Survey of Deep Learning in Remote Sensing: Theories, Tools and Challenges for the Community

John E. Ball,Derek T. Anderson,Chee Seng Chan

DOI: https://doi.org/10.1117/1.JRS.11.042609

2017-09-24

Abstract:In recent years, deep learning (DL), a re-branding of neural networks (NNs), has risen to the top in numerous areas, namely computer vision (CV), speech recognition, natural language processing, etc. Whereas remote sensing (RS) possesses a number of unique challenges, primarily related to sensors and applications, inevitably RS draws from many of the same theories as CV; e.g., statistics, fusion, and machine learning, to name a few. This means that the RS community should be aware of, if not at the leading edge of, of advancements like DL. Herein, we provide the most comprehensive survey of state-of-the-art RS DL research. We also review recent new developments in the DL field that can be used in DL for RS. Namely, we focus on theories, tools and challenges for the RS community. Specifically, we focus on unsolved challenges and opportunities as it relates to (i) inadequate data sets, (ii) human-understandable solutions for modelling physical phenomena, (iii) Big Data, (iv) non-traditional heterogeneous data sources, (v) DL architectures and learning algorithms for spectral, spatial and temporal data, (vi) transfer learning, (vii) an improved theoretical understanding of DL systems, (viii) high barriers to entry, and (ix) training and optimizing the DL.

Computer Vision and Pattern Recognition
Advanced Machine Learning and Big Data Analytics in Remote Sensing for Natural Hazards Management

Francisco Martínez-Álvarez,Dieu Tien Bui

DOI: https://doi.org/10.3390/rs12020301

IF: 5

2020-01-16

Remote Sensing

Abstract:This editorial summarizes the performance of the special issue entitled Advanced Machine Learning and Big Data Analytics in Remote Sensing for Natural Hazards Management, which was published at MDPI’s Remote Sensing journal. The special issue took place in years 2018 and 2019 and accepted a total of nine papers from authors of thirteen different countries. So far, these papers have dealt with 116 cites. Earthquakes, landslides, floods, wildfire and soil salinity were the topics analyzed. New methods were introduced, with applications of the utmost relevance.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
Deep learning in environmental remote sensing: Achievements and challenges

Qiangqiang Yuan,Huanfeng Shen,Tongwen Li,Zhiwei Li,Shuwen Li,Yun Jiang,Hongzhang Xu,Weiwei Tan,Qianqian Yang,Jiwen Wang,Jianhao Gao,Liangpei Zhang

DOI: https://doi.org/10.1016/j.rse.2020.111716

IF: 13.5

2020-05-01

Remote Sensing of Environment

Abstract:Various forms of machine learning (ML) methods have historically played a valuable role in environmental remote sensing research. With an increasing amount of "big data" from earth observation and rapid advances in ML, increasing opportunities for novel methods have emerged to aid in earth environmental monitoring. Over the last decade, a typical and state-of-the-art ML framework named deep learning (DL), which is developed from the traditional neural network (NN), has outperformed traditional models with considerable improvement in performance. Substantial progress in developing a DL methodology for a variety of earth science applications has been observed. Therefore, this review will concentrate on the use of the traditional NN and DL methods to advance the environmental remote sensing process. First, the potential of DL in environmental remote sensing, including land cover mapping, environmental parameter retrieval, data fusion and downscaling, and information reconstruction and prediction, will be analyzed. A typical network structure will then be introduced. Afterward, the applications of DL environmental monitoring in the atmosphere, vegetation, hydrology, air and land surface temperature, evapotranspiration, solar radiation, and ocean color are specifically reviewed. Finally, challenges and future perspectives will be comprehensively analyzed and discussed.

environmental sciences,imaging science & photographic technology,remote sensing
A survey of machine learning and deep learning in remote sensing of geological environment: Challenges, advances, and opportunities

Wei Han,Xiaohan Zhang,Yi Wang,Lizhe Wang,Xiaohui Huang,Jun Li,Sheng Wang,Weitao Chen,Xianju Li,Ruyi Feng,Runyu Fan,Xinyu Zhang,Yuewei Wang

DOI: https://doi.org/10.1016/j.isprsjprs.2023.05.032

IF: 12.7

2023-06-15

ISPRS Journal of Photogrammetry and Remote Sensing

Abstract:Due to limited resources and environmental pollution , monitoring the geological environment has become essential for many countries' sustainable development. As various high-resolution remote-sensing (RS) imaging platforms are continuously available, the remote sensing of the geological environment (GERS) provides a fine-grain, all-weather, and low-cost method for identifying geological elements. Mainstream machine learning (ML) and deep learning (DL) methods can extract high-level high-dimensional semantic information and thus supply an efficient tool for high-precision classification and recognition in many fields. Therefore, the integration of advanced methods and multi-source RS images for GERS interpretation has achieved remarkable breakthroughs during the past decades. However, to the best of our knowledge, a systematic survey of the advances of GERS interpretation regarding ML and DL methods is still lacking. Through the collection of extensive published research in this area, this survey outlines and analyzes the challenges, progress, and promising directions of GERS interpretation. Specifically, the main challenges and difficulties in identifying GERS elements are first summarized in four aspects: sufficient element characteristics and variations, complex context disturbance, RS image quality and types, and other limitations in GERS interpretation. Second, we systematically introduce various RS imaging platforms and advanced ML and DL methods for GERS interpretation. Third, the research status and trends of several GERS applications, including their use for lithology, soil, water, rock glacier, and geological disaster , are ultimately collected and compared. Finally, potential opportunities for future research are discussed. After the systematic and comprehensive review, the conclusive findings suggest that longtime large-scale GERS interpretation and corresponding change pattern analysis will be a significant future direction to meet the needs of environment improvement and sustainable development. To complete the above goals, a fusion of satellite, airplane, environmental monitoring, geological survey, and other types of data will provide enough discriminative information, and expert knowledge, GIS, and high-performance computing techniques will be helpful to improve the efficiency and generalizability of ML and DL methods for processing the multi-platform RS data.

imaging science & photographic technology,remote sensing,geography, physical,geosciences, multidisciplinary
Fine-Grained Image Recognition Methods and Their Applications in Remote Sensing Images: A Review

Yang Chu,Minchao Ye,Yuntao Qian

DOI: https://doi.org/10.1109/jstars.2024.3482348

IF: 4.715

2024-01-01

IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing

Abstract:Fine-grained image recognition (FGIR), unlike traditional coarse-grained recognition, is centered on distinguishing fine-level subclasses within broader semantic categories. It holds significant scientific research value, particularly in remote sensing, where the precise identification of specific objects—such as ships, buildings, and land use categories— is critical for tasks like boundary security, environmental monitoring, and urban planning. Recent advancements in FGIR have notably improved feature representation and generalization, especially under the diverse imaging conditions typical of remote sensing. However, challenges remain, including the heavy reliance on high-quality, large-scale fine-grained image data and difficulties in extracting subtle image features. Efficiently utilizing limited data and enhancing feature extraction capabilities have thus become key focus areas in current FGIR research. This paper systematically reviews the advancements in FGIR, covering its foundational principles, key methodologies, and the latest research developments, while providing a comprehensive comparative analysis of their performance in remote sensing images applications. Additionally, it addresses the specific challenges posed by fine-grained recognition in remote sensing imagery and explores potential directions for future research in this field
Foreword to the Special Issue on Pattern Recognition in Remote Sensing

Qian Du,Eckart Michaelsen,Peijun Du,Lorenzo Bruzzone,Xiaohua Tong,Uwe Stilla

DOI: https://doi.org/10.1109/jstars.2014.2384931

IF: 4.715

2014-01-01

IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing

Abstract:The articles in this special section focus on the use of pattern recognition in remote sensing applications.
Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art

Bo Du,Liangpei Zhang,Lefei Zhang

DOI: https://doi.org/10.1109/MGRS.2016.2540798

IF: 14.6

2016-06-07

IEEE Geoscience and Remote Sensing Magazine

Abstract:Deep-learning (DL) algorithms, which learn the representative and discriminative features in a hierarchical manner from the data, have recently become a hotspot in the machine-learning area and have been introduced into the geoscience and remote sensing (RS) community for RS big data analysis. Considering the low-level features (e.g., spectral and texture) as the bottom level, the output feature representation from the top level of the network can be directly fed into a subsequent classifier for pixel-based classification. As a matter of fact, by carefully addressing the practical demands in RS applications and designing the input?output levels of the whole network, we have found that DL is actually everywhere in RS data analysis: from the traditional topics of image preprocessing, pixel-based classification, and target recognition, to the recent challenging tasks of high-level semantic feature extraction and RS scene understanding.In this technical tutorial, a general framework of DL for RS data is provided, and the state-of-the-art DL methods in RS are regarded as special cases of input-output data combined with various deep networks and tuning tricks. Although extensive experimental results confirm the excellent performance of the DL-based algorithms in RS big data analysis, even more exciting prospects can be expected for DL in RS. Key bottlenecks and potential directions are also indicated in this article, guiding further research into DL for RS data.

Environmental Science,Computer Science
Special Section Guest Editorial: Advanced Infrared Technology and Remote Sensing Applications II

Marija Strojnik,Wen Chen,Sarath Gunapala,Joern Helbert,Esteban Vera,Eric Shirley

DOI: https://doi.org/10.1117/1.jrs.18.022201

IF: 1.568

2024-06-12

Journal of Applied Remote Sensing

Abstract:Guest Editors Marija Strojnik, Wen Chen, Sarath Gunapala, Joern Helbert, Esteban Vera, and Eric Shirley introduce the Special Section on Advanced Infrared Technology and Remote Sensing Applications II.

environmental sciences,imaging science & photographic technology,remote sensing
Deep learning in remote sensing applications: A meta-analysis and review

Lei Ma,Yu Liu,Xueliang Zhang,Yuanxin Ye,Gaofei Yin,Brian Alan Johnson

DOI: https://doi.org/10.1016/j.isprsjprs.2019.04.015

IF: 12.7

2019-06-01

ISPRS Journal of Photogrammetry and Remote Sensing

Abstract:Deep learning (DL) algorithms have seen a massive rise in popularity for remote-sensing image analysis over the past few years. In this study, the major DL concepts pertinent to remote-sensing are introduced, and more than 200 publications in this field, most of which were published during the last two years, are reviewed and analyzed. Initially, a meta-analysis was conducted to analyze the status of remote sensing DL studies in terms of the study targets, DL model(s) used, image spatial resolution(s), type of study area, and level of classification accuracy achieved. Subsequently, a detailed review is conducted to describe/discuss how DL has been applied for remote sensing image analysis tasks including image fusion, image registration, scene classification, object detection, land use and land cover (LULC) classification, segmentation, and object-based image analysis (OBIA). This review covers nearly every application and technology in the field of remote sensing, ranging from preprocessing to mapping. Finally, a conclusion regarding the current state-of-the art methods, a critical conclusion on open challenges, and directions for future research are presented.

imaging science & photographic technology,remote sensing,geography, physical,geosciences, multidisciplinary
Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources

Xiao Xiang Zhu,Devis Tuia,Lichao Mou,Gui-Song Xia,Liangpei Zhang,Feng Xu,Friedrich Fraundorfer

DOI: https://doi.org/10.1109/MGRS.2017.2762307

IF: 14.6

2017-01-01

IEEE Geoscience and Remote Sensing Magazine

Abstract:Central to the looming paradigm shift toward data-intensive science, machine-learning techniques are becoming increasingly important. In particular, deep learning has proven to be both a major breakthrough and an extremely powerful tool in many fields. Shall we embrace deep learning as the key to everything? Or should we resist a black-box solution? These are controversial issues within the remote...
Deep learning in remote sensing: a review

Xiao Xiang Zhu,Devis Tuia,Lichao Mou,Gui-Song Xia,Liangpei Zhang,Feng Xu,Friedrich Fraundorfer

DOI: https://doi.org/10.48550/arXiv.1710.03959

2017-10-11

Computer Vision and Pattern Recognition

Abstract:Standing at the paradigm shift towards data-intensive science, machine learning techniques are becoming increasingly important. In particular, as a major breakthrough in the field, deep learning has proven as an extremely powerful tool in many fields. Shall we embrace deep learning as the key to all? Or, should we resist a 'black-box' solution? There are controversial opinions in the remote sensing community. In this article, we analyze the challenges of using deep learning for remote sensing data analysis, review the recent advances, and provide resources to make deep learning in remote sensing ridiculously simple to start with. More importantly, we advocate remote sensing scientists to bring their expertise into deep learning, and use it as an implicit general model to tackle unprecedented large-scale influential challenges, such as climate change and urbanization.
Deep Learning Methods for Land Cover and Land Use Classification in Remote Sensing: A Review

Abebaw Alem,Shailender Kumar

DOI: https://doi.org/10.1109/ICRITO48877.2020.9197824

2020-06-01

Abstract:Land Cover and Land Use classification is a problem in remote sensing imagery data. The volume of remote sensing data in the earth observation, which need analysis and interpretations, is extremely increasing in this ‘Big Data’ era. To overcome this critical challenge, Deep learning methods have been identified as a recent powerful modelling technique to extract hidden information from big remote sensing imagery for LCLU classification. Classification of RS data in earth domain is vital for land administration and environmental protection in planning and decision making. The applications of deep learning methods for LCLU classification using remote sensing imagery data become increasing in recent. Deep learning methods such as CNN, GAN and RNN are able to be used to classify remote sensing image data. We are planning to use deep CNNs models to analyse and compare their results using various parameters and three different scale remote sensing data sets: UC Merced, NWPU-RESISC45 and EuroSAT: Sentile 2.

Computer Science,Environmental Science
Computer Vision and Pattern Recognition for the Analysis of 2D/3D Remote Sensing Data in Geoscience: A Survey

Michalis A. Savelonas,Christos N. Veinidis,Theodoros K. Bartsokas

DOI: https://doi.org/10.3390/rs14236017

IF: 5

2022-11-27

Remote Sensing

Abstract:Historically, geoscience has been a prominent domain for applications of computer vision and pattern recognition. The numerous challenges associated with geoscience-related imaging data, which include poor imaging quality, noise, missing values, lack of precise boundaries defining various geoscience objects and processes, as well as non-stationarity in space and/or time, provide an ideal test bed for advanced computer vision techniques. On the other hand, the developments in pattern recognition, especially with the rapid evolution of powerful graphical processing units (GPUs) and the subsequent deep learning breakthrough, enable valuable computational tools, which can aid geoscientists in important problems, such as land cover mapping, target detection, pattern mining in imaging data, boundary extraction and change detection. In this landscape, classical computer vision approaches, such as active contours, superpixels, or descriptor-guided classification, provide alternatives that remain relevant when domain expert labelling of large sample collections is often not feasible. This issue persists, despite efforts for the standardization of geoscience datasets, such as Microsoft's effort for AI on Earth, or Google Earth. This work covers developments in applications of computer vision and pattern recognition on geoscience-related imaging data, following both pre-deep learning and post-deep learning paradigms. Various imaging modalities are addressed, including: multispectral images, hyperspectral images (HSIs), synthetic aperture radar (SAR) images, point clouds obtained from light detection and ranging (LiDAR) sensors or digital elevation models (DEMs).

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
Introduction to the special issue on spatial machine learning

Kevin Credit

DOI: https://doi.org/10.1007/s10109-024-00452-1

2024-11-20

Journal of Geographical Systems

Abstract:While, many of the machine learning (ML) and artificial intelligence (AI) methods that are now commonly being used to answer questions across scientific disciplines have been around for some time, their widespread application to spatial data and spatially-explicit research questions is much more recent. The large number of excellent review papers and special issues in leading journals published in the last few years—which this issue of the Journal of Geographical Systems takes its place among—attest to the growing interest in the application and development of cutting-edge methodologies for spatial data. This editorial begins by proposing a new inclusive definition for spatial ML, then provides a brief overview of each of the six papers in this special issue, and ends with a suggestion of several possible directions for future research in spatial ML.

geography
Remote Sensing Single-Image Resolution Improvement Using A Deep Gradient-Aware Network with Image-Specific Enhancement

Mengjiao Qin,Sebastien Mavromatis,Linshu Hu,Feng Zhang,Renyi Liu,Jean Sequeira,Zhenhong Du

DOI: https://doi.org/10.3390/rs12050758

IF: 5

2020-01-01

Remote Sensing

Abstract:Super-resolution (SR) is able to improve the spatial resolution of remote sensing images, which is critical for many practical applications such as fine urban monitoring. In this paper, a new single-image SR method, deep gradient-aware network with image-specific enhancement (DGANet-ISE) was proposed to improve the spatial resolution of remote sensing images. First, DGANet was proposed to model the complex relationship between low- and high-resolution images. A new gradient-aware loss was designed in the training phase to preserve more gradient details in super-resolved remote sensing images. Then, the ISE approach was proposed in the testing phase to further improve the SR performance. By using the specific features of each test image, ISE can further boost the generalization capability and adaptability of our method on inexperienced datasets. Finally, three datasets were used to verify the effectiveness of our method. The results indicate that DGANet-ISE outperforms the other 14 methods in the remote sensing image SR, and the cross-database test results demonstrate that our method exhibits satisfactory generalization performance in adapting to new data.
Deep learning for semantic segmentation of remote sensing images with rich spectral content

A Hamida,A. Benoît,P. Lambert,L Klein,C Amar,N. Audebert,S. Lefèvre

DOI: https://doi.org/10.48550/arXiv.1712.01600

2017-12-05

Abstract:With the rapid development of Remote Sensing acquisition techniques, there is a need to scale and improve processing tools to cope with the observed increase of both data volume and richness. Among popular techniques in remote sensing, Deep Learning gains increasing interest but depends on the quality of the training data. Therefore, this paper presents recent Deep Learning approaches for fine or coarse land cover semantic segmentation estimation. Various 2D architectures are tested and a new 3D model is introduced in order to jointly process the spatial and spectral dimensions of the data. Such a set of networks enables the comparison of the different spectral fusion schemes. Besides, we also assess the use of a " noisy ground truth " (i.e. outdated and low spatial resolution labels) for training and testing the networks.

Computer Vision and Pattern Recognition,Machine Learning
Editorial to Special Issue "Multispectral Image Acquisition, Processing and Analysis—2nd Edition"

Benoit Vozel,Vladimir Lukin,Yakoub Bazi

DOI: https://doi.org/10.3390/rs16234532

IF: 5

2024-12-04

Remote Sensing

Abstract:Modern means of remote sensing (RS) in general and multispectral imaging in particular have experienced rapid development in recent years [...]

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
Special Section Guest Editorial: Change Detection Using Multi-Source Remotely Sensed Imagery

Xin Huang,Jiayi Li,Francesca Bovolo,Qi Wang

DOI: https://doi.org/10.3390/rs11192216

IF: 5

2019-09-23

Remote Sensing

Abstract:This special issue hosts papers on change detection technologies and analysis in remote sensing, including multi-source sensors, advanced machine learning technologies for change information mining, and the utilization of these technologies in a variety of geospatial applications. The presented results showed improved results when multi-source remote sensed data was used in change detection.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
Advances and Challenges in Deep Learning-Based Change Detection for Remote Sensing Images: A Review through Various Learning Paradigms

Lukang Wang,Min Zhang,Xu Gao,Wenzhong Shi

DOI: https://doi.org/10.3390/rs16050804

IF: 5

2024-02-26

Remote Sensing

Abstract:Change detection (CD) in remote sensing (RS) imagery is a pivotal method for detecting changes in the Earth's surface, finding wide applications in urban planning, disaster management, and national security. Recently, deep learning (DL) has experienced explosive growth and, with its superior capabilities in feature learning and pattern recognition, it has introduced innovative approaches to CD. This review explores the latest techniques, applications, and challenges in DL-based CD, examining them through the lens of various learning paradigms, including fully supervised, semi-supervised, weakly supervised, and unsupervised. Initially, the review introduces the basic network architectures for CD methods using DL. Then, it provides a comprehensive analysis of CD methods under different learning paradigms, summarizing commonly used frameworks. Additionally, an overview of publicly available datasets for CD is offered. Finally, the review addresses the opportunities and challenges in the field, including: (a) incomplete supervised CD, encompassing semi-supervised and weakly supervised methods, which is still in its infancy and requires further in-depth investigation; (b) the potential of self-supervised learning, offering significant opportunities for Few-shot and One-shot Learning of CD; (c) the development of Foundation Models, with their multi-task adaptability, providing new perspectives and tools for CD; and (d) the expansion of data sources, presenting both opportunities and challenges for multimodal CD. These areas suggest promising directions for future research in CD. In conclusion, this review aims to assist researchers in gaining a comprehensive understanding of the CD field.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
A summary of the special issue on remote sensing of land change science with Google earth engine

Le Wang,Chunyuan Diao,George Xian,Dameng Yin,Ying Lu,Shengyuan Zou,Tyler A. Erickson

DOI: https://doi.org/10.1016/j.rse.2020.112002

IF: 13.5

2020-10-01

Remote Sensing of Environment

Abstract:To embrace the burgeoning land change science studies that exploit public-domain cloud-computing platforms such as Google Earth Engine (GEE), for the first time, we organized a special issue entitled "Remote Sensing of Land Change Science with Google Earth Engine" in the journal "Remote Sensing of Environment". This paper serves as a summary to a collection of 19 papers that have been published since the inception of the special issue in November 2017. In particular, we summarized their contributions with regard to two perspectives: what new themes of questions are articulated, what contributions have been made. Taking account of the disciplinary difference, we carried out the summary separately in two major science domains: Remote Sensing of Environment (RSE), i.e., naturally-induced land change, and Remote Sensing of Society (RSS), i.e., human-induced land change. Furthermore, we presented a historical review of the developments of GEE-relevant studies published before our special issue. Finally, we provided a future prospect on how GEE will continue to evolve to further the study of land change science.

environmental sciences,imaging science & photographic technology,remote sensing

Advanced Machine Learning and Deep Learning Approaches for Remote Sensing II

A Comprehensive Survey of Deep Learning in Remote Sensing: Theories, Tools and Challenges for the Community

Advanced Machine Learning and Big Data Analytics in Remote Sensing for Natural Hazards Management

Deep learning in environmental remote sensing: Achievements and challenges

A survey of machine learning and deep learning in remote sensing of geological environment: Challenges, advances, and opportunities

Fine-Grained Image Recognition Methods and Their Applications in Remote Sensing Images: A Review

Foreword to the Special Issue on Pattern Recognition in Remote Sensing

Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art

Special Section Guest Editorial: Advanced Infrared Technology and Remote Sensing Applications II

Deep learning in remote sensing applications: A meta-analysis and review

Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources

Deep learning in remote sensing: a review

Deep Learning Methods for Land Cover and Land Use Classification in Remote Sensing: A Review

Computer Vision and Pattern Recognition for the Analysis of 2D/3D Remote Sensing Data in Geoscience: A Survey

Introduction to the special issue on spatial machine learning

Remote Sensing Single-Image Resolution Improvement Using A Deep Gradient-Aware Network with Image-Specific Enhancement

Deep learning for semantic segmentation of remote sensing images with rich spectral content

Editorial to Special Issue "Multispectral Image Acquisition, Processing and Analysis—2nd Edition"

Special Section Guest Editorial: Change Detection Using Multi-Source Remotely Sensed Imagery

Advances and Challenges in Deep Learning-Based Change Detection for Remote Sensing Images: A Review through Various Learning Paradigms

A summary of the special issue on remote sensing of land change science with Google earth engine