Interpretable Geotechnical Artificial Intelligence (Xgeot-Ai) Application to Demystify Image Recognition of Soil Cracks [Datasets]

Jin‐Jian Xu,Hao Zhang,Chaosheng Tang,Lei Lin,Da-Zhan Zhang,Dianlong Wang,Bin Shi

DOI: https://doi.org/10.5281/zenodo.7353297

2022-01-01

Abstract:Here is the test data for the paper "Interpretable Geoscience Artificial Intelligence (XGeoS-AI): Application to Demystify Image Recognition".

What problem does this paper attempt to address?

Interpretable Geoscience Artificial Intelligence (XGeoS-AI): Application to Demystify Image Recognition

Jin-Jian Xu,Hao Zhang,Chao-Sheng Tang,Lin Li,Bin Shi

DOI: https://doi.org/10.48550/arXiv.2311.04940

2023-11-08

Computer Vision and Pattern Recognition

Abstract:As Earth science enters the era of big data, artificial intelligence (AI) not only offers great potential for solving geoscience problems, but also plays a critical role in accelerating the understanding of the complex, interactive, and multiscale processes of Earth's behavior. As geoscience AI models are progressively utilized for significant predictions in crucial situations, geoscience researchers are increasingly demanding their interpretability and versatility. This study proposes an interpretable geoscience artificial intelligence (XGeoS-AI) framework to unravel the mystery of image recognition in the Earth sciences, and its effectiveness and versatility is demonstrated by taking computed tomography (CT) image recognition as an example. Inspired by the mechanism of human vision, the proposed XGeoS-AI framework generates a threshold value from a local region within the whole image to complete the recognition. Different kinds of artificial intelligence (AI) methods, such as Support Vector Regression (SVR), Multilayer Perceptron (MLP), Convolutional Neural Network (CNN), can be adopted as the AI engines of the proposed XGeoS-AI framework to efficiently complete geoscience image recognition tasks. Experimental results demonstrate that the effectiveness, versatility, and heuristics of the proposed framework have great potential in solving geoscience image recognition problems. Interpretable AI should receive more and more attention in the field of the Earth sciences, which is the key to promoting more rational and wider applications of AI in the field of Earth sciences. In addition, the proposed interpretable framework may be the forerunner of technological innovation in the Earth sciences.
The challenges of integrating explainable artificial intelligence into GeoAI

Jin Xing,Renee Sieber

DOI: https://doi.org/10.1111/tgis.13045

IF: 2.568

2023-04-26

Transactions in GIS

Abstract:Although explainable artificial intelligence (XAI) promises considerable progress in glassboxing deep learning models, there are challenges in applying XAI to geospatial artificial intelligence (GeoAI), specifically geospatial deep neural networks (DNNs). We summarize these as three major challenges, related generally to XAI computation, to GeoAI and geographic data handling, and to geosocial issues. XAI computation includes the difficulty of selecting reference data/models and the shortcomings of attributing explanatory power to gradients, as well as the difficulty in accommodating geographic scale, geovisualization, and underlying geographic data structures. Geosocial challenges encompass the limitations of knowledge scope—semantics and ontologies—in the explanation of GeoAI as well as the lack of integrating non‐technical aspects in XAI, including processes that are not amenable to XAI. We illustrate these issues with a land use classification case study.

geography
Automatic soil crack recognition under uneven illumination condition with the application of artificial intelligence

Jin-Jian Xu,Hao Zhang,Chao-Sheng Tang,Qing Cheng,Ben-gang Tian,Bo Liu,Bin Shi

DOI: https://doi.org/10.1016/j.enggeo.2021.106495

IF: 6.902

2022-01-01

Engineering Geology

Abstract:Drought-induced soil desiccation cracking has attracted great attention in various disciplines with the advent of global climate change. Accurately obtaining soil crack networks is essential to understand the cracking mechanism. Inspired by recent advances of artificial intelligence (AI) in computer vision, we propose a new automatic soil crack recognition method based a novel network architecture, named Attention Res-UNet. Deep Res-UNet inherits both the advantages from residual learning for training deeper networks and U-Net for semantic segmentation. Moreover, attention mechanism is utilized to alleviate the influences caused by the uneven illumination conditions. Firstly, the soil crack images under different uneven illumination conditions are collected to create a new soil cracking image dataset. Then, traditional method and multiple state-of-the-art deep learning based different semantic segmentation models are tested on our collected dataset. Finally, a professional evaluation standard, which considers both the overall metrics (precision, recall, dice, surface crack ratio) and details (crack total length, average crack width, number of crack segments) of the soil crack features is proposed to evaluate the recognition results of the different models. Extensive experimental results demonstrate the superiority of our proposed Attention Res-UNet approach compared with traditional methods and other deep learning models in recognizing soil cracks under complex environmental conditions. Our method is also suitable for crack recognition of other materials under complex environmental conditions.
From classification to segmentation with explainable AI: A study on crack detection and growth monitoring

Florent Forest,Hugo Porta,Devis Tuia,Olga Fink

DOI: https://doi.org/10.1016/j.autcon.2024.105497

IF: 10.3

2024-06-16

Automation in Construction

Abstract:Monitoring surface cracks in infrastructure is crucial for structural health monitoring. Automatic visual inspection offers an effective solution, especially in hard-to-reach areas. Machine learning approaches have proven their effectiveness but typically require large annotated datasets for supervised training. Once a crack is detected, monitoring its severity often demands precise segmentation of the damage. However, pixel-level annotation of images for segmentation is labor-intensive. To mitigate this cost, one can leverage explainable artificial intelligence (XAI) to derive segmentations from the explanations of a classifier, requiring only weak image-level supervision. This paper proposes applying this methodology to segment and monitor surface cracks. We evaluate the performance of various XAI methods and examine how this approach facilitates severity quantification and growth monitoring. Results reveal that while the resulting segmentation masks may exhibit lower quality than those produced by supervised methods, they remain meaningful and enable severity monitoring, thus reducing substantial labeling costs. Code and data available at https://github.com/EPFL-IMOS/crack-explanations .

construction & building technology,engineering, civil
Soil Desiccation Crack Recognition: New Paradigm and Field Application

Jin‐Jian Xu,Hao Zhang,Chao‐Sheng Tang,Yaowen Yang,Lin Li,Dian‐Long Wang,Bo Liu,Bin Shi

DOI: https://doi.org/10.1029/2024jh000347

2024-09-01

Abstract:Abstract Drought‐induced desiccation cracking can trigger several weakening mechanisms in surface soils, which not only potentially create preferential pathways for gravity‐driven flow and contaminant transport, but also contribute to the instability and failure of slopes and earthen structures. With the continuous innovation of artificial intelligence (AI) and the burgeoning emergence of foundation models, soil desiccation crack recognition (SDCR) is currently undergoing a fundamental shift toward a data‐centric paradigm. This study proposes a knowledge‐driven unsupervised framework for SDCR under complicated and volatile field conditions, referred to as U‐CrackNet framework. Pseudo‐labels for crack recognition are generated through a fusion paradigm that combines strong knowledge from the Segment Anything Model (SAM) developed by Meta AI with weak knowledge derived from threshold‐based methods. An innovative low‐parameter and low‐computational semantic segmentation architecture (Lite‐UNet) is proposed to achieve an effective trade‐off between accuracy and inference speed, which facilitates application on portable devices under challenging field environments. Extensive experimental results unequivocally demonstrate the superior performance of the U‐CrackNet framework in recognizing field soil desiccation cracking, surpassing other state‐of‐the‐art methods in both overall and detailed evaluations. The unsupervised and generalized attributes of U‐CrackNet framework hold substantial potential for developing SDCR foundation model, which not only offers an unprecedented level of precision and adaptability in quantification, evaluation, prediction, and decision‐making of soil desiccation crack phenomena, but also provides a novel perspective for unraveling the causal mechanisms underlying observed surface cracking patterns and climate changes.
Neural network attribution methods for problems in geoscience: A novel synthetic benchmark dataset

Antonios Mamalakis,Imme Ebert-Uphoff,Elizabeth A. Barnes

DOI: https://doi.org/10.1017/eds.2022.7

2022-01-01

Environmental Data Science

Abstract:Abstract Despite the increasingly successful application of neural networks to many problems in the geosciences, their complex and nonlinear structure makes the interpretation of their predictions difficult, which limits model trust and does not allow scientists to gain physical insights about the problem at hand. Many different methods have been introduced in the emerging field of eXplainable Artificial Intelligence (XAI), which aims at attributing the network’s prediction to specific features in the input domain. XAI methods are usually assessed by using benchmark datasets (such as MNIST or ImageNet for image classification). However, an objective, theoretically derived ground truth for the attribution is lacking for most of these datasets, making the assessment of XAI in many cases subjective. Also, benchmark datasets specifically designed for problems in geosciences are rare. Here, we provide a framework, based on the use of additively separable functions, to generate attribution benchmark datasets for regression problems for which the ground truth of the attribution is known a priori. We generate a large benchmark dataset and train a fully connected network to learn the underlying function that was used for simulation. We then compare estimated heatmaps from different XAI methods to the ground truth in order to identify examples where specific XAI methods perform well or poorly. We believe that attribution benchmarks as the ones introduced herein are of great importance for further application of neural networks in the geosciences, and for more objective assessment and accurate implementation of XAI methods, which will increase model trust and assist in discovering new science.
Automatic soil desiccation crack recognition using deep learning

Jin-Jian Xu,Hao Zhang,Chao-Sheng Tang,Qing Cheng,Bo Liu,Bin Shi

DOI: https://doi.org/10.1680/jgeot.20.P.091

2022-01-01

Geotechnique

Abstract:Soil desiccation cracking is a common natural phenomenon. The existence of cracks can negatively impact both the mechanical and hydraulic properties of soil. Accurate acquisition of soil crack networks is not only the basis for obtaining the relevant geometrical parameters of crack networks, but also an important foundation and premise for further study about the formation mechanism of shrinkage and desiccation cracking. This study proposes a new automatic soil cracks recognition method based on a U-Net convolutional neural network (CNN) architecture for segmentation on soil desiccation crack images. The backbone of the U-Net encoder is selected as ResNet and a new loss function combining both binary cross-entropy (BCE) loss and dice loss is used during the training stage to fit an imbalance problem. Subsequently, the U-Net with an encoder based on ResNet and a decoder part is trained from end to end on a subset of 524 labelled crack images with 224 x 224 pixels for semantic segmentation. The U-Net architecture achieves 94 center dot 38%, 74 center dot 43% and 81 center dot 13% for precision, recall and dice scores on test sets, which are better than all results using the Otsu threshold method employed in the traditional crack image processing technique. Experimental results reveal that deep learning can achieve higher accuracy than the traditional method (binarisation by thresholding) in quantifying surface crack ratio, average crack width, total crack length and crack number. Moreover, deep learning can not only accurately identify cracks or spots by means of crack edge features, but also can accurately separate soil cracks and clod areas under a bad photographing condition (such as uneven illumination, a field environment or poor photographing angle). Overall, the proposed deep learning-based method presents a satisfactory performance in soil crack image recognition and quantification. It may also be applied to other materials with cracks.
Intelligent image-based identification and 3-D reconstruction of rock fractures: Implementation and application

Dongdong Pan,Yihui Li,Xiaote Wang,Zhenhao Xu

DOI: https://doi.org/10.1016/j.tust.2023.105582

IF: 6.9

2024-01-20

Tunnelling and Underground Space Technology

Abstract:This paper develops a method for intelligent identification and semi-automated extraction of 3D fracture parameters based on images in rock slope or underground engineering. Firstly, the exposed fracture trace is automatically identified by the enhanced deeplabv3 + model. Using transfer training methods, rock fracture images of multi-location and multi-type were used to train the model to improve the generalization ability. Secondly, rock sparse point cloud is generated using Structure from Motion (SfM) algorithm and dense reconstruction of rock is realized by Multi-View Stereo (MVS) method, which serve to transform the 2D fracture features to 3D. Finally, the coordinates of fracture feature points are obtained by fitting the planar features using algorithm. The methodology is validated through three types of data fields: (1) a simple and small-size laboratory installation is made up of two regular-shaped concrete blocks; (2) a slope with outcrop fractures in practical engineering; (3) a palm face from a tunnel project in Xinjiang, China. The error of the discontinuity parameters obtained using this method is about 1 %∼20 %, indicating that the proposed method is effective for parameter extraction and analysis of rock masses.

construction & building technology,engineering, civil
GeoImageNet: a multi-source natural feature benchmark dataset for GeoAI and supervised machine learning

Wenwen Li,Sizhe Wang,Samantha T. Arundel,Chia-Yu Hsu

DOI: https://doi.org/10.1007/s10707-022-00476-z

IF: 2.7729

2022-09-04

GeoInformatica

Abstract:The field of GeoAI or Geospatial Artificial Intelligence has undergone rapid development since 2017. It has been widely applied to address environmental and social science problems, from understanding climate change to tracking the spread of infectious disease. A foundational task in advancing GeoAI research is the creation of open, benchmark datasets to train and evaluate the performance of GeoAI models. While a number of datasets have been published, very few have centered on the natural terrain and its landforms. To bridge this gulf, this paper introduces a first-of-its-kind benchmark dataset, GeoImageNet, which supports natural feature detection in a supervised machine-learning paradigm. A distinctive feature of this dataset is the fusion of multi-source data, including both remote sensing imagery and DEM in depicting spatial objects of interest. This multi-source dataset allows a GeoAI model to extract rich spatio-contextual information to gain stronger confidence in high-precision object detection and recognition. The image dataset is tested with a multi-source GeoAI extension against two well-known object detection models, Faster-RCNN and RetinaNet. The results demonstrate the robustness of the dataset in aiding GeoAI models to achieve convergence and the superiority of multi-source data in yielding much higher prediction accuracy than the commonly used single data source.

computer science, information systems,geography, physical
Tiangong Remote Sensing Natural Scene Intelligent Recognition and Interpretablity Analysis

Kun Liu,Jianglong Li,Guofeng Xu,Peng Wang

DOI: https://doi.org/10.1117/12.2671376

2023-01-01

Abstract:This paper focuses on the intelligent recognition of images in the Tiangong remote sensing image dataset and its interpretability analysis. In this paper, we classified the aforementioned dataset, retrained the Resnet-18 model on the training set, and then verified the results on the validation set with an accuracy of 97.9%. Furthermore, this paper presented an interpretability analysis of deep learning for intelligent recognition of the Tiangong remote sensing image dataset.
GeoAI in Social Science

Wenwen Li

2023-12-20

Abstract:GeoAI, or geospatial artificial intelligence, is an exciting new area that leverages artificial intelligence (AI), geospatial big data, and massive computing power to solve problems with high automation and intelligence. This paper reviews the progress of AI in social science research, highlighting important advancements in using GeoAI to fill critical data and knowledge gaps. It also discusses the importance of breaking down data silos, accelerating convergence among GeoAI research methods, as well as moving GeoAI beyond geospatial benefits.

Computers and Society,Artificial Intelligence
Towards Explainable Artificial Intelligence (XAI): A Data Mining Perspective

Haoyi Xiong,Xuhong Li,Xiaofei Zhang,Jiamin Chen,Xinhao Sun,Yuchen Li,Zeyi Sun,Mengnan Du

2024-01-13

Abstract:Given the complexity and lack of transparency in deep neural networks (DNNs), extensive efforts have been made to make these systems more interpretable or explain their behaviors in accessible terms. Unlike most reviews, which focus on algorithmic and model-centric perspectives, this work takes a "data-centric" view, examining how data collection, processing, and analysis contribute to explainable AI (XAI). We categorize existing work into three categories subject to their purposes: interpretations of deep models, referring to feature attributions and reasoning processes that correlate data points with model outputs; influences of training data, examining the impact of training data nuances, such as data valuation and sample anomalies, on decision-making processes; and insights of domain knowledge, discovering latent patterns and fostering new knowledge from data and models to advance social values and scientific discovery. Specifically, we distill XAI methodologies into data mining operations on training and testing data across modalities, such as images, text, and tabular data, as well as on training logs, checkpoints, models and other DNN behavior descriptors. In this way, our study offers a comprehensive, data-centric examination of XAI from a lens of data mining methods and applications.

Artificial Intelligence,Machine Learning
XAI-FUNGI: Dataset resulting from the user study on comprehensibility of explainable AI algorithms

Szymon Bobek,Paloma Korycińska,Monika Krakowska,Maciej Mozolewski,Dorota Rak,Magdalena Zych,Magdalena Wójcik,Grzegorz J. Nalepa

2024-10-21

Abstract:This paper introduces a dataset that is the result of a user study on the comprehensibility of explainable artificial intelligence (XAI) algorithms. The study participants were recruited from 149 candidates to form three groups representing experts in the domain of mycology (DE), students with a data science and visualization background (IT) and students from social sciences and humanities (SSH). The main part of the dataset contains 39 transcripts of interviews during which participants were asked to complete a series of tasks and questions related to the interpretation of explanations of decisions of a machine learning model trained to distinguish between edible and inedible mushrooms. The transcripts were complemented with additional data that includes visualizations of explanations presented to the user, results from thematic analysis, recommendations of improvements of explanations provided by the participants, and the initial survey results that allow to determine the domain knowledge of the participant and data analysis literacy. The transcripts were manually tagged to allow for automatic matching between the text and other data related to particular fragments. In the advent of the area of rapid development of XAI techniques, the need for a multidisciplinary qualitative evaluation of explainability is one of the emerging topics in the community. Our dataset allows not only to reproduce the study we conducted, but also to open a wide range of possibilities for the analysis of the material we gathered.

Computers and Society,Artificial Intelligence,Machine Learning
Explainable GeoAI: can saliency maps help interpret artificial intelligence's learning process? An empirical study on natural feature detection

Chia-Yu Hsu,Wenwen Li

DOI: https://doi.org/10.1080/13658816.2023.2191256

2023-03-25

International Journal of Geographical Information Science

Abstract:Improving the interpretability of geospatial artificial intelligence (GeoAI) models has become critically important to open the 'black box' of complex AI models, such as deep learning. This paper compares popular saliency map generation techniques and their strengths and weaknesses in interpreting GeoAI and deep learning models' reasoning behaviors, particularly when applied to geospatial analysis and image processing tasks. We surveyed two broad classes of model explanation methods: perturbation-based and gradient-based methods. The former identifies important image areas, which help machines make predictions by modifying a localized area of the input image. The latter evaluates the contribution of every single pixel of the input image to the model's prediction results through gradient backpropagation. In this study, three algorithms—the occlusion method, the integrated gradients method, and the class activation map method—are examined for a natural feature detection task using deep learning. The algorithms' strengths and weaknesses are discussed, and the consistency between model-learned and human-understandable concepts for object recognition is also compared. The experiments used two GeoAI-ready datasets to demonstrate the generalizability of the research findings.

geography, physical,computer science, information systems,information science & library science
GeoGLUE: A GeoGraphic Language Understanding Evaluation Benchmark

Dongyang Li,Ruixue Ding,Qiang Zhang,Zheng Li,Boli Chen,Pengjun Xie,Yao Xu,Xin Li,Ning Guo,Fei Huang,Xiaofeng He

DOI: https://doi.org/10.48550/arXiv.2305.06545

2023-05-11

Abstract:With a fast developing pace of geographic applications, automatable and intelligent models are essential to be designed to handle the large volume of information. However, few researchers focus on geographic natural language processing, and there has never been a benchmark to build a unified standard. In this work, we propose a GeoGraphic Language Understanding Evaluation benchmark, named GeoGLUE. We collect data from open-released geographic resources and introduce six natural language understanding tasks, including geographic textual similarity on recall, geographic textual similarity on rerank, geographic elements tagging, geographic composition analysis, geographic where what cut, and geographic entity alignment. We also pro vide evaluation experiments and analysis of general baselines, indicating the effectiveness and significance of the GeoGLUE benchmark.

Computation and Language,Artificial Intelligence
Evaluating explainable artificial intelligence methods for multi-label deep learning classification tasks in remote sensing

Ioannis Kakogeorgiou,Konstantinos Karantzalos

DOI: https://doi.org/10.1016/j.jag.2021.102520

2021-09-20

Abstract:Although deep neural networks hold the state-of-the-art in several remote sensing tasks, their black-box operation hinders the understanding of their decisions, concealing any bias and other shortcomings in datasets and model performance. To this end, we have applied explainable artificial intelligence (XAI) methods in remote sensing multi-label classification tasks towards producing human-interpretable explanations and improve transparency. In particular, we utilized and trained deep learning models with state-of-the-art performance in the benchmark BigEarthNet and SEN12MS datasets. Ten XAI methods were employed towards understanding and interpreting models' predictions, along with quantitative metrics to assess and compare their performance. Numerous experiments were performed to assess the overall performance of XAI methods for straightforward prediction cases, competing multiple labels, as well as misclassification cases. According to our findings, Occlusion, Grad-CAM and Lime were the most interpretable and reliable XAI methods. However, none delivers high-resolution outputs, while apart from Grad-CAM, both Lime and Occlusion are computationally expensive. We also highlight different aspects of XAI performance and elaborate with insights on black-box decisions in order to improve transparency, understand their behavior and reveal, as well, datasets' particularities.

Machine Learning,Computer Vision and Pattern Recognition
Deep learning based approach for the instance segmentation of clayey soil desiccation cracks

Xiao-Le Han,Ning-Jun Jiang,Yu-Fei Yang,Jongseong Choi,Devandra N. Singh,Priyanka Beta,Yan-Jun Du,Yi-Jie Wang

DOI: https://doi.org/10.1016/j.compgeo.2022.104733

IF: 5.218

2022-06-01

Computers and Geotechnics

Abstract:The identification of clayey soil desiccation cracks is an important practical issue in geotechnical engineering and engineering geology. The desiccation cracks can dramatically increase the hydraulic conductivity and deteriorate the mechanical performances of clayey soils. Traditionally, the analysis of soil desiccation cracks relies on visual inspection and image processing techniques, which lack automation and intelligence. Therefore, there is an increasing need for an automated algorithm to meet accuracy and efficiency requirements for various engineering scenarios. In this study, a state-of-the-art deep-learning algorithm, Mask R-CNN, was utilized for the clayey soil crack detection, localization and segmentation. A comprehensive dataset including 1200 annotated crack images of 256 × 256 resolution was prepared for the algorithm training and validation. The proposed Mask R-CNN algorithm achieved precision, recall and F1 score of 73.29%, 82.76% and 77.74%, respectively. Besides, the algorithm gained a mean localization accuracy (APbb) of 64.14% and a mean segmentation accuracy (APm) of 47.59%. The detection performance of the Mask R-CNN was also compared with that of the U-Net under three different scenarios. The test results have demonstrated the superiority of the Mask R-CNN over the U-Net algorithm in crack detection, localization and segmentation.

computer science, interdisciplinary applications,geosciences, multidisciplinary,engineering, geological
An open dataset for intelligent recognition and classification of abnormal condition in longwall mining

Wenjuan Yang,Xuhui Zhang,Bing Ma,Yanqun Wang,Yujia Wu,Jianxing Yan,Yongwei Liu,Chao Zhang,Jicheng Wan,Yue Wang,Mengyao Huang,Yuyang Li,Dian Zhao

DOI: https://doi.org/10.1038/s41597-023-02322-9

2023-06-28

Scientific Data

Abstract:The underground coal mine production of the fully mechanized mining face exists many problems, such as poor operating environment, high accident rate and so on. Recently, the intelligent autonomous coal mining is gradually replacing the traditional mining process. The artificial intelligence technology is an active research area and is expect to identify and warn the underground abnormal conditions for intelligent longwall mining. It is inseparable from the construction of datasets, but the downhole dataset is still blank at present. This work develops an image dataset of underground longwall mining face (DsLMF+), which consists of 138004 images with annotation 6 categories of mine personnel, hydraulic support guard plate, large coal, towline, miners' behaviour and mine safety helmet. All the labels of dataset are publicly available in YOLO format and COCO format. The availability and accuracy of the datasets were reviewed by experts in coal mine field. The dataset is open access and aims to support further research and advancement of the intelligent identification and classification of abnormal conditions for underground mining.

multidisciplinary sciences
AI Security for Geoscience and Remote Sensing: Challenges and Future Trends

Yonghao Xu,Tao Bai,Weikang Yu,Shizhen Chang,Peter M. Atkinson,Pedram Ghamisi

DOI: https://doi.org/10.1109/MGRS.2023.3272825

2023-06-22

Abstract:Recent advances in artificial intelligence (AI) have significantly intensified research in the geoscience and remote sensing (RS) field. AI algorithms, especially deep learning-based ones, have been developed and applied widely to RS data analysis. The successful application of AI covers almost all aspects of Earth observation (EO) missions, from low-level vision tasks like super-resolution, denoising and inpainting, to high-level vision tasks like scene classification, object detection and semantic segmentation. While AI techniques enable researchers to observe and understand the Earth more accurately, the vulnerability and uncertainty of AI models deserve further attention, considering that many geoscience and RS tasks are highly safety-critical. This paper reviews the current development of AI security in the geoscience and RS field, covering the following five important aspects: adversarial attack, backdoor attack, federated learning, uncertainty and explainability. Moreover, the potential opportunities and trends are discussed to provide insights for future research. To the best of the authors' knowledge, this paper is the first attempt to provide a systematic review of AI security-related research in the geoscience and RS community. Available code and datasets are also listed in the paper to move this vibrant field of research forward.

Computer Vision and Pattern Recognition

Interpretable Geotechnical Artificial Intelligence (Xgeot-Ai) Application to Demystify Image Recognition of Soil Cracks [Datasets]

Interpretable Geoscience Artificial Intelligence (XGeoS-AI): Application to Demystify Image Recognition

The challenges of integrating explainable artificial intelligence into GeoAI

Automatic soil crack recognition under uneven illumination condition with the application of artificial intelligence

From classification to segmentation with explainable AI: A study on crack detection and growth monitoring

Soil Desiccation Crack Recognition: New Paradigm and Field Application

Neural network attribution methods for problems in geoscience: A novel synthetic benchmark dataset

Automatic soil desiccation crack recognition using deep learning

Intelligent image-based identification and 3-D reconstruction of rock fractures: Implementation and application

GeoImageNet: a multi-source natural feature benchmark dataset for GeoAI and supervised machine learning

Tiangong Remote Sensing Natural Scene Intelligent Recognition and Interpretablity Analysis

GeoAI in Social Science

Towards Explainable Artificial Intelligence (XAI): A Data Mining Perspective

XAI-FUNGI: Dataset resulting from the user study on comprehensibility of explainable AI algorithms

Explainable GeoAI: can saliency maps help interpret artificial intelligence's learning process? An empirical study on natural feature detection

GeoGLUE: A GeoGraphic Language Understanding Evaluation Benchmark

Evaluating explainable artificial intelligence methods for multi-label deep learning classification tasks in remote sensing

Deep learning based approach for the instance segmentation of clayey soil desiccation cracks

An open dataset for intelligent recognition and classification of abnormal condition in longwall mining

AI Security for Geoscience and Remote Sensing: Challenges and Future Trends