Primary intraosseous carcinoma of the anterior maxilla: report of a new case.

I. A. El-naaj,A. Krausz,L. Ardekian,M. Peled

DOI: https://doi.org/10.1016/J.JOMS.2004.05.227

IF: 1.9

2005-03-01

Journal of Oral and Maxillofacial Surgery

Abstract:

What problem does this paper attempt to address?

Superpixel-Based Long-Range Dependent Network for High-Resolution Remote-Sensing Image Classification

Liangzhi Li,Ling Han,Qing Miao,Yang Zhang,Ying Jing

DOI: https://doi.org/10.3390/land11112028

IF: 3.905

2022-01-01

Land

Abstract:Data-driven deep neural networks have demonstrated their superiority in high-resolution remote-sensing image (HRSI) classification based on superpixel-based objects. Currently, most HRSI classification methods that combine deep learning and superpixel object segmentation use multiple scales of stacking to satisfy the contextual semantic-information extraction of one analyzed object. However, this approach does not consider the long-distance dependencies between objects, which not only weakens the representation of feature information but also increases computational redundancy. To solve this problem, a superpixel-based long-range dependent network is proposed for HRSI classification. First, a superpixel segmentation algorithm is used to segment HRSI into homogeneous analysis objects as input. Secondly, a multi-channel deep convolutional neural network is proposed for the feature mapping of the analysis objects. Finally, we design a long-range dependent framework based on a long short-term memory (LSTM) network for obtaining contextual relationships and outputting classes of analysis objects. Additionally, we define the semantic range and investigate how it affects classification accuracy. A test is conducted by using two HRSI with overall accuracy (0.79, 0.76) and kappa coefficients (kappa) (0.92, 0.89). Both qualitative and quantitative comparisons are adopted to test the proposed method's efficacy. Findings concluded that the proposed method is competitive and consistently superior to the benchmark comparison method.
Super-Resolved Segmentation of X-ray Images of Carbonate Rocks Using Deep Learning

Naif J. Alqahtani,Yufu Niu,Ying Da Wang,Traiwit Chung,Zakhar Lanetc,Aleksandr Zhuravljov,Ryan T. Armstrong,Peyman Mostaghimi

DOI: https://doi.org/10.1007/s11242-022-01781-9

IF: 3.6097

2022-04-28

Transport in Porous Media

Abstract:Abstract Reliable quantitative analysis of digital rock images requires precise segmentation and identification of the macroporosity, sub-resolution porosity, and solid\mineral phases. This is highly emphasized in heterogeneous rocks with complex pore size distributions such as carbonates. Multi-label segmentation of carbonates using classic segmentation methods such as multi-thresholding is highly sensitive to user bias and often fails in identifying low-contrast sub-resolution porosity. In recent years, deep learning has introduced efficient and automated algorithms that are capable of handling hard tasks with precision comparable to human performance, with application to digital rocks super-resolution and segmentation emerging. Here, we present a framework for using convolutional neural networks (CNNs) to produce super-resolved segmentations of carbonates rock images for the objective of identifying sub-resolution porosity. The volumes used for training and testing are based on two different carbonates rocks imaged in-house at low and high resolutions. We experiment with various implementations of CNNs architectures where super-resolved segmentation is obtained in an end-to-end scheme and using two networks (super-resolution and segmentation) separately. We show the capability of the trained model of producing accurate segmentation by comparing multiple voxel-wise segmentation accuracy metrics, topological features, and measuring effective properties. The results underline the value of integrating deep learning frameworks in digital rock analysis.

engineering, chemical
CarbonNet: How Computer Vision Plays a Role in Climate Change? Application: Learning Geomechanics from Subsurface Geometry of CCS to Mitigate Global Warming

Wei Chen,Yunan Li,Yuan Tian

DOI: https://doi.org/10.48550/arXiv.2403.06025

2024-03-19

Abstract:We introduce a new approach using computer vision to predict the land surface displacement from subsurface geometry images for Carbon Capture and Sequestration (CCS). CCS has been proved to be a key component for a carbon neutral society. However, scientists see there are challenges along the way including the high computational cost due to the large model scale and limitations to generalize a pre-trained model with complex physics. We tackle those challenges by training models directly from the subsurface geometry images. The goal is to understand the respons of land surface displacement due to carbon injection and utilize our trained models to inform decision making in CCS projects. We implement multiple models (CNN, ResNet, and ResNetUNet) for static mechanics problem, which is a image prediction problem. Next, we use the LSTM and transformer for transient mechanics scenario, which is a video prediction problem. It shows ResNetUNet outperforms the others thanks to its architecture in static mechanics problem, and LSTM shows comparable performance to transformer in transient problem. This report proceeds by outlining our dataset in detail followed by model descriptions in method section. Result and discussion state the key learning, observations, and conclusion with future work rounds out the paper.

Computer Vision and Pattern Recognition,Artificial Intelligence
A lightweight convolutional neural network based on dense connection for open-pit coal mine service identification using the edge-cloud architecture

DOI: https://doi.org/10.1186/s13677-023-00407-9

2023-03-08

Journal of Cloud Computing

Abstract:Remote sensing is an important technical tool for rapid detection of illegal mining behavior. Due to the complex features of open-pit coal mines, there are few studies about automatic extraction of open-pit coal mines. Based on Convolutional Neural Network and Dense Block, we propose a lightweight densely connected network-AD-Net for the extraction of open-pit coal mining areas from Sentinel-2 remote sensing images, and construct three sample libraries of open-pit coal mining areas in north-central Xinzhou City, Shanxi Province. The AD-Net model consists of two convolutional layers, two pooling layers, a channel attention module, and a Dense Block. The two convolutional layers greatly reduce the complexity of the model, and the Dense Block enhances the feature propagation while reducing the parameter computation. The application is designed in different modules that runs independently on different machines and communicate with each other. Furthermore, we create and build a unique remote sensing image service system that connects a remote datacentre and its associated edge networks, employing the edge-cloud architecture. While the datacentre acts as the cloud platform and is in charge of storing and processing the original remote sensing images, the edge network is largely utilised for caching, predicting, and disseminating the processed images. First, we find out the optimal optimizer and the optimal size of the input image by extensive experiments, and then we compare the extraction effect of AD-Net with AlexNet, VGG-16, GoogLeNet, Xception, ResNet50, and DenseNet121 models in the study area. The experimental results show that the combination of NIR, red, green, and blue band synthesis is more suitable for the extraction of the open-pit coal mine, and the OA and Kappa of AD-Net reach 0.959 and 0.918 respectively, which is better than other models and well balances the classification accuracy and running speed. With this design of edge-cloud, the proposed system not only evenly distributes the strain of processing activities across the edges but also achieves data efficiency among them, reducing the cost of data transmission and improving the latency.
Segmentation for Multi-Rock Types on Digital Outcrop Photographs Using Deep Learning Techniques

Idrus Puasa,Daphne Teck Ching Lai,Owais A. Malik

DOI: https://doi.org/10.3390/s22218086

IF: 3.9

2022-10-23

Sensors

Abstract:The basic identification and classification of sedimentary rocks into sandstone and mudstone are important in the study of sedimentology and they are executed by a sedimentologist. However, such manual activity involves countless hours of observation and data collection prior to any interpretation. When such activity is conducted in the field as part of an outcrop study, the sedimentologist is likely to be exposed to challenging conditions such as the weather and their accessibility to the outcrops. This study uses high-resolution photographs which are acquired from a sedimentological study to test an alternative basic multi-rock identification through machine learning. While existing studies have effectively applied deep learning techniques to classify the rock types in field rock images, their approaches only handle a single rock-type classification per image. One study applied deep learning techniques to classify multi-rock types in each image; however, the test was performed on artificially overlaid images of different rock types in a test sample and not of naturally occurring rock surfaces of multiple rock types. To the best of our knowledge, no study has applied semantic segmentation to solve the multi-rock classification problem using digital photographs of multiple rock types. This paper presents the application of two state-of-the-art segmentation models, namely U-Net and LinkNet, to identify multiple rock types in digital photographs by segmenting the sandstone, mudstone, and background classes in a self-collected dataset of 102 images from a field in Brunei Darussalam. Four pre-trained networks, including Resnet34, Inceptionv3, VGG16, and Efficientnetb7 were used as a backbone for both models, and the performances of the individual models and their ensembles were compared. We also investigated the impact of image enhancement and different color representations on the performances of these segmentation models. The experiment results of this study show that among the individual models, LinkNet with Efficientnetb7 as a backbone had the best performance with a mean over intersection (MIoU) value of 0.8135 for all of the classes. While the ensemble of U-Net models (with all four backbones) performed slightly better than the LinkNet with Efficientnetb7 did with an MIoU of 0.8201. When different color representations and image enhancements were explored, the best performance (MIoU = 0.8178) was noticed for the L*a*b* color representation with Efficientnetb7 using U-Net segmentation. For the individual classes of interest (sandstone and mudstone), U-Net with Efficientnetb7 was found to be the best model for the segmentation. Thus, this study presents the potential of semantic segmentation in automating the reservoir characterization process whereby we can extract the patches of interest from the rocks for much deeper study and modeling to be conducted.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Design and implementation of an Automatic Deep Stacked Sparsely Connected Convolutional Autoencoder (ADSSCCA) neural network for remote sensing lithological mapping using calculated dropout

Charlie Gael Atangana Otele,Mathias Akong Onabid,Patrick Stephane Assembe

DOI: https://doi.org/10.1007/s12145-024-01257-y

2024-03-12

Earth Science Informatics

Abstract:The accurate mapping of lithological units in tropical environments characterised by dense forest, persistent cloud cover, and limited bedrock exposures from remote sensing data is very challenging. In this paper, we propose the design and implementation of an Automatic Deep Stacked Sparsely Connected Convolutional Autoencoder (ADSSCCA) neural network for lithological mapping without data filtering. The model integrates convolutional neural networks architecture with Principal Component Analysis for feature extraction and dimensionality reduction. We also combine 3D and 2D convolutions to generate feature maps, and the fully connected block is configured using the ADSSCA philosophy with dropout calculated as a function of model capacity. The dropout serves to randomly drop hidden computing units and their connections during training, thus reducing overfitting and improving the model's generalization ability. The proposed classification model was tested on non-processed Landsat-8 images from the Yaounde-Sangmelima region in southern Cameroon. The proposed ADSSCCA mapped the five dominant lithological classes namely, gneisses, schists, micaschists, biotite-granites and pyroxene-granites with an impressive overall accuracy of 99.85%. The novelty in this study is the removal of the pre-processing stage which results in a simplified work flow, reduces overhead and preserves data integrity. Secondly, the introduction of dynamically calculated dropout based on neuron and layer count enhances generalization. It is expected that; this new finding will enhance lithological mapping and analysis in the forest zones and areas with similar characteristics.

geosciences, multidisciplinary,computer science, interdisciplinary applications
RockSeg: A Novel Semantic Segmentation Network Based on a Hybrid Framework Combining a Convolutional Neural Network and Transformer for Deep Space Rock Images

Lili Fan,Jiabin Yuan,Xuewei Niu,Keke Zha,Weiqi Ma

DOI: https://doi.org/10.3390/rs15163935

IF: 5

2023-08-10

Remote Sensing

Abstract:Rock detection on the surface of celestial bodies is critical in the deep space environment for obstacle avoidance and path planning of space probes. However, in the remote and complex deep environment, rocks have the characteristics of irregular shape, being similar to the background, sparse pixel characteristics, and being easy for light and dust to affect. Most existing methods face significant challenges to attain high accuracy and low computational complexity in rock detection. In this paper, we propose a novel semantic segmentation network based on a hybrid framework combining CNN and transformer for deep space rock images, namely RockSeg. The network includes a multiscale low-level feature fusion (MSF) module and an efficient backbone network for feature extraction to achieve the effective segmentation of the rocks. Firstly, in the network encoder, we propose a new backbone network (Resnet-T) that combines the part of the Resnet backbone and the transformer block with a multi-headed attention mechanism to capture the global context information. Additionally, a simple and efficient multiscale feature fusion module is designed to fuse low-level features at different scales to generate richer and more detailed feature maps. In the network decoder, these feature maps are integrated with the output feature maps to obtain more precise semantic segmentation results. Finally, we conduct experiments on two deep space rock datasets: the MoonData and MarsData datasets. The experimental results demonstrate that the proposed model outperforms state-of-the-art rock detection algorithms under the conditions of low computational complexity and fast inference speed.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
Synergistic application of digital outcrop characterization techniques and deep learning algorithms in geological exploration

Zhicheng Dong,Pan Tang,Gongyang Chen,Senlin Yin

DOI: https://doi.org/10.1038/s41598-024-74903-6

IF: 4.6

2024-10-04

Scientific Reports

Abstract:In order to meet the needs of geologists for the analysis of data characterizing field outcrops (rock sections or formations exposed on the ground surface), this study developed a field digital outcrop visualization platform based on Cesium (a 3D geospatial visualization technology) digital outcrop characterization technology. The platform was developed based on WebGL (a protocol for rendering interactions on web pages), which overcame the shortcomings of traditional software in terms of visualization, cross-device, cross-platform, and ease of use. Firstly, UAV inclined photography is used for data collection, which transforms a large amount of geological data into an intuitive 3D geological model, while the visualization platform provides rich measurement and mapping tools for the identified features, which more intuitively displays the outcrop information, helps geological explorers to understand the geological conditions in the field more quickly and comprehensively, and improves the analysis efficiency and ease-of-use of outcrop characterization data. Combined with the improved VGG19 (a deep convolutional neural network architecture) algorithm model, it has excellent performance in dealing with the fine texture and complex structure of rocks, which significantly improves the accuracy of lithology identification. The synergistic application of this technology provides geologists with a faster and more comprehensive means to understand the geological conditions in the field. The reliability of combining the Cesium digital outcrop characterization technology with the VGG19 lithology identification algorithm in geological exploration is verified through case studies. The synergistic application of this technology will greatly enhance the efficiency and ease of analysis of outcrop characterization in the field, and provide new perspectives for future research in geosciences.

multidisciplinary sciences
Automatic Carbonate Rock Facies Identification with Deep Learning

Sonali Pattnaik,Songhua Chen,Adly Helba,Shouxiang Ma

DOI: https://doi.org/10.2118/201673-ms

2020-10-19

Abstract:Abstract Linking depositional properties and post-depositional diagenetic modifications of a rock with its petrophysical attributes remains a greatest challenge for carbonate rock characterization, formation evaluation and petrophysical rock typing. Generally, characterization of carbonate rock facies is labor intensive which requires an experienced geologist to interpret and integrate core, petrographic thin-sections and borehole image logs. In this approach, the carbonate lithofacies are identified with an emphasis on the diagenetic features, such as grain packing, micritization, cementation and dolomitization as well as diagenetic/karstic dissolution, and related connected or partial connected interparticle pores, intraparticle pores, separate and oversized vugs and micrite micro-porosity, etc. Here, we focused on developing deep learning based technique for automatizing manual facies identification process, a powerful tool to provide consistent and faster turnaround interpretations of geological facies for applications such as petrophysical parameter prediction. In this paper, an architecture for unsupervised multi-class semantic segmentation of carbonate facies that incorporates deep U-Net based architecture is presented. The advantages of using such a network comes from adding skip connections which allows better flow of information in the network. This in return ensures comparable performances along with better feature representation for semantic segmentation tasks. Although many machine learning techniques have been previously applied for facies image analysis automation, the foundation is always the effectiveness of segmentation of multiple overlapping objects in the image. In case of carbonate rocks, diagenesis multiplies the heterogeneity complication. Therefore, in order to deal with this heterogeneity of carbonates we focused on unsupervised approaches because supervised learning methods can become very impractical due to the daunting task of manual feature labeling. Multiple experiments are conducted on representative images of three types of carbonate facies (grainstone, rudstone, and packstone) to evaluate the performance of our segmentation algorithm and provide quantitative metrics useful for geological and petrophysical applications. Additionally, the segmentation algorithm is also used to detect primary resistive features from resistivity based borehole images. The consistent segmentation results have proved both the effectiveness and validity of the algorithm.
MudrockNet: Semantic Segmentation of Mudrock SEM Images through Deep Learning

Abhishek Bihani,Hugh Daigle,Javier E. Santos,Christopher Landry,Masa Prodanovic,Kitty Milliken

DOI: https://doi.org/10.1016/j.cageo.2021.104952

2021-02-06

Abstract:Segmentation and analysis of individual pores and grains of mudrocks from scanning electron microscope images is non-trivial because of noise, imaging artifacts, variation in pixel grayscale values across images, and overlaps in grayscale values among different physical features such as silt grains, clay grains, and pores in an image, which make their identification difficult. Moreover, because grains and pores often have overlapping grayscale values, direct application of threshold-based segmentation techniques is not sufficient. Recent advances in the field of computer vision have made it easier and faster to segment images and identify multiple occurrences of such features in an image, provided that ground-truth data for training the algorithm is available. Here, we propose a deep learning SEM image segmentation model, MudrockNet based on Google's DeepLab-v3+ architecture implemented with the TensorFlow library. The ground-truth data was obtained from an image-processing workflow applied to scanning electron microscope images of uncemented muds from the Kumano Basin offshore Japan at depths < 1.1 km. The trained deep learning model obtained a pixel-accuracy about 90%, and predictions for the test data obtained a mean intersection over union (IoU) of 0.6591 for silt grains and 0.6642 for pores. We also compared our model with the random forest classifier using trainable Weka segmentation in ImageJ, and it was observed that MudrockNet gave better predictions for both silt grains and pores. The size, concentration, and spatial arrangement of the silt and clay grains can affect the petrophysical properties of a mudrock, and an automated method to accurately identify the different grains and pores in mudrocks can help improve reservoir and seal characterization for petroleum exploration and anthropogenic waste sequestration.

Computer Vision and Pattern Recognition,Image and Video Processing,Geophysics
Uncertainty Quantification Based on Deep-Learning Approach Integrating Time-Lapse Seismic Data for Geological Carbon Storage

Hyunmin Kim,Hyundon Shin,Honggeun Jo

DOI: https://doi.org/10.2113/2024/lithosphere_2024_209

2024-12-01

Lithosphere

Abstract:Carbon capture and storage (CCS) is a crucial technology for reducing greenhouse gas emissions to achieve net-zero goals by 2050. Reasonable assessment of CO2 plume behavior through reliable subsurface characterization and continuous monitoring (e.g., time-lapse seismic) is a prerequisite for the successful implementation CCS. However, the scarcity of data acquisition and the high degree of error during seismic inversion have hindered successful subsurface characterization and monitoring for CCS in many previous attempts. In this study, we propose a novel workflow that integrates time-lapse seismic data into subsurface model characterization with the assistance of deep learning. The suggested workflow demonstrates enhanced reservoir characterization performance and accurate prediction of future CO2 plume behavior. The study consists of three main components: (1) a seismic forward model, which generates synthetic time-lapse seismic data from relevant acoustic attributes such as porosity, density, and P-wave velocity; (2) a deep learning model based on generative adversarial networks (GANs), which inputs seismic data and outputs porosity and facies properties; and (3) a demonstration of the workflow in an anticline saline aquifer. By integrating initial and 5 years postinjection seismic data, the proposed workflow enables the creation of a more accurate ensemble of subsurface models compared to the initial ensemble. This approach effectively handles multiple possible geological scenarios and added noise in the seismic data, resulting in better predictions of future CO2 plume behavior.

geochemistry & geophysics,geology
Connect the Dots: In Situ 4D Seismic Monitoring of CO2 Storage with Spatio-temporal CNNs

Shihang Feng,Xitong Zhang,Brendt Wohlberg,Neill Symons,Youzuo Lin

DOI: https://doi.org/10.1109/TGRS.2021.3116618

2021-08-25

Abstract:4D seismic imaging has been widely used in CO$_2$ sequestration projects to monitor the fluid flow in the volumetric subsurface region that is not sampled by wells. Ideally, real-time monitoring and near-future forecasting would provide site operators with great insights to understand the dynamics of the subsurface reservoir and assess any potential risks. However, due to obstacles such as high deployment cost, availability of acquisition equipment, exclusion zones around surface structures, only very sparse seismic imaging data can be obtained during monitoring. That leads to an unavoidable and growing knowledge gap over time. The operator needs to understand the fluid flow throughout the project lifetime and the seismic data are only available at a limited number of times. This is insufficient for understanding the reservoir behavior. To overcome those challenges, we have developed spatio-temporal neural-network-based models that can produce high-fidelity interpolated or extrapolated images effectively and efficiently. Specifically, our models are built on an autoencoder, and incorporate the long short-term memory (LSTM) structure with a new loss function regularized by optical flow. We validate the performance of our models using real 4D post-stack seismic imaging data acquired at the Sleipner CO$_2$ sequestration field. We employ two different strategies in evaluating our models. Numerically, we compare our models with different baseline approaches using classic pixel-based metrics. We also conduct a blind survey and collect a total of 20 responses from domain experts to evaluate the quality of data generated by our models. Via both numerical and expert evaluation, we conclude that our models can produce high-quality 2D/3D seismic imaging data at a reasonable cost, offering the possibility of real-time monitoring or even near-future forecasting of the CO$_2$ storage reservoir.

Geophysics,Machine Learning
Classification of Very-High-Spatial-Resolution Aerial Images Based on Multiscale Features with Limited Semantic Information

Han Gao,Jinhui Guo,Peng Guo,Xiuwan Chen

DOI: https://doi.org/10.3390/rs13030364

IF: 5

2021-01-01

Remote Sensing

Abstract:Recently, deep learning has become the most innovative trend for a variety of high-spatial-resolution remote sensing imaging applications. However, large-scale land cover classification via traditional convolutional neural networks (CNNs) with sliding windows is computationally expensive and produces coarse results. Additionally, although such supervised learning approaches have performed well, collecting and annotating datasets for every task are extremely laborious, especially for those fully supervised cases where the pixel-level ground-truth labels are dense. In this work, we propose a new object-oriented deep learning framework that leverages residual networks with different depths to learn adjacent feature representations by embedding a multibranch architecture in the deep learning pipeline. The idea is to exploit limited training data at different neighboring scales to make a tradeoff between weak semantics and strong feature representations for operational land cover mapping tasks. We draw from established geographic object-based image analysis (GEOBIA) as an auxiliary module to reduce the computational burden of spatial reasoning and optimize the classification boundaries. We evaluated the proposed approach on two subdecimeter-resolution datasets involving both urban and rural landscapes. It presented better classification accuracy (88.9%) compared to traditional object-based deep learning methods and achieves an excellent inference time (11.3 s/ha).
Integrating deep learning and logging data analytics for lithofacies classification and 3D modeling of tight sandstone reservoirs

Jing-Jing Liu,Jian-Chao Liu

DOI: https://doi.org/10.1016/j.gsf.2021.101311

IF: 8.9

2022-01-01

Geoscience Frontiers

Abstract:Hybrid CNN-LSTM model applied to lithofacies classification for the first time.Hybrid model performed better than the other models.Application of borderline SMOTE algorithm greatly improve the accuracy of the model.Proposed model tested by 3D geological models.The lithofacies classification is essential for oil and gas reservoir exploration and development. The traditional method of lithofacies classification is based on "core calibration logging" and the experience of geologists. This approach has strong subjectivity, low efficiency, and high uncertainty. This uncertainty may be one of the key factors affecting the results of 3D modeling of tight sandstone reservoirs. In recent years, deep learning, which is a cutting-edge artificial intelligence technology, has attracted attention from various fields. However, the study of deep-learning techniques in the field of lithofacies classification has not been sufficient. Therefore, this paper proposes a novel hybrid deep-learning model based on the efficient data feature-extraction ability of convolutional neural networks (CNN) and the excellent ability to describe time-dependent features of long short-term memory networks (LSTM) to conduct lithological facies-classification experiments. The results of a series of experiments show that the hybrid CNN-LSTM model had an average accuracy of 87.3% and the best classification effect compared to the CNN, LSTM or the three commonly used machine learning models (Support vector machine, random forest, and gradient boosting decision tree). In addition, the borderline synthetic minority oversampling technique (BSMOTE) is introduced to address the class-imbalance issue of raw data. The results show that processed data balance can significantly improve the accuracy of lithofacies classification. Beside that, based on the fine lithofacies constraints, the sequential indicator simulation method is used to establish a three-dimensional lithofacies model, which completes the fine description of the spatial distribution of tight sandstone reservoirs in the study area. According to this comprehensive analysis, the proposed CNN-LSTM model, which eliminates class imbalance, can be effectively applied to lithofacies classification, and is expected to improve the reality of the geological model for the tight sandstone reservoirs.Download : Download high-res image (135KB)Download : Download full-size image

geosciences, multidisciplinary
Transformer and CNN Hybrid Deep Neural Network for Semantic Segmentation of Very-High-Resolution Remote Sensing Imagery

Cheng Zhang,Wanshou Jiang,Yuan Zhang,Wei Wang,Qing Zhao,Chenjie Wang

DOI: https://doi.org/10.1109/tgrs.2022.3144894

IF: 8.2

2022-01-01

IEEE Transactions on Geoscience and Remote Sensing

Abstract:This article presents a transformer and convolutional neural network (CNN) hybrid deep neural network for semantic segmentation of very high resolution (VHR) remote sensing imagery. The model follows an encoder–decoder structure. The encoder module uses a new universal backbone Swin transformer to extract features to achieve better long-range spatial dependencies modeling. The decoder module draws on some effective blocks and successful strategies of CNN-based models in remote sensing image segmentation. In the middle of the framework, an atrous spatial pyramid pooling block based on depthwise separable convolution (SASPP) is applied to obtain a multiscale context. A U-shaped decoder is used to gradually restore the size of the feature maps. Three skip connections are built between the encoder and decoder feature maps of the same size to maintain the transmission of local details and enhance the communication of multiscale features. A squeeze-and-excitation (SE) channel attention block is added before segmentation for feature augmentation. An auxiliary boundary detection branch is combined to provide edge constraints for semantic segmentation. Extensive ablation experiments were conducted on the International Society for Photogrammetry and Remote Sensing (ISPRS) Vaihingen and Potsdam benchmarks to test the effectiveness of multiple components of the network. At the same time, the proposed method is compared with the current state-of-the-art methods on the two benchmarks. The proposed hybrid network achieved the second highest overall accuracy (OA) on both the Potsdam and Vaihingen benchmarks (code and models are available at https://github.com/zq7734509/mmsegmentation- multilayer).

imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
A Stage-Adaptive Selective Network with Position Awareness for Semantic Segmentation of LULC Remote Sensing Images

Wei Zheng,Jiangfan Feng,Zhujun Gu,Maimai Zeng

DOI: https://doi.org/10.3390/rs15112811

IF: 5

2023-05-29

Remote Sensing

Abstract:Deep learning has proven to be highly successful at semantic segmentation of remote sensing images (RSIs); however, it remains challenging due to the significant intraclass variation and interclass similarity, which limit the accuracy and continuity of feature recognition in land use and land cover (LULC) applications. Here, we develop a stage-adaptive selective network that can significantly improve the accuracy and continuity of multiscale ground objects. Our proposed framework can learn to implement multiscale details based on a specific attention method (SaSPE) and transformer that work collectively. In addition, we enhance the feature extraction capability of the backbone network at both local and global scales by improving the window attention mechanism of the Swin Transfer. We experimentally demonstrate the success of this framework through quantitative and qualitative results. This study demonstrates the strong potential of the prior knowledge of deep learning-based models for semantic segmentation of RSIs.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
Geology-constrained dynamic graph convolutional networks for seismic facies classification

Ziyad Alswaidan,Motaz Alfarraj,Hamzah Luqman

DOI: https://doi.org/10.1016/j.cageo.2023.105516

IF: 5.168

2024-01-04

Computers & Geosciences

Abstract:Knowing a land's facies type before drilling is an essential step in oil exploration. In seismic surveying, subsurface images are analyzed to segment and classify the facies in that volume. With the recent developments in deep learning, multiple works have utilized deep neural networks to classify facies from subsurface images. Unlike natural images, seismic data have different patterns and structures, which means that although general deep learning architectures can work with seismic data, it would be more effective if these architectures were optimized and refined specifically for such types of data. Most of the works in the seismic domain focus on convolution neural networks as the main backbone for the architectures, and more recently transformers started becoming more common in seismic data processing. Proposing a different approach that can capture unique correlations in the data, we introduce the use of dynamic graph convolutional networks as a method for capturing long-term dependencies for seismic facies classification. The proposed architecture combines the use of convolution neural networks and graph convolution networks to capture both global and local structures of the data. The performance of the model was evaluated on a facies classification dataset, and the proposed method provided state-of-the-art results while significantly reducing the number of parameters in the model compared to other architectures. Code is available at https://github.com/swaidan/Geology-Restricted-DGCNN .

geosciences, multidisciplinary,computer science, interdisciplinary applications
Efficient and generalizable nested Fourier-DeepONet for three-dimensional geological carbon sequestration

Jonathan E. Lee,Min Zhu,Ziqiao Xi,Kun Wang,Yanhua O. Yuan,Lu Lu

2024-09-25

Abstract:Geological carbon sequestration (GCS) involves injecting CO$_2$ into subsurface geological formations for permanent storage. Numerical simulations could guide decisions in GCS projects by predicting CO$_2$ migration pathways and the pressure distribution in storage formation. However, these simulations are often computationally expensive due to highly coupled physics and large spatial-temporal simulation domains. Surrogate modeling with data-driven machine learning has become a promising alternative to accelerate physics-based simulations. Among these, the Fourier neural operator (FNO) has been applied to three-dimensional synthetic subsurface models. Here, to further improve performance, we have developed a nested Fourier-DeepONet by combining the expressiveness of the FNO with the modularity of a deep operator network (DeepONet). This new framework is twice as efficient as a nested FNO for training and has at least 80% lower GPU memory requirement due to its flexibility to treat temporal coordinates separately. These performance improvements are achieved without compromising prediction accuracy. In addition, the generalization and extrapolation ability of nested Fourier-DeepONet beyond the training range has been thoroughly evaluated. Nested Fourier-DeepONet outperformed the nested FNO for extrapolation in time with more than 50% reduced error. It also exhibited good extrapolation accuracy beyond the training range in terms of reservoir properties, number of wells, and injection rate.

Machine Learning,Computational Physics
Direct mineral content prediction from drill core images via transfer learning

Romana Boiger,Sergey V. Churakov,Ignacio Ballester Llagaria,Georg Kosakowski,Raphael Wüst,Nikolaos I. Prasianakis

2024-03-27

Abstract:Deep subsurface exploration is important for mining, oil and gas industries, as well as in the assessment of geological units for the disposal of chemical or nuclear waste, or the viability of geothermal energy systems. Typically, detailed examinations of subsurface formations or units are performed on cuttings or core materials extracted during drilling campaigns, as well as on geophysical borehole data, which provide detailed information about the petrophysical properties of the rocks. Depending on the volume of rock samples and the analytical program, the laboratory analysis and diagnostics can be very time-consuming. This study investigates the potential of utilizing machine learning, specifically convolutional neural networks (CNN), to assess the lithology and mineral content solely from analysis of drill core images, aiming to support and expedite the subsurface geological exploration. The paper outlines a comprehensive methodology, encompassing data preprocessing, machine learning methods, and transfer learning techniques. The outcome reveals a remarkable 96.7% accuracy in the classification of drill core segments into distinct formation classes. Furthermore, a CNN model was trained for the evaluation of mineral content using a learning data set from multidimensional log analysis data (silicate, total clay, carbonate). When benchmarked against laboratory XRD measurements on samples from the cores, both the advanced multidimensional log analysis model and the neural network approach developed here provide equally good performance. This work demonstrates that deep learning and particularly transfer learning can support extracting petrophysical properties, including mineral content and formation classification, from drill core images, thus offering a road map for enhancing model performance and data set quality in image-based analysis of drill cores.

Computer Vision and Pattern Recognition,Machine Learning,Image and Video Processing

Primary intraosseous carcinoma of the anterior maxilla: report of a new case.

Superpixel-Based Long-Range Dependent Network for High-Resolution Remote-Sensing Image Classification

Super-Resolved Segmentation of X-ray Images of Carbonate Rocks Using Deep Learning

CarbonNet: How Computer Vision Plays a Role in Climate Change? Application: Learning Geomechanics from Subsurface Geometry of CCS to Mitigate Global Warming

A lightweight convolutional neural network based on dense connection for open-pit coal mine service identification using the edge-cloud architecture

Segmentation for Multi-Rock Types on Digital Outcrop Photographs Using Deep Learning Techniques

Design and implementation of an Automatic Deep Stacked Sparsely Connected Convolutional Autoencoder (ADSSCCA) neural network for remote sensing lithological mapping using calculated dropout

RockSeg: A Novel Semantic Segmentation Network Based on a Hybrid Framework Combining a Convolutional Neural Network and Transformer for Deep Space Rock Images

Synergistic application of digital outcrop characterization techniques and deep learning algorithms in geological exploration

Automatic Carbonate Rock Facies Identification with Deep Learning

MudrockNet: Semantic Segmentation of Mudrock SEM Images through Deep Learning

Uncertainty Quantification Based on Deep-Learning Approach Integrating Time-Lapse Seismic Data for Geological Carbon Storage

Connect the Dots: In Situ 4D Seismic Monitoring of CO2 Storage with Spatio-temporal CNNs

Classification of Very-High-Spatial-Resolution Aerial Images Based on Multiscale Features with Limited Semantic Information

Integrating deep learning and logging data analytics for lithofacies classification and 3D modeling of tight sandstone reservoirs

Transformer and CNN Hybrid Deep Neural Network for Semantic Segmentation of Very-High-Resolution Remote Sensing Imagery

A Stage-Adaptive Selective Network with Position Awareness for Semantic Segmentation of LULC Remote Sensing Images

Geology-constrained dynamic graph convolutional networks for seismic facies classification

Efficient and generalizable nested Fourier-DeepONet for three-dimensional geological carbon sequestration

Direct mineral content prediction from drill core images via transfer learning