Abstract:Soil and rock, as typical porous media, widely exist in natural slopes and landslides and underground reservoirs. Accurate predicting the permeability of porous media is crucial in preventing geological disasters and extracting underground energy. The conventional methods for obtaining the porous media permeability involve experiments or numerical simulations, both of which are usually time-consuming. In recent years, a new approach to predicting the porous media permeability has emerged, utilizing porous media images and leveraging deep learning algorithms. However, previous image-based permeability prediction frameworks have been dominated by convolutional neural networks (CNNs). CNNs require extensive data and intricate network architectures to achieve reasonably accurate predictive performance. State-of-the-art neural networks and methods are employed to overcome the shortcomings of CNNs. To initiate this research, we generated 1200 two-dimensional porous media images. The permeability labels for the target porous media were acquired through computational fluid dynamics. Subsequently, an end-to-end permeability prediction surrogate model was established based on the Swin Transformer architecture. The proposed model falls under the category of transfer learning models, where pre-trained weights and bias from other datasets serve as the initial weights and bias for our dataset. Our model has achieved State-of-the-art performance, outperforming CNN by a significant margin on small-size datasets. Even with a small dataset size as 200, the proposed model still achieves an R 2 score of 0.9717 on the testing set. Both transfer learning and the Swin Transformer architecture have demonstrated robust predictive capabilities in the context of predicting permeability in small-size dataset porous media based on computer vision.

Hybrid Swin Transformer-CNN Model for Pore–Crack Structure Identification

Ultrasonic Array Tomography-Oriented Subsurface Crack Recognition and Cross-Section Image Reconstruction of Reinforced Concrete Structure Using Deep Neural Networks

Two-Stream Boundary-Aware Neural Network for Concrete Crack Segmentation and Quantification

Enhanced Concrete Crack Detection and Proactive Safety Warning Based on I-St-Unet Model

SwinCrack: Pavement crack detection using convolutional swin-transformer network

An improved transformer-based concrete crack classification method

Hybrid semantic segmentation for tunnel lining cracks based on Swin Transformer and convolutional neural network

Semantic segmentation model for concrete cracks based on parallel Swin-CNNs framework

Swin transformer based transfer learning model for predicting porous media permeability from 2D images

A novel transformer-based network with attention mechanism for automatic pavement crack detection

Swin–UNet++: A Nested Swin Transformer Architecture for Location Identification and Morphology Segmentation of Dimples on 2.25Cr1Mo0.25V Fractured Surface

Underwater Dam Crack Image Classification Algorithm Based on Improved VanillaNet

CrackNet: A Hybrid Model for Crack Segmentation with Dynamic Loss Function

Intelligent recognition and identification of fracture types and parameters for borehole images based on developed convolutional neural networks and post-processing

Classification of cracking sources of different engineering media via machine learning

A Convolutional-Transformer Network for Crack Segmentation with Boundary Awareness

CrackViT: a unified CNN-transformer model for pixel-level crack extraction

An average pooling designed Transformer for robust crack segmentation

MultiScaleCrackNet: A parallel multiscale deep CNN architecture for concrete crack classification

Automatic Identification of Cracks from Borehole Image under Complicated Geological Conditions

Unifying transformer and convolution for dam crack detection