Isolation and interspecies-transfer of a plasmid from Pasteurella multocida encoding for streptomycin resistance

S. Schwarz,U. Spies,F. Schäfer,H. Blobel

DOI: https://doi.org/10.1007/BF00203308

Abstract:

What problem does this paper attempt to address?

Fast and accurate reconstruction of large-scale 3D porous media using deep learning

HouLin Zhang,Hao Yu,SiWei Meng,MengCheng Huang,Marembo Micheal,Jian Su,He Liu,HengAn Wu,HouLin Zhang,Hao Yu,SiWei Meng,MengCheng Huang,Marembo Micheal,Jian Su,He Liu,HengAn Wu

DOI: https://doi.org/10.1016/j.petrol.2022.110937

IF: 5.168

2022-10-01

Journal of Petroleum Science and Engineering

Abstract:The accurate and efficient reconstruction of the porous media is the fundamental link to revealing its structural features and physical properties. In this work, we propose a deep learning (DL)-based algorithm to reconstruct large-scale three-dimensional (3D) porous media that can be treated as the representative element volumes (REVs), based on generative adversarial networks (GAN) and convolutional neural networks (CNN), named LGCNN. The proposed framework consists of a machine learning based (ML-based) reconstruction method for small-scale porous media and an adjustable splicing algorithm to achieve the REVs reconstruction. On this basis, four special neural networks are established to reconstruct the porous media and ensure the connectivity between the adjacent porous media during the splicing process. Subsequently, the detailed validation of LGCNN against traditional reconstruction methods and other deep learning algorithms is performed. The results show that the reconstruction speed (6003 voxels) of LGCNN (10 min) is much faster than traditional numerical reconstruction methods including QSGS (642 min), CCSIM (5973 min), and SD (33,628 min) with higher accuracy on structural parameters (e.g., porosity and pore size distribution), when compared with real porous media. In particular, the size of constructed porous media is far larger than previous ML-based reconstruction algorithms as much as 3–4 orders of magnitude, indicating the puissant ability of LGCNN to be used for high-resolution or multi-scale reconstruction.

energy & fuels,engineering, petroleum
3D stochastic reconstruction of porous media based on attention mechanisms and residual networks

Ting Zhang,Pengfei Xia,Fangfang Lu

DOI: https://doi.org/10.1007/s00477-021-02092-z

IF: 3.821

2021-09-17

Stochastic Environmental Research and Risk Assessment

Abstract:Because of the complex internal porous structures, the reconstruction of porous media has encountered many difficulties in practical research and development. At present, numerical simulation methods are widely used in the field of reconstructing porous media, which can reconstruct results similar to the true pore structure, but generally are CPU-intensive and time-consuming. Recently, with the rapid development of deep learning, the powerful ability of feature extraction and structure prediction owned by deep learning can be transferred to reconstruct porous media. The convolutional neural network (CNN) is one of the classical methods in deep learning. A traditional CNN is unable to specially focus on the effective features in learning and possibly has degradation problem with the increase of layers. To address the degradation problem and make CNNs extract important features, residual networks and attention mechanisms are combined in CNNs to respectively alleviate network degradation and focus on the important features in the reconstruction of porous media. Besides, the bilinear interpolation is used to enlarge the size of compressed data. Compared with some traditional numerical reconstruction methods, CNN, GAN and some variants of GAN, our method has shown its practicability and effectiveness.

environmental sciences,engineering, environmental,water resources, civil,statistics & probability
Super-Resolution Reconstruction of Porous Media Using Concurrent Generative Adversarial Networks and Residual Blocks

Ting Zhang,Qingyang Liu,Yi Du

DOI: https://doi.org/10.1007/s11242-022-01892-3

IF: 3.6097

2022-12-26

Transport in Porous Media

Abstract:Accurate porous media reconstruction has always been one of the significant research hotspots in the numerical simulation of reservoirs. The traditional methods such as multi-point statistics perform porous media reconstruction based on the statistical features of training images, but the process is possibly cumbersome and the result is less effective. Porous media reconstruction has been greatly developed and benefited by applying current flourishing deep learning to its simulation process thanks to the strong capability of extracting features by deep learning. As a typical branch of deep learning methods, generative adversarial network (GAN) can simulate a two-person zero-sum game through confrontation between a generator and a discriminator. However, in real experiments, constrained by the resolution of physical equipment and the size of samples, it is difficult to physically obtain a large-scale image of porous media with high-resolution (HR) since HR and large field of view are usually contradictory for physical equipment. In this paper, a method is proposed based on multistage concurrent GAN to learn the structural features of porous media from one low-resolution 3D image and then stochastically reconstruct larger-sized porous media images. Experimental comparison with some typical methods proves that this method can reconstruct HR images with favorable quality.

engineering, chemical
Reconstruction of three-dimensional porous media using generative adversarial neural networks

Lukas Mosser,Olivier Dubrule,Martin J. Blunt

DOI: https://doi.org/10.1103/PhysRevE.96.043309

2017-04-11

Abstract:To evaluate the variability of multi-phase flow properties of porous media at the pore scale, it is necessary to acquire a number of representative samples of the void-solid structure. While modern x-ray computer tomography has made it possible to extract three-dimensional images of the pore space, assessment of the variability in the inherent material properties is often experimentally not feasible. We present a novel method to reconstruct the solid-void structure of porous media by applying a generative neural network that allows an implicit description of the probability distribution represented by three-dimensional image datasets. We show, by using an adversarial learning approach for neural networks, that this method of unsupervised learning is able to generate representative samples of porous media that honor their statistics. We successfully compare measures of pore morphology, such as the Euler characteristic, two-point statistics and directional single-phase permeability of synthetic realizations with the calculated properties of a bead pack, Berea sandstone, and Ketton limestone. Results show that GANs can be used to reconstruct high-resolution three-dimensional images of porous media at different scales that are representative of the morphology of the images used to train the neural network. The fully convolutional nature of the trained neural network allows the generation of large samples while maintaining computational efficiency. Compared to classical stochastic methods of image reconstruction, the implicit representation of the learned data distribution can be stored and reused to generate multiple realizations of the pore structure very rapidly.

Computer Vision and Pattern Recognition,Materials Science,Fluid Dynamics,Geophysics
Three-dimensional reconstruction of granular porous media based on deep generative models.

Qizhi Teng,Rongyan Yin,Xiaohong Wu,Shuhua Xiong,Fan Zhang

DOI: https://doi.org/10.1103/physreve.108.055303

IF: 2.707

2023-11-01

Physical Review E

Abstract:Reconstruction of microstructure in granular porous media, which can be viewed as granular assemblies, is crucial for studying their characteristics and physical properties in various fields concerned with the behavior of such media, including petroleum geology and computational materials science. In spite of the fact that many existing studies have investigated grain reconstruction, most of them treat grains as simplified individuals for discrete reconstruction, which cannot replicate the complex geometrical shapes and natural interactions between grains. In this work, a hybrid generative model based on a deep-learning algorithm is proposed for high-quality three-dimensional (3D) microstructure reconstruction of granular porous media from a single two-dimensional (2D) slice image. The method extracts 2D prior information from the given image and generates the grain set as a whole. Both a self-attention module and effective pattern loss are introduced in a bid to enhance the reconstruction ability of the model. Samples with grains of varied geometrical shapes are utilized for the validation of our method, and experimental results demonstrate that our proposed approach can accurately reproduce the complex morphology and spatial distribution of grains without any artificiality. Furthermore, once the model training is complete, rapid end-to-end generation of diverse 3D realizations from a single 2D image can be achieved.

Computer Science,Medicine,Geology,Materials Science
Stochastic reconstruction of porous media based on attention mechanisms and multi-stage generative adversarial network

Ting Zhang,Peng Zhu,Fangfang Lu

DOI: https://doi.org/10.1007/s10596-023-10208-3

IF: 2.9482

2023-05-07

Computational Geosciences

Abstract:The accurate reconstruction of porous media is difficult to accomplish in practical research due to the intricacy of the internal structure of porous media, which cannot be described only using some equations or languages. The emerging deep learning methods open up a new research field for the reconstruction of porous media. One of the classic deep learning methods is generative adversarial network (GAN), which has been applied to the reconstruction of porous media, but also requires sufficient training samples as well as a long simulation process. Some GAN's variants, such as the single-image GAN (SinGAN), are proposed to achieve desired results with only one training image (TI), but its serial structure still necessitates lengthy training time. Based on SinGAN, a stochastic reconstruction method of porous media combining attention mechanisms with multiple-stage GAN is proposed, focusing on important features of porous media with a single TI to achieve favorable simulation quality and using two discriminators to maintain enough diversity (one discriminator prefers real data, and the other favors fake data). Experiments prove that our method outperforms some numerical reconstruction methods and SinGAN in terms of practicality and efficiency.

geosciences, multidisciplinary,computer science, interdisciplinary applications
Reconstruction of 3D Porous Medium Using a Type of Cascaded Polymorphic Method

Fuxiang Liu,Mingliang Gao,Xiangqun Li,Hongwei Lin,Keyan Deng,Yongsheng Xu,Jun Jiang

DOI: https://doi.org/10.1016/j.micromeso.2021.111356

IF: 5.876

2021-01-01

Microporous and Mesoporous Materials

Abstract:Three-dimensional (3D) digital images are helpful in studying the physical properties of a medium. Moreover, reconstructing a 3D image from a two-dimensional (2D) image via computer-mathematical modeling is an important process. Based on the relationship between cascaded grids, an ingenious cascaded polymorphic method is proposed in this work to reconstruct a 3D image from a 2D image. By using the cascaded polymorphic method, a patch can be copied directly into a reconstruction grid by matching the patterns between cascaded grids; the polymorphism of the templates correspond to the grid size. To improve the reconstruction performance further, the non-edge region expansion strategy for a layer and the non-edge region replication strategy for adjacent layers were also proposed. A core sample and building material were selected as the test materials, and several effective measurements were used as quantitative means. To display the reconstruction effect intuitively, 2D reconstruction experiments were also performed along with the 3D experiment. The results show that the reconstruction speed is significantly improved using the cascaded polymorphic method, and the morphological features of the 3D reconstruction are clearly promoted.
Multiscale Deep-Learning Network Based Reconstruction of PET Images from Sinogram Domain

Zhiyuan Liu,Huafeng Liu

DOI: https://doi.org/10.1117/12.2601192

2021-01-01

Abstract:Positron emission tomography (PET) is an indispensable medical imaging technique which can reveal the physiology activities by injecting special PET tracers. In recent years, deep learning has been widely used in PET reconstruction tasks. In this work, a multiscale direct reconstruction framework based on cGANs has been presented. First, the generator is built as two scales which will combine both global and detail information in training phase. Second, to match the generator, we tried multiscale discriminators. Each discriminator shares the same structure, but operates on different scales. Both coarse field and fine field were scored by the discriminators, so this score considered not only the global structure but also fine details. In order to verify the feasibility of the proposed framework, both simulation datasets and real SD rat dataset were utilized in our experiments. We also compared our method with U-Net and Deep-PET network, the results showed that we got more accurate and real radioactivity images on all datasets.
Stochastic reconstruction of 3D porous media from 2D images using generative adversarial networks

Andrea Valsecchi,Sergio Damas,Cristina Tubilleja,Javier Arechalde

DOI: https://doi.org/10.1016/j.neucom.2019.12.040

IF: 6

2020-07-01

Neurocomputing

Abstract:Micro computed tomography (CT) provides petrophysics laboratories with the ability to image three dimensional porous media at pore scale. However, evaluating flow properties requires the acquisition of a large number of representative images, which is often unfeasible. Stochastic reconstruction methods are algorithms able to generate novel, realistic rock images from a small sample, thus avoiding a large acquisition process. A more convenient approach would use only two dimensional images, replacing 3D scans with images of the rock cuttings made during the drilling. This would extend the technique to media having pores smaller than the resolution of the micro-CT, but that can be imaged by microscopy.We introduce a novel method for 2D-to-3D reconstruction of the structure of porous media by applying generative adversarial neural networks. We compare several measures of pore morphology between simulated and acquired images. Experiments include bead pack, Berea sandstone, and Ketton limestone images. Results show that our GANs-based method can reconstruct three-dimensional images of porous media at different scales that are representative of the morphology of the original images. Also, compared to classical stochastic methods of image reconstruction, the generation of multiple images is much faster.

computer science, artificial intelligence
A three-dimension multi-scale fusion reconstruction method for porous media based on pattern-matching

Ningning Zhang,Qizhi Teng,Pengcheng Yan,Xiaohong Wu,Juan Li

DOI: https://doi.org/10.1016/j.petrol.2022.110673

IF: 5.168

2022-08-01

Journal of Petroleum Science and Engineering

Abstract:Accurate three-dimensional modeling has an important influence on the evaluation and prediction of the physical properties of porous media. In view of the inherent natural structures, pores are multiscale in many porous media. As a result of the tradeoff between the field of view (FOV) and resolution, it is difficult to obtain high-resolution and large-scale images using single-resolution imaging equipment. Generally, low-resolution images with a large FOV lack detailed features, while the FOV of high-resolution images is too small to contain the information of the entire microstructure. Therefore, fusing images from different resolutions and scales to reconstruct models is an promising solution for addressing these issues. In this study, an improved method for reconstructing a high-resolution and large-scale model based on three-dimensional pattern matching is proposed. The algorithm can fuse two models from different resolutions and scales, in which the structures of large-scale pores in the low-resolution model are used as background and a high-resolution model is applied to build pattern sets to reconstruct fine-scale pores based on the background. The final result is a model containing large-scale and fine-scale pores. The accuracy and stability of the proposed method were tested by using two samples. From subjective and objective perspectives, through the comparisons of visual effects and statistical properties between generating models and target models, we found that the method can reconstruct accurate models.

energy & fuels,engineering, petroleum
Sliced Wasserstein Distance-Guided Three-Dimensional Porous Media Reconstruction Based on Cycle-Consistent Adversarial Network and Few-Shot Learning

Mingyang Wang,Enzhi Wang,Xiaoli Liu,Congcong Wang

DOI: https://doi.org/10.1007/s11242-024-02099-4

IF: 3.6097

2024-01-01

Transport in Porous Media

Abstract:Numerical simulation studies of water–rock interaction mechanisms and pore-scale multiphase flow properties often require high computational efficiency and realistic geometries to enable a fast and accurate description of hydrodynamic behavior. In this paper, we have chosen to use deep learning models to achieve these requirements, firstly by using encoder structures to refine the image segmentation of void-solid structures on complex geometries of scanning electron microscopy (SEM) images of porous media through few-shot learning (FSL), not only obtaining an accuracy of 0.97, but also reducing the amount of annotation work. We then focus on pore-scale three-dimensional (3D) structural reconstruction using the unpaired image-to-image translation method, optimizing the cycle-consistent adversarial network (cycle-GAN) model via sliced Wasserstein distance (SWD) to transfer marine sedimentary sandstone features to the initial image, and the geometric stochastic reconstruction problems are transformed into optimization problems. Subsequently, the computational efficiency was improved by a factor of 21 by implementing the lattice Boltzmann simulation method (LBM) accelerated by GPU through compute-unified device architecture (CUDA). The flow field distribution and absolute permeability of the extracted 2D samples and the reconstructed 3D porous media structure were simulated. The results showed that our method could rapidly and accurately reconstruct the 3D structures of a given feature, ensuring statistical equivalence between the 3D reconstructed structures and 2D samples. We solve the problem of extrapolation-based 3D reconstruction of porous media and significantly reduce the time spent on structure extraction and numerical calculations.
Transformer-based deep learning models for predicting permeability of porous media

Yinquan Meng,Jianguo Jiang,Jichun Wu,Dong Wang

DOI: https://doi.org/10.1016/j.advwatres.2023.104520

IF: 5.361

2023-08-14

Advances in Water Resources

Abstract:The direct acquisition of the permeability of porous media by digital images helps to enhance our understanding of and facilitate research into the problem of subsurface flow. A complex pore space makes the numerical simulation methods used to calculate the permeability quite time-consuming. Deep learning models represented by three-dimensional convolutional neural networks (3D CNNs), as a promising approach to improving efficiency, have made significant advances concerning predicting the permeability of porous media. However, 3D CNNs require significant computational resources due to their extensive parameters, which limit studies to small-sized porous media, and their generalization capabilities are insufficiently explored. To address these challenges, we propose a novel CNN-Transformer hybrid neural network, merging a 2D CNN with a self-attention mechanism. Additionally, we incorporate physical information into digital images, constructing a PhyCNN-Transformer model to reflect the impact of physical properties on permeability prediction. In terms of dataset preparation, we employ the publicly available DeePore porous media dataset with sample size of 256 3 cubic voxels and labeled permeability calculated by pore network modelling (PNM). We compare the two transformer-based models with a 3D CNN in terms of parameter number, training efficiency, prediction performance, and generalization, and the results show significant improvement. By employing transfer learning, the well-trained transformer-based models proved capable of adapting to porous media with different sizes (achieving an R 2 score of 0.9563 with 300 training samples), while the 3D CNN lacks this transferability.

water resources
Reconstruction of Thin-Slice Medical Images Using Generative Adversarial Network.

Zeju Li,Yuanyuan Wang,Jinhua Yu

DOI: https://doi.org/10.1007/978-3-319-67389-9_38

2017-01-01

Abstract:Slice thickness is a very important parameter for medical imaging such as magnetic resonance (MR) imaging or computed tomography (CT). Thinner slice imaging obviously provides higher spatial resolution and more diagnostic information, however also involves higher imaging cost both in time and expense. For the sake of efficiency, a relatively thick slice interval is usually used in the daily routine medical imaging. A novel generative adversarial network was proposed in this paper to reconstruct medical images with thinner slice thickness from regular thick slice images. A fully convolutional network with three-dimensional convolutional kernels and residual blocks was firstly applied to generate the slices between the imaging intervals. A novel perceptual loss function was proposed to guarantee both the pixel similarity and the spatial coherence in 3D. Moreover, a discriminator network with a sustained adversarial loss was utilized to push the solution to be more realistic. 43 pairs of MR images were used to validate the performance of the proposed method. The presented method is able to recover preoperative t2flair MR images with slice thickness of 2 mm from routine t2flair MR images with thickness of 6 mm. The reconstruction results on two datasets show the superiority of the presented method over other competitive image reconstruction methods.
Deep learning method of stochastic reconstruction of three-dimensional digital cores from a two-dimensional image

Juan Li,Qizhi Teng,Ningning Zhang,Honggang Chen,Xiaohai He

DOI: https://doi.org/10.1103/PhysRevE.107.055309

Abstract:Digital cores can characterize the true internal structure of rocks at the pore scale. This method has become one of the most effective ways to quantitatively analyze the pore structure and other properties of digital cores in rock physics and petroleum science. Deep learning can precisely extract features from training images for a rapid reconstruction of digital cores. Usually, the reconstruction of three-dimensional (3D) digital cores is performed by optimization using generative adversarial networks. The training data required for the 3D reconstruction are 3D training images. In practice, two-dimensional (2D) imaging devices are widely used because they can achieve faster imaging, higher resolution, and easier identification of different rock phases, so replacing 3D images with 2D ones avoids the difficulty of acquiring 3D images. In this paper, we propose a method, named EWGAN-GP, for the reconstruction of 3D structures from a 2D image. Our proposed method includes an encoder, a generator, and three discriminators. The main purpose of the encoder is to extract statistical features of a 2D image. The generator extends the extracted features into 3D data structures. Meanwhile, the three discriminators have been designed to gauge the similarity of morphological characteristics between cross sections of the reconstructed 3D structure and the real image. The porosity loss function is used to control the distribution of each phase in general. In the entire optimization process, a strategy using Wasserstein distance with gradient penalty makes the convergence of the training process faster and the reconstruction result more stable; it also avoids the problems of gradient disappearance and mode collapse. Finally, the reconstructed 3D structure and the target 3D structure are visualized to ascertain their similar morphologies. The morphological parameter indicators of the reconstructed 3D structure were consistent with those of the target 3D structure. The microstructure parameters of the 3D structure were also compared and analyzed. The proposed method can achieve accurate and stable 3D reconstruction compared with classical stochastic methods of image reconstruction.
Multiscale reconstruction of porous media based on multiple dictionaries learning

Pengcheng Yan,Qizhi Teng,Xiaohai He,Zhenchuan Ma,Ningning Zhang

DOI: https://doi.org/10.1016/j.cageo.2023.105356

IF: 5.168

2023-07-01

Computers & Geosciences

Abstract:Digital modeling of the microstructure is important for studying the physical and transport properties of porous media. Multiscale modeling for porous media can accurately characterize large-pores and fine-pores in a large-FoV (field of view) high-resolution three-dimensional pore structure model. This paper proposes a multiscale reconstruction algorithm based on multiple dictionaries learning, in which edge patterns and fine-pore patterns from homology high-resolution pore structure are introduced into low-resolution pore structure to build a fine multiscale pore structure model. The qualitative and quantitative comparisons of the experimental results show that the results of multiscale reconstruction are similar to the real high-resolution pore structure in terms of complex pore geometry and pore surface morphology. The geometric, topological and permeability properties of multiscale reconstruction results are almost identical to those of the real high-resolution pore structures. The experiments also demonstrate the proposal algorithm is capable of multiscale reconstruction without regard to the size of the input. This work provides an effective method for fine multiscale modeling of porous media.

geosciences, multidisciplinary,computer science, interdisciplinary applications
Reconstruction of 3D Porous Media Using Multiple-Point Statistics Based on a 2D Training Image

Yuqi Wu,Weichao Tian,Yimin Zhang,Chengyan Lin,L. Ren,Yang Wang

DOI: https://doi.org/10.2118/190859-MS

2018-06-08

Abstract:Macroscopic transport properties of porous media essentially rely on the geometry and topology of their pore space. The premise of predicting these transport properties is to construct an accurate 3D pore space. To date the methods of modeling porous media are divided into two main groups, direct measurements by some equipment and stochastic statistical methods. Direct measurements of pore structure can be acquired with current equipment such as X-ray computed tomography and laser scanning confocal microscopy, but the unavailability of the equipment and the high cost of the measurement make their widespread application impossible. Many stochastic statistical methods, such as truncated Gaussian random field and simulated annealing methods, reconstruct 3D porous media based on some 2D thin sections by means of lower-order statistical functions. However these functions cannot reproduce the long-range connectivity of pore structure. Therefore, this paper will present a stochastic technique of reconstructing 3D pore space using multiple-point statistics with the purpose of solving the proposed problems. The single normal equation simulation algorithm (SNESIM), one of the most common methods for discrete variable simulation in multiple-point statistics, is the main tool to reproduce the long-range feature of pore space. To test the method, Berea sandstone was used as a sample. In the simulation process, a 2D thin section was taken as the training image for providing patterns of pore structure and some pixels were extracted from it as the conditioning data. The models were reconstructed using the SNESIM algorithm that serves as the simulation engine. In order to test the accuracy of these reconstructed models, pore geometry and topology and transport properties of the reconstructed models were compared with those of the real model obtained by X-ray computed tomography scanning. The comparison result shows that the reconstructed models are good agreement with the real model obtained by X-ray computed tomography scanning in the two-point correlation function, the pore space features and single- and two-phase flow permeabilities, which verifies that the long-range connectivity of pore space can be reproduced by this method. Comparing with other stochastic methods, a more accurate stochastic technique of reconstructing 3D porous media is put forward when only some 2D thin sections are available.

Computer Science,Engineering,Materials Science,Environmental Science
Computationally efficient deep neural network for computed tomography image reconstruction

Dufan Wu,Kyungsang Kim,Quanzheng Li

DOI: https://doi.org/10.1002/mp.13627

IF: 4.506

2019-09-21

Medical Physics

Abstract:<h3> Purpose</h3><p>Deep‐neural‐network‐based image reconstruction has demonstrated promising performance in medical imaging for under‐sampled and low‐dose scenarios. However, it requires large amount of memory and extensive time for the training. It is especially challenging to train the reconstruction networks for three‐dimensional computed tomography (CT) because of the high resolution of CT images. The purpose of this work is to reduce the memory and time consumption of the training of the reconstruction networks for CT to make it practical for current hardware, while maintaining the quality of the reconstructed images.</p><h3> Methods</h3><p>We unrolled the proximal gradient descent algorithm for iterative image reconstruction to finite iterations and replaced the terms related to the penalty function with trainable convolutional neural networks (CNN). The network was trained greedily iteration by iteration in the image‐domain on patches, which requires reasonable amount of memory and time on mainstream graphics processing unit (GPU). To overcome the local‐minimum problem caused by greedy learning, we used deep UNet as the CNN and incorporated separable quadratic surrogate with ordered subsets for data fidelity, so that the solution could escape from easy local minimums and achieve better image quality.</p><h3> Results</h3><p>The proposed method achieved comparable image quality with state‐of‐the‐art neural network for CT image reconstruction on 2D sparse‐view and limited‐angle problems on the low‐dose CT challenge dataset. The difference in root‐mean‐square‐error (RMSE) and structural similarity index (SSIM) was within [−0.23,0.47]HU and [0,0.001] respectively with 95% confidence level. For 3D image reconstruction with ordinary‐size CT volume, the proposed method only needed 2 GB graphics processing unit (GPU) memory and 0.45 seconds per training iteration as minimum requirement, whereas existing methods may require 417 GB and 31 minutes. The proposed method achieved improved performance compared to total‐variation‐ and dictionary‐learning‐based iterative reconstruction for both 2D and 3D problems.</p><h3> Conclusions</h3><p>We proposed a training‐time computationally efficient neural network for CT image reconstruction. The proposed method achieved comparable image quality with state‐of‐the‐art neural network for CT reconstruction, with significantly reduced memory and time requirement during training. The proposed method is applicable to 3D image reconstruction problems such as cone‐beam CT and tomosynthesis on mainstream GPUs.</p><p>This article is protected by copyright. All rights reserved.</p>

radiology, nuclear medicine & medical imaging
Modeling finer microstructure of random heterogeneous porous materials by fusing 2D high- and 3D low- resolution images

Pengcheng Yan,Qizhi Teng,Zhenchuan Ma,Xiaohong Wu,Xiaohai He

DOI: https://doi.org/10.1016/j.compgeo.2024.106145

IF: 5.218

2024-02-11

Computers and Geotechnics

Abstract:Modeling the finer microstructure is crucial for studying the microscopic and macroscopic characteristics of random heterogeneous porous materials. Multi-scale reconstruction is a feasible way to model finer microstructures. However, most of the traditional methods focus on reconstructing a single type of low-level features, while the neural network-based methods are heavily dependent on the dataset. This paper proposes a novel multi-scale reconstruction framework based on Neural Network-based Transform Mapping (NNTM) to modeling the finer microstructure. The number of network layer and input noise scale are determined by the pixel-size ratio between LRI and HRI . This allows the network to fit the corresponding transformation sub-mapping at different feature scales, thus effectively and accurately fusing the multi-scale information of 2D HRI and 3D LRI . More notably, without the training on a large dataset, and providing only a 2D HRI and a 3D LRI of the same sample, NNTM enables the modeling of high-resolution finer microstructure. Experiments were conducted on rock materials with different pore morphologies, and the morphological characteristics and physical properties were compared to the original high-resolution structure. The qualitative and quantitative evaluation criteria indicate a high consistency between the reconstructed finer microstructure and the original structure.

computer science, interdisciplinary applications,geosciences, multidisciplinary,engineering, geological
MRIo3DS-Net: A Mutually Reinforcing Images to 3D Surface RNN-like framework for model-adaptation indoor 3D reconstruction

Chang Li,Jiao Guo,Yufei Zhao,Yongjun Zhang

2024-07-16

Abstract:This paper is the first to propose an end-to-end framework of mutually reinforcing images to 3D surface recurrent neural network-like for model-adaptation indoor 3D reconstruction,where multi-view dense matching and point cloud surface optimization are mutually reinforced by a RNN-like structure rather than being treated as a separate issue.The characteristics are as follows:In the multi-view dense matching module, the model-adaptation strategy is used to fine-tune and optimize a Transformer-based multi-view dense matching DNN,so that it has the higher image feature for matching and detail expression capabilities;In the point cloud surface optimization module,the 3D surface reconstruction network based on 3D implicit field is optimized by using model-adaptation strategy,which solves the problem of point cloud surface optimization without knowing normal vector of 3D <a class="link-external link-http" href="http://surface.To" rel="external noopener nofollow">this http URL</a> improve and finely reconstruct 3D surfaces from point cloud,smooth loss is proposed and added to this module;The MRIo3DS-Net is a RNN-like framework,which utilizes the finely optimized 3D surface obtained by PCSOM to recursively reinforce the differentiable warping for optimizing MVDMM.This refinement leads to achieving better dense matching results, and better dense matching results leads to achieving better 3D surface results recursively and mutually.Hence, model-adaptation strategy can better collaborate the differences between the two network modules,so that they complement each other to achieve the better effect;To accelerate the transfer learning and training convergence from source domain to target domain,a multi-task loss function based on Bayesian uncertainty is used to adaptively adjust the weights between the two networks loss functions of MVDMM and PCSOM;In this multi-task cascade network framework,any modules can be replaced by any state-of-the-art networks to achieve better 3D reconstruction results.

Computer Vision and Pattern Recognition
Accelerated Super-resolution MR Image Reconstruction via a 3D Densely Connected Deep Convolutional Neural Network

Yuanyuan Jia,Zhongshi He,A. Gholipour,Jinglong Du,Lulu Wang

DOI: https://doi.org/10.1109/BIBM.2018.8621073

2018-12-01

Abstract:Magnetic resonance (MR) images are often acquired with low resolution (LR) due to hardware limitations, practical limitations on acquisition time, and patient comfort. In this study, we propose a novel method to reconstruct high resolution (HR) MR images through efficiently learning the LR to HR nonlinear mapping by a densely connected 3D deep convolutional neural network (CNN) that uses learnable deconvolution on multi-level features for upsampling. Different from the current CNN-based MR image super-resolution (SR) methods that take interpolated patches as input, the proposed method directly takes LR MR images (or LR patches) as input to reduce computational complexity and accelerate SR reconstruction. Improved dense blocks in this architecture are adopted to extract multi-level features from the LR image, and carry the information forward with dense connections. The final deconvolution layer automatically learns a filter to fuse and upscale all feature maps to generate HR MR images. The experimental results on three benchmark datasets demonstrate that the proposed method achieves state-of-the-art MR image SR reconstruction performance with less computational load and memory usage.

Medicine,Computer Science,Engineering

Isolation and interspecies-transfer of a plasmid from Pasteurella multocida encoding for streptomycin resistance

Fast and accurate reconstruction of large-scale 3D porous media using deep learning

3D stochastic reconstruction of porous media based on attention mechanisms and residual networks

Super-Resolution Reconstruction of Porous Media Using Concurrent Generative Adversarial Networks and Residual Blocks

Reconstruction of three-dimensional porous media using generative adversarial neural networks

Three-dimensional reconstruction of granular porous media based on deep generative models.

Stochastic reconstruction of porous media based on attention mechanisms and multi-stage generative adversarial network

Reconstruction of 3D Porous Medium Using a Type of Cascaded Polymorphic Method

Multiscale Deep-Learning Network Based Reconstruction of PET Images from Sinogram Domain

Stochastic reconstruction of 3D porous media from 2D images using generative adversarial networks

A three-dimension multi-scale fusion reconstruction method for porous media based on pattern-matching

Sliced Wasserstein Distance-Guided Three-Dimensional Porous Media Reconstruction Based on Cycle-Consistent Adversarial Network and Few-Shot Learning

Transformer-based deep learning models for predicting permeability of porous media

Reconstruction of Thin-Slice Medical Images Using Generative Adversarial Network.

Deep learning method of stochastic reconstruction of three-dimensional digital cores from a two-dimensional image

Multiscale reconstruction of porous media based on multiple dictionaries learning

Reconstruction of 3D Porous Media Using Multiple-Point Statistics Based on a 2D Training Image

Computationally efficient deep neural network for computed tomography image reconstruction

Modeling finer microstructure of random heterogeneous porous materials by fusing 2D high- and 3D low- resolution images

MRIo3DS-Net: A Mutually Reinforcing Images to 3D Surface RNN-like framework for model-adaptation indoor 3D reconstruction

Accelerated Super-resolution MR Image Reconstruction via a 3D Densely Connected Deep Convolutional Neural Network