Porosity and Permeability Prediction Using a Transformer and Periodic Long Short-Term Network

Liuqing Yang,Sergey Fomel,Shoudong Wang,Xiaohong Chen,Wei Chen,Omar M. Saad,Yangkang Chen
DOI: https://doi.org/10.1190/geo2022-0150.1
IF: 3.264
2023-01-01
Geophysics
Abstract:Effective reservoir parameter prediction is important for subsur-face characterization and understanding fluid migration. However, conventional methods for obtaining porosity and permeability are based on either core measurements or mathematical/petrophysical modeling, which are expensive or inefficient. In this study, we develop a reliable and low-cost deep learning (DL) framework for reservoir permeability and porosity prediction from real log-ging data at different regions. We leverage an advanced learning architecture (i.e., the transformer model) and design a new regres-sion network (RPTransformer) that is sensitive to the depth period change of the logging data. The RPTransformer is composed of 1D convolutional, long short-term memory (LSTM), and trans-former layers. First, we use a 1D convolutional layer for the first layer of the network to extract significant features from the logging data. Then, the nonlinear mapping relationships between logging data and reservoir parameters are established using several LSTM layers with a period parameter. Afterward, we use the encoder in the vision transformer with the self-attention mecha-nism to further extract logging data features. The developed net-work is a data-driven supervised learning framework and indicates highly accurate and robust prediction results when applied to dif-ferent geographic regions. To demonstrate the reliable prediction performance of our network, we compare it with several classic machine learning and state-of-the-art DL methods, e.g., random forest, multilayer LSTM, and long short-term time-series network (LSTNet). More importantly, we find the generalization and un-certainty of the network in real-world applications through com-prehensive numerical experiments.
What problem does this paper attempt to address?