Abstract:Recent experience in applying recurrent neural networks (RNNs) to interpreting Permannt Downhole Gauge (PDG) records has highlighted the potential utility of machine learning algorithms to learn reservoir behavior from data. The power of the RNN resides in its ability to retain information in a form of memory of previous patterns and information contained in the previous behavior of phenomena being modeled. This memory plays a role of informing the decision at the present time by using what happened in the past. This property suggests RNNs as a suitable choice to model sequences of reservoir information, even when the reservoir modeler is faced with incomplete knowledge of the underlying physical system. Convolutional Neural Networks (CNNs) are another variant of machine learning algorithms that have shown promise in sequence modeling domains, such as audio synthesis and machine translation. In this study, RNN and CNN were applied to tasks that traditionally would be modeled by a reservoir simulator. This was achieved by formulating the relationship between physical quantities of interest from subsurface reservoirs as a sequence mapping problem. In addition, the performance of a CNN layer as compared to RNN was evaluated systematically to investigate their capabilities in a variety of tasks of interest to the reservoir engineer. Preliminary results suggest that CNNs, with specific design modifications, are as capable as RNNs in modeling sequences of information and as reliable when making inferences to cases that has not been seen by the algorithm during training. Design details and reasons pertaining to the way these two seemingly different architectures process information, and handle memory are also discussed.

Convolutional Neural Networks with Recurrent Neural Filters

Residual Recurrent Neural Networks for Learning Sequential Representations.

Advances in Convolutional Neural Networks

Learning Context-Sensitive Convolutional Filters for Text Processing

Attentive Convolution: Equipping CNNs with RNN-style Attention Mechanisms

Non-linear Convolution Filters for CNN-based Learning

A Hierarchical Model with Recurrent Convolutional Neural Networks for Sequential Sentence Classification

Convolutional Neural Networks with Gated Recurrent Connections

Learning FRAME Models Using CNN Filters

Recurrent Convolutional Neural Network for Speech Processing

Convolutional recurrent neural networks: Learning spatial dependencies for image representation

Recurrently Controlled Recurrent Networks

Contextual Recurrent Units for Cloze-style Reading Comprehension

Recurrent Neural Networks for Still Images

Long-Term Recurrent Convolutional Networks for Visual Recognition and Description

Long Short-Term Memory based Convolutional Recurrent Neural Networks for Large Vocabulary Speech Recognition

Recurrent Filter Learning for Visual Tracking

Learning text representation using recurrent convolutional neural network with highway layers

Simulating the Behavior of Reservoirs with Convolutional and Recurrent Neural Networks

Speech Separation Using an Asynchronous Fully Recurrent Convolutional Neural Network

Molding CNNs for text: non-linear, non-consecutive convolutions