Abstract:This study introduces PV-RNN, a novel variational RNN inspired by predictive-coding ideas. The model learns to extract the probabilistic structures hidden in fluctuating temporal patterns by dynamically changing the stochasticity of its latent states. Its architecture attempts to address two major concerns of variational Bayes RNNs: how latent variables can learn meaningful representations and how the inference model can transfer future observations to the latent variables. PV-RNN does both by introducing adaptive vectors mirroring the training data, whose values can then be adapted differently during evaluation. Moreover, prediction errors during backpropagation-rather than external inputs during the forward computation-are used to convey information to the network about the external data. For testing, we introduce error regression for predicting unseen sequences as inspired by predictive coding that leverages those mechanisms. As in other variational Bayes RNNs, our model learns by maximizing a lower bound on the marginal likelihood of the sequential data, which is composed of two terms: the negative of the expectation of prediction errors and the negative of the Kullback-Leibler divergence between the prior and the approximate posterior distributions. The model introduces a weighting parameter, the meta-prior, to balance the optimization pressure placed on those two terms. We test the model on two data sets with probabilistic structures and show that with high values of the meta-prior, the network develops deterministic chaos through which the randomness of the data is imitated. For low values, the model behaves as a random process. The network performs best on intermediate values and is able to capture the latent probabilistic structure with good generalization. Analyzing the meta-prior's impact on the network allows us to precisely study the theoretical value and practical benefits of incorporating stochastic dynamics in our model. We demonstrate better prediction performance on a robot imitation task with our model using error regression compared to a standard variational Bayes model lacking such a procedure.

A Novel Framework for Learning Stochastic Representations for Sequence Generation and Recognition

Residual Recurrent Neural Networks for Learning Sequential Representations.

A Spiking Neural Network System for Robust Sequence Recognition

A Novel Predictive-Coding-Inspired Variational RNN Model for Online Prediction and Recognition

Coherent noise enables probabilistic sequence replay in spiking neuronal networks

From Deterministic to Generative: Multimodal Stochastic RNNs for Video Captioning

Visual Representation Learning with Stochastic Frame Prediction

Generative Modeling of Neural Dynamics via Latent Stochastic Differential Equations

Stochastic Graph Recurrent Neural Network

Recognizing recurrent neural networks (rRNN): Bayesian inference for recurrent neural networks

Novel deep generative simultaneous recurrent model for efficient representation learning

Autonomous Sequence Generation for a Neural Dynamic Robot: Scene Perception, Serial Order, and Object-Oriented Movement

A recurrent neural network framework for flexible and adaptive decision making based on sequence learning

Deep Recurrent Stochastic Configuration Networks for Modelling Nonlinear Dynamic Systems

Dynamic Spatiotemporal Pattern Recognition with Recurrent Spiking Neural Network

Neuronal Sequence Models for Bayesian Online Inference

Bridging the Gap between Probabilistic and Deterministic Models: A Simulation Study on a Variational Bayes Predictive Coding Recurrent Neural Network Model

Stimulus-Driven and Spontaneous Dynamics in Excitatory-Inhibitory Recurrent Neural Networks for Sequence Representation

From Deterministic to Generative: Multi-Modal Stochastic RNNs for Video Captioning

Deep RNN Framework for Visual Sequential Applications

Stochastic Recurrent Neural Network for Multistep Time Series Forecasting