Abstract:The recent success of sequential learning models, such as deep recurrent neural networks, is largely due to their superior representation-learning capability for learning the informative representation of a targeted time series. The learning of these representations is generally goal-directed, resulting in their task-specific nature, giving rise to excellent performance in completing a single downstream task but hindering between-task generalisation. Meanwhile, with increasingly intricate sequential learning models, learned representation becomes abstract to human knowledge and comprehension. Hence, we propose a unified local predictive model based on the multi-task learning paradigm to learn the task-agnostic and interpretable subsequence-based time series representation, allowing versatile use of learned representations in temporal prediction, smoothing, and classification tasks. The targeted interpretable representation could convey the spectral information of the modelled time series to the level of human comprehension. Through a proof-of-concept evaluation study, we demonstrate the empirical superiority of learned task-agnostic and interpretable representation over task-specific and conventional subsequence-based representation, such as symbolic and recurrent learning-based representation, in solving temporal prediction, smoothing, and classification tasks. These learned task-agnostic representations can also reveal the ground-truth periodicity of the modelled time series. We further propose two applications of our unified local predictive model in functional magnetic resonance imaging (fMRI) analysis to reveal the spectral characterisation of cortical areas at rest and reconstruct more smoothed temporal dynamics of cortical activations in both resting-state and task-evoked fMRI data, giving rise to robust decoding.

Learning and Processing the Ordinal Information of Temporal Sequences in Recurrent Neural Circuits

Learning Sequence Attractors in Recurrent Networks with Hidden Neurons

A Brain-Inspired Spiking Neural Network Model with Temporal Encoding and Learning

A Recurrent Neural Circuit Mechanism of Temporal-scaling Equivariant Representation

A New Hierarchical Temporal Memory Based on Recurrent Learning Unit

A Spiking Neural Network System for Robust Sequence Recognition

Rapid Feedforward Computation by Temporal Encoding and Learning with Spiking Neurons

Ensemble perspective for understanding temporal credit assignment

Learning spatiotemporal signals using a recurrent spiking network that discretizes time

Pattern Recognition Computation in a Spiking Neural Network with Temporal Encoding and Learning

Temporal sequence learning in winner-take-all networks of spiking neurons demonstrated in a brain-based device

A Hierarchically Organized Memory Model With Temporal Population Coding

A Brain-Inspired Computational Model for Spatio-Temporal Information Processing

Ordered Memory.

Understanding the computation of time using neural network models

Learning Sequence Representations by Non-local Recurrent Neural Memory

Temporal-Sequential Learning with Columnar-Structured Spiking Neural Networks.

Learning The Sequential Temporal Information with Recurrent Neural Networks

Stimulus-Driven and Spontaneous Dynamics in Excitatory-Inhibitory Recurrent Neural Networks for Sequence Representation

Learning task-agnostic and interpretable subsequence-based representation of time series and its applications in fMRI analysis

Sequence learning, prediction, and replay in networks of spiking neurons