Abstract:Time is of the essence in how neural codes, synchronies, and oscillations might function in encoding, representation, transmission, integration, storage, and retrieval of information in brains. This Hypothesis and Theory article examines observed and possible relations between codes, synchronies, oscillations, and types of neural networks they require. Toward reverse-engineering informational functions in brains, prospective, alternative neural architectures incorporating principles from radio modulation and demodulation, active reverberant circuits, distributed content-addressable memory, signal-signal time-domain correlation and convolution operations, spike-correlation-based holography, and self-organizing, autoencoding anticipatory systems are outlined. Synchronies and oscillations are thought to subserve many possible functions: sensation, perception, action, cognition, motivation, affect, memory, attention, anticipation, and imagination. These include direct involvement in coding attributes of events and objects through phase-locking as well as characteristic patterns of spike latency and oscillatory response. They are thought to be involved in segmentation and binding, working memory, attention, gating and routing of signals, temporal reset mechanisms, inter-regional coordination, time discretization, time-warping transformations, and support for temporal wave-interference based operations. A high level, partial taxonomy of neural codes consists of channel, temporal pattern, and spike latency codes. The functional roles of synchronies and oscillations in candidate neural codes, including oscillatory phase-offset codes, are outlined. Various forms of multiplexing neural signals are considered: time-division, frequency-division, code-division, oscillatory-phase, synchronized channels, oscillatory hierarchies, polychronous ensembles. An expandable, annotative neural spike train framework for encoding low- and high-level attributes of events and objects is proposed. Coding schemes require appropriate neural architectures for their interpretation. Time-delay, oscillatory, wave-interference, synfire chain, polychronous, and neural timing networks are discussed. Some novel concepts for formulating an alternative, more time-centric theory of brain function are discussed. As in radio communication systems, brains can be regarded as networks of dynamic, adaptive transceivers that broadcast and selectively receive multiplexed temporally-patterned pulse signals. These signals enable complex signal interactions that select, reinforce, and bind common subpatterns and create emergent lower dimensional signals that propagate through spreading activation interference networks. If memory traces share the same kind of temporal pattern forms as do active neuronal representations, then distributed, holograph-like content-addressable memories are made possible via temporal pattern resonances.

Neural Sequences and the Encoding of Time

Time Is of the Essence: Neural Codes, Synchronies, Oscillations, Architectures

Computation with Sequences in a Model of the Brain

Neural timescales from a computational perspective

Neural coding of space by time

Human hippocampal and entorhinal neurons encode the temporal structure of experience

Neuronal sequences in population bursts encode information in human cortex

Learning spatiotemporal signals using a recurrent spiking network that discretizes time

A model for cortical activity sequences

Spatio-Temporal Investigation of Brain-Wide Sequences

Cell assembly sequences arising from spike threshold adaptation keep track of time in the hippocampus

Encoding Sensory and Motor Patterns as Time-Invariant Trajectories in Recurrent Neural Networks

Understanding the computation of time using neural network models

Neuronal Sequence Models for Bayesian Online Inference

The Generation of Time in the Hippocampal Memory System.

Computation with Sequences of Assemblies in a Model of the Brain

Networks that learn the precise timing of event sequences

Sequential Memory: a Putative Neural and Synaptic Dynamical Mechanism.

Sequence learning, prediction, and replay in networks of spiking neurons

Temporal sequence learning in winner-take-all networks of spiking neurons demonstrated in a brain-based device

Sequence memory for prediction, inference and behaviour