Abstract:Neural circuits in the brain perform a variety of essential functions, including input classification, pattern completion, and the generation of rhythms and oscillations that support processes such as breathing and locomotion. There is also substantial evidence that the brain encodes memories and processes information via sequences of neural activity. In this dissertation, we are focused on the general problem of how neural circuits encode rhythmic activity, as in central pattern generators (CPGs), as well as the encoding of sequences. Traditionally, rhythmic activity and CPGs have been modeled using coupled oscillators. Here we take a different approach, and present models for several different neural functions using threshold-linear networks. Our approach aims to unify attractor-based models (e.g., Hopfield networks) which encode static and dynamic patterns as attractors of the network. In the first half of this dissertation, we present several attractor-based models. These include: a network that can count the number of external inputs it receives; two models for locomotion, one encoding five different quadruped gaits and another encoding the orientation system of a swimming mollusk; and, finally, a model that connects the fixed point sequences with locomotion attractors to obtain a network that steps through a sequence of dynamic attractors. In the second half of the thesis, we present new theoretical results, some of which have already been published. There, we established conditions on network architectures to produce sequential attractors. Here we also include several new theorems relating the fixed points of composite networks to those of their component subnetworks, as well as a new architecture for layering networks which produces "fusion" attractors by minimizing interference between the attractors of individual layers.

Learning Sequence Attractors in Recurrent Networks with Hidden Neurons

Coexistence of Cyclic Sequential Pattern Recognition and Associative Memory in Neural Networks by Attractor Mechanisms

Learning and Processing the Ordinal Information of Temporal Sequences in Recurrent Neural Circuits

Memory Dynamics in Attractor Networks with Saliency Weights.

Stimulus-Driven and Spontaneous Dynamics in Excitatory-Inhibitory Recurrent Neural Networks for Sequence Representation

A Brain-Inspired Spiking Neural Network Model with Temporal Encoding and Learning

Learning, Storing, and Disentangling Correlated Patterns in Neural Networks.

Biologically Plausible Sequence Learning with Spiking Neural Networks.

Recurrent Network Models Of Sequence Generation And Memory

Learning Sequence Representations by Non-local Recurrent Neural Memory

Continuous Attractors of Discrete-Time Recurrent Neural Networks

A Spiking Neural Network System for Robust Sequence Recognition

Learning spatiotemporal signals using a recurrent spiking network that discretizes time

Attractor-based models for sequences and pattern generation in neural circuits

Memorizing morph patterns in small-world neuronal network

Coherent noise enables probabilistic sequence replay in spiking neuronal networks

Sequence learning, prediction, and replay in networks of spiking neurons

Incorporating structural plasticity into self-organization recurrent networks for sequence learning

Continuous Online Sequence Learning with an Unsupervised Neural Network Model

Learning And Retrieving Spatio-Temporal Sequences With Any Static Associative Neural Network

Networks that learn the precise timing of event sequences