Abstract:The nervous system is under tight energy constraints and must represent information efficiently. This is particularly relevant in the dorsal part of the medial superior temporal area (MSTd) in primates where neurons encode complex motion patterns to support a variety of behaviors. A sparse decomposition model based on a dimensionality reduction principle known as non-negative matrix factorization (NMF) was previously shown to account for a wide range of monkey MSTd visual response properties. This model resulted in sparse, parts-based representations that could be regarded as basis flow fields, a linear superposition of which accurately reconstructed the input stimuli. This model provided evidence that the seemingly complex response properties of MSTd may be a by-product of MSTd neurons performing dimensionality reduction on their input. However, an open question is how a neural circuit could carry out this function. In the current study, we propose a spiking neural network (SNN) model of MSTd based on evolved spike-timing-dependent plasticity and homeostatic synaptic scaling (STDP-H) learning rules. We demonstrate that the SNN model learns compressed and efficient representations of the input patterns similar to the patterns that emerge from NMF, resulting in MSTd-like receptive fields observed in monkeys. This SNN model suggests that STDP-H observed in the nervous system may be performing a similar function as NMF with sparsity constraints, which provides a test bed for mechanistic theories of how MSTd may efficiently encode complex patterns of visual motion to support robust self-motion perception.SIGNIFICANCE STATEMENT The brain may use dimensionality reduction and sparse coding to efficiently represent stimuli under metabolic constraints. Neurons in monkey area MSTd respond to complex optic flow patterns resulting from self-motion. We developed a spiking neural network model that showed MSTd-like response properties can emerge from evolving spike-timing-dependent plasticity with STDP-H parameters of the connections between then middle temporal area and MSTd. Simulated MSTd neurons formed a sparse, reduced population code capable of encoding perceptual variables important for self-motion perception. This model demonstrates that complex neuronal responses observed in MSTd may emerge from efficient coding and suggests that neurobiological plasticity, like STDP-H, may contribute to reducing the dimensions of input stimuli and allowing spiking neurons to learn sparse representations.

Adaptation to visual sparsity enhances responses to infrequent stimuli

Adaptation to visual sparsity enhances responses to isolated stimuli

Cellular Adaptation Accounts for the Sparse and Reliable Sensory Stimulus Representation

Differential response of the retinal neural code with respect to the sparseness of natural images

Adaptation shapes the representational geometry in mouse V1 to efficiently encode the environment

Adaptation of retinal discriminability to natural scenes

Sparsity and Compressed Coding in Sensory Systems

Experimentally derived model shows that adaptation acts as a powerful spatiotemporal filter of visual responses in the rat collicular neurons

Adaptation optimizes sensory encoding of future stimuli

Adaptation to Low Signal to Noise Decreases Visual Sensitivity

Cascaded effects of spatial adaptation in the early visual system

Synaptic and network mechanisms of sparse and reliable visual cortical activity during nonclassical receptive field stimulation.

Neuronal Selectivity, Population Sparseness, and Ergodicity in the Inferior Temporal Visual Cortex.

Cortical Brightness Adaptation when Darkness and Brightness Produce Different Dynamical States in the Visual Cortex.

Visual Adaptation and Its Neural Mechanisms

Adaptation of spontaneous activity in the developing visual cortex

Spatial modulation of dark versus bright stimulus responses in the mouse visual system

Cortical Motion Perception Emerges from Dimensionality Reduction with Evolved Spike-Timing-Dependent Plasticity Rules

Adaptation to Visual Stimulation Modifies the Burst Firing Property of V1 Neurons

A Model of Attention-Guided Visual Sparse Coding

Adaptation-Dependent Synchronous Activity Contributes To Receptive Field Size Change Of Bullfrog Retinal Ganglion Cell