Abstract:Abstract To understand the complexity of stimulus selectivity in primary visual cortex (V1), models constructed to match observed responses to complex time-varying stimuli, instead of to explain responses to simple parametric stimuli, are increasingly used. While such models often can more accurately reflect the computations performed by V1 neurons in more natural visual environments, they do not by themselves provide insight into established measures of V1 neural selectivity such as receptive field size, spatial frequency tuning and phase invariance. Here, we suggest a series of analyses that can be directly applied to encoding models to link complex encoding models to more interpretable aspects of stimulus selectivity, applied to nonlinear models of V1 neurons recorded in awake macaque in response to random bar stimuli. In linking model properties to more classical measurements, we demonstrate several novel aspects of V1 selectivity not available to simpler experimental measurements. For example, we find that individual spatiotemporal elements of the V1 models often have a smaller spatial scale than the overall neuron sensitivity, and that this results in non-trivial tuning to spatial frequencies. Additionally, our proposed measures of nonlinear integration suggest that more classical classifications of V1 neurons into simple versus complex cells are spatial-frequency dependent. In total, rather than obfuscate classical characterizations of V1 neurons, model-based characterizations offer a means to more fully understand their selectivity, and provide a means to link their classical tuning properties to their roles in more complex, natural, visual processing. Significance statement Visual neurons are increasingly being studied with more complex, natural visual stimuli, with increasingly complex models necessary to characterize their response properties. Here, we describe a battery of analyses that relate these more complex models to classical characterizations. Using such model-based characterizations of V1 neurons furthermore yields several new insights into V1 processing not possible to capture in more classical means to measure their visual selectivity.

Modeling Response Properties of V2 Neurons Using a Hierarchical K-means Model

Hierarchical k-means algorithm for modeling visual area v2 neurons

A Model of V4 Neurons Based on Sparse Coding.

Predicting Single Neuron Responses of the Primary Visual Cortex with Deep Learning Model

Spatiotemporal Dynamics of Neuronal Population Response in the Primary Visual Cortex.

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

An Image Local Feature Representation Method Using Hierarchical Vision Network Model

Hierarchical Bayesian Inference and Learning in Spiking Neural Networks.

A neural model for V1 that incorporates dendritic nonlinearities and back-propagating action potentials

Modeling the Human Visual System: Comparative Insights from Response-Optimized and Task-Optimized Vision Models, Language Models, and different Readout Mechanisms

A Hierarchical Model Based on Visual Cortex

Model-based characterization of the selectivity of neurons in primary visual cortex

V4 Neural Network Model for Shape-Based Feature Extraction and Object Discrimination

Convolutional neural network models applied to neuronal responses in macaque V1 reveal limited nonlinear processing

Deep Learning Predicts Correlation between a Functional Signature of Higher Visual Areas and Sparse Firing of Neurons

Testing our conceptual understanding of V1 function

V4 neural network model for visual saliency and discriminative local representation of shapes

Binocular Matching Model Based on Hierarchical V1 and V2 Receptive Fields With Color, Orientation, and Region Feature Information

Convolutional neural network models of neuronal responses in macaque V1 reveal limited non-linear processing

Hierarchical Bayesian Modeling of Inter-Trial Variability and Variational Bayesian Learning of Common Spatial Patterns from Multichannel EEG

Complex Properties of Training Stimuli Affect Brain Alignment in a Deep Network Model of Mouse Visual Cortex