Abstract:Two sensory neurons usually display trial-by-trial spike-count correlations given the repeated representations of a stimulus. The effects of such response correlations on population-level sensory coding have been the focal contention in computational neuroscience over the past few years. In the meantime, multivariate pattern analysis (MVPA) has become the leading analysis approach in functional magnetic resonance imaging (fMRI), but the effects of response correlations among voxel populations remain underexplored. Here, instead of conventional MVPA analysis, we calculate linear Fisher information of population responses in human visual cortex (five males, one female) and hypothetically remove response correlations between voxels. We found that voxelwise response correlations generally enhance stimulus information, a result standing in stark contrast to the detrimental effects of response correlations reported in empirical neurophysiological studies. By voxel-encoding modeling, we further show that these two seemingly opposite effects actually can coexist within the primate visual system. Furthermore, we use principal component analysis to decompose stimulus information in population responses onto different principal dimensions in a high-dimensional representational space. Interestingly, response correlations simultaneously reduce and enhance information on higher- and lower-variance principal dimensions, respectively. The relative strength of the two antagonistic effects within the same computational framework produces the apparent discrepancy in the effects of response correlations in neuronal and voxel populations. Our results suggest that multivariate fMRI data contain rich statistical structures that are directly related to sensory information representation, and the general computational framework to analyze neuronal and voxel population responses can be applied in many types of neural measurements. SIGNIFICANCE STATEMENT Despite the vast research interest in the effect of spike-count noise correlations on population codes in neurophysiology, it remains unclear how the response correlations between voxels influence MVPA in human imaging. We used an information-theoretic approach and showed that unlike the detrimental effects of response correlations reported in neurophysiology, voxelwise response correlations generally improve sensory coding. We conducted a series of in-depth analyses and demonstrated that neuronal and voxel response correlations can coexist within the visual system and share some common computational mechanisms. These results shed new light on how the population codes of sensory information can be evaluated via different neural measurements.

Representational Geometries Reveal Differential Effects of Response Correlations on Population Codes in Neurophysiology and Functional Magnetic Resonance Imaging

Understanding Multivariate Brain Activity: Evaluating the Effect of Voxelwise Noise Correlations on Population Codes in Functional Magnetic Resonance Imaging

Population coding in mouse visual cortex: response reliability and dissociability of stimulus tuning and noise correlation

Stimulus-dependent correlations and population codes

Revisiting the high-dimensional geometry of population responses in visual cortex

Population Coding and Decoding in a Neural Field: A Computational Study

The Impact of Noise Correlation on Multivariate Pattern Classification in Fmri

Spatiotemporal Dynamics of Neuronal Population Response in the Primary Visual Cortex.

High-Fidelity Coding with Correlated Neurons

The geometry of correlated variability leads to highly suboptimal discriminative sensory coding

The impact of functional correlations on task information coding

Strong, but not weak, noise correlations are beneficial for population coding

Extracting multidimensional stimulus-response correlations using hybrid encoding-decoding of neural activity

Impact of triplet correlations on neural population codes

Neuronal firing rate diversity lowers the dimension of population covariability

Decoding Population Neuronal Responses by Topological Clustering

Subspace Projection Approaches To Classification And Visualization Of Neural Network-Level Encoding Patterns

Exploring Brain Effective Connectivity in Visual Perception Using a Hierarchical Correlation Network.

Decoding the encoding of functional brain networks: An fMRI classification comparison of non-negative matrix factorization (NMF), independent component analysis (ICA), and sparse coding algorithms

Spatial and temporal correlations of spike trains in frog retinal ganglion cells

Decoding Visual Feature Versus Visual Spatial Attention Control with Deep Neural Networks