Abstract:Two sensory neurons usually display trial-by-trial spike-count correlations given the repeated representations of a stimulus. The effects of such response correlations on population-level sensory coding have been the focal contention in computational neuroscience over the past few years. In the meantime, multivariate pattern analysis (MVPA) has become the leading analysis approach in functional magnetic resonance imaging (fMRI), but the effects of response correlations among voxel populations remain underexplored. Here, instead of conventional MVPA analysis, we calculate linear Fisher information of population responses in human visual cortex (five males, one female) and hypothetically remove response correlations between voxels. We found that voxelwise response correlations generally enhance stimulus information, a result standing in stark contrast to the detrimental effects of response correlations reported in empirical neurophysiological studies. By voxel-encoding modeling, we further show that these two seemingly opposite effects actually can coexist within the primate visual system. Furthermore, we use principal component analysis to decompose stimulus information in population responses onto different principal dimensions in a high-dimensional representational space. Interestingly, response correlations simultaneously reduce and enhance information on higher- and lower-variance principal dimensions, respectively. The relative strength of the two antagonistic effects within the same computational framework produces the apparent discrepancy in the effects of response correlations in neuronal and voxel populations. Our results suggest that multivariate fMRI data contain rich statistical structures that are directly related to sensory information representation, and the general computational framework to analyze neuronal and voxel population responses can be applied in many types of neural measurements. SIGNIFICANCE STATEMENT Despite the vast research interest in the effect of spike-count noise correlations on population codes in neurophysiology, it remains unclear how the response correlations between voxels influence MVPA in human imaging. We used an information-theoretic approach and showed that unlike the detrimental effects of response correlations reported in neurophysiology, voxelwise response correlations generally improve sensory coding. We conducted a series of in-depth analyses and demonstrated that neuronal and voxel response correlations can coexist within the visual system and share some common computational mechanisms. These results shed new light on how the population codes of sensory information can be evaluated via different neural measurements.

Stimulus-dependent correlations and population codes

High-Fidelity Coding with Correlated Neurons

Impact of triplet correlations on neural population codes

Strong, but not weak, noise correlations are beneficial for population coding

Representational Geometries Reveal Differential Effects of Response Correlations on Population Codes in Neurophysiology and Functional Magnetic Resonance Imaging

Correlations and the Encoding of Information in the Nervous System

Population Coding and Decoding in a Neural Field: A Computational Study

The impact of functional correlations on task information coding

Population coding in mouse visual cortex: response reliability and dissociability of stimulus tuning and noise correlation

The use of decoding to analyze the contribution to the information of the correlations between the firing of simultaneously recorded neurons

Correlated Firing and the Information Represented by Neurons in Short Epochs

Measuring Stimulus Information Transfer Between Neural Populations through the Communication Subspace

Population rate codes carried by mean, fluctuation and synchrony of neuronal firings

Population Rate Coding in Recurrent Neuronal Networks with Unreliable Synapses

Information processing in a neuron ensemble with the multiplicative correlation structure.

Recurrent Circuit Based Neural Population Codes for Stimulus Representation and Inference

The geometry of correlated variability leads to highly suboptimal discriminative sensory coding

Stimulus-dependent maximum entropy models of neural population codes

An Information Theoretic Approach to the Contributions of the Firing Rates and the Correlations Between the Firing of Neurons.

Separating intrinsic interactions from extrinsic correlations in a network of sensory neurons

Decorrelation of Neural-Network Activity by Inhibitory Feedback