Abstract:Visual perceptual learning (VPL), defined as long-term improvement in a visual task, is considered a crucial tool for elucidating underlying visual and brain plasticity. However, the identification of a unified theory of VPL has long been controversial. Multiple existing models have proposed diverse mechanisms, including improved signal-to-noise ratio, changes in tuning curves, and reduction of noise correlations, as major contributors to improved neural representations associated with VPL. However, each model only accounts for specific aspects of the empirical findings, and there exists no theory that can comprehensively explain all empirical results. Here, we argue that all neural changes at single units can be conceptualized as geometric transformations of population response manifolds in a high-dimensional neural space. This approach enables conflicting major models of VPL to be quantitatively tested and compared within a unified computational theory. Following this approach, we found that changes in tuning curves and noise correlations, as emphasized by previous models, make no significant contributions to improved population representations by visual training. Instead, we identified neural manifold shrinkage due to reduced trial-by-trial neural response variability, a previously unexplored factor, as the primary mechanism underlying improved population representations. Furthermore, we showed that manifold shrinkage successfully accounts for learning effects across various domains, including artificial neural responses in deep neural networks trained on typical VPL tasks, multivariate BOLD signals in humans, and multi-unit activities in monkeys. These converging results suggest that our neural geometry theory offers a quantitative and comprehensive approach to explain a wide range of empirical results and to reconcile previously conflicting models of VPL.

A Geometrical Representation of M-P Neural Model and Its Applications

A geometrical representation of McCulloch-Pitts neural model and its applications

Geometric Methods in the Modeling of Robot Mechanisms

Visualizing and Understanding Neural Models in NLP

A New Neural Network Model And Its Application

Neural population geometry: An approach for understanding biological and artificial neural networks

Neural Network Based Classifers for a Vast Amount of Data

Geometrization of deep networks for the interpretability of deep learning systems

Geometry Distributions

A Fuzzy Classifier Based on the Constructive Covering Approach in Neural Networks

Learning nonlinear manifolds based on mixtures of localized linear manifolds under a self-organizing framework

Understanding over-parameterized deep networks by geometrization

Geometric Decomposition of Feed Forward Neural Networks

A Survey of Geometric Graph Neural Networks: Data Structures, Models and Applications

Neural P^3M: A Long-Range Interaction Modeling Enhancer for Geometric GNNs

Representations and generalization in artificial and brain neural networks

Understanding Neural Network Through Neuron Level Visualization.

A Bio-inspired Model for Image Representation and Image Analysis

A neural geometry theory comprehensively explains apparently conflicting models of visual perceptual learning

Revisiting Marr in Face: The Building of 2D--2.5D--3D Representations in Deep Neural Networks

Neural P$^3$M: A Long-Range Interaction Modeling Enhancer for Geometric GNNs