Abstract:Human ability to recognize complex visual patterns arises through transformations performed by successive areas in the ventral visual cortex. Deep neural networks trained end-to-end for object recognition approach human capabilities, and offer the best descriptions to date of neural responses in the late stages of the hierarchy. But these networks provide a poor account of the early stages, compared to traditional hand-engineered models, or models optimized for coding efficiency or prediction. Moreover, the gradient backpropagation used in end-to-end learning is generally considered to be biologically implausible. Here, we overcome both of these limitations by developing a bottom-up self-supervised training methodology that operates independently on successive layers. Specifically, we maximize feature similarity between pairs of locally-deformed natural image patches, while decorrelating features across patches sampled from other images. Crucially, the deformation amplitudes are adjusted proportionally to receptive field sizes in each layer, thus matching the task complexity to the capacity at each stage of processing. In comparison with architecture-matched versions of previous models, we demonstrate that our layerwise complexity-matched learning (LCL) formulation produces a two-stage model (LCL-V2) that is better aligned with selectivity properties and neural activity in primate area V2. We demonstrate that the complexity-matched learning paradigm is responsible for much of the emergence of the improved biological alignment. Finally, when the two-stage model is used as a fixed front-end for a deep network trained to perform object recognition, the resultant model (LCL-V2Net) is significantly better than standard end-to-end self-supervised, supervised, and adversarially-trained models in terms of generalization to out-of-distribution tasks and alignment with human behavior.

Multilayer In-Place Learning Networks with Adaptive Lateral Connections: Models and Simulations

Multilayer In-Place Learning Networks: Multitask Invariance And Adaptive Lateral Connections

Multilayer In-Place Learning Networks for Modeling Functional Layers in the Laminar Cortex.

Cortex Inspired In-Place Learning Networks For General Invariance And Multi-Tasks

TheMultilayer In-Place Learning NetworkfortheDevelopment of GeneralInvariances Andmulti-Task Learning

The Multilayer In-Place Learning Network for the Development of General Invariances and Multi-Task Learning

A Multilayer In-Place Learning Network For Development Of General Invariances

Biological lateral inhibition and digital cellular neural network applied on associations memory

Layered Self-Adaptive Neural Network Approach To Early Visual Information-Processing

Local design for multi-layer perceptron

Lateral Connections Improve Generalizability of Learning in a Simple Neural Network

A lateral inhibition neural network based on neocortex topology

Evolving Connections in Group of Neurons for Robust Learning

A Chaotic Multilayer Lif Scheme To Model The Primary Visual Cortex

Learn Layer-wise Connections in Graph Neural Networks

In-situ learning in multilayer locally-connected memristive spiking neural network

Towards Modeling the Interaction of Spatial-Associative Neural Network Representations for Multisensory Perception

Layerwise complexity-matched learning yields an improved model of cortical area V2

Receptive Field and Feature Map Formation in the Primary Visual Cortex via Hebbian Learning with Inhibitory Feedback

Spatio-Temporal Adaptation in the Unsupervised Development of Networked Visual Neurons

Multisensory Concept Learning Framework Based on Spiking Neural Networks