Abstract:Natural scenes usually contain a vast number of objects that need to be segmented and segregated from each other and from the background to guide behaviour. In the visual brain, object-based attention is the process by which image fragments belonging to the same objects are grouped together. The curve-tracing task is a special case of a perceptual grouping task that tests our ability to group image elements of an elongated curve. The task consists in determining which image elements belong to the same curve, and in the brain, neurons spread an enhanced activity level over the representation of the relevant curve. A previous "growth-cone model of attention" accounted for the scale invariance of tracing by proposing that the enhanced activity propagates at multiple levels of the visual cortical hierarchy. However, the precise neuronal circuitry for learning and implementing scale-invariant tracing remains unknown. We propose a new recurrent architecture for the scale-invariant labelling of curves and objects. The architecture is composed of a feedforward pathway that dynamically selects the right scale and prevents the spilling over of the enhanced activity to other curves, and a recurrent pathway for tag spreading that involves horizontal and feedback interactions, mediated by a disinhibitory loop involving VIP and SOM interneurons. We trained the network with curves up to seven pixels long using reinforcement learning and a learning rule local in time and space and we found that it generalized to curves of any length and to spatially extended objects. The network chose the appropriate scale and switched to higher or lower scales as dictated by the distance between curves, just has as been observed in human psychophysics and in the visual cortex of monkeys. Our work provide a mechanistic account of the learning of scale-invariant perceptual grouping in the brain.

A multi-scale neurodynamic implementation of incremental grouping

Incremental grouping of image elements in vision

How the brain learns to parse images using an attentional, incremental grouping process

Multi-Scale Extension in an Entorhinal-Hippocampal Model for Cognitive Map Building.

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

Learning compact generalizable neural representations supporting perceptual grouping

Accentuation, Boolean maps and perception of (dis)similarity in a neural model of visual segmentation

The quest for multiscale brain modeling

Incremental Deep Neural Network for Visual Categories

Neurobiologically realistic neural network enables cross-scale modeling of neural dynamics

Scaling Laws for Task-Optimized Models of the Primate Visual Ventral Stream

A model for integrating elementary neural functions into delayed-response behavior

Disentangling neural mechanisms for perceptual grouping

Multi-scale Image Analysis Based on Non-Classical Receptive Field Mechanism.

Gossamer: Scaling Image Processing and Reconstruction to Whole Brains

iNeMo: Incremental Neural Mesh Models for Robust Class-Incremental Learning

Advancing Spiking Neural Networks towards Multiscale Spatiotemporal Interaction Learning

Adaptive scales of integration and response latencies in a critically-balanced model of the primary visual cortex

A brain-inspired object-based attention network for multiobject recognition and visual reasoning

Running Large-Scale Simulations on the Neurorobotics Platform to Understand Vision – The Case of Visual Crowding

Mechanisms of Adaptive Spatial Integration in a Neural Model of Cortical Motion Processing