Abstract:A widely accepted description of the primate visual cortex includes two information processing pathways: a ventral (or "what") pathway that computes properties of object identity such as shape and color, and a dorsal (or "where") pathway that computes properties of the location of stimuli on the retina. The current state-of-the-art work of visual cortex, including the well-known Neocognitron and HMAX models, exclusively concentrated on the modeling of ventral pathway to deliver the functionality for object identification. The fact that the two visual pathways are densely interconnected and interacted in the primate visual cortex was largely neglected. This work in contrast addresses how spatial ("where") and category ("what") representations could interconnect and interact via bidirectional processing and predict both location and identification of an object given a visual input.Our computational approach is based on the development of a scalable network model, which integrates a ventral pathway, dedicated to object identification, with a dorsal pathway, dedicated to object localization and segmentation. The network receive image stimuli and coupled "what" labels and "where" labels as three external signals, constructing a Y-shaped network as a hierarchy of (deep hidden) cortical layers. The sparse coding model at each level is l0-constrained and results in a highly efficient online learning that does not require iterative steps to reach a fixed point of sparse representation. The proposed sparse coding model can be further implemented in a divide-and-conquer manner to provide an effective solution to learn this deep network with bidirectional connections. A preliminary result has shown the network in small scale to deal with multiple objects slowing shifting in various natural backgrounds. The results have demonstrated the high accuracy of both attentional tuning and object recognition, as well as the interaction between them. Meeting abstract presented at VSS 2012

Spontaneous segregation of visual information between parallel streams of a multi-stream convolutional neural network

An analysis of information segregation in parallel streams of a multi-stream convolutional neural network

A Dual-Stream Neural Network Explains the Functional Segregation of Dorsal and Ventral Visual Pathways in Human Brains

Understanding Cortical Streams from a Computational Perspective

Exploring neural architectures for simultaneously recognizing multiple visual attributes

A single computational objective drives specialization of streams in visual cortex

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

Online Discriminative Sparse Coding As a Systems-level Model of the Primate's Dorsal and Ventral Pathways

Spatial and Colour Opponency in Anatomically Constrained Deep Networks

Vision at A Glance: Interplay between Fine and Coarse Information Processing Pathways

Visual information processing through the interplay between fine and coarse signal pathways

Interpreting the Residual Stream of ResNet18

Neural mechanisms for learning hierarchical structures of information

A Unified Theory of Early Visual Representations from Retina to Cortex through Anatomically Constrained Deep CNNs

What Makes a Face Look like a Hat: Decoupling Low-level and High-level Visual Properties with Image Triplets

Dual-stream Image Recognition Network Based on Visual Field-of-view Mechanism

Parallel Backpropagation for Shared-Feature Visualization

Automated scalable segmentation of neurons from multispectral images

Integrating Pixels and Segments: A Deep-Learning Method Inspired by the Informational Diversity of the Visual Pathways

Deep Neural Networks predict Hierarchical Spatio-temporal Cortical Dynamics of Human Visual Object Recognition