Revealing structure components of the retina by deep learning networks

Qi Yan,Zhaofei Yu,Feng Chen,Jian K. Liu

DOI: https://doi.org/10.48550/arXiv.1711.02837

2017-11-08

Abstract:Deep convolutional neural networks (CNNs) have demonstrated impressive performance on visual object classification tasks. In addition, it is a useful model for predication of neuronal responses recorded in visual system. However, there is still no clear understanding of what CNNs learn in terms of visual neuronal circuits. Visualizing CNN's features to obtain possible connections to neuronscience underpinnings is not easy due to highly complex circuits from the retina to higher visual cortex. Here we address this issue by focusing on single retinal ganglion cells with a simple model and electrophysiological recordings from salamanders. By training CNNs with white noise images to predicate neural responses, we found that convolutional filters learned in the end are resembling to biological components of the retinal circuit. Features represented by these filters tile the space of conventional receptive field of retinal ganglion cells. These results suggest that CNN could be used to reveal structure components of neuronal circuits.

Machine Learning,Computer Vision and Pattern Recognition,Neurons and Cognition

What problem does this paper attempt to address?

This paper aims to explore the ability of deep convolutional neural networks (CNNs) in learning the structural components of retinal neural circuits. Specifically, by training a CNN to predict the responses of individual retinal ganglion cells (RGCs) to white - noise images, the researchers attempt to reveal whether the CNN can learn features similar to the biological structural components of the retina. The main goal of the study is to understand, visualize, and interpret the components in the CNN, especially how these components are related to the biological basis of the retinal neural circuit. The paper mentions that although CNNs perform well in visual object classification tasks and can be used to predict the neuronal responses recorded in the visual system, there is currently a lack of clear understanding of what kind of visual neural circuit structures CNNs have actually learned during the learning process. Therefore, by focusing on a simple model of individual RGCs and electrophysiological recordings from salamanders, the researchers hope to find out whether the convolutional filters learned by CNNs can match the biological components of the retinal circuit. The experimental results show that CNNs can indeed learn features similar to the biological components in the retinal circuit, and these features can cover the traditional receptive field space of RGCs, thus demonstrating the potential of CNNs in revealing the structural components of neural circuits.

Revealing structure components of the retina by deep learning networks

Revealing Fine Structures of the Retinal Receptive Field by Deep-Learning Networks

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

A Retina-LGN-V1 Structure-like Spiking Neuron Network for Image Feature Extraction

CSNN: an Augmented Spiking Based Framework with Perceptron-Inception

Modeling responses of macaque and human retinal ganglion cells to natural images using a convolutional neural network

Unraveling Neural Coding of Dynamic Natural Visual Scenes Via Convolutional Recurrent Neural Networks.

A Unified Theory of Early Visual Representations from Retina to Cortex through Anatomically Constrained Deep CNNs

Learning Sensor-Specific Spatial-Spectral Features of Hyperspectral Images Via Convolutional Neural Networks

Neural Encoding and Decoding with Deep Learning for Dynamic Natural Vision

Convolutional neural networks for vision neuroscience: significance, developments, and outstanding issues

Convolutional Neural Networks Exploiting Attributes of Biological Neurons

Towards Better Analysis of Deep Convolutional Neural Networks

From deep learning to mechanistic understanding in neuroscience: the structure of retinal prediction

Deeper Interpretability of Deep Networks

Explaining V1 Properties with a Biologically Constrained Deep Learning Architecture

Saliency Prediction on Omnidirectional Images with Brain-Like Shallow Neural Network.

Retinotopic Mapping Enhances the Robustness of Convolutional Neural Networks

Human Eyes Inspired Recurrent Neural Networks are More Robust Against Adversarial Noises

Human Eyes-Inspired Recurrent Neural Networks Are More Robust Against Adversarial Noises

Study Of The Application Of Deep Convolutional Neural Networks (Cnns) In Processing Sensor Data And Biomedical Images