Abstract:In this era of artificial intelligence, deep neural networks like Convolutional Neural Networks (CNNs) have emerged as front-runners, often surpassing human capabilities. These deep networks are often perceived as the panacea for all challenges. Unfortunately, a common downside of these networks is their ''black-box'' character, which does not necessarily mirror the operation of biological neural systems. Some even have millions/billions of learnable (tunable) parameters, and their training demands extensive data and time. Here, we integrate the principles of biological neurons in certain layer(s) of CNNs. Specifically, we explore the use of neuro-science-inspired computational models of the Lateral Geniculate Nucleus (LGN) and simple cells of the primary visual cortex. By leveraging such models, we aim to extract image features to use as input to CNNs, hoping to enhance training efficiency and achieve better accuracy. We aspire to enable shallow networks with a Push-Pull Combination of Receptive Fields (PP-CORF) model of simple cells as the foundation layer of CNNs to enhance their learning process and performance. To achieve this, we propose a two-tower CNN, one shallow tower and the other as ResNet 18. Rather than extracting the features blindly, it seeks to mimic how the brain perceives and extracts features. The proposed system exhibits a noticeable improvement in the performance (on an average of $5\%-10\%$) on CIFAR-10, CIFAR-100, and ImageNet-100 datasets compared to ResNet-18. We also check the efficiency of only the Push-Pull tower of the network.

Visualizing and Comparing Convolutional Neural Networks

Visualizing and comparing AlexNet and VGG using deconvolutional layers

Advances in Convolutional Neural Networks

Towards Better Analysis of Deep Convolutional Neural Networks

How convolutional neural network see the world - A survey of convolutional neural network visualization methods

Visualization Comparison of Vision Transformers and Convolutional Neural Networks

Return of the Devil in the Details: Delving Deep into Convolutional Nets

Deeper Interpretability of Deep Networks

Understanding Neural Networks Through Deep Visualization

Elliptical Convolution Kernel: More Real Visual Field

Convolutional Neural Networks Exploiting Attributes of Biological Neurons

Convolutional neural network-based image representation for visual loop closure detection

Understanding Neural Network Through Neuron Level Visualization.

A comprehensive survey on convolutional neural network in medical image analysis

A Visual Cortex-Attentive Deep Convolutional Neural Network for Digital Image Design

Comparison between layer-to-layer network training and conventional network training using Deep Convolutional Neural Networks

Convolutional neural networks for vision neuroscience: significance, developments, and outstanding issues

Brain inspired Robust Vision using Convolutional Neural Networks with Feedback

Complex Network for Complex Problems: A comparative study of CNN and Complex-valued CNN

Image recognition in depth: comparative study of CNN and Pre-trained VGG16 architecture for classification tasks

Visualization of Convolutional Neural Networks for Monocular Depth Estimation