Abstract:In this era of artificial intelligence, deep neural networks like Convolutional Neural Networks (CNNs) have emerged as front-runners, often surpassing human capabilities. These deep networks are often perceived as the panacea for all challenges. Unfortunately, a common downside of these networks is their ''black-box'' character, which does not necessarily mirror the operation of biological neural systems. Some even have millions/billions of learnable (tunable) parameters, and their training demands extensive data and time. Here, we integrate the principles of biological neurons in certain layer(s) of CNNs. Specifically, we explore the use of neuro-science-inspired computational models of the Lateral Geniculate Nucleus (LGN) and simple cells of the primary visual cortex. By leveraging such models, we aim to extract image features to use as input to CNNs, hoping to enhance training efficiency and achieve better accuracy. We aspire to enable shallow networks with a Push-Pull Combination of Receptive Fields (PP-CORF) model of simple cells as the foundation layer of CNNs to enhance their learning process and performance. To achieve this, we propose a two-tower CNN, one shallow tower and the other as ResNet 18. Rather than extracting the features blindly, it seeks to mimic how the brain perceives and extracts features. The proposed system exhibits a noticeable improvement in the performance (on an average of $5\%-10\%$) on CIFAR-10, CIFAR-100, and ImageNet-100 datasets compared to ResNet-18. We also check the efficiency of only the Push-Pull tower of the network.

A Novel Deep Learning Network Architecture with Cross-Layer Neurons

Convolutional Networks with Cross-Layer Neurons for Image Recognition

Advances in Convolutional Neural Networks

A deep graph convolutional neural network architecture for graph classification

Rethinking the Usage of Batch Normalization and Dropout in the Training of Deep Neural Networks

Multi-column Deep Neural Networks for Image Classification

Deeper Interpretability of Deep Networks

Convolutional Neural Networks Exploiting Attributes of Biological Neurons

Cross-layer transmission realized by light-emitting memristor for constructing ultra-deep neural network with transfer learning ability

A Novel Feature Fusion with Self-adaptive Weight Method Based on Deep Learning for Image Classification

Inter-layer Collision Networks

A novel capsule network based on deep routing and residual learning

Enhancing Image Classification Accuracy Based on AlexNet

Structure Learning of Deep Networks via DNA Computing Algorithm

Deep Adaptive Network: An Efficient Deep Neural Network with Sparse Binary Connections

Learning Deep Classifiers With Deep Features

Towards Better Analysis of Deep Convolutional Neural Networks

An End-to-End Deep Learning Architecture for Graph Classification

A layer-stress learning framework universally augments deep neural network tasks

A Layer-Wise Theoretical Framework for Deep Learning of Convolutional Neural Networks

IC-Network: Efficient Structure for Convolutional Neural Networks