Abstract:The state of the art in many computer vision tasks is represented by Convolutional Neural Networks (CNNs). Although their hierarchical organization and local feature extraction are inspired by the structure of primate visual systems, the lack of lateral connections in such architectures critically distinguishes their analysis from biological object processing. The idea of enriching CNNs with recurrent lateral connections of convolutional type has been put into practice in recent years, in the form of learned recurrent kernels with no geometrical constraints. In the present work, we introduce biologically plausible lateral kernels encoding a notion of correlation between the feedforward filters of a CNN: at each layer, the associated kernel acts as a transition kernel on the space of activations. The lateral kernels are defined in terms of the filters, thus providing a parameter-free approach to assess the geometry of horizontal connections based on the feedforward structure. We then test this new architecture, which we call KerCNN, on a generalization task related to global shape analysis and pattern completion: once trained for performing basic image classification, the network is evaluated on corrupted testing images. The image perturbations examined are designed to undermine the recognition of the images via local features, thus requiring an integration of context information - which in biological vision is critically linked to lateral connectivity. Our KerCNNs turn out to be far more stable than CNNs and recurrent CNNs to such degradations, thus validating this biologically inspired approach to reinforce object recognition under challenging conditions.

Kervolutional Neural Networks

Continuous Volumetric Convolution Network with Self-Learning Kernels for Point Clouds

Advances in Convolutional Neural Networks

Elliptical Convolution Kernel: More Real Visual Field

Convolutional Kernel Networks

Non-linear Convolution Filters for CNN-based Learning

Convolutional Neural Network with Nonlinear Competitive Units.

KRR-CNN: kernels redundancy reduction in convolutional neural networks

Vector-kernel Convolutional Neural Networks.

Nonlinear CNN: Improving CNNs with Quadratic Convolutions

KNLConv: Kernel-space Non-local Convolution for Hyperspectral Image Super-resolution

Complex Convolution Kernel for Deep Networks

Kernel-based Translations of Convolutional Networks

KerCNNs: biologically inspired lateral connections for classification of corrupted images

C-volution: A Hybrid Operator for Visual Recognition.

CovNN: A Covariance Neural Network Extended from CNN

Anomaly Detection And Classification In Time Series With Kervolutional Neural Networks

Kriging Convolutional Networks

DK-CNNs: Dynamic Kernel Convolutional Neural Networks

Neural Collobrative Networks

A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects