Abstract:This paper presents an in-depth analysis of the scale generalisation properties of the scale-covariant and scale-invariant Gaussian derivative networks, complemented with both conceptual and algorithmic extensions. For this purpose, Gaussian derivative networks are evaluated on new rescaled versions of the Fashion-MNIST and the CIFAR-10 datasets, with spatial scaling variations over a factor of 4 in the testing data, that are not present in the training data. Additionally, evaluations on the previously existing STIR datasets show that the Gaussian derivative networks achieve better scale generalisation than previously reported for these datasets for other types of deep networks. We first experimentally demonstrate that the Gaussian derivative networks have quite good scale generalisation properties on the new datasets, and that average pooling of feature responses over scales may sometimes also lead to better results than the previously used approach of max pooling over scales. Then, we demonstrate that using a spatial max pooling mechanism after the final layer enables localisation of non-centred objects in image domain, with maintained scale generalisation properties. We also show that regularisation during training, by applying dropout across the scale channels, referred to as scale-channel dropout, improves both the performance and the scale generalisation. In additional ablation studies, we demonstrate that discretisations of Gaussian derivative networks, based on the discrete analogue of the Gaussian kernel in combination with central difference operators, perform best or among the best, compared to a set of other discrete approximations of the Gaussian derivative kernels. Finally, by visualising the activation maps and the learned receptive fields, we demonstrate that the Gaussian derivative networks have very good explainability properties.

Frequency and Scale Perspectives of Feature Extraction

Dynamic Convolution Covariance Network Using Multi-Scale Feature Fusion for Remote Sensing Scene Image Classification

CSNN: an Augmented Spiking Based Framework with Perceptron-Inception

Scalenet: A Convolutional Network to Extract Multi-Scale and Fine-Grained Visual Features

Multiscale Spatial-Spectral Feature Extraction Network for Hyperspectral Image Classification

Hyperspectral Classification Via Spatial Context Exploration with Multi-Scale CNN

Approximation analysis of CNNs from a feature extraction view

Deep CovDenseSNN: A Hierarchical Event-Driven Dynamic Framework with Spiking Neurons in Noisy Environment

Statistical Characteristics-Based Multi-Scale Image Feature Extraction

Exploring Frequency Domain Interpretation of Convolutional Neural Networks

ScaleGCN: Efficient and Effective Graph Convolution Via Channel-Wise Scale Transformation.

Scale generalisation properties of extended scale-covariant and scale-invariant Gaussian derivative networks on image datasets with spatial scaling variations

Neural Gaussian Scale-Space Fields

Remote Sensing Image Scene Classification Using Multiscale Feature Fusion Covariance Network with Octave Convolution

DISCO: accurate Discrete Scale Convolutions

Effective Point Cloud Analysis Using Multi-Scale Features.

ScaleNet: Rethinking Feature Interaction from a Scale-Wise Perspective for Medical Image Segmentation.

Going Deeper in Frequency Convolutional Neural Network: A Theoretical Perspective

SAN: Learning Relationship between Convolutional Features for Multi-Scale Object Detection

High Efficient Deep Feature Extraction and Classification of Spectral-Spatial Hyperspectral Image Using Cross Domain Convolutional Neural Networks