Abstract:This paper presents an in-depth analysis of the scale generalisation properties of the scale-covariant and scale-invariant Gaussian derivative networks, complemented with both conceptual and algorithmic extensions. For this purpose, Gaussian derivative networks are evaluated on new rescaled versions of the Fashion-MNIST and the CIFAR-10 datasets, with spatial scaling variations over a factor of 4 in the testing data, that are not present in the training data. Additionally, evaluations on the previously existing STIR datasets show that the Gaussian derivative networks achieve better scale generalisation than previously reported for these datasets for other types of deep networks. We first experimentally demonstrate that the Gaussian derivative networks have quite good scale generalisation properties on the new datasets, and that average pooling of feature responses over scales may sometimes also lead to better results than the previously used approach of max pooling over scales. Then, we demonstrate that using a spatial max pooling mechanism after the final layer enables localisation of non-centred objects in image domain, with maintained scale generalisation properties. We also show that regularisation during training, by applying dropout across the scale channels, referred to as scale-channel dropout, improves both the performance and the scale generalisation. In additional ablation studies, we demonstrate that discretisations of Gaussian derivative networks, based on the discrete analogue of the Gaussian kernel in combination with central difference operators, perform best or among the best, compared to a set of other discrete approximations of the Gaussian derivative kernels. Finally, by visualising the activation maps and the learned receptive fields, we demonstrate that the Gaussian derivative networks have very good explainability properties.

Using Multi-Scale Gaussian Derivatives for Appearance-Based Recognition

Combination of Local Multiple Patterns and Exponential Discriminant Analysis for facial recognition

Multivariate image analysis in gaussian multi-scale space for defect detection

Multi‐scale Cross‐domain Alignment for Person Image Generation

Gabor Surface Feature for Face Recognition

Robust 3D Face Recognition by Local Shape Difference Boosting

Multiscale bi-Gaussian filter for adjacent curvilinear structures detection with application to vasculature images

Dietary intake and physical performance in healthy elderly women: A 3-year follow-up

Multi-Scale Object Detection in Remote Sensing Images Based on Feature Interaction and Gaussian Distribution

Cascaded Maximum Median-Margin Discriminant Projection with Its Application to Face Recognition

Edge-Guided Image Object Detection in Multiscale Segmentation for High-Resolution Remotely Sensed Imagery.

Scale generalisation properties of extended scale-covariant and scale-invariant Gaussian derivative networks on image datasets with spatial scaling variations

Large-margin multi-view Gaussian process for image classification

Gabor Feature Based Class-Dependence Feature Analysis For Face Recognition

InstanceGaussian: Appearance-Semantic Joint Gaussian Representation for 3D Instance-Level Perception

Natural Object Recognition Using the Combination of Gaussian Model and Region Growing

Covariance descriptors on a Gaussian manifold and their application to image set classification

Data-driven hierarchical structure kernel for multiscale part-based object recognition

A Multi-Modal Face Recognition Method Using Complete Local Derivative Patterns And Depth Maps

Grassmannian Discriminant Maps (GDM) for Manifold Dimensionality Reduction with Application to Image Set Classification

Efficient Multi-Object Recognition Using GMM Segmentation Feature Fusion Approach