Abstract:Convolutional Neural Networks (CNNs) are a kind of artificial neural network designed to extract features and find out patterns for tasks such as segmentation, recognizing objects, and drawing up classification. Within a CNNs architecture, pooling operations are used until the number of parameters and the computational complexity are reduced. Numerous papers have focused on investigating the impact of pooling on the performance of Convolutional Neural Networks (CNNs), leading to the development of various pooling models. Recently, a fuzzy pooling operation based on type-1 fuzzy sets was introduced to cope with the local imprecision of the feature maps. However, in fuzzy set theory, it is not always accurate to assume that the degree of non-membership of an element in a fuzzy set is simply the complement of the degree of membership. This is due to the potential existence of a hesitation degree, which implies a certain level of uncertainty. To overcome this limitation, intuitionistic fuzzy sets (IFS) were introduced to incorporate the concept of a degree of hesitation. In this paper, we introduce a novel pooling operation based on intuitionistic fuzzy sets to incorporate the degree of hesitation heretofore neglected by a fuzzy pooling operation based on classical fuzzy sets, and we investigate its performance in the context of image classification. Intuitionistic pooling is performed in four steps: bifuzzification (by the transformation of data through the use of membership and non-membership maps), first aggregation (through the transformation of the IFS into a standard fuzzy set, second aggregation (through the transformation and use of a sum operator), and the defuzzification of feature map neighborhoods by using a max operator. IFS pooling is used for the construction of an intuitionistic pooling layer that can be applied as a drop-in replacement for the current, fuzzy (type-1) and crisp, pooling layers of CNN architectures. Various experiments involving multiple datasets demonstrate that an IFS-based pooling can enhance the classification performance of a CNN. A benchmarking study reveals that this significantly outperforms even the most recent pooling models, especially in stochastic environments.

Fix your downsampling ASAP! Be natively more robust via Aliasing and Spectral Artifact free Pooling

Detail-Preserving Pooling in Deep Networks

Adaptive Salience Preserving Pooling for Deep Convolutional Neural Networks

Exploring Novel Pooling Strategies for Edge Preserved Feature Maps in Convolutional Neural Networks

Self-Attentive Pooling for Efficient Deep Learning

Delving Deeper into Anti-Aliasing in ConvNets

Position-Aware Anti-Aliasing Filters for 3D Medical Image Analysis

LIP: Local Importance-Based Pooling

Improving Feature Stability during Upsampling -- Spectral Artifacts and the Importance of Spatial Context

Enhanced mechanisms of pooling and channel attention for deep learning feature maps

The Importance of Anti-Aliasing in Tiny Object Detection

Improving the Robustness of Deep Convolutional Neural Networks Through Feature Learning

EARN: Toward Efficient and Robust JPEG Compression Artifact Reduction

Hartley Spectral Pooling for Deep Learning

Making Convolutional Networks Shift-Invariant Again

Learning Spatio-Temporal Downsampling for Effective Video Upscaling

A improved pooling method for convolutional neural networks

Building Detail-Sensitive Semantic Segmentation Networks with Polynomial Pooling.

INT-FUP: Intuitionistic Fuzzy Pooling

Fast algorithm of arbitrary factor subpixel downsampling based on frequency analysis

Balanced Mixture of SuperNets for Learning the CNN Pooling Architecture