Abstract:Semantic segmentation is an important computer vision task, which aims to allocate a semantic label to each pixel in an image. When training a segmentation model, it is common to fine-tune a classification network pre-trained on a large-scale dataset. However, as an intrinsic property of the classification model, invariance to spatial perturbation resulting from the lose of detail-sensitivity prevents segmentation networks from achieving high performance. The use of standard poolings is one of the key factors for this invariance. The most common standard poolings are max and average pooling. Max pooling can increase both the invariance to spatial perturbations and the non-linearity of the networks. Average pooling, on the other hand, is sensitive to spatial perturbations, but is a linear function. For semantic segmentation, we prefer both the preservation of detailed cues within a local feature region and non-linearity that increases a network's functional complexity. In this work, we propose a polynomial pooling (P-pooling) function that finds an intermediate form between max and average pooling to provide an optimally balanced and self-adjusted pooling strategy for semantic segmentation. The P-pooling is differentiable and can be applied into a variety of pre-trained networks. Extensive studies on the PASCAL VOC, Cityscapes and ADE20k datasets demonstrate the superiority of P-pooling over other poolings. Experiments on various network architectures and state-of-the-art training strategies also show that models with P-pooling layers consistently outperform those directly fine-tuned using pre-trained classification models.

Feature Pooling in Scene Character Recognition: A Comprehensive Study

Deep Contextual Stroke Pooling for Scene Character Recognition.

Scene Aligned Pooling For Complex Video Recognition

Scene Character Recognition via Bag-of-Words Model: A Comprehensive Study

Face Image Classification by Pooling Raw Features

A New Perspective for Flexible Feature Gathering in Scene Text Recognition Via Character Anchor Pooling

Face Identification with Second-Order Pooling

Learning Important Spatial Pooling Regions for Scene Classification

Building Detail-Sensitive Semantic Segmentation Networks with Polynomial Pooling.

Consecutive Convolutional Activations for Scene Character Recognition

Scene Understanding Based on Multi-Scale Pooling of Deep Learning Features

Performance Comparison Of Two Pooling Strategies For Remote Sensing Image Scene Classification

Simple Techniques Make Sense: Feature Pooling and Normalization for Image Classification

Face Identification with Second-Order Pooling in Single-Layer Networks

Strip Pooling: Rethinking Spatial Pooling for Scene Parsing

Bag of Shape Features with a Learned Pooling Function for Shape Recognition

Scene Character Recognition Using Coupled Spatial Learning

Face recognition with a small occluded training set using spatial and statistical pooling.

Combining Local and Global: Rich and Robust Feature Pooling for Visual Recognition.

Attribute Aware Pooling for Pedestrian Attribute Recognition

Learning to Pool High-Level Features for Face Representation.