Abstract:Feature pyramid has been an efficient method to extract features at different scales. Development over this method mainly focuses on aggregating contextual information at different levels while seldom touching the inter-level correlation in the feature pyramid. Early computer vision methods extracted scale-invariant features by locating the feature extrema in both spatial and scale dimension. Inspired by this, a convolution across the pyramid level is proposed in this study, which is termed pyramid convolution and is a modified 3-D convolution. Stacked pyramid convolutions directly extract 3-D (scale and spatial) features and outperforms other meticulously designed feature fusion modules. Based on the viewpoint of 3-D convolution, an integrated batch normalization that collects statistics from the whole feature pyramid is naturally inserted after the pyramid convolution. Furthermore, we also show that the naive pyramid convolution, together with the design of RetinaNet head, actually best applies for extracting features from a Gaussian pyramid, whose properties can hardly be satisfied by a feature pyramid. In order to alleviate this discrepancy, we build a scale-equalizing pyramid convolution (SEPC) that aligns the shared pyramid convolution kernel only at high-level feature maps. Being computationally efficient and compatible with the head design of most single-stage object detectors, the SEPC module brings significant performance improvement ($>4$AP increase on MS-COCO2017 dataset) in state-of-the-art one-stage object detectors, and a light version of SEPC also has $\sim3.5$AP gain with only around 7% inference time increase. The pyramid convolution also functions well as a stand-alone module in two-stage object detectors and is able to improve the performance by $\sim2$AP. The source code can be found at <a class="link-external link-https" href="https://github.com/jshilong/SEPC" rel="external noopener nofollow">this https URL</a>.

Pyramid Dilated Deeper Convlstm For Video Salient Object Detection

SAFPN: a Full Semantic Feature Pyramid Network for Object Detection

Multilevel Spatial-Temporal Feature Aggregation for Video Object Detection

Video Salient Object Detection via Fully Convolutional Networks

Pyramid R-CNN: Towards Better Performance and Adaptability for 3D Object Detection

Salient Object Detection with Pyramid Attention and Salient Edges

Dense Residual Pyramid Networks for Salient Object Detection

Scale-Equalizing Pyramid Convolution for Object Detection

Enhanced Feature Pyramidal Network for Object Detection

Dual Pyramid Network for Salient Object Detection

Regularized Densely-Connected Pyramid Network for Salient Instance Segmentation

Video Object Segmentation with 3D Convolution Network

DeepPyram: Enabling Pyramid View and Deformable Pyramid Reception for Semantic Segmentation in Cataract Surgery Videos

Aggregating Attentional Dilated Features for Salient Object Detection

Video object segmentation by Multi-Scale Pyramidal Multi-Dimensional LSTM with generated depth context

Parallel Residual Bi-Fusion Feature Pyramid Network for Accurate Single-Shot Object Detection

Symmetric Pyramid Attention Convolutional Neural Network for Moving Object Detection

Reverse Densely Connected Feature Pyramid Network For Object Detection

MSSD: multi-scale object detector based on spatial pyramid depthwise convolution and efficient channel attention mechanism

LiDAR-based Online 3D Video Object Detection with Graph-based Message Passing and Spatiotemporal Transformer Attention

AWANet: Attentive-Aware Wide-Kernels Asymmetrical Network with Blended Contour Information for Salient Object Detection