Abstract:State-of-the-art two-stage object detectors apply a classifier to a sparse set of object proposals, relying on region-wise features extracted by RoIPool or RoIAlign as inputs. The region-wise features, in spite of aligning well with the proposal locations, may still lack the crucial context information which is necessary for filtering out noisy background detections, as well as recognizing objects possessing no distinctive appearances. To address this issue, we present a simple but effective Hierarchical Context Embedding (HCE) framework, which can be applied as a plug-and-play component, to facilitate the classification ability of a series of region-based detectors by mining contextual cues. Specifically, to advance the recognition of context-dependent object categories, we propose an image-level categorical embedding module which leverages the holistic image-level context to learn object-level concepts. Then, novel RoI features are generated by exploiting hierarchically embedded context information beneath both whole images and interested regions, which are also complementary to conventional RoI features. Moreover, to make full use of our hierarchical contextual RoI features, we propose the early-and-late fusion strategies (i.e., feature fusion and confidence fusion), which can be combined to boost the classification accuracy of region-based detectors. Comprehensive experiments demonstrate that our HCE framework is flexible and generalizable, leading to significant and consistent improvements upon various region-based detectors, including FPN, Cascade R-CNN, Mask R-CNN and PA-FPN. With simple modification, our HCE framework can be conveniently adapted to fit the structure of one-stage detectors, and achieve improved performance for SSD, RetinaNet and EfficientDet.

Hierarchical Context Features Embedding for Object Detection

Hierarchical Context Embedding for Region-based Object Detection.

Deep Dual-Stream Network with Scale Context Selection Attention Module for Semantic Segmentation

Context Encoding for Semantic Segmentation

HCNet: Hierarchical Context Network for Semantic Segmentation

Multi-scale Global Context Feature Pyramid Network for Object Detector

Salient Object Detection via High-to-Low Hierarchical Context Aggregation

Attention-guided chained context aggregation for semantic segmentation

Context Union Edge Network for Semantic Segmentation of Small-Scale Objects in Very High Resolution Remote Sensing Images

Learning discriminative context for salient object detection

FHEDN: A based on context modeling Feature Hierarchy Encoder-Decoder Network for face detection

Enhancing Unsupervised Semantic Segmentation Through Context-Aware Clustering

Global Context Encoding For Salient Objects Detection

Encouraging the Mutual Interact Between Dataset-Level and Image-Level Context for Semantic Segmentation of Remote Sensing Image

Deep Salient Object Detection with Contextual Information Guidance

Pyramidal Region Context Module for Semantic Segmentation

Hierarchical video object segmentation

Hierarchical Self-Attention Embedded Neural Network With Dense Connection for Remote-Sensing Image Semantic Segmentation

Exploring Dense Context for Salient Object Detection

Improving small object detection via context-aware and feature-enhanced plug-and-play modules

MM-FPN: Multi-path and Multi-scale Feature Pyramid Network for Object Detection