Abstract:State-of-the-art two-stage object detectors apply a classifier to a sparse set of object proposals, relying on region-wise features extracted by RoIPool or RoIAlign as inputs. The region-wise features, in spite of aligning well with the proposal locations, may still lack the crucial context information which is necessary for filtering out noisy background detections, as well as recognizing objects possessing no distinctive appearances. To address this issue, we present a simple but effective Hierarchical Context Embedding (HCE) framework, which can be applied as a plug-and-play component, to facilitate the classification ability of a series of region-based detectors by mining contextual cues. Specifically, to advance the recognition of context-dependent object categories, we propose an image-level categorical embedding module which leverages the holistic image-level context to learn object-level concepts. Then, novel RoI features are generated by exploiting hierarchically embedded context information beneath both whole images and interested regions, which are also complementary to conventional RoI features. Moreover, to make full use of our hierarchical contextual RoI features, we propose the early-and-late fusion strategies (i.e., feature fusion and confidence fusion), which can be combined to boost the classification accuracy of region-based detectors. Comprehensive experiments demonstrate that our HCE framework is flexible and generalizable, leading to significant and consistent improvements upon various region-based detectors, including FPN, Cascade R-CNN, Mask R-CNN and PA-FPN. With simple modification, our HCE framework can be conveniently adapted to fit the structure of one-stage detectors, and achieve improved performance for SSD, RetinaNet and EfficientDet.

Hierarchical-Based Object Detection with Improved Locality Sparse Coding

Detection and Segmentation of Moving Objects Using Temporal and Spatial Cues

Hierarchical Saliency Mapping for Weakly Supervised Object Localization Based on Class Activation Mapping

Robust Object Tracking with a Hierarchical Ensemble Framework

A New Detection and Tracking Algorithm for Moving Objects

Beyond Local Search: Tracking Objects Everywhere with Instance-Specific Proposals

Real-time Detection of the Moving Object in Video Sequences

Object detection based on hierarchical visual perception mechanism

Body Detection and Tracking with Hierarchical Scheme in Dynamic Scenes

Hierarchical video object segmentation

A Dual-Input Moving Object Detection Method in Remote Sensing Image Sequences via Temporal Semantics

Hierarchical objectness network for region proposal generation and object detection.

Moving Object Detection of Dynamic Scenes Using Spatio-Temporal Context and Background Modeling

Hierarchical fusion and divergent activation based weakly supervised learning for object detection from remote sensing images

Embracing Events and Frames with Hierarchical Feature Refinement Network for Object Detection

Detecting and segmenting multiple moving objects using level-set method

Hierarchical object detection for very high-resolution satellite images

Hierarchical Structure and Joint Training for Large Scale Semi-supervised Object Detection

Motion Cue Based Instance-level Moving Object Detection

Multi-Object Tracking by Hierarchical Visual Representations

Hierarchical Context Embedding for Region-based Object Detection.