Abstract:Modern deep neural network-based object detection methods typically classify candidate proposals using their interior features. However, global and local surrounding contexts that are believed to be valuable for object detection are not fully exploited by existing methods yet. In this work, we take a step towards understanding what is a robust practice to extract and utilize contextual information to facilitate object detection in practice. Specifically, we consider the following two questions: “how to identify useful global contextual information for detecting a certain object?” and “how to exploit local context surrounding a proposal for better inferring its contents?” We provide preliminary answers to these questions through developing a novel attention to context convolution neural network (AC-CNN)-based object detection model. AC-CNN effectively incorporates global and local contextual information into the region-based CNN (e.g., fast R-CNN and faster R-CNN) detection framework and provides better object detection performance. It consists of one attention-based global contextualized (AGC) subnetwork and one multi-scale local contextualized (MLC) subnetwork. To capture global context, the AGC subnetwork recurrently generates an attention map for an input image to highlight useful global contextual locations, through multiple stacked long short-term memory layers. For capturing surrounding local context, the MLC subnetwork exploits both the inside and outside contextual information of each specific proposal at multiple scales. The global and local context are then fused together for making the final decision for detection. Extensive experiments on PASCAL VOC 2007 and VOC 2012 well demonstrate the superiority of the proposed AC-CNN over well-established baselines.

Using Contextual Words for Object Detection

Contextual Object Detection with Spatial Context Prototypes

Discovering spatial context prototypes for object detection

How Context Helps: A Discriminative Codeword Selection Method for Object Detection

Quantifying and Transferring Contextual Information in Object Detection

Contextualizing Object Detection and Classification

Object detection using discriminative photogrammetric context

Deep feature based contextual model for object detection

Fusing Context Features and Spatial Attention to Improve Object Detection

A Contextual Bidirectional Enhancement Method for Remote Sensing Image Object Detection

Bag of Contextual-Visual Words for Road Scene Object Detection from Mobile Laser Scanning Data

An Efficient Isolation Method for Contextual Object Detection

Exploring Person Context and Local Scene Context for Object Detection

Context-Aware Semi-Local Feature Detector.

Attentive Contexts for Object Detection

Contextual Object Detection with Multimodal Large Language Models

Object Categorization Using Local Feature Context.

A Context Model for Object Recognition Improved by Spatial Relationships

Object Recognition Based on Improved Context Model

Context Refinement for Object Detection

An Object-Level High-Order Contextual Descriptor Based on Semantic, Spatial, and Scale Cues.