Abstract:Spatial contexts, such as the backgrounds and surroundings, are considered critical in Human-Object Interaction (HOI) recognition, especially when the instance-centric foreground is blurred or occluded. Recent advancements in HOI detectors are usually built upon detection transformer pipelines. While such an object-detection-oriented paradigm shows promise in localizing objects, its exploration of spatial context is often insufficient for accurately recognizing human actions. To enhance the capabilities of object detectors for HOI detection, we present a dual-branch framework named ContextHOI, which efficiently captures both object detection features and spatial contexts. In the context branch, we train the model to extract informative spatial context without requiring additional hand-craft background labels. Furthermore, we introduce context-aware spatial and semantic supervision to the context branch to filter out irrelevant noise and capture informative contexts. ContextHOI achieves state-of-the-art performance on the HICO-DET and v-coco benchmarks. For further validation, we construct a novel benchmark, HICO-ambiguous, which is a subset of HICO-DET that contains images with occluded or impaired instance cues. Extensive experiments across all benchmarks, complemented by visualizations, underscore the enhancements provided by ContextHOI, especially in recognizing interactions involving occluded or blurred instances.

An Efficient Isolation Method for Contextual Object Detection

Contextual Object Detection with Spatial Context Prototypes

Discovering spatial context prototypes for object detection

Using Contextual Words for Object Detection

Quantifying and Transferring Contextual Information in Object Detection

Contextualizing Object Detection and Classification

Context Refinement for Object Detection

Dynamic Local and Global Context Exploration for Small Object Detection

Object Tracking Algorithm Based on Improved Context Model in Combination with Detection Mechanism for Suspected Objects

Multi-scale Feature and Spatial Relation Inference for Object Detection.

ContextHOI: Spatial Context Learning for Human-Object Interaction Detection

A Spindle Model For Contextual Object Detection

A Context Model for Object Recognition Improved by Spatial Relationships

Exploring Context Information for Accurate and Fast Object Detection

Object detection using discriminative photogrammetric context

Object Recognition Based on Improved Context Model

Discriminative Hough Context Model for Object Detection

Task-Specific Context Decoupling for Object Detection

SELECTIVE CONVOLUTIONAL NETWORK: AN EFFICIENT OBJECT DETECTOR WITH IGNORING BACKGROUND

Learning discriminative context for salient object detection

Exploring Person Context and Local Scene Context for Object Detection