Abstract:Multi-scale object detection in natural scenes is still challenging. To enhance the multi-scale perception capability, some algorithms combine the lower-level and higher-level information via multi-scale feature fusion strategies. However, the inherent spatial properties among instances and relations between foreground and background are ignored. In addition, the human-defined "center-based" regression quality evaluation strategy, predicting a high-to-low score based on a linear relationship with the distance to the center of ground-truth box, is not robust to scale-variant objects. In this work, we propose a Depth-Guided Progressive Network (DGPNet) for multi-scale object detection. Specifically, besides the prediction of classification and localization, the depth is estimated and used to guide the image features in a weighted manner to obtain a better spatial representation. Therefore, depth estimation and 2D object detection are simultaneously learned via a unified network, where the depth features are merged as auxiliary information into the detection branch to enhance the discrimination among multi-scale objects. Moreover, to overcome the difficulty of empirically fitting the localization quality function, high-quality predicted boxes on scale-variant objects are more adaptively obtained by an IoU-aware progressive sampling strategy. We divide the sampling process into two stages, i.e., "statistical-aware" and "IoU-aware". The former selects thresholds for positive samples based on statistical characteristics of multi-scale instances, and the latter further selects high-quality samples by IoU on the basis of the former. Therefore, the final ranking scores better reflect the quality of localization. Experiments verify that our method outperforms state-of-the-art methods on the KINS and Cityscapes dataset.

Previewer for Multi-Scale Object Detector.

Deep Dual-Stream Network with Scale Context Selection Attention Module for Semantic Segmentation

MSSD: multi-scale object detector based on spatial pyramid depthwise convolution and efficient channel attention mechanism

Multi-Scale Positive Sample Refinement for Few-Shot Object Detection

Delving into the Scale Variance Problem in Object Detection

Pooling Pyramid Network for Object Detection

Precise Single-stage Detector

SSD: Single Shot MultiBox Detector

Multiple-in-Single-out Object Detector Leveraging Spiking Neural Membrane Systems and Multiple Transformers

3DSSD: Point-based 3D Single Stage Object Detector

DPSSD: Dual-Path Single-Shot Detector

Multi-scale detector optimized for small target

MPF-Net: multi-projection filtering network for few-shot object detection

Single-Shot Object Detection via Feature Enhancement and Channel Attention

SSN: Scale Selection Network for Multi-Scale Object Detection in Remote Sensing Images

Comprehensive Feature Enhancement Module For Single-Shot Object Detector

TDFSSD: Top-Down Feature Fusion Single Shot MultiBox Detector

Towards Better Object Detection in Scale Variation with Adaptive Feature Selection

Detecting Small Objects in Thermal Images Using Single-Shot Detector

Depth-Guided Progressive Network for Object Detection

FSSD: Feature Fusion Single Shot Multibox Detector