Abstract:The recent advances in compressing high-accuracy convolutional neural networks (CNNs) have witnessed remarkable progress in real-time object detection. To accelerate detection speed, lightweight detectors always have few convolution layers using a single-path backbone. Single-path architecture, however, involves continuous pooling and downsampling operations, always resulting in coarse and inaccurate feature maps that are disadvantageous to locate objects. On the other hand, due to limited network capacity, recent lightweight networks are often weak in representing large-scale visual data. To address these problems, we present a dual-path network, named DPNet, with a lightweight attention scheme for real-time object detection. The dual-path architecture enables us to extract in parallel high-level semantic features and low-level object details. Although DPNet has a nearly duplicated shape with respect to single-path detectors, the computational costs and model size are not significantly increased. To enhance representation capability, a lightweight self-correlation module (LSCM) is designed to capture global interactions, with only a few computational overheads and network parameters. In the neck, LSCM is extended into a lightweight cross correlation module (LCCM), capturing mutual dependencies among neighboring scale features. We have conducted exhaustive experiments on MS COCO, Pascal VOC 2007, and ImageNet datasets. The experimental results demonstrate that DPNet achieves a state-of-the-art trade off between detection accuracy and implementation efficiency. More specifically, DPNet achieves 31.3% AP on MS COCO test-dev, 82.7% mAP on Pascal VOC 2007 test set, and 41.6% mAP on ImageNet validation set, together with nearly 2.5M model size, 1.04 GFLOPs, and 164 and 196 frames/s (FPS) FPS for [Formula: see text] input images of three datasets.

MSPNet: Multi-level Semantic Pyramid Network for Real-Time Object Detection.

Tiny-RetinaNet: A One-Stage Detector for Real-Time Object Detection

Multi-scale Lightweight Neural Network for Real-Time Object Detection.

RSANet: Towards Real-Time Object Detection with Residual Semantic-Guided Attention Feature Pyramid Network

MLA-Net: Feature Pyramid Network with Multi-Level Local Attention for Object Detection

A Lightweight Object Detection Framework for Remote Sensing Images

DPNet: Dual-Path Network for Real-Time Object Detection With Lightweight Attention

DMPNet: Distributed Multi-Scale Pyramid Network for Real-Time Semantic Segmentation

MRMNet: Multi-scale residual multi-branch neural network for object detection

SPMNet: A Light-Weighted Network with Separable Pyramid Module for Real-Time Semantic Segmentation

MSSD: multi-scale object detector based on spatial pyramid depthwise convolution and efficient channel attention mechanism

Fast Multi Semantic Pyramids Via Cross Fusing Inherent Features for Different-Scale Detection.

High-Level Semantic Networks for Multi-Scale Object Detection.

MSF-CSPNet: A Specially Designed Backbone Network for Faster R-CNN

A lightweight multi-dimension dynamic convolutional network for real-time semantic segmentation

Enhanced semantic feature pyramid network for small object detection

Lightweight Progressive Multilevel Feature Collaborative Network for Remote Sensing Image Salient Object Detection

PVANET: Deep but Lightweight Neural Networks for Real-time Object Detection

Lightweight Spatial Pyramid Pooling Network for Real-Time Semantic Segmentation

IPG-Net: Image Pyramid Guidance Network for Small Object Detection

Small Object Detection Method Based on Adaptive Spatial Parallel Convolution and Fast Multi-Scale Fusion