Abstract:Modern top-performing object detectors depend heavily on backbone networks, whose advances bring consistent performance gains through exploring more effective network structures. In this paper, we propose a novel and flexible backbone framework, namely CBNetV2, to construct high-performance detectors using existing open-sourced pre-trained backbones under the pre-training fine-tuning paradigm. In particular, CBNetV2 architecture groups multiple identical backbones, which are connected through composite connections. Specifically, it integrates the high- and low-level features of multiple backbone networks and gradually expands the receptive field to more efficiently perform object detection. We also propose a better training strategy with assistant supervision for CBNet-based detectors. Without additional pre-training of the composite backbone, CBNetV2 can be adapted to various backbones (CNN-based vs. Transformer-based) and head designs of most mainstream detectors (one-stage vs. two-stage, anchor-based vs. anchor-free-based). Experiments provide strong evidence that, compared with simply increasing the depth and width of the network, CBNetV2 introduces a more efficient, effective, and resource-friendly way to build high-performance backbone networks. Particularly, our Dual-Swin-L achieves 59.4% box AP and 51.6% mask AP on COCO test-dev under the single-model and single-scale testing protocol, which is significantly better than the state-of-the-art result (57.7% box AP and 50.2% mask AP) achieved by Swin-L, while the training schedule is reduced by 6$\times$. With multi-scale testing, we push the current best single model result to a new record of 60.1% box AP and 52.3% mask AP without using extra training data. Code is available at <a class="link-external link-https" href="https://github.com/VDIGPKU/CBNetV2" rel="external noopener nofollow">this https URL</a>.

Adaptive Linear Span Network for Object Skeleton Detection

DeepSkeleton: Learning Multi-task Scale-associated Deep Side Outputs for Object Skeleton Extraction in Natural Images

SSN: Scale Selection Network for Multi-Scale Object Detection in Remote Sensing Images

Attention-based scale sequence network for small object detection

SM-NAS: Structural-to-Modular Neural Architecture Search for Object Detection

SAFDNet: A Simple and Effective Network for Fully Sparse 3D Object Detection

Lightweight Multi-Scale Spatiotemporal Graph Convolutional Network for Skeleton-Based Action Recognition

ALFPN: Adaptive Learning Feature Pyramid Network for Small Object Detection

Relational Network for Skeleton-Based Action Recognition

Slim-neck by GSConv: A lightweight-design for real-time detector architectures

Hi-Fi: Hierarchical Feature Integration for Skeleton Detection

Multi-Modality Adaptive Feature Fusion Graph Convolutional Network for Skeleton-Based Action Recognition

CBNet: A Composite Backbone Network Architecture for Object Detection

Semantics-Guided Neural Networks for Efficient Skeleton-Based Human Action Recognition

Cross stage partial connections based weighted Bi-directional feature pyramid and enhanced spatial transformation network for robust object detection

Full-Dimensional Optimizable Network: A Channel, Frame and Joint-Specific Network Modeling for Skeleton-Based Action Recognition

NAS-ASDet: An Adaptive Design Method for Surface Defect Detection Network using Neural Architecture Search

DSN: A New Deformable Subnetwork for Object Detection

ScaleNAS: One-Shot Learning of Scale-Aware Representations for Visual Recognition

MTA-Net: A One-Stage Detector Based on a Multiscale Task-Aligned Network for Catenary Support Components

AFANet: A Multibackbone Compatible Feature Fusion Framework for Effective Remote Sensing Object Detection