Abstract:Multi-layer detection is a widely used method in the field of object detection. It extracts multiple feature maps with different resolutions from the backbone network to detect objects of different scales, which can effectively cope with the problem of object scale change in object detection. Although the multi-layer detection utilizes multiple detection layers to alleviate the burden of one single detection layer and can improve the detection accuracy to some extent, this method has two limitations. First, manually assigning anchor boxes of different sizes to different feature maps is too dependent on the human experience. Second, there is a semantic gap between each detection layer in multi-layer detection. The same detector needs to simultaneously process the detection layers with inconsistent semantic strength, which increases the optimization difficulty of the detector. In this article, we propose a feature integrated network (FIN) based on single layer detection to deal with the problems mentioned above. Different from the existing methods, we design a series of verification experiments based on the multi-layer detection model, which shows that the shallow high-resolution feature map has the potential to simultaneously and effectively detect objects of various scales. Considering that the semantic information of the shallow feature map is weak, we propose two modules to enhance the representation ability of the single detection layer. First, we propose a detection adaptation network (DANet) to extract powerful feature maps that are useful for object detection tasks. Second, we combine global context information and local detail information with a verified hourglass module (VHM) to generate a single feature map with high resolution and rich semantic information so that we can assign all anchor boxes to this detection layer. In our model, all the detection operations are concentrated on a high-resolution feature map whose semantic information and detailed information are enhanced as much as possible. Therefore, the proposed model can solve the problem of anchor assignment and inconsistent semantic strength between multiple detection layers mentioned above. A large number of experiments on the Pattern Analysis, Statistical Modelling and Computational Learning Visual Object Classes (PASCAL VOC) and Microsoft Common Objects in Context (MS COCO) datasets show that our model has good detection performance for objects of various sizes. The proposed model can achieve 81.9 mAP when the size of the input image is 300 x 300.

Synthetical application of multi-feature map detection and multi-branch convolution

Dual-Branch Feature Fusion Network for Salient Object Detection

A Multi-Branch Feature Fusion Network for Building Detection in Remote Sensing Images

Multi-branch feature fusion and refinement network for salient object detection

Multi-scale Matching Networks for Semantic Correspondence

A Multi-Branch Feature Fusion Strategy Based on an Attention Mechanism for Remote Sensing Image Scene Classification

Multi-branch Input Structure for Pyramid Scene Parsing Network

Feature Correlation Analysis of Two-Branch Convolutional Networks for Multi-Source Image Classification.

Receptive Field Broadening and Boosting for Salient Object Detection

Multi-Object Detection in Security Screening Scene Based on Convolutional Neural Network

Fast Object Detection and Recognition Algorithm Based on Improved Multi-Scale Feature Maps

Remote Sensing Images Feature Learning Based On Multi-Branch Networks

Multi-Branch Parallel Networks for Object Detection in High-Resolution UAV Remote Sensing Images

Face detection method fusing multi-layer features

High-Level Semantic Networks for Multi-Scale Object Detection.

FIN: Feature Integrated Network for Object Detection

Multi-scale and Discriminative Part Detectors Based Features for Multi-label Image Classification.

Scene Classification Via Learning a Multi-Branch Convolutional Network.

Pedestrian Detection with Multi-View Convolution Fusion Algorithm

Multi-branch Bounding Box Regression for Object Detection

Head Detection Based on Convolutional Neural Network with Multi-Stage Weighted Feature