An Embedded Feature Pyramid Network Enables Bidirectional Information Flow for Object Detection and Instance Segmentation
Chunning Meng,Zequn Sun,Tao Li,Lianzhi Huo,Sheng-Jiang Chang,Zhiqing Zhang
DOI: https://doi.org/10.2139/ssrn.4830894
IF: 6
2024-12-18
Neurocomputing
Abstract:Object detection and instance segmentation are fundamental tasks in computer vision. In the past decade, deep neural networks have become the dominating approach for accomplishing these purposes, among which feature pyramid networks (FPNs) are popular models for simultaneous object detection and instance segmentation because their unique capability in multi-scale feature representation. However, the existing FPNs are often suffered from low utilization of multi-scale information and inadequacy in receptive field. To address these issues, here we proposed an efficient embedded feature pyramid network (EFPNet), which enables bidirectional information flow to create and utilize feature pyramids with richer multi-scale information. To establish the bidirectional parallel information flow, small three-level feature pyramids were firstly inserted into the main feature pyramid of the backbone model, leading to an enlarged receptive field and the increased utilization of multi-scale information, especially the deep semantic information. Moreover, we further designed a pathway enhancement module to form another cascading bidirectional information flow, enhancing the utilization of the shallow detailed information. Finally, we presented a global selection module, based on global pooling, to further expand the receptive field and select important features from the rich multi-scale information extracted in previous steps. Experiments on the MS COCO, PASCAL VOC and HRSID datasets validated the superiority of our proposed EFPNet approach over state-of-the-art baseline methods by achieving an improvement of 1.2%-4.8% in average precision (AP) for both object detection and instance segmentation tasks.
computer science, artificial intelligence