Abstract:Despite notable advancements in the field of computer vision, the precise detection of tiny objects continues to pose a significant challenge, largely owing to the minuscule pixel representation allocated to these objects in imagery data. This challenge resonates profoundly in the domain of geoscience and remote sensing, where high-fidelity detection of tiny objects can facilitate a myriad of applications ranging from urban planning to environmental monitoring. In this paper, we propose a new framework, namely, DeNoising FPN with Trans R-CNN (DNTR), to improve the performance of tiny object detection. DNTR consists of an easy plug-in design, DeNoising FPN (DN-FPN), and an effective Transformer-based detector, Trans R-CNN. Specifically, feature fusion in the feature pyramid network is important for detecting multiscale objects. However, noisy features may be produced during the fusion process since there is no regularization between the features of different scales. Therefore, we introduce a DN-FPN module that utilizes contrastive learning to suppress noise in each level's features in the top-down path of FPN. Second, based on the two-stage framework, we replace the obsolete R-CNN detector with a novel Trans R-CNN detector to focus on the representation of tiny objects with self-attention. Experimental results manifest that our DNTR outperforms the baselines by at least 17.4% in terms of APvt on the AI-TOD dataset and 9.6% in terms of AP on the VisDrone dataset, respectively. Our code will be available at <a class="link-external link-https" href="https://github.com/hoiliu-0801/DNTR" rel="external noopener nofollow">this https URL</a>.

NeRF-RPN: A general framework for object detection in NeRFs

NeRF-Loc: Transformer-Based Object Localization Within Neural Radiance Fields

DeRPN: Taking a Further Step Toward More General Object Detection.

NeRF-Det: Learning Geometry-Aware Volumetric Representation for Multi-View 3D Object Detection

DReg-NeRF: Deep Registration for Neural Radiance Fields

DiscoNeRF: Class-Agnostic Object Field for 3D Object Discovery

RFP-Net: Receptive field-based proposal generation network for object detection

RPFA-Net - a 4D RaDAR Pillar Feature Attention Network for 3D Object Detection.

Instance Neural Radiance Field

Pre-NeRF 360: Enriching Unbounded Appearances for Neural Radiance Fields

Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks

MonoNeRD: NeRF-like Representations for Monocular 3D Object Detection

C-RPNs: Promoting object detection in real world via a cascade structure of Region Proposal Networks.

Ensemble R-FCN for Object Detection.

NeRF-Feat: 6D Object Pose Estimation using Feature Rendering

NeRF-In: Free-Form NeRF Inpainting with RGB-D Priors

NeRF-In: Free-Form Inpainting for Pretrained NeRF With RGB-D Priors

NeRF-DetS: Enhanced Adaptive Spatial-wise Sampling and View-wise Fusion Strategies for NeRF-based Indoor Multi-view 3D Object Detection

A DeNoising FPN With Transformer R-CNN for Tiny Object Detection