Abstract:Recent years have seen a significant rise in gigapixel-level image/video capture systems and benchmarks with high-resolution wide (HRW) shots. Different from close-up shots like MS COCO, the higher resolution and wider field of view raise new research and application problems, such as how to perform accurate and efficient object detection with such large input in low-power edge devices like UAVs. There are several unique challenges in HRW shots. (1) Sparse information: the objects of interest cover less area. (2) Various scale: there is 10 to 100x x object scale change in one single image. (3) Incomplete objects: the sliding window strategy to handle the large input leads to truncated objects at the window edge. (4) Multi-scale information: it is unclear how to use multi-scale information in training and inference. Consequently, directly using a close-up detector leads to inaccuracy and inefficiency. In this paper, we systematically investigate this problem and bridge the gap between object detection in close-up and HRW shots, by introducing a novel sparse architecture that can be integrated with common networks like ConvNet and Transformer. It leverages alternative sparse learning to complementarily fuse coarse-grained and fine-grained features to (1) adaptively extract valuable information from (2) different object scales. We also propose a novel Cross-window Non-Maximum Suppression (C-NMS) algorithm to (3) improve the box merge from different windows. Furthermore, we propose a (4) simple yet effective multi-scale training and inference strategy to improve accuracy. Experiments on two benchmarks with HRW shots, PANDA and DOTA-v1.0, demonstrate that our methods significantly improve accuracy (up to 5.8%) and speed (up to 3x) over SotAs, for both ConvNet or Transformer based detectors, on edge devices. Our code is open-sourced and available at https://github.com/liwenxi/SparseFormer.

CSVM Architectures for Pixel-Wise Object Detection in High-Resolution Remote Sensing Images

Fully Convolutional Svm For Car Detection In Uav Imagery

Small Low-Contrast Target Detection: Data-Driven Spatiotemporal Feature Fusion and Implementation

A Lightweight SE-YOLOv3 Network for Multi-Scale Object Detection in Remote Sensing Imagery.

SSF: Sparse Point Cloud Object Detection Based on Self-Adaptive Voxel Encoding and Focal-Sparse Convolution

Resource-Constrained Simultaneous Detection and Labeling of Objects in High-Resolution Satellite Images

An Effective and Lightweight Hybrid Network for Object Detection in Remote Sensing Images

Robust Object Detection For Tiny And Dense Targets In Vhr Aerial Images

An Efficient And Robust Integrated Geospatial Object Detection Framework For High Spatial Resolution Remote Sensing Imagery

Global Context-Augmented Objection Detection in VHR Optical Remote Sensing Images

Cognitive Video Surveillance Management in Hierarchical Edge Computing System with Long Short-Term Memory Model

SCCMDet: Adaptive Sparse Convolutional Networks Based on Class Maps for Real-Time Onboard Detection in Unmanned Aerial Vehicle Remote Sensing Images

Accelerating Convolution-Based Detection Model on Gpu

Bridging the Gap Between Object Detection in Close-Up and High-Resolution Wide Shots

Transformer and CNN Hybrid Deep Neural Network for Semantic Segmentation of Very-High-Resolution Remote Sensing Imagery

Parallel Cascade R-CNN for Object Detection in Remote Sensing Imagery

An Object Detection Algorithm with Visual Perception for High-Resolution Remote Sensing Images

GA-Net: Accurate and Efficient Object Detection on UAV Images Based on Grid Activations

Fast and Accurate, Convolutional Neural Network Based Approach for Object Detection from UAV

High-Resolution Network with Transformer Embedding Parallel Detection for Small Object Detection in Optical Remote Sensing Images

ConvMambaSR: Leveraging State-Space Models and CNNs in a Dual-Branch Architecture for Remote Sensing Imagery Super-Resolution