Abstract:Recent years have seen a significant rise in gigapixel-level image/video capture systems and benchmarks with high-resolution wide (HRW) shots. Different from close-up shots like MS COCO, the higher resolution and wider field of view raise new research and application problems, such as how to perform accurate and efficient object detection with such large input in low-power edge devices like UAVs. There are several unique challenges in HRW shots. (1) Sparse information: the objects of interest cover less area. (2) Various scale: there is 10 to 100x x object scale change in one single image. (3) Incomplete objects: the sliding window strategy to handle the large input leads to truncated objects at the window edge. (4) Multi-scale information: it is unclear how to use multi-scale information in training and inference. Consequently, directly using a close-up detector leads to inaccuracy and inefficiency. In this paper, we systematically investigate this problem and bridge the gap between object detection in close-up and HRW shots, by introducing a novel sparse architecture that can be integrated with common networks like ConvNet and Transformer. It leverages alternative sparse learning to complementarily fuse coarse-grained and fine-grained features to (1) adaptively extract valuable information from (2) different object scales. We also propose a novel Cross-window Non-Maximum Suppression (C-NMS) algorithm to (3) improve the box merge from different windows. Furthermore, we propose a (4) simple yet effective multi-scale training and inference strategy to improve accuracy. Experiments on two benchmarks with HRW shots, PANDA and DOTA-v1.0, demonstrate that our methods significantly improve accuracy (up to 5.8%) and speed (up to 3x) over SotAs, for both ConvNet or Transformer based detectors, on edge devices. Our code is open-sourced and available at https://github.com/liwenxi/SparseFormer.

LAROD-HD: Low-Cost Adaptive Real-Time Object Detection for High-Resolution Video Surveillance

Accelerating real‐time object detection in high‐resolution video surveillance

A Lightweight SE-YOLOv3 Network for Multi-Scale Object Detection in Remote Sensing Imagery.

Adaptive Resolution Optimization and Tracklet Reliability Assessment for Efficient Multi-Object Tracking

ESOD: Efficient Small Object Detection on High-Resolution Images

Hybrid harris hawk-arithmetic optimization with deep learning-driven object detection and classification for surveillance video analysis

Robust Real-Time Object Detection Based On Deep Learning For Very High Resolution Remote Sensing Images

Bridging the Gap Between Object Detection in Close-Up and High-Resolution Wide Shots

PLOD-YOLO: Premium Lightweight Object Detection for Autonomous Following Robot

Real-Time High-Resolution Pedestrian Detection in Crowded Scenes via Parallel Edge Offloading

A Low-Cost and Lightweight Real-Time Object-Detection Method Based on UAV Remote Sensing in Transportation Systems

Using Physical Dynamics: Accurate and Real-Time Object Detection for High-Resolution Video Streaming on Internet of Things Devices

LES-YOLO: Efficient Object Detection Algorithm Used on UAV for Traffic Monitoring

DALDet: Depth-Aware Learning Based Object Detection for Autonomous Driving

A Real-Time Object Detector for Autonomous Vehicles Based on YOLOv4

MHLDet: A Multi-Scale and High-Precision Lightweight Object Detector Based on Large Receptive Field and Attention Mechanism for Remote Sensing Images

Fast and Accurate Object Detection in Remote Sensing Images Based on Lightweight Deep Neural Network

3D Object Detection Based on Extremely Sparse Laser Point Cloud and RGB Images

An effective method for small objects detection based on MDFFAM and LKSPP

YOLO-Drone:Airborne real-time detection of dense small objects from high-altitude perspective

Edge YOLO: Real-Time Intelligent Object Detection System Based on Edge-Cloud Cooperation in Autonomous Vehicles