Abstract:Recent years have seen a significant rise in gigapixel-level image/video capture systems and benchmarks with high-resolution wide (HRW) shots. Different from close-up shots like MS COCO, the higher resolution and wider field of view raise new research and application problems, such as how to perform accurate and efficient object detection with such large input in low-power edge devices like UAVs. There are several unique challenges in HRW shots. (1) Sparse information: the objects of interest cover less area. (2) Various scale: there is 10 to 100x x object scale change in one single image. (3) Incomplete objects: the sliding window strategy to handle the large input leads to truncated objects at the window edge. (4) Multi-scale information: it is unclear how to use multi-scale information in training and inference. Consequently, directly using a close-up detector leads to inaccuracy and inefficiency. In this paper, we systematically investigate this problem and bridge the gap between object detection in close-up and HRW shots, by introducing a novel sparse architecture that can be integrated with common networks like ConvNet and Transformer. It leverages alternative sparse learning to complementarily fuse coarse-grained and fine-grained features to (1) adaptively extract valuable information from (2) different object scales. We also propose a novel Cross-window Non-Maximum Suppression (C-NMS) algorithm to (3) improve the box merge from different windows. Furthermore, we propose a (4) simple yet effective multi-scale training and inference strategy to improve accuracy. Experiments on two benchmarks with HRW shots, PANDA and DOTA-v1.0, demonstrate that our methods significantly improve accuracy (up to 5.8%) and speed (up to 3x) over SotAs, for both ConvNet or Transformer based detectors, on edge devices. Our code is open-sourced and available at https://github.com/liwenxi/SparseFormer.

High-Definition Technology of AI Inference Scheme for Object Detection on Edge/Terminal

High-definition object detection technology based on AI inference scheme and its implementation

Flexible high-resolution object detection on edge devices with tunable latency.

AyE-Edge: Automated Deployment Space Search Empowering Accuracy Yet Efficient Real-Time Object Detection on the Edge

Object Detection Acceleration Method by Improving Execution Efficiency of Edge AI Device

Slicing Aided Hyper Inference and Fine-tuning for Small Object Detection

Adaptive Slicing-Aided Hyper Inference for Small Object Detection in High-Resolution Remote Sensing Images

One-Stage Small Object Detection Using Super-Resolved Feature Map for Edge Devices

Small Object Detection in UAV Images Based on YOLOv8n

Finding a Needle in a Haystack: Tiny Flying Object Detection in 4K Videos using a Joint Detection-and-Tracking Approach

Accelerating real‐time object detection in high‐resolution video surveillance

OSDDY: embedded system-based object surveillance detection system with small drone using deep YOLO

Real-Time Object Detection and Recognition with Computer Vision

VVC Extension Scheme for Object Detection Using Contrast Reduction

Edge Device Verification Techniques for Updated Object Detection AI via Target Object Existence Detector

Edge-assisted Online On-device Object Detection for Real-time Video Analytics.

Bridging the Gap Between Object Detection in Close-Up and High-Resolution Wide Shots

Detection and tracking of infrared small target by jointly using SSD and pipeline filter

High-resolution processing and sigmoid fusion modules for efficient detection of small objects in an embedded system

Small object detection leveraging density‐aware scale adaptation