Abstract:Video object detection is a tough task due to the severe appearance degradation caused by rapid motion, sudden occlusion or rare poses. The great challenge facing video object detection is the simultaneous requirements on both accuracy and speed because the pursuit of one aspect usually causes significant expense to the other. Most existing methods mainly focus on improving detection accuracy with little attention to computationally efficient solutions, and thus they are impractical for many real-world applications. This motivates us to develop a real-time and high-accuracy video object detection method. In this paper, we propose a novel video object detector, called FastVOD-Net, which can yield highly accurate detection results at real-time speed. Specifically, we first develop a temporally-cascaded deformable alignment (TCDA) module to model the object displacements induced by video motion. Then, we introduce another two modules, namely spatially-refined temporal aggregation (SRTA) and attention-guided semantic distillation (AGSD), to improve the appearance feature of the currently processed frame and enhance the semantic representation of non-keyframes, respectively. For keyframe scheduling, we design an adaptive keyframe selection scheduler (AKSS) to adjust the keyframe interval online, making the keyframe usage more rational. On one hand, the characteristics of our FastVOD-Net enable it to sparsely perform expensive feature extraction, which significantly reduces the computational cost and thus guarantees real-time speed. On the other hand, the collaboration of the above tightly-coupled modules and adaptive keyframe scheduler makes FastVOD-Net fully exploit inter-frame temporal dependencies and thus guarantees high accuracy. Experiments on the ImageNet VID dataset show that our FastVOD-Net achieves 79.3% mAP at 29.6 fps or 81.2% mAP at 23.0 fps on an Nvidia RTX 2080 Ti GPU, which is the state-of-the-art performance in real time.

A Cross Frame Post-Processing Strategy for Video Object Detection.

Foreground Gating and Background Refining Network for Surveillance Object Detection

A Transformer-Based Object Detector with Coarse-Fine Crossing Representations

Optical-flow-based framework to boost video object detection performance with object enhancement

Object Detection Based on Faster R-CNN Algorithm with Skip Pooling and Fusion of Contextual Information

Fast video shot boundary detection framework employing pre-processing techniques

Progressive Frame-Proposal Mining for Weakly Supervised Video Object Detection

Frame Filtering and Path Verification for Improving Video Copy Detection

Tracking Assisted Faster Video Object Detection

Progressive Sparse Local Attention for Video Object Detection.

Accelerating real‐time object detection in high‐resolution video surveillance

Target detection for remote sensing based on the enhanced YOLOv4 with improved BiFPN

Video Object Detection by Aggregating Features Across Adjacent Frames

Impression Network for Video Object Detection

Dynamic Context-Sensitive Filtering Network for Video Salient Object Detection

FastVOD-Net: A Real-Time and High-Accuracy Video Object Detector

Exploiting Detected Visual Objects for Frame-Level Video Filtering

FFAVOD: Feature fusion architecture for video object detection

Practical Video Object Detection via Feature Selection and Aggregation

Bi-directional Skip Connection Feature Pyramid Network and Sub-Pixel Convolution for High-Quality Object Detection

Context-Aware Video Object Proposals.