Abstract:in video understanding, a core task is to detect the objects in frames and recently state-of-art methods are proposed to exhaustively detect the possible objects. Few studies are discussing exact these objects by the importance of object roles, which refer to ones that are relatively concerned and attract more attention of the audience in a short video clip. This paper intends to represent the audience's attention transfer mechanism by attractive objects (key object) and proposes a key object detection network based on temporal reinforcement learning (RL). Temporal RL means our model structure using LSTM to output RL reward values dynamically. In a sense, it avoids formal reward setting may cause the RL result does not achieve expectation. In order to mark the object that attracts the audience's attention in successive switching video clips, our method keeps an eye of the attractive object by iterating the value of temporal RL strategy. The proposed model can detect multiple key objects simultaneously with the help of a temporal RL strategy that analyses the attention transfer. Specifically, the spatial features and temporal features, extracted by the ensemble convolution networks, are sent into the RL model to represent the objects, corresponding motions and less relative backgrounds. Google AVA [24] dataset, annotate the position and action of the main characters among many existing objects, are selected as the experiment dataset. Compared with other models, the results show that the proposed method can continuously focus on the attractive objects in the sequenced fragments. Different from the general structure of the deep reinforcement model based on DQN network, our temporal RL parameters are mainly generated and calculated in the KOD-attention block. Therefore, in the process of simulating the attention transfer mechanism, our method uses lightweight computation to achieve satisfactory detection precision and speed in the performance of key object detection.

ReinforceNet: A reinforcement learning embedded object detection framework with region selection network

Reinforcedet - Object Detection by Integrating Reinforcement Learning with Decoupled Pipeline.

Foreground Gating and Background Refining Network for Surveillance Object Detection

R2Net: Residual refinement network for salient object detection

Reinforced Axial Refinement Network for Monocular 3D Object Detection

A Recurrent Reinforcement Learning Approach for Small Object Detection with Dynamic Refinement

R-Net: Recursive Decoder with Edge Refinement Network for Salient Object Detection

FRBNet: feature-iterative reinforcement and boundary-directed network for camouflaged object detection

Integrating Saliency Ranking and Reinforcement Learning for Enhanced Object Detection

Video Key Object Detection Network via Reinforcement Learning

Training Robust Object Detectors From Noisy Category Labels and Imprecise Bounding Boxes

HyperNet: Towards Accurate Region Proposal Generation and Joint Object Detection

C-RPNs: Promoting object detection in real world via a cascade structure of Region Proposal Networks.

Deep Regionlets: Blended Representation and Deep Learning for Generic Object Detection

Residual Learning for Salient Object Detection

Hierarchical Region Proposal Refinement Network for Weakly Supervised Object Detection

Deep Reinforcement Learning for Object Detection with the Updatable Target Network

Enhancing representation learning by exploiting effective receptive fields for object detection

Bi-RRNet: Bi-level recurrent refinement network for camouflaged object detection

Parallel Search by Reinforcement Learning for Object Detection

Residual Refinement Network with Attribute Guidance for Precise Saliency Detection