Abstract:Temporal Action Detection is an important yet challenging task, in which temporal action proposal generation plays an important part. Since the temporal boundaries of action instances in videos are often ambiguous, it’s difficult to locate them precisely. Boundary Sensitive Network (BSN) (Lin et al. in ECCV, 2018) is a state-of-the-art corner-based method that can generate high-quality proposals with high recall rate. It contains a temporal evaluation network and a proposal evaluation network to generate and evaluate proposals separately, which can find the temporal boundaries of action instances directly to produce proposals with flexible temporal intervals and evaluate the quality of proposals. But BSN still has some issues: (1) Due to the small reception field of temporal evaluation network, it often generates many false temporal boundaries. (2) Evaluating the quality of proposals is a difficult task and not well solved in the paper. To address these issues, we propose Complementary Boundary Estimation Network (CBEN), an improved approach to temporal action proposal generation based on the framework of BSN. Specifically, we improve BSN in two aspects: Firstly, considering the temporal evaluation network of BSN can only capture local information and tends to have high response at background segments, we combine it with a new network with larger reception field to better identify false temporal action boundaries. Secondly, to evaluate the quality of temporal action proposals more accurately, we propose a class-based proposal evaluation network and combine it with a tIoU-based proposal evaluation network to filter out low-quality proposals. Extensive experiments on THUMOS14 and ActivityNet-1.3 datasets indicate that CBEN can achieve better performance than current mainstream methods on temporal action proposal generation. We further combine CBEN with an off-the-shelf action classifier, and show consistent performance improvements on THUMOS14 dataset.

Boundary Information Matters More: Accurate Temporal Action Detection with Temporal Boundary Network

Temporal Action Detection with Structured Segment Networks

Boundary Discretization and Reliable Classification Network for Temporal Action Detection

BACNet: Boundary-Anchor Complementary Network for Temporal Action Detection

A Malleable Boundary Network for temporal action detection?

Advancing Temporal Action Localization with a Boundary Awareness Network

BSN: Boundary Sensitive Network for Temporal Action Proposal Generation

Cascaded Boundary Network for High-Quality Temporal Action Proposal Generation

Boundary-Recovering Network for Temporal Action Detection

Boundary-Aware Cascade Networks for Temporal Action Segmentation

Pyramid Dilated Attention Network for Action Segmentation

Complementary Boundary Estimation Network for Temporal Action Proposal Generation.

Boundary Adjusted Network Based on Cosine Similarity for Temporal Action Proposal Generation

BLP - Boundary Likelihood Pinpointing Networks for Accurate Temporal Action Localization

Boundary Sensitive and Confidence Fusion Network for Temporal Action Localization

Multi-level Temporal Pyramid Network for Action Detection

Boundary Sensitive and Category Sensitive Network for Temporal Action Proposal Generation

A New Temporal Deconvolutional Pyramid Network For Action Detection

Non-Local Temporal Difference Network for Temporal Action Detection

Boundary-sensitive Denoised Temporal Reasoning Network for Video Action Segmentation

Boundary Sensitive Network : Submission to ActivityNet Challenge 2018