Abstract:Recently, temporal action localization (TAL) methods, especially the weakly-supervised and unsupervised ones, have become a hot research topic. Existing unsupervised methods follow an iterative ''clustering and training'' strategy with diverse model designs during training stage, while they often overlook maintaining consistency between these stages, which is crucial: more accurate clustering results can reduce the noises of pseudolabels and thus enhance model training, while more robust training can in turn enrich clustering feature representation. We identify two critical challenges in unsupervised scenarios: 1. What features should the model generate for clustering? 2. Which pseudolabeled instances from clustering should be chosen for model training? After extensive explorations, we proposed a novel yet simple framework called Consistency-Oriented Progressive high actionness Learning to address these issues. For feature generation, our framework adopts a High Actionness snippet Selection (HAS) module to generate more discriminative global video features for clustering from the enhanced actionness features obtained from a designed Inner-Outer Consistency Network (IOCNet). For pseudolabel selection, we introduces a Progressive Learning With Representative Instances (PLRI) strategy to identify the most reliable and informative instances within each cluster for model training. These three modules, HAS, IOCNet, and PLRI, synergistically improve consistency in model training and clustering performance. Extensive experiments on THUMOS'14 and ActivityNet v1.2 datasets under both unsupervised and weakly-supervised settings demonstrate that our framework achieves the state-of-the-art results.

Realigning Confidence with Temporal Saliency Information for Point-Level Weakly-Supervised Temporal Action Localization

Point-Level Temporal Action Localization: Bridging Fully-supervised Proposals to Weakly-supervised Losses

Action Sensitivity Learning for Temporal Action Localization

Learning a Robust Model with Pseudo Boundaries for Noisy Temporal Action Localization.

Active learning with effective scoring functions for semi-supervised temporal action localization

Revisiting Unsupervised Temporal Action Localization: the Primacy of High-Quality Actionness and Pseudolabels

Advancing Temporal Action Localization with a Boundary Awareness Network

Adaptive Two-Stream Consensus Network for Weakly-Supervised Temporal Action Localization

Learning Salient Boundary Feature for Anchor-free Temporal Action Localization

Learning Temporal Co-Attention Models for Unsupervised Video Action Localization.

Towards Adaptive Pseudo-label Learning for Semi-Supervised Temporal Action Localization

Bottom-Up Temporal Action Localization with Mutual Regularization

Learning Proposal-Aware Re-Ranking for Weakly-Supervised Temporal Action Localization

Exploiting Human Pose for Weakly-Supervised Temporal Action Localization

Unleashing the Potential of Adjacent Snippets for Weakly-supervised Temporal Action Localization

Sub-action Prototype Learning for Point-level Weakly-supervised Temporal Action Localization

Action Coherence Network for Weakly-Supervised Temporal Action Localization

Enriching Local and Global Contexts for Temporal Action Localization.

Weakly Supervised Temporal Action Localization through Contrast based Evaluation Networks

Exploring Action Centers for Temporal Action Localization

Boosting Semi-Supervised Temporal Action Localization by Learning from Non-Target Classes