Abstract:Video semantic recognition usually suffers from the curse of dimensionality and the absence of enough high-quality labeled instances, thus semisupervised feature selection gains increasing attentions for its efficiency and comprehensibility. Most of the previous methods assume that videos with close distance (neighbors) have similar labels and characterize the intrinsic local structure through a predetermined graph of both labeled and unlabeled data. However, besides the parameter tuning problem underlying the construction of the graph, the affinity measurement in the original feature space usually suffers from the curse of dimensionality. Additionally, the predetermined graph separates itself from the procedure of feature selection, which might lead to downgraded performance for video semantic recognition. In this paper, we exploit a novel semisupervised feature selection method from a new perspective. The primary assumption underlying our model is that the instances with similar labels should have a larger probability of being neighbors. Instead of using a predetermined similarity graph, we incorporate the exploration of the local structure into the procedure of joint feature selection so as to learn the optimal graph simultaneously. Moreover, an adaptive loss function is exploited to measure the label fitness, which significantly enhances model's robustness to videos with a small or substantial loss. We propose an efficient alternating optimization algorithm to solve the proposed challenging problem, together with analyses on its convergence and computational complexity in theory. Finally, extensive experimental results on benchmark datasets illustrate the effectiveness and superiority of the proposed approach on video semantic recognition related tasks.

Semisupervised Surveillance Video Character Extraction and Recognition With Attentional Learning Multiframe Fusion

Video object matching across multiple non-overlapping camera views based on multi-feature fusion and incremental learning.

Multiscale Feature Fusion for Surveillance Video Diagnosis

A Video Target Re-Recognition Method Based on Adaptive Attention Enhancement and Multi-Scale Feature Fusion

A Video Classification Method Based on Spatiotemporal Detail Attention and Feature Fusion

An Adaptive Semisupervised Feature Analysis for Video Semantic Recognition

Multimodal and multiscale feature fusion for weakly supervised video anomaly detection

Fusion target attention mask generation network for video segmentation

Coarse-to-Fine Video Instance Segmentation With Factorized Conditional Appearance Flows

Detecting Abnormal Behaviors in Surveillance Videos Based on Fuzzy Clustering and Multiple Auto-Encoders

Combined spatial and frequency dual stream network for face forgery detection

Exposing video surveillance object forgery by combining TSF features and attention-based deep neural networks

Face Manipulation Detection Based on Supervised Multi-Feature Fusion Attention Network

Learning Task-Specific Representation for Video Anomaly Detection with Spatial-Temporal Attention

Socializing the Videos: A Multimodal Approach for Social Relation Recognition

CNN Spatiotemporal Features and Fusion for Surveillance Video Forgery Detection

Detecting Deepfake Videos Based on Spatiotemporal Attention and Convolutional LSTM

Unsupervised Video Anomaly Detection with Self-Attention Based Feature Aggregating

Frame Attention Mechanism and Transfer Learning Network for Classification on Motion Video

Towards Robust Video Text Detection with Spatio-Temporal Attention Modeling and Text Cues Fusion

Hybrid Human Detection and Recognition in Surveillance