Abstract:Violence detection aims to locate violent content in video frames. Improving the accuracy of violence detection is of great importance for security. However, the current methods do not make full use of the multi-modal vision and audio information, which affects the accuracy of violence detection. We found that the violence detection accuracy of different kinds of videos is related to the change of optical flow. With this in mind, we propose an optical flow-aware-based multi-modal fusion network (OAMFN) for violence detection. Specifically, we use three different fusion strategies to fully integrate multi-modal features. First, the main branch concatenates RGB features and audio features and the optical flow branch concatenates optical flow features with RGB features and audio features, respectively. Then, the cross-modal information fusion module integrates the features of different combinations and applies weights to them to capture cross-modal information in audio and video. After that, the channel attention module extracts valuable information by weighting the integration features. Furthermore, an optical flow-aware-based score fusion strategy is introduced to fuse features of different modalities from two branches. Compared with methods on the XD-Violence dataset, our multi-modal fusion network yields APs that are 83.09% and 1.4% higher than those of the state-of-the-art methods in offline detection, and 78.09% and 4.42% higher than those of the state-of-the-art methods in online detection.

Fighting Detection Based on Optical Flow Context Histogram

Abnormal Behavior Detection Based on Regional Optical Flow

Violence detection based on histogram of optical flow orientation

Detection Of Abnormal Events Via Optical Flow Feature Analysis

Detection of Abnormal Visual Events Via Global Optical Flow Orientation Histogram

Histograms of Optical Flow Orientation for Visual Abnormal Events Detection

Histograms of optical flow orientation for abnormal events detection

Violence detection in surveillance video using low-level features

Violence Detection Algorithm Based on Local Spatio-temporal Features and Optical Flow

A Optical Flow-Based Fight Behavior Detection Method for Campus Scene

Motion Direction Inconsistency-Based Fight Detection for Multiview Surveillance Videos.

Real-Time Detection of ATM Abnormal Events Based on Optical Flow

Histogram of Maximal Optical Flow Projection for Abnormal Events Detection in Crowded Scenes

Fast fight detection

Abnormal Event Detection Via Covariance Matrix for Optical Flow Based Feature.

A New Method for Violence Detection in Surveillance Scenes

Violence Detection Using Oriented VIolent Flows

Violence Detection Based on Spatio-Temporal Feature and Fisher Vector.

Abnormal event detection via the analysis of multi-frame optical flow information

Optical Flow-Aware-Based Multi-Modal Fusion Network for Violence Detection.

Conv3D-Based Video Violence Detection Network Using Optical Flow and RGB Data