Abstract:The Visual Security Index (VSI) of encrypted videos measure the security of encryption algorithms by evaluating the visual information content, which provides a critical evaluation criterion for selective encryption. The VSI for encrypted videos needs to assess security in both spatial and temporal domains. Existing visual security metrics, which rely on averaging, optical flow, and convolutions, fail to capture information leakage in the temporal domain effectively. This paper proposes a spatiotemporal self-attention-based video security assessment model called Spatiotemporal Self Attention (StSA). In the spatial domain, windowed self-attention is used to calculate regional correlations within video frames. By introducing multi-layer outputs, a multi-depth self-attention network named Multi-Depth Swin-Transformer (MDST) is constructed to compute the regional correlation within video frames. A weak label calculation method based on edge similarity is proposed to calculate the scores for frames and blocks based on the video Mean Opinion Score (MOS), thereby supporting the pre-training of spatial models. In the temporal domain, considering human visual persistence characteristics and the one-way relationship between video frames, temporal unidirectional window self-attention is proposed to calculate frame correlations in the temporal sequence. Finally, the visual security index score for encrypted videos is obtained by combining the spatiotemporal correlation changes of encrypted and plaintext videos. Experimental results show that StSA achieves a Pearson Linear Correlation Coefficient (PLCC) of 0.955 and a Root Mean Squared Error (RMSE) of 0.458 on the encryption datasets. Compared to other visual security metrics, StSA demonstrates higher accuracy and correlation, effectively capturing spatiotemporal information leakage in encrypted videos and reflecting the human perception of the security.

Visual Security Assessment for Video Encryption Based on Structural Distortion

Visual Security Evaluation for Video Encryption.

Quality assessment for a perceptual video encryption system.

Visual Security Index of Selective Encrypted Images Based on Multi-Directional Structure and Content-Aware Features

Visual Quality Control for Perceptual Video Encryption with Multiple Transforms

A Method of Video Quality Assessment Based on the Sensitive Region.

A Novel Selective Encryption Scheme for H.264/AVC Video with Improved Visual Security

Content Based Authentication of Visual Cryptography

Visually Meaningful Image Encryption Scheme Using Multi-Parameter Fractal Theory and Block Synchronous Sorting Diffusion

Visual Cryptography for Image Processing and Security

A Video Visual Security Metric Based on Spatiotemporal Self-Attention

A Visually Secure Image Encryption Scheme Based on Compressive Sensing.

A visually meaningful secure image encryption algorithm based on conservative hyperchaotic system and optimized compressed sensing

Enhancing Visual Security: An Image Encryption Scheme based on Parallel Compressive Sensing and Edge Detection Embedding

A visually secure image encryption method based on semi-tensor product compressed sensing and IWT-HD-SVD embedding

A comprehensive study of visual cryptography

An Improved Aspect Ratio Invariant Visual Cryptography Scheme with Flexible Pixel Expansion.

SDM: Semantic Distortion Measurement for Video Encryption.

A New Visual Evaluation Criterion of Visual Cryptography Scheme for Character Secret Image

A novel spectrogram visual security encryption algorithm based on block compressed sensing and five-dimensional chaotic system

Improved perceptual video encryption using alternative unitary transforms