Abstract:The Visual Security Index (VSI) of encrypted videos measure the security of encryption algorithms by evaluating the visual information content, which provides a critical evaluation criterion for selective encryption. The VSI for encrypted videos needs to assess security in both spatial and temporal domains. Existing visual security metrics, which rely on averaging, optical flow, and convolutions, fail to capture information leakage in the temporal domain effectively. This paper proposes a spatiotemporal self-attention-based video security assessment model called Spatiotemporal Self Attention (StSA). In the spatial domain, windowed self-attention is used to calculate regional correlations within video frames. By introducing multi-layer outputs, a multi-depth self-attention network named Multi-Depth Swin-Transformer (MDST) is constructed to compute the regional correlation within video frames. A weak label calculation method based on edge similarity is proposed to calculate the scores for frames and blocks based on the video Mean Opinion Score (MOS), thereby supporting the pre-training of spatial models. In the temporal domain, considering human visual persistence characteristics and the one-way relationship between video frames, temporal unidirectional window self-attention is proposed to calculate frame correlations in the temporal sequence. Finally, the visual security index score for encrypted videos is obtained by combining the spatiotemporal correlation changes of encrypted and plaintext videos. Experimental results show that StSA achieves a Pearson Linear Correlation Coefficient (PLCC) of 0.955 and a Root Mean Squared Error (RMSE) of 0.458 on the encryption datasets. Compared to other visual security metrics, StSA demonstrates higher accuracy and correlation, effectively capturing spatiotemporal information leakage in encrypted videos and reflecting the human perception of the security.

Visual Security Index Combining CNN and Filter for Perceptually Encrypted Light Field Images

Visual Security Index of Selective Encrypted Images Based on Multi-Directional Structure and Content-Aware Features

A Video Visual Security Metric Based on Spatiotemporal Self-Attention

Visual Security Evaluation for Video Encryption.

Visually Meaningful Image Encryption Scheme Using Multi-Parameter Fractal Theory and Block Synchronous Sorting Diffusion

Exploiting Compressed Sensing and Polynomial-Based Progressive Secret Image Sharing for Visually Secure Image Selection Encryption with Authentication

Face Search in Encrypted Domain.

Enhancing Visual Security: An Image Encryption Scheme based on Parallel Compressive Sensing and Edge Detection Embedding

A visually secure image encryption method based on semi-tensor product compressed sensing and IWT-HD-SVD embedding

Visual Cryptography for Image Processing and Security

A visually secure image encryption scheme using newly designed 1D sinusoidal chaotic map and P-tensor product compressive sensing

Visually meaningful image encryption based on 2D compressive sensing and dynamic embedding

CIE-LSCP: Color Image Encryption Scheme Based on the Lifting Scheme and Cross-Component Permutation

Privacy‐preserving Remote Sensing Images Recognition Based on Limited Visual Cryptography

A Visually Secure Image Encryption Scheme Based on Parallel Compressive Sensing

A Lightweight Privacy-Preserving System for the Security of Remote Sensing Images on IoT

A fast visually meaningful image encryption algorithm based on compressive sensing and joint diffusion and scrambling

Meaningful Encryption: Generating Visually Meaningful Encrypted Images by Compressive Sensing and Reversible Color Transformation

A novel visually meaningful image encryption algorithm using two-way intertwine scrambling and deep embedding

High-quality Visually Secure Image Cryptosystem Using Improved Chebyshev Map and 2D Compressive Sensing Model

PVBLiF: A Pseudo Video-Based Blind Quality Assessment Metric for Light Field Image