Abstract:Video surveillance plays an important role in public security. To store the growing volume of surveillance videos, video compression is beneficial for reducing video volume; however, it is simultaneously harmful to the video quality. Video quality assessment (VQA) methods help to achieve a tradeoff between the data volume and perceptual quality of compressed surveillance videos. Generally speaking, surveillance video quality assessment (SVQA) is different from conventional VQA, because surveillance videos are usually used for specific tasks, e.g., pedestrian recognition, rather than for entertainment purposes. Therefore, in this paper, we propose two full-reference SVQA methods based on the concept of quality of recognition. We first design two new tasks, distorted face verification (DFV) and distorted face identification (DFI), based on which we further propose two SVQA methods, DFV-SVQA and DFI-SVQA, and corresponding quality metrics. The core components of the DFV-SVQA and DFI-SVQA methods are feature extractors (a DFV model and a DFI model), which we construct using convolutional-neural-network-based face recognition models. In addition, we construct a real-world surveillance video data set, based on which we analyze how various factors, including the video codec, compression level, face resolution, and light intensity, affect the quality of compressed surveillance videos. We find that, compared with conventional VQA methods, our methods are more effective in measuring the quality of surveillance videos while maintaining an acceptable time efficiency.

Face Pose Analysis from Mpeg Compressed Video for Surveillance Applications

Clear Face Analysis from MPEG Compressed Video

Video Based Head Detection and Tracking Surveillance System

An Intelligent Surveillance System Base on Accelerated Human and Face Detection

Based on network probabilistic graph human pose segmentation algorithm

Real-time Detection and Tracking Algorithm Based on the Color and Character of Human Face

Foreground-Background Parallel Compression with Residual Encoding for Surveillance Video

Visual Attention Based Video Object Segmentation in MPEG Compressed Domain

Video-Based Facial Expression Recognition Using Histogram Sequence of Local Gabor Binary Patterns from Three Orthogonal Planes

Partially Occluded Head Posture Estimation for 2D Images Using Pyramid HoG Features

Face Detection on Surveillance Images

How to Assess the Quality of Compressed Surveillance Videos Using Face Recognition

Automatic pose normalization for open-set single-sample face recognition in video surveillance

Part-Based Set Matching For Face Recognition In Surveillance

Intelligent Analysis Oriented Surveillance Video Coding.

Multi-cue-based Face and Facial Feature Detection on Video Segments

An Automatic System for Unconstrained Video-Based Face Recognition

Multi-Clue Based Facial Feature Detection and Tracking in Video

Pose-Tolerant Non-Frontal Face Recognition Using Ebgm

Surveillance Video Quality Assessment Based on Face Recognition.

Human Detection in Video over Large Viewpoint Changes