Abstract:There exists an intrinsic relationship between the spectral sensitivity of the Human Visual System (HVS) and colour perception; these intertwined phenomena are often overlooked in perceptual compression research. In general, most previously proposed visually lossless compression techniques exploit luminance (luma) masking including luma spatiotemporal masking, luma contrast masking and luma texture/edge masking. The perceptual relevance of color in a picture is often overlooked, which constitutes a gap in the literature. With regard to the spectral sensitivity phenomenon of the HVS, the color channels of raw RGB 4:4:4 data contain significant color-based psychovisual redundancies. These perceptual redundancies can be quantized via color channel-level perceptual quantization. In this paper, we propose a novel spatiotemporal visually lossless coding method named Spectral Perceptual Quantization (Spectral-PQ). With application for RGB 4:4:4 video data, Spectral-PQ exploits HVS spectral sensitivity-related color masking in addition to spatial masking and temporal masking; the proposed method operates at the Coding Block (CB) level and the Prediction Unit (PU) level in the HEVC standard. Spectral-PQ perceptually adjusts the Quantization Step Size (QStep) at the CB level if high variance spatial data in G, B and R CBs is detected and also if high motion vector magnitudes in PUs are detected. Compared with anchor 1 (HEVC HM 16.17 RExt), Spectral-PQ considerably reduces bitrates with a maximum reduction of approximately 81%. The Mean Opinion Score (MOS) in the subjective evaluations show that Spectral-PQ successfully achieves perceptually lossless quality.

Spatiotemporal Adaptive Quantization for the Perceptual Video Coding of RGB 4:4:4 Data

Spectral-PQ: A Novel Spectral Sensitivity-Orientated Perceptual Compression Technique for RGB 4:4:4 Video Data

Coding Block-Level Perceptual Video Coding for 4:4:4 Data in HEVC

Visually Lossless Coding in HEVC: A High Bit Depth and 4:4:4 Capable JND-Based Perceptual Quantisation Technique for HEVC

Spatiotemporal Perception Aware Quantization Algorithm for Video Coding.

JND-Based Perceptual Video Coding for 4:4:4 Screen Content Data in HEVC

An adaptive spatio-temporal perception aware quantization algorithm for AVS2

Visual Attention-aware High Dynamic Range Quantization for HEVC Video Coding

An Improved Adaptive Quantization Method Based on Perceptual CU Early Splitting for HEVC

Content Adaptive Quantization Scheme Based on Visual Perception for Video Coding

Perceptual Adaptive Quantisation Scheme for H.263 Video Coder

A perceptually temporal adaptive quantization algorithm for HEVC.

Perceptual Video Coding Based on Visual Saliency Modulated Just Noticeable Distortion.

A Predictive VQ Based Video Compression Scheme

A novel adaptive quantization method for video coding

Surprise-based JND estimation for perceptual quantization in H.265/HEVC codecs

On Video Source Format of Screen Content Compression

Perceptual Video Quality Assessment on a Mobile Platform Considering Both Spatial Resolution and Quantization Artifacts

Visual saliency guided perceptual adaptive quantization based on HEVC intra-coding for planetary images

Introducing Gop-Level Quantization Parameter Offset In High Efficiency Video Coding

Perceptual CTU Level Bit Allocation for AVS2