Abstract:Recent researches have shown that the Structural SIMilariy (SSIM)-based Rate-Distortion Optimization (RDO) can obtain more structural information than the traditional SSE-based RDO for video coding. Correspondingly, the perceptual video quality is improved at certain degree for the video stream encoded by the SSIM-based RDO. However, for the MB with significant luminance change (due to the flashlight or sunshine change, etc.) but little structure change compared to the co-located MB in the referred frame, the SSIM-based RDO may select improper encoding mode (SKIP) which leads to uncomfortable visual experience. In this paper, involving the surrounding pixels of the current coding MB into the measurement of spacial texture quality degradation, the RDO which jointly considers the SSIM-based distortion and SSE-based distortion is proposed to improve H.264/AVC perceptual coding performance. The Lagrange multiplier in the proposed RDO is firstly derived at the frame level. Then, to make the Lagrange multiplier more adaptive to the specific video content, the Lagrange multiplier for each individual MB is refined based on the visual information theory. Experimental results show that the proposed perceptual RDO can select the optimal encoding mode which preserves as much structural information as possible with as little SSE-based distortion as possible, and that the perceptual quality of the encoded video is improved.

Improved Best Prediction Mode(S) Selection Methods Based On Structural Similarity In H.264 I-Frame Encoder

Improved inter prediction based on structural similarity for H.264

A New Rate-Distortion Optimization Using Structural Information in H.264 I-Frame Encoder.

Fast Inter Mode Decision Using Spatial Property of Motion Field

Scene Information-based Mode Skipping Algorithm for Inter Frame Coding

A Fast Inter Mode Decision Algorithm Based on AVS Video Coding

An Inter-mode Decision Algorithm Based on Spatiotemporal Correlation in H. 264

Research and Improvement of Selection Algorithm Based on the H. 264 Intra-prediction Model

A Fast Intra Prediction Method for H.264 Video Coding

Inter-frame Prediction Mode Selection AlgorithmBased on Motion Information Distribution

A Fast H.264 Intra Prediction Algorithm Using All Zero Block Detection and Texture Feature

Selective VS-MRF-ME and intra coding in H.264 based on spatiotemporal continuity of motion field

Research and Optimization for the Intraframe Prediction in H.264

Fast adaptive inter-prediction mode decision method for H.264 based on spatial correlation

Fast Intra Prediction Mode Decision By Adaptively Selecting Fewer Number Of Modes

Fast Adaptive Inter Mode Decision Method for P Slices in H.264.

Rate-SSIM optimization for video coding

An Ssim-Optimal H.264/Avc Inter Frame Encoder

SSIM-based Rate-Distortion Optimization in H.264

A Fast Intra-prediction Mode Selection Algorithm of H.264/AVC

Perceptual Rate-Distortion Optimization for H.264/AVC Video Coding from Both Signal and Vision Perspectives