Abstract:With the increasing popularity of screen-sharing applications, efficient encoding of text content has become even more crucial. Text patterns typically exhibit distinct boundaries and sparse color histograms. However, in current hybrid codec frameworks, the positions of coding units are often misaligned with the text patterns, resulting in prediction and color mapping tools consuming a large number of bits to indicate these patterns. Nowadays, some text detection and recognition methods have been proposed to accurately locate and analyze the text regions in screen images. Combined with these techniques, we propose a character position-aware compression framework for screen text content. On the encoder side, a low-complexity detection method is adopted to locate the text characters. Then it copies the detected characters to the position aligned with the coding unit (CU) grid to form a text layer. This text-layer representation can further increase the efficiency of existing screen content coding tools such as Intra Block Copy (IBC). Moreover, we design several compression tools based on this representation. We extend the two Motion Vector (MV) prediction modes: Adaptive Motion Vector Prediction (AMVP) and Merge. We modify the MV encoding syntax according to the layout characteristics of the text layer. We present a Gradient-guided In-loop Filter (GIF) to sharpen the text lines using a convolutional network. Experiments on HEVC-SCC reference software HM-SCM intra_main_scc configuration show that the proposed framework can achieve an average bitrate savings of 9.5% and 8.5% under w/ GIF and w/o GIF versions, with 113% and 16% additional CPU encoding complexity, respectively.

Rearrangement pixel granularity template matching for lossy screen content picture intra coding

Neighbour Area Based Rearrangement Pixel Granularity Template Matching for Lossy Screen Content Video

Pixel Granularity Template Matching Method for Screen Content Lossless Intra Picture

Improvement Of Re-Sample Template Matching For Lossless Screen Content Video

Dynamic Contour Matching for Lossy Screen Content Picture Intra Coding.

Fast Intra Mode Decision and Block Matching for HEVC Screen Content Compression.

Low-complexity Dictionary Based Lossless Screen Content Coding

Improving Lossless Intra Coding of H.264/AVC by Pixel-Wise Spatial Interleave Prediction

Palette Improvement for Template Matching Intra Coding

Pixel-Copy Prediction Based Lossless Reference Frame Compression.

Content Adaptive Compressed Screen Content Video Quality Enhancement

Extended application of scalable video coding methods

Weighted Rate-Distortion Optimization for Screen Content Intra Coding

Texture and Correlation Based Fast Intra Prediction Algorithm for HEVC

Improved Hierarchical Quantisation Parameter Setting Method for Screen Content Coding in High Efficiency Video Coding

Advanced Screen Content Coding Using Color Table and Index Map

Image Segmentation For Improved Lossless Screen Content Compression

Weighted Rate-Distortion Optimization for Screen Content Coding

A Character Position-aware Compression Framework for Screen Text Content

TSA-SCC: Text Semantic-Aware Screen Content Coding with Ultra Low Bitrate

Priority-based template matching intra prediction