Abstract:With the increasing popularity of screen-sharing applications, efficient encoding of text content has become even more crucial. Text patterns typically exhibit distinct boundaries and sparse color histograms. However, in current hybrid codec frameworks, the positions of coding units are often misaligned with the text patterns, resulting in prediction and color mapping tools consuming a large number of bits to indicate these patterns. Nowadays, some text detection and recognition methods have been proposed to accurately locate and analyze the text regions in screen images. Combined with these techniques, we propose a character position-aware compression framework for screen text content. On the encoder side, a low-complexity detection method is adopted to locate the text characters. Then it copies the detected characters to the position aligned with the coding unit (CU) grid to form a text layer. This text-layer representation can further increase the efficiency of existing screen content coding tools such as Intra Block Copy (IBC). Moreover, we design several compression tools based on this representation. We extend the two Motion Vector (MV) prediction modes: Adaptive Motion Vector Prediction (AMVP) and Merge. We modify the MV encoding syntax according to the layout characteristics of the text layer. We present a Gradient-guided In-loop Filter (GIF) to sharpen the text lines using a convolutional network. Experiments on HEVC-SCC reference software HM-SCM intra_main_scc configuration show that the proposed framework can achieve an average bitrate savings of 9.5% and 8.5% under w/ GIF and w/o GIF versions, with 113% and 16% additional CPU encoding complexity, respectively.

Jbig2 Text Image Compression Based on Ocr

Lossy JBIG2 Based on Optical Character Recognition

JPEG compression history detection based on detail deviation.

Chinese Textual Image Compression Based on Multi-feature Extraction

Recognizable or Not: Towards Image Semantic Quality Assessment for Compression

Image Compression Algorithms Based on Side-Match Vector Quantizer with Gradient-Based Classifiers

Study on Template-Based Coding Method of Binary OCR Table Image

Learned Image Compression with Text Quality Enhancement

Compound Image Compression with Multi-step Text Extraction Method

An Efficient Btc Image Compression Algorithm With Vector Quantization

OCR for TIFF Compressed Document Images Directly in Compressed Domain Using Text segmentation and Hidden Markov Model

A Character Position-aware Compression Framework for Screen Text Content

Document Image Compression Using Straight Line Extraction and Block Context Model

Gray-Level Reducing-Based Text Image Coding

High efficiency lossless image recompression algorithm with asymmetric numeral systems for real-time mobile application

OCR Result Optimization Based on Pattern Matching.

Neural Image Compression with Text-guided Encoding for both Pixel-level and Perceptual Fidelity

Image compression method based on adaptive scanning

Postprocessing Algorithm for the Optical Recognition of Degraded Characters

Lossless Recompression of Vector Quantization Index Table for Texture Images Based on Adaptive Huffman Coding Through Multi-Type Processing

Perceptual Image Compression with Cooperative Cross-Modal Side Information