Abstract:Dynamic textures are time-varying motion patterns that exhibit certain temporal stationarity. The motion of such patterns is usually anisotropic, which is a great challenge for video coding. In this paper, we firstly analyze the predictive and temporal characteristics of dynamic textures and, based on the analysis, a pixel-level segmentation-synthesis framework for dynamic texture compression is proposed to improve predictive-coding efficiency. This framework consists of three sub-modules: dynamic texture segmentation, dynamic texture synthesis and fusion process. A deep-learning-based segmentation method is introduced to obtain a pixel-level mask. Subsequently, optical flow fields are used to generate flowlines and help analyze the motion periodicity of a given sequence. The flowlines and period values are utilized as inputs for flow-based dynamic texture synthesis. The segmented dynamic texture area is then reconstructed using the synthesized results at the decoder side at pixel-level, such that the overhead for transmitting these contents could be saved. The segmented mask is transmitted through an All-Zero-Run-Length coding algorithm and an effective fusion module is further proposed to reduce edge artifacts that occur at the boundary of dynamic texture areas. Coding blocks have been classified into three types and a weighting reconstruction scheme is performed. The proposed framework has been integrated into VTM-10.0. Experimental results on a collected dynamic texture test set demonstrate that 15.1% and 16.1% MOS BD-rate savings can be achieved on average for LDB and LDP configurations, respectively.

A Video Texture Synthesis Method Based on Wavelet Transform

The Technology of Sampled-based Texture Synthesis

A Constrained Multi-sample Texture Synthesis Algorithm Based on Random Expanding of Circular Patches

Shape Context Based Video Texture Synthesis from Still Images

Dynamic textures using wavelet analysis

A Visual Video Synthesis Tool Based on Video Materials

Skeletal Texture Synthesis

Dynamic texture synthesis using a spatial temporal descriptor

Texture synthesis based on minimum energy cut and its applications

Texture Image Fusion Based on Wavelet Transforms

An Efficient Texture Synthesis Algorithm Based on WT

Texture fusion based wavelet transform applied to video text enhancement

Wavelet Transform and Multi-Resolution Synthesis of Texture Images

Video coding by texture analysis and synthesis using graph cut

Image and Video Retexturing

AN EFFICIENT MULTI-RESOLUTION TEXTURE SYNTHESIZING METHOD BASED ON WAVELET TRANSFORM

Flow Video Synthesis from an Image.

A Pixel-Level Segmentation-Synthesis Framework for Dynamic Texture Video Compression

A Local Texture Refinement and Adaptive Background Construction Method for Free Viewpoint Video

A Novel Method of Dynamic Textures Analysis and Synthesis.

Video-based Dynamic Scenes Generation with Compound Micro-Frame