Abstract:Natural scenes contain a wide range of textured motion patterns which are characterized by the move- ment of a large amount of particle and wave elements, such as falling snow, water waves, dancing grass, etc. In this paper, we present a generative method for modeling these motion phenomena and our method consists of four components: (1). A photometric model which represents an image as a linear superposition of image bases selected from a generic and over-complete dictionary. The dictionary contains Gabor and LoG bases for point/particle-elements and Fourier bases for wave-elements. These bases compete to explain the input images and transfer a raw image to a base (token) representation with O(102)-fold of dimension reduction. (2). A geometric model which groups adjacent bases and their motion trajectories into a number of basic moving elements { called \motons". A moton is a deformable template in space-time representing a moving element, such as a snow∞ake. (3). A dynamic model which characterizes the motion of particles, waves, and their interactions, e.g., balls/leaves ∞oating on water. The trajectories of these elements are coupled Markov chains. Given an input video sequence, a statistical learning algorithm computes a set of motons with their trajectories as hidden variables. It also learns the parameters that govern the geo- metric deformations and motion dynamics by maximum likelihood estimation (MLE). Consequently, novel sequences are synthesized easily from the learnt models. (4). A sketch model replaces the dictionary of Gabor/LoG and Fourier bases with symbolic sketches (token symbols). With the same generative model, the sketch model can render realistic and stylish cartoon animation. In this paper, cartoon sketch is viewed as a symbolic visualization and simpliflcation of the inner representation in visual perception. The success of the cartoon animation, in turn, suggests that the generative model captures the essence of visual perception of textured motion.

Entropy Based Cartoon Texture Separation

Alternating Direction Method for TGV-TGV* Based Cartoon-Texture Image Decomposition.

Multiscale texture separation

Rough-fuzzy set approach for color and texture based image segmentation

Euler's Elastica Based Cartoon-Smooth-Texture Image Decomposition

Texture synthesis based on minimum energy cut and its applications

Image Decomposition and Texture Segmentation Via Sparse Representation

Separation Surfaces in the Spectral TV Domain for Texture Decomposition

Decomposition of Shading and Reflectance from a Texture Image

An Improved Image Compression Method Using Cartoon-Texture Decomposition

Image Decomposition: Theory, Numerical Schemes, and Performance Evaluation

Texture Segmentation Using Kernel-based Techniques

An Image Decomposition Model Using The Dual Method And H-1 Norm

A non-extensive entropy feature and its application to texture classification

Statistical Modeling of Texture Sketch.

Robust Contrast Enhancement Via Graph-Based Cartoon-Texture Decomposition

Suitable and Style-consistent Multi-texture Recommendation for Cartoon Illustrations

Retrieval Based Cartoon Synthesis Via Heterogeneous Features Learning

Analysis and Synthesis of Textured Motion: Particle, Wave and Cartoon Sketch

Animating texture-based images in visualizing curvilinear irregular vector fields

Bregman implementation of Meyer's $G-$norm for cartoon + textures decomposition