Abstract:Local binary descriptors, such as local binary pattern (LBP) and its various variants, have been studied extensively in texture and dynamic texture analysis due to their outstanding characteristics, such as grayscale invariance, low computational complexity and good discriminability. Most existing local binary feature extraction methods extract spatio-temporal features from three orthogonal planes of a spatio-temporal volume by viewing a dynamic texture in 3D space. For a given pixel in a video, only a proportion of its surrounding pixels is incorporated in the local binary feature extraction process. We argue that the ignored pixels contain discriminative information that should be explored. To fully utilize the information conveyed by all the pixels in a local neighborhood, we propose extracting local binary features from the spatio-temporal domain with 3D filters that are learned in an unsupervised manner so that the discriminative features along both the spatial and temporal dimensions are captured simultaneously. The proposed approach consists of three components: 1) 3D filtering; 2) binary hashing; and 3) joint histogramming. Densely sampled 3D blocks of a dynamic texture are first normalized to have zero mean and are then filtered by 3D filters that are learned in advance. To preserve more of the structure information, the filter response vectors are decomposed into two complementary components, namely, the signs and the magnitudes, which are further encoded separately into binary codes. The local mean pixels of the 3D blocks are also converted into binary codes. Finally, three types of binary codes are combined via joint or hybrid histograms for the final feature representation. Extensive experiments are conducted on three commonly used dynamic texture databases: 1) UCLA; 2) DynTex; and 3) YUVL. The proposed method provides comparable results to, and even outperforms, many state-of-the-art methods.

Dynamic texture recognition by aggregating spatial and temporal features via ensemble SVMs.

Dynamic texture recognition with video set based collaborative representation

Dynamic Texture Video Classification Using Extreme Learning Machine

SMTCNN - A Global Spatio-Temporal Texture Convolutional Neural Network for 3D Dynamic Texture Recognition

Unsupervised Dynamic Texture Segmentation Using Local Spatiotemporal Descriptors

Dynamic Texture Recognition by Spatio-Temporal Multiresolution Histograms

Classifying Dynamic Textures Via Spatiotemporal Fractal Analysis

Exploiting high level feature for dynamic textures recognition

Chaotic Features for Dynamic Textures Recognition with Group Sparsity Representation

Dynamic Texture Classification Using Dynamic Fractal Analysis

Dynamical Textures Modeling Via Joint Video Dictionary Learning

Dynamic Texture Recognition via Orthogonal Tensor Dictionary Learning

DTSGAN: Learning Dynamic Textures via Spatiotemporal Generative Adversarial Network

Spatio-temporal markov random field based dynamic texture segmentation

Dynamic texture synthesis using a spatial temporal descriptor

Dynamic Texture Recognition Using 3D Random Features.

Unsupervised Dynamic Texture Segmentation Using Appearance and Motion

Manifold Regularized Slow Feature Analysis for Dynamic Texture Recognition

Dynamic Texture Classification Based on Motion Statistical Feature Matrix.

Dynamic Texture Classification Using Unsupervised 3D Filter Learning and Local Binary Encoding

Characterizing Dynamic Textures with Space-Time Lacunarity Analysis.