Abstract:Automatic video annotation is an important ingredient for semantic-level video browsing, search and navigation. Much attention has been paid to this topic in recent years. These researches have evolved through two paradigms. In the first paradigm, each concept is individually annotated by a pre-trained binary classifier. However, this method ignores the rich information between the video concepts and only achieves limited success. Evolved from the first paradigm, the methods in the second paradigm add an extra step on the top of the first individual classifiers to fuse the multiple detections of the concepts. However, the performance of these methods can be degraded by the error propagation incurred in the first step to the second fusion one. In this article, another paradigm of the video annotation method is proposed to address these problems. It simultaneously annotates the concepts as well as model correlations between them in one step by the proposed Correlative Multilabel (CML) method, which benefits from the compensation of complementary information between different labels. Furthermore, since the video clips are composed by temporally ordered frame sequences, we extend the proposed method to exploit the rich temporal information in the videos. Specifically, a temporal-kernel is incorporated into the CML method based on the discriminative information between Hidden Markov Models (HMMs) that are learned from the videos. We compare the performance between the proposed approach and the state-of-the-art approaches in the first and second paradigms on the widely used TRECVID data set. As to be shown, superior performance of the proposed method is gained.

Markov Chain Local Binary Pattern And Its Application To Video Concept Detection

A new video text detection method.

Texture Clustering Combining Complex Wavelet Features and Local Binary Pattern

One Step Beyond Histograms: Image Representation Using Markov Stationary Features

Median Robust Extended Local Binary Pattern for Texture Classification

A content-based video copy detection method with randomly projected binary features.

Using global information to refine local patterns for texture representation and classification

Marginalized multi-layer multi-instance kernel for video concept detection

2D-LBP: an Enhanced Local Binary Feature for Texture Image Classification

A Unifying Multi-Label Temporal Kernel Machine with Its Application to Video Annotation

RBM-LBP: Joint Distribution of Multiple Local Binary Patterns for Texture Classification.

Correlative Multilabel Video Annotation with Temporal Kernels

Dynamic Texture Recognition using PDV Hashing and Dictionary Learning on Multi-scale Volume Local Binary Pattern

A Completed Modeling of Local Binary Pattern Operator for Texture Classification

Dynamic texture recognition with video set based collaborative representation

A Novel Extended Local-Binary-pattern Operator for Texture Analysis

Decorrelated Local Binary Patterns for Efficient Texture Classification

Scale-Selective and Noise-Robust Extended Local Binary Pattern for Texture Classification

Color-related Local Binary Pattern: A Learned Local Descriptor for Color Image Recognition

Local multiple patterns based multiresolution gray-scale and rotation invariant texture classification

Rlbp: Robust Local Binary Pattern