Abstract:This thesis is primarily focused on the information combination at different levels of a statistical pattern classification framework for image annotation and retrieval. Based on the previous study within the fields of image annotation and retrieval, it has been well-recognized that the low-level visual features, such as color and texture, and high-level features, such as textual description and context, are distinct yet complementary in terms of their distributions and the corresponding discriminative powers of dealing with machine-based recognition and retrieval tasks. Therefore, effective feature combination for image annotation and retrieval has become a desirable and promising perspective from which the semantic gap can be further bridged. Motivated by this fact, the combination of the visual and context modalities and that of different features in the visual domain are tackled by developing two statistical patterns classification approaches considering that the features of the visual modality and those across different modalities exhibit different degrees of heterogeneities, and thus, should be treated differently. Regarding the cross-modality feature combination, a Bayesian framework is proposed to integrate visual content and context, which has been applied to various image annotation and retrieval frameworks. In terms of the combination of different low-level features in the visual domain, the problem is tackled with a novel method that combines texture and color features via a mixture model of their joint distribution. To evaluate the proposed frameworks, many different datasets are employed in the experiments, including the COREL database for image retrieval and the MSRC, LabelMe, PASCAL VOC2009, and an animal image database collected by ourselves for image annotation. Using various evaluation criteria, the first framework is shown to be more effective than the methods purely based on the low-level features or high-level context. As for the second, the experimental results demonstrate not only its superior performance to other feature combination methods but also its ability to discover visual clusters using texture and color simultaneously. Moreover, a demo search engine based on the Bayesian framework is implemented and available online.

Combining Fine Texture and Coarse Color Features for Color Texture Classification

Multi-Level Feature Descriptor for Robust Texture Classification via Locality-Constrained Collaborative Strategy

Combining Sorted Random Features for Texture Classification

Compact Interchannel Sampling Difference Descriptor for Color Texture Classification

Texture Classification by Combining Wavelet and Contourlet Features

Unsupervised Texture Classification by Combining Multi-Scale Features and K-Means Classifier

A Multiscale Hierarchical Threshold-Based Completed Local Entropy Binary Pattern for Texture Classification

Combining the contrast information with LPQ for texture classification

A novel feature descriptor for image retrieval by combining modified color histogram and diagonally symmetric co-occurrence texture pattern

A Color-Texture-Structure Descriptor For High-Resolution Satellite Image Classification

Compressed Sensing For Robust Texture Classification

Combining visual features and contextual information for image retrieval and annotation

Texture Classification Using Combined Image Decomposition Methods

Combining Multiple Feature for Texture Image Classification

Age Classification Combining Contour and Texture Feature

Texture Classification Using Multi-Resolution Global and Local Gabor Features in Pyramid Space

Multi-scale Counting and Difference Representation for Texture Classification

Image classification using color, texture and regions

Nonsubsampled Contourlet Transform for Texture Classifications using Support Vector Machines

Texture Classification via Local Feature Representation of Multi-order Gradients.

Color texture segmentation based on image pixel classification