Abstract:Designing discriminative powerful texture features robust to realistic imaging conditions is a challenging computer vision problem with many applications, including material recognition and analysis of satellite or aerial imagery. In the past, most texture description approaches were based on dense orderless statistical distribution of local features. However, most recent approaches to texture recognition and remote sensing scene classification are based on Convolutional Neural Networks (CNNs). The de facto practice when learning these CNN models is to use RGB patches as input with training performed on large amounts of labeled data (ImageNet). In this paper, we show that Local Binary Patterns (LBP) encoded CNN models, codenamed TEX-Nets, trained using mapped coded images with explicit LBP based texture information provide complementary information to the standard RGB deep models. Additionally, two deep architectures, namely early and late fusion, are investigated to combine the texture and color information. To the best of our knowledge, we are the first to investigate Binary Patterns encoded CNNs and different deep network fusion architectures for texture recognition and remote sensing scene classification. We perform comprehensive experiments on four texture recognition datasets and four remote sensing scene classification benchmarks: UC-Merced with 21 scene categories, WHU-RS19 with 19 scene classes, RSSCN7 with 7 categories and the recently introduced large scale aerial image dataset (AID) with 30 aerial scene types. We demonstrate that TEX-Nets provide complementary information to standard RGB deep model of the same network architecture. Our late fusion TEX-Net architecture always improves the overall performance compared to the standard RGB network on both recognition problems. Furthermore, our final combination leads to consistent improvement over the state-of-the-art for remote sensing scene classification.

A multilevel pooling scheme in convolutional neural networks for texture image recognition

Multi-Level Feature Descriptor for Robust Texture Classification via Locality-Constrained Collaborative Strategy

Texture Compensation with Multi-Scale Dilated Residual Blocks for Image Denoising.

Research on Image Classification Method of Features of Combinatorial Convolution

Deep convolutional filter banks for texture recognition and segmentation

Texture and Materials Image Classification Based on Wavelet Pooling Layer in CNN

Texture Classification Using Pair-Wise Difference Pooling-Based Bilinear Convolutional Neural Networks

Deep Texture Recognition Via Exploiting Cross-Layer Statistical Self-Similarity

Locally-Transferred Fisher Vectors For Texture Classification

Lacunarity Pooling Layers for Plant Image Classification using Texture Analysis

Multi-scale Convolutional Neural Network for Texture Recognition

Binary patterns encoded convolutional neural networks for texture recognition and remote sensing scene classification

Enhanced Pooling Method for Convolutional Neural Networks Based on Optimal Search Theory

Recurrent Convolutions of Binary-Constraint Cellular Neural Network for Texture Recognition

Wasserstein Pooling for Image Classification

Detail-Preserving Pooling in Deep Networks

Texture Image Recognition Based on Deep Convolutional Neural Network and Transfer Learning

Weighted Pooling for Image Recognition of Deep Convolutional Neural Networks

Cross-convolutional-layer Pooling for Generic Visual Recognition.

Effect of pooling strategy on convolutional neural network for classification of hyperspectral remote sensing images

Multilevel Features Fusion In Deep Convolutional Neural Networks