Abstract:Designing discriminative powerful texture features robust to realistic imaging conditions is a challenging computer vision problem with many applications, including material recognition and analysis of satellite or aerial imagery. In the past, most texture description approaches were based on dense orderless statistical distribution of local features. However, most recent approaches to texture recognition and remote sensing scene classification are based on Convolutional Neural Networks (CNNs). The de facto practice when learning these CNN models is to use RGB patches as input with training performed on large amounts of labeled data (ImageNet). In this paper, we show that Local Binary Patterns (LBP) encoded CNN models, codenamed TEX-Nets, trained using mapped coded images with explicit LBP based texture information provide complementary information to the standard RGB deep models. Additionally, two deep architectures, namely early and late fusion, are investigated to combine the texture and color information. To the best of our knowledge, we are the first to investigate Binary Patterns encoded CNNs and different deep network fusion architectures for texture recognition and remote sensing scene classification. We perform comprehensive experiments on four texture recognition datasets and four remote sensing scene classification benchmarks: UC-Merced with 21 scene categories, WHU-RS19 with 19 scene classes, RSSCN7 with 7 categories and the recently introduced large scale aerial image dataset (AID) with 30 aerial scene types. We demonstrate that TEX-Nets provide complementary information to standard RGB deep model of the same network architecture. Our late fusion TEX-Net architecture always improves the overall performance compared to the standard RGB network on both recognition problems. Furthermore, our final combination leads to consistent improvement over the state-of-the-art for remote sensing scene classification.

Color-texture classification based on spatio-spectral complex network representations

U-Net-Based Multispectral Image Generation from an RGB Image

Spnet: A Spectral Patching Network For End-To-End Hyperspectral Image Classification

BoW-MSN: A Novel Texture Classification Approach.

Neural Networks and Texture Classification

Random Convolutional Network for Hyperspectral Image Classification.

A Spiking Neural Network for Visual Color Feature Classification for Pictures with RGB-HSV Model

Spectral-spatial classification of hyperspectral imagery based on recurrent neural networks

Binary patterns encoded convolutional neural networks for texture recognition and remote sensing scene classification

Statistical Texture Awareness Network for Hyperspectral Image Classification

Multispectral Texture Synthesis using RGB Convolutional Neural Networks

Monogenic Wavelet Scattering Network for Texture Image Classification

SPECTRAL-SPATIAL MULTISCALE RESIDUAL NETWORK FOR HYPERSPECTRAL IMAGE CLASSIFICATION

Learning a complex network representation for shape classification

A Neural Network Model for Color Element Data Analysis for Urban Spatial Environment

Modelling Spatial Correlations by Using Deep CNN and LSTM for Texture Image Classification

Performance evaluation of wavelet scattering network in image texture classification in various color spaces

Deep Multiple-Attribute-Perceived Network For Real-World Texture Recognition

Spectral–Spatial Residual Network for Hyperspectral Image Classification: A 3-D Deep Learning Framework

A bio-inspired spiking neural network encoding color-biased images

Hyper-S3NN: Spatial–spectral Spiking Neural Network for Hyperspectral Image Classification