Abstract:The traditional Bag Of Words (BOW) model disregards the scene label information of remote sensing images and ambiguity or redundancy of visual vocabularies.Hence,utilizing BOW to classify categories with similar backgrounds is unsuitable.Therefore,we propose an image scene classification algorithm based on the optimization of visual words with respect to scene label information to handle the said problem.This paper reports on an image scene classification algorithm based on the optimization of visual words with respect to scene label information.The algorithm procedure is as follows:first,images are divided into patches utilizing Spatial Pyramid Matching,and then Scale Invariant Features Transform (SIFT) features are extracted for each local image patch.These features are then clustered with K-means to form a histogram of each patch at different levels utilizing the Boiman strategy.We adopt Image Frequency as the feature selection method on visual words in each category to eliminate visual vocabulary irrelevant to a specific category and obtain a class-specific codebook.Principal Component Analysis (PCA) is then utilized to eliminate redundant visual vocabulary.Finally,we produce a mixture of class-specific histograms in each image patch at different pyramid levels and a traditional histogram with an adaptive weight.A fusion of histograms will be placed in a Support Vector Machine (SVM).We conducted experiments in this study on standard datasets of scene classification.Five experiments were conducted to demonstrate the performance of proposed algorithm.The first experiment shows that our algorithm performs better than methods that do not consider the scene label information with an increased accuracy of approximately 6 percent.The second experiment shows that the proposed method suitably performs in classifying categories with similar backgrounds and classifying error decreases in most categories.The third experiment demonstrates that the accuracy of the proposed method is higher at each pyramid level,and combined pyramids can offer even higher accuracy.The fourth experiment shows that method utilizing an adaptive weighted fusion method is more accurate than methods without.The final experiment demonstrates that the proposed algorithm performs better than other representative methods under the same conditions.This study proposes a method based on the optimization of visual words with respect to scene label information.This algorithm extracts SIFT features at different levels of pyramids combined with the Boiman strategy to generate universal histograms.DF is adopted as the feature selection method to remove visual words irrelevant to a specific category.PCA is then applied to remove redundancy and obtain class-specific codebook and histograms.Finally,a practical adaptive weighted fusion method that combines the traditional histograms of different levels with the class-specific histogram is proposed and placed in an SVM trainer and classifier.The experiment results show that the proposed algorithm suitably performs in classifying categories with similar backgrounds and displays higher stability.However,the proposed algorithm only considers one SIFT descriptor that corresponds to only one visual word.We can perform experiments on one SIFT descriptor that corresponds to several visual words and other feature selection procedures in future research.

Scene image categorization algorithm based on multi-level features representation

Image Classification Method by Combining Multi-features and Sparse Coding

A Pca Based Automatic Image Categorization Approach Using Dominant Color Features

An Attribute-Based High-Level Image Representation for Scene Classification

Research on the Robust Image Representation Scheme for Natural Scene Categorization

Image classification based on multi-descriptor hierarchical feature learning

Scene Categorization Based on Heterogeneous Features.

Fusing Deep Local And Global Features For Remote Sensing Image Scene Classification

Coordinate CNNs and LSTMs to Categorize Scene Images with Multi-Views and Multi-Levels of Abstraction.

Image Scene Categorization Using Multi-Bag-of-features

Multi-Channel and Multi-Scale Mid-Level Image Representation for Scene Classification

Multi-scale sparse representation based scene categorization

Scene classification using a multi-resolution bag-of-features model

Scene Classification Using Low-Level Feature and Intermediate Feature

Scene Classification Using Multi-Resolution Low-Level Feature Combination

Scene Classification of Remote Sensing Images by Optimizing Visual Vocabulary Concerning Scene Label Information

Learning Two-Pathway Convolutional Neural Networks for Categorizing Scene Images

Discriminative High-Level Representations For Scene Classification

Boosting Classifiers for Scene Category Recognition.

Minimum Volume Simplex-Based Scene Representation and Attribute Recognition with Feature Fusion.

A Multi-Modal High Spatial Resolution Aerial Imagery Scene Classification Model with Visual Enhancement