Abstract:The traditional Bag Of Words (BOW) model disregards the scene label information of remote sensing images and ambiguity or redundancy of visual vocabularies.Hence,utilizing BOW to classify categories with similar backgrounds is unsuitable.Therefore,we propose an image scene classification algorithm based on the optimization of visual words with respect to scene label information to handle the said problem.This paper reports on an image scene classification algorithm based on the optimization of visual words with respect to scene label information.The algorithm procedure is as follows:first,images are divided into patches utilizing Spatial Pyramid Matching,and then Scale Invariant Features Transform (SIFT) features are extracted for each local image patch.These features are then clustered with K-means to form a histogram of each patch at different levels utilizing the Boiman strategy.We adopt Image Frequency as the feature selection method on visual words in each category to eliminate visual vocabulary irrelevant to a specific category and obtain a class-specific codebook.Principal Component Analysis (PCA) is then utilized to eliminate redundant visual vocabulary.Finally,we produce a mixture of class-specific histograms in each image patch at different pyramid levels and a traditional histogram with an adaptive weight.A fusion of histograms will be placed in a Support Vector Machine (SVM).We conducted experiments in this study on standard datasets of scene classification.Five experiments were conducted to demonstrate the performance of proposed algorithm.The first experiment shows that our algorithm performs better than methods that do not consider the scene label information with an increased accuracy of approximately 6 percent.The second experiment shows that the proposed method suitably performs in classifying categories with similar backgrounds and classifying error decreases in most categories.The third experiment demonstrates that the accuracy of the proposed method is higher at each pyramid level,and combined pyramids can offer even higher accuracy.The fourth experiment shows that method utilizing an adaptive weighted fusion method is more accurate than methods without.The final experiment demonstrates that the proposed algorithm performs better than other representative methods under the same conditions.This study proposes a method based on the optimization of visual words with respect to scene label information.This algorithm extracts SIFT features at different levels of pyramids combined with the Boiman strategy to generate universal histograms.DF is adopted as the feature selection method to remove visual words irrelevant to a specific category.PCA is then applied to remove redundancy and obtain class-specific codebook and histograms.Finally,a practical adaptive weighted fusion method that combines the traditional histograms of different levels with the class-specific histogram is proposed and placed in an SVM trainer and classifier.The experiment results show that the proposed algorithm suitably performs in classifying categories with similar backgrounds and displays higher stability.However,the proposed algorithm only considers one SIFT descriptor that corresponds to only one visual word.We can perform experiments on one SIFT descriptor that corresponds to several visual words and other feature selection procedures in future research.

Scene classification using a multi-resolution bag-of-features model

Scene Classification Using Multi-Resolution Low-Level Feature Combination

Image Scene Categorization Using Multi-Bag-of-features

Bag of Spatial Visual Words Model for Scene Classification

Scene Classification Using Local and Global Features with Collaborative Representation Fusion

Scene Recognition Combining Structural and Textural Features

Scene Classification of Remote Sensing Images by Optimizing Visual Vocabulary Concerning Scene Label Information

Scene Classification Based on Heterogeneous Features of Multi-Source Data

A Multi-Scale Approach For Remote Sensing Scene Classification Based On Feature Maps Selection And Region Representation

Boosting Classifiers for Scene Category Recognition.

Scene Classification Using Multi-Scale Deeply Described Visual Words

Scene Classification Using Low-Level Feature and Intermediate Feature

Scene Classification Based on Spatial Pyramid Representation by Superpixel Lattices and Contextual Visual Features

Scene Categorization Based on Heterogeneous Features.

Feature significance-based multibag-of-visual-words model for remote sensing image scene classification

Discriminative High-Level Representations For Scene Classification

A Multi-Modal High Spatial Resolution Aerial Imagery Scene Classification Model with Visual Enhancement

Multi-Label Remote Sensing Scene Classification Using Multi-Bag Integration

Scene Capture and Selected Codebook-Based Refined Fuzzy Classification of Large High- Resolution Images

Scene Classification Via Learning a Multi-Branch Convolutional Network.

The Bag-of-visual-words Scene Classifier Combining Local and Global Features for High Spatial Resolution Imagery.