Abstract:In recent years, object-based segmentation methods and shallow-model classification algorithms have been widely integrated for remote sensing image supervised classification. However, as the image resolution increases, remote sensing images contain increasingly complex characteristics, leading to higher intraclass heterogeneity and interclass homogeneity and thus posing substantial challenges for the application of segmentation methods and shallow-model classification algorithms. As important methods of deep learning technology, convolutional neural networks (CNNs) can hierarchically extract higher-level spatial features from images, providing CNNs with a more powerful recognition ability for target detection and scene classification in high-resolution remote sensing images. However, the input of the traditional CNN is an image patch, the shape of which is scarcely consistent with a given segment. This inconsistency may lead to errors when directly using CNNs in object-based remote sensing classification: jagged errors may appear along the land cover boundaries, and some land cover areas may overexpand or shrink, leading to many obvious classification errors in the resulting image. To address the above problem, this paper proposes an object-based and heterogeneous segment filter convolutional neural network (OHSF-CNN) for high-resolution remote sensing image classification. Before the CNN processes an image patch, the OHSF-CNN includes a heterogeneous segment filter (HSF) to process the input image. For the segments in the image patch that are obviously different from the segment to be classified, the HSF can differentiate them and reduce their negative influence on the CNN training and decision-making processes. Experimental results show that the OHSF-CNN not only can take full advantage of the recognition capabilities of deep learning methods but also can effectively avoid the jagged errors along land cover boundaries and the expansion/shrinkage of land cover areas originating from traditional CNN structures. Moreover, compared with the traditional methods, the proposed OHSF-CNN can achieve higher classification accuracy. Furthermore, the OHSF-CNN algorithm can serve as a bridge between deep learning technology and object-based segmentation algorithms thereby enabling the application of object-based segmentation methods to more complex high-resolution remote sensing images.

CNN Refinement Based Object Recognition Through Optimized Segmentation

ObjectFusion: an Object Detection and Segmentation Framework with RGB-D SLAM and Convolutional Neural Networks

Optimized CNN Based Image Recognition Through Target Region Selection

A Multistage Refinement Network for Salient Object Detection

A Stagewise Refinement Model for Detecting Salient Objects in Images.

RefineNet: Multi-Path Refinement Networks for High-Resolution Semantic Segmentation

An Object-Oriented CNN Model Based on Improved Superpixel Segmentation for High-Resolution Remote Sensing Image Classification

A Hybrid-Backward Refinement Model for Salient Object Detection

Feature refinement with multi-level context for object detection

Learning Deep Conditional Neural Network for Image Segmentation

RefineMask: Towards High-Quality Instance Segmentation with Fine-Grained Features

Discriminative Features Reconstruction Network For Semantic Segmentation

Efficient Object Detection and Segmentation for Fine-Grained Recognition

RefineNet: Multi-Path Refinement Networks for Dense Prediction

Improve Object Detection Via a Multi-Feature and Multi-Task CNN Model

Motion-Guided Cascaded Refinement Network for Video Object Segmentation

FINE-GRAINED AND LAYERED OBJECT RECOGNITION

Refined Feature Enhancement Network for Object Detection

Feature Refinement from Multiple Perspectives for High Performance Salient Object Detection.

An Object-Based and Heterogeneous Segment Filter Convolutional Neural Network for High-Resolution Remote Sensing Image Classiﬁcation

A Novel Approach to Optimizing Convolutional Neural Networks for Improved Digital Image Segmentation