Abstract:Spectral-spatial processing has been increasingly explored in remote sensing hyperspectral image classification. While extensive studies have focused on developing methods to improve the classification accuracy, experimental setting and design for method evaluation have drawn little attention. In the scope of supervised classification, we find that traditional experimental designs for spectral processing are often improperly used in the spectral-spatial processing context, leading to unfair or biased performance evaluation. This is especially the case when training and testing samples are randomly drawn from the same image—a practice that has been commonly adopted in the experiments. Under such setting, the dependence caused by overlap between the training and testing samples may be artificially enhanced by some spatial information processing methods, such as spatial filtering and morphological operation. Such enhancement of dependence in return amplifies the classification accuracy, leading to an improper evaluation of spectral-spatial classification techniques. Therefore, the widely adopted pixel-based random sampling strategy is not always suitable to evaluate spectral-spatial classification algorithms, because it is difficult to determine whether the improvement of classification accuracy is caused by incorporating spatial information into classifier or by increasing the overlap between training and testing samples. To tackle this problem, we propose a novel controlled random sampling strategy for spectral-spatial methods. It can greatly reduce the overlap between training and testing samples and provides more objective and accurate evaluation.

Are Sampling Heuristics Necessary in Object Detectors?

Is Sampling Heuristics Necessary in Training Deep Object Detectors?

Are Sampling Heuristics Necessary in Object Detectors

Is Heuristic Sampling Necessary in Training Deep Object Detectors?

Revisiting Foreground-Background Imbalance in Object Detectors

Crowdsourcing Detection of Sampling Biases in Image Datasets

Foreground-Background Imbalance Problem in Deep Object Detectors: A Review

Residual Objectness for Imbalance Reduction

Bridging the Gap Between Anchor-based and Anchor-free Detection via Adaptive Training Sample Selection

On the Sampling Strategy for Evaluation of Spectral-Spatial Methods in Hyperspectral Image Classification

Training Region-Based Object Detectors with Online Hard Example Mining

Sample Weighting: an Inherent Approach for Outlier Suppressing Discriminant Analysis

HPS-Det: Dynamic Sample Assignment with Hyper-Parameter Search for Object Detection

Class Imbalance in Object Detection: An Experimental Diagnosis and Study of Mitigation Strategies

Sampling Techniques for Large-Scale Object Detection From Sparsely Annotated Objects

Balance-Oriented Focal Loss with Linear Scheduling for Anchor Free Object Detection

S4OD: Semi-Supervised learning for Single-Stage Object Detection

Balanced One-Stage Object Detection by Enhancing the Effect of Positive Samples

Improving Training Instance Quality in Aerial Image Object Detection With a Sampling-Balance-Based Multistage Network

False Positive Sampling-based Data Augmentation for Enhanced 3D Object Detection Accuracy

Gradient-based Sampling for Class Imbalanced Semi-supervised Object Detection