Abstract:Spectral-spatial processing has been increasingly explored in remote sensing hyperspectral image classification. While extensive studies have focused on developing methods to improve the classification accuracy, experimental setting and design for method evaluation have drawn little attention. In the scope of supervised classification, we find that traditional experimental designs for spectral processing are often improperly used in the spectral-spatial processing context, leading to unfair or biased performance evaluation. This is especially the case when training and testing samples are randomly drawn from the same image—a practice that has been commonly adopted in the experiments. Under such setting, the dependence caused by overlap between the training and testing samples may be artificially enhanced by some spatial information processing methods, such as spatial filtering and morphological operation. Such enhancement of dependence in return amplifies the classification accuracy, leading to an improper evaluation of spectral-spatial classification techniques. Therefore, the widely adopted pixel-based random sampling strategy is not always suitable to evaluate spectral-spatial classification algorithms, because it is difficult to determine whether the improvement of classification accuracy is caused by incorporating spatial information into classifier or by increasing the overlap between training and testing samples. To tackle this problem, we propose a novel controlled random sampling strategy for spectral-spatial methods. It can greatly reduce the overlap between training and testing samples and provides more objective and accurate evaluation.

Reducing Identification Error Using Over-Sampling Technique

Analysis of Over-Sampling Based Identification

On Anti-Aliasing Filtering and Over-Sampling Scheme in System Identification

New closed-loop identification approach based on output over-sampling scheme

Subspace based direct closed-loop identification via output over-sampling scheme

System Identification Using Slow and Irregular Output Samples

Asymptotic Variance Expression in Output Over-sampling Based Closed-loop Identification

Imbalanced Data Sets Classification Method Based on Over-Sampling Technique

System identification: New developments of the asymptotic theory/method

Identification Based Fault Detection: Residual Selection and Optimal Filter

Multivariable Process Identification Based on Frequency Domain Measures

Use of Error Criteria in Identification for Control

Mimo Process Identification for Controller-Design - Test Signals, Nominal Model and Error-Bounds

Improve recursive identification using multi-iteration

A new closed-loop identification technique for step-response model based on subspace approach

Model Recognition Orientated at Small Sample Data

A New Excitation Scheme for Closed-Loop Subspace Identification Using Additional Sampling Outputs and Its Extension to Instrumental Variable Method.

Beyond Nyquist in Frequency Response Function Identification: Applied to Slow-Sampled Systems

Subspace Identification for Continuous-Time Errors-in-variables Model from Sampled Data

A few-shot identification method for stochastic dynamical systems based on residual multipeaks adaptive sampling

On the Sampling Strategy for Evaluation of Spectral-Spatial Methods in Hyperspectral Image Classification