Abstract:As artificial intelligence technology advances, the application of object detection technology in the field of SAR (synthetic aperture radar) imagery is becoming increasingly widespread. However, it also faces challenges such as resource limitations in spaceborne environments and significant uncertainty in the intensity of interference in application scenarios. These factors make the performance evaluation of object detection key to ensuring the smooth execution of tasks. In the face of such complex and harsh application scenarios, methods that rely on single-dimensional evaluation to assess models have had their limitations highlighted. Therefore, this paper proposes a multi-dimensional evaluation method for deep learning models used in SAR image object detection. This method evaluates models in a multi-dimensional manner, covering the training, testing, and application stages of the model, and constructs a multi-dimensional evaluation index system. The training stage includes assessing training efficiency and the impact of training samples; the testing stage includes model performance evaluation, application-based evaluation, and task-based evaluation; and the application stage includes model operation evaluation and model deployment evaluation. The evaluations of these three stages constitute the key links in the performance evaluation of deep learning models. Furthermore, this paper proposes a multi-indicator comprehensive evaluation method based on entropy weight correlation scaling, which calculates the weights of each evaluation indicator through test data, thereby providing a balanced and comprehensive evaluation mechanism for model performance. In the experiments, we designed specific interferences for SAR images in the testing stage and tested three models from the YOLO series. Finally, we constructed a multi-dimensional performance profile diagram for deep learning object detection models, providing a new visualization method to comprehensively characterize model performance in complex application scenarios. This can provide more accurate and comprehensive model performance evaluation for remote sensing data processing, thereby guiding model selection and optimization. The evaluation method proposed in this study adopts a multi-dimensional perspective, comprehensively assessing the three core stages of a model's lifecycle: training, testing, and application. This framework demonstrates significant versatility and adaptability, enabling it to transcend the boundaries of remote sensing technology and provide support for a wide range of model evaluation and optimization tasks.

Accuracy Evaluation for Sensed Data.

Accuracy Evaluation of Segmentation for High Resolution Imagery and 3D Laser Point Cloud Data

Quantifying Accuracy Dimension within Available Context

On the Sampling Strategy for Evaluation of Spectral-Spatial Methods in Hyperspectral Image Classification

METHODS AND ACCURACY ASSESSMENT FOR LAND USE AND COVER CLASSIFICATION BASED ON MEDIUM RESOLUTION REMOTELY SENSED DATA

On the Sampling Strategies for Evaluation of Joint Spectral-Spatial Information Based Classifiers

Spectral-Spatial Classification of Hyperspectral Images Using Joint Bilateral Filter and Graph Cut Based Model.

A 3-stage Spectral-spatial Method for Hyperspectral Image Classification

Spatial analysis of remote sensing image classification accuracy

Spatial classification in the presence of measurement error

A New Accuracy Assessment Method for One-Class Remote Sensing Classification

Confidence-interval based sensing quality evaluation for mobile sensor networks.

A framework for the geometric accuracy assessment of classified objects

Analysis of Registration Algorithm for Two-dimensional Multi-sensor Error

Semantic and Instance Segmentation in Coastal Urban Spatial Perception: A Multi-Task Learning Framework with an Attention Mechanism

A Multi-Modal High Spatial Resolution Aerial Imagery Scene Classification Model with Visual Enhancement

Multidimensional Evaluation Methods for Deep Learning Models in Target Detection for SAR Images

MultiSenseSeg: A Cost-Effective Unified Multimodal Semantic Segmentation Model for Remote Sensing

Error Analysis and Improvements of Spectral Angle Mapper (SAM) Model

Automatic Discovery and Assessment of Interpretable Systematic Errors in Semantic Segmentation

A Signal Quality Assessment Metrics for Vibration-based Human Sensing Data Acquisition.