Abstract:As artificial intelligence technology advances, the application of object detection technology in the field of SAR (synthetic aperture radar) imagery is becoming increasingly widespread. However, it also faces challenges such as resource limitations in spaceborne environments and significant uncertainty in the intensity of interference in application scenarios. These factors make the performance evaluation of object detection key to ensuring the smooth execution of tasks. In the face of such complex and harsh application scenarios, methods that rely on single-dimensional evaluation to assess models have had their limitations highlighted. Therefore, this paper proposes a multi-dimensional evaluation method for deep learning models used in SAR image object detection. This method evaluates models in a multi-dimensional manner, covering the training, testing, and application stages of the model, and constructs a multi-dimensional evaluation index system. The training stage includes assessing training efficiency and the impact of training samples; the testing stage includes model performance evaluation, application-based evaluation, and task-based evaluation; and the application stage includes model operation evaluation and model deployment evaluation. The evaluations of these three stages constitute the key links in the performance evaluation of deep learning models. Furthermore, this paper proposes a multi-indicator comprehensive evaluation method based on entropy weight correlation scaling, which calculates the weights of each evaluation indicator through test data, thereby providing a balanced and comprehensive evaluation mechanism for model performance. In the experiments, we designed specific interferences for SAR images in the testing stage and tested three models from the YOLO series. Finally, we constructed a multi-dimensional performance profile diagram for deep learning object detection models, providing a new visualization method to comprehensively characterize model performance in complex application scenarios. This can provide more accurate and comprehensive model performance evaluation for remote sensing data processing, thereby guiding model selection and optimization. The evaluation method proposed in this study adopts a multi-dimensional perspective, comprehensively assessing the three core stages of a model's lifecycle: training, testing, and application. This framework demonstrates significant versatility and adaptability, enabling it to transcend the boundaries of remote sensing technology and provide support for a wide range of model evaluation and optimization tasks.

Efficient Accuracy Evaluation for Multi-Modal Sensed Data

Accuracy Evaluation for Sensed Data.

Quantifying Accuracy Dimension within Available Context

Accuracy Evaluation of Segmentation for High Resolution Imagery and 3D Laser Point Cloud Data

Hyperspectral Image Quality Evaluation Based On Multi-Model Fusion

On the Sampling Strategy for Evaluation of Spectral-Spatial Methods in Hyperspectral Image Classification

Multi-modal Quality Prediction Algorithm Based on Anomalous Energy Tracking Attention

A Novel Framework to Assess All-Round Performances of Spatiotemporal Fusion Models

A New Accuracy Assessment Method for One-Class Remote Sensing Classification

MultiSenseSeg: A Cost-Effective Unified Multimodal Semantic Segmentation Model for Remote Sensing

Semantic and Instance Segmentation in Coastal Urban Spatial Perception: A Multi-Task Learning Framework with an Attention Mechanism

Multidimensional Evaluation Methods for Deep Learning Models in Target Detection for SAR Images

Confidence-interval based sensing quality evaluation for mobile sensor networks.

A Multimodal Data Fusion Model for Accurate and Interpretable Urban Land Use Mapping with Uncertainty Analysis

METHODS AND ACCURACY ASSESSMENT FOR LAND USE AND COVER CLASSIFICATION BASED ON MEDIUM RESOLUTION REMOTELY SENSED DATA

MultiSense: Cross Labelling and Learning Human Activities Using Multimodal Sensing Data

Handling missing data and measurement error for early-onset myopia risk prediction models

Multi-scale accuracy assessment of land cover datasets based on histo-variograms

Adaptive sensor management in multisensor data fusion system

Dynamic Error Spectrum for Estimation Performance Evaluation: a Case Study on Interacting Multiple Model Algorithm

Multimodal Image Aesthetic Prediction with Missing Modality