Abstract:As artificial intelligence technology advances, the application of object detection technology in the field of SAR (synthetic aperture radar) imagery is becoming increasingly widespread. However, it also faces challenges such as resource limitations in spaceborne environments and significant uncertainty in the intensity of interference in application scenarios. These factors make the performance evaluation of object detection key to ensuring the smooth execution of tasks. In the face of such complex and harsh application scenarios, methods that rely on single-dimensional evaluation to assess models have had their limitations highlighted. Therefore, this paper proposes a multi-dimensional evaluation method for deep learning models used in SAR image object detection. This method evaluates models in a multi-dimensional manner, covering the training, testing, and application stages of the model, and constructs a multi-dimensional evaluation index system. The training stage includes assessing training efficiency and the impact of training samples; the testing stage includes model performance evaluation, application-based evaluation, and task-based evaluation; and the application stage includes model operation evaluation and model deployment evaluation. The evaluations of these three stages constitute the key links in the performance evaluation of deep learning models. Furthermore, this paper proposes a multi-indicator comprehensive evaluation method based on entropy weight correlation scaling, which calculates the weights of each evaluation indicator through test data, thereby providing a balanced and comprehensive evaluation mechanism for model performance. In the experiments, we designed specific interferences for SAR images in the testing stage and tested three models from the YOLO series. Finally, we constructed a multi-dimensional performance profile diagram for deep learning object detection models, providing a new visualization method to comprehensively characterize model performance in complex application scenarios. This can provide more accurate and comprehensive model performance evaluation for remote sensing data processing, thereby guiding model selection and optimization. The evaluation method proposed in this study adopts a multi-dimensional perspective, comprehensively assessing the three core stages of a model's lifecycle: training, testing, and application. This framework demonstrates significant versatility and adaptability, enabling it to transcend the boundaries of remote sensing technology and provide support for a wide range of model evaluation and optimization tasks.

A parameterized evaluation model of similarity on multi-target retrieval for remote sensing image

An Object-Level Feature Representation Model for the Multi-target Retrieval of Remote Sensing Images.

A Feature Extraction and Similarity Metric-Learning Framework for Urban Model Retrieval.

Combining similarity measures in content-based image retrieval guided by mutual information

Comparative studies on similarity measures for remote sensing image retrieval

The Conceptual Framework Design of Intelligent Multi-feature Remote Sensing Image Retrieval

Efficient probabilistic image retrieval based on a mixed feature model

Enhancing Remote Sensing Image Retrieval: A Hierarchical Approach Integrating Visual and Semantic Similarities

Robust Local Feature Descriptor for Multisource Remote Sensing Image Registration

A Deep Cross-Modality Hashing Network for SAR and Optical Remote Sensing Images Retrieval

A Retrieval Mechanism for Complex Similarity Queries in Image Databases

An Approach for Similar Image Retrieval Based on Multi-features Combination

Feature-Based Similarity Retrieval in Content-Based Image Retrieval

Query-Adaptive Remote Sensing Image Retrieval Based on Image Rank Similarity and Image-to-Query Class Similarity.

Probabilistic Similarity Measures Analysis For Remote Sensing Image Retrieval

A novel method of image retrieval based on combination of semantic and visual features

Hyperspectral Remote Sensing Image Retrieval Based On Spectral Similarity Measure

Deep Multi-Similarity Hashing with Spatial-Enhanced Learning for Remote Sensing Image Retrieval

Remote Sensing Image Retrieval Based on Target Object

A prototype system of content-based retrieval of remote sensing images

Multidimensional Evaluation Methods for Deep Learning Models in Target Detection for SAR Images