Intelligent Known and Novel Aircraft Recognition -- A Shift from Classification to Similarity Learning for Combat Identification

Ahmad Saeed,Haasha Bin Atif,Usman Habib,Mohsin Bilal
2024-02-26
Abstract:Precise aircraft recognition in low-resolution remote sensing imagery is a challenging yet crucial task in aviation, especially combat identification. This research addresses this problem with a novel, scalable, and AI-driven solution. The primary hurdle in combat identification in remote sensing imagery is the accurate recognition of Novel/Unknown types of aircraft in addition to Known types. Traditional methods, human expert-driven combat identification and image classification, fall short in identifying Novel classes. Our methodology employs similarity learning to discern features of a broad spectrum of military and civilian aircraft. It discerns both Known and Novel aircraft types, leveraging metric learning for the identification and supervised few-shot learning for aircraft type classification. To counter the challenge of limited low-resolution remote sensing data, we propose an end-to-end framework that adapts to the diverse and versatile process of military aircraft recognition by training a generalized embedder in fully supervised manner. Comparative analysis with earlier aircraft image classification methods shows that our approach is effective for aircraft image classification (F1-score Aircraft Type of 0.861) and pioneering for quantifying the identification of Novel types (F1-score Bipartitioning of 0.936). The proposed methodology effectively addresses inherent challenges in remote sensing data, thereby setting new standards in dataset quality. The research opens new avenues for domain experts and demonstrates unique capabilities in distinguishing various aircraft types, contributing to a more robust, domain-adapted potential for real-time aircraft recognition.
Artificial Intelligence
What problem does this paper attempt to address?
### Problems the Paper Aims to Solve This paper aims to address the challenge of accurately identifying known and unknown (novel) aircraft in low-resolution remote sensing images. Specifically, the paper focuses on issues in the aviation field, particularly in Combat Identification (CID). Traditional combat identification methods rely on human experts or image classification-based approaches, which perform poorly in identifying unknown types of aircraft. Therefore, this paper proposes a new, scalable, AI-driven solution that distinguishes various military and civilian aircraft, including known and unknown types, through similarity learning. ### Main Challenges 1. **Accurate Identification of Unknown Types of Aircraft**: Traditional methods have limitations in identifying newly emerging unknown aircraft types. 2. **Limited Data**: The amount of low-resolution remote sensing image data is limited, and the datasets contain noise and annotation errors. 3. **Dynamic Changes**: Aircraft designs are diverse and frequently change in appearance, increasing the difficulty of identification. 4. **Intra-class Variation**: Aircraft of the same category may exhibit different features under different conditions. ### Solution The paper proposes a method called "Intelligent Known and Novel Aircraft Recognition (INNAR)" to achieve its goals through the following steps: 1. **Embedding Space Construction**: Train a general embedder to generate vector representations that capture aircraft features. 2. **Few-shot Learning**: Utilize few-shot learning techniques to construct the embedding space with a small number of samples, addressing the data scarcity issue. 3. **Binary Classification Threshold Mechanism**: Introduce a threshold technique to determine whether an image belongs to a known category distribution, thereby distinguishing known and unknown aircraft. 4. **Final Classification**: For images belonging to known categories, use the K-nearest neighbors method for final classification. ### Contributions 1. **Automated Combat Identification**: Propose a new method for automated CID. 2. **Improved Dataset**: Conduct a thorough evaluation and cleaning of the MTARSI dataset, creating a higher quality dataset (MTARSI-INNAR). 3. **High-accuracy Identification**: Achieve high accuracy in identifying known and unknown aircraft categories. 4. **Method Validation**: Validate through experiments the inaccuracy of image classification methods on the original noisy dataset and propose a shift towards similarity and few-shot learning methods. ### Conclusion This study effectively addresses the challenge of identifying known and unknown aircraft in low-resolution remote sensing images by introducing the INNAR method, providing new benchmarks and solutions for the field of combat identification.