An automatic detecting method for multi-scale foreign object debris in civil aircraft manufacturing and assembly scenario
Minghao Yu,Qijie Zhao,Sheng Cheng,Hongxia Cai,Lilan Liu
DOI: https://doi.org/10.1007/s10845-024-02508-x
IF: 8.3
2024-10-26
Journal of Intelligent Manufacturing
Abstract:Foreign Object Debris (FOD) is a critical aviation safety concern, and the detection of FOD has been highly prioritized by aircraft manufacturers. Currently, FOD detection is primarily conducted through manual vision inspection. However, due to the extensive range of FOD types and scales, manual inspection is susceptible to overlooking and misidentifying some small-scale FOD. To handle these difficulties, a lightweight model for detecting small-scale FOD is proposed based on YOLOv5s. This intelligent FOD detection method is of great significance in promoting the aircraft intelligent manufacturing industry. Firstly, we design the backbone feature extraction network (LSGK-GhostNet), which can automatically extract multi-scale features of FOD while reducing computational resources. Secondly, the Deformable Receptive Field Module (DRFB) is proposed by imitating human vision. It utilizes a three-branch structure to integrate various receptive fields for extracting effective FOD scale and contextual information. Additionally, it dynamically adjusts the spatial distribution of the receptive fields. A refined module (DFPN) is designed to amplify the details of small-scale FOD. In addition, the head of the model for detecting the small target is decoupled to strengthen the localizing accuracy for small-scale FOD. Finally, to improve the detection precision of dense detection and address unbalanced sample training, this paper improves the post-processing method and the localization loss of FOD. Detection experiments of FOD are conducted in laboratory and assembly scenarios, The results indicate that our algorithm notably outperforms other methods, and achieves an average accuracy of 94.1%, with a speed of 34.8 Frames per second (FPS) across seven FOD categories. This paper proposes a pioneering way to detect FOD automatically in the assembly process of civil aircraft.
engineering, manufacturing,computer science, artificial intelligence