Virtual Sample Generation Methods and Application in Few-Shot Object Detection for Industrial Scenarios

Xiuwen Tao,Guoyang Wan,Ming Jiang,Jian Zhang,Qianqian Wang,Qin He
DOI: https://doi.org/10.1109/cac59555.2023.10450262
2023-01-01
Abstract:Due to the long-term relatively fixed state of industrial installations, the diversity of industrial data is low, with high repetitiveness and uneven distribution, which makes industrial few-shot object detection still challenging. Therefore, from the perspective of handling the dataset, this paper proposes a virtual sample generation method based on virtual reality. Firstly, by using a virtual engine, the target workpiece model is created to directly simulate the states of the workpieces captured by the visual system in various environments. Secondly, random algorithms are added and improved to simulate workpieces with different materials and degrees of wear, distributed in random positions with different poses and types in the visual system, thereby generating virtual samples containing workpieces. Finally, virtual samples are introduced for experimental testing in the target detection network. The proposed method is tested in both YOLOv5 and YOLOv7 and compared with datasets without virtual samples, resulting in an improvement of 3.06% and 2.23% in mAP values, respectively. The experimental results demonstrate that the proposed method effectively improves the issue of industrial small-sample object detection.
What problem does this paper attempt to address?