Abstract:In the context of 3C assembly scenarios, characterized by numerous semi-flexible, heterogeneous, and small slender targets, traditional target detection algorithms face significant challenges such as low accuracy, weak generalization, large model sizes, and slow inference speeds. To address these issues, this study introduces an enhanced method based on the YOLOv5 model, named YOLOv5-GTB. This method integrates Bidirectional Feature Pyramid Network (BiFPN), Ghost lightweight convolution, Vision Transformer (ViT), and adaptive activation function technologies, aiming to improve the accuracy and speed of target detection. Our approach utilizes Ghost convolution to construct a Ghost bottleneck layer, optimizing the feature extraction network while significantly reducing computational costs and enhancing the convolutional neural network's feature extraction capabilities. Additionally, the Cross-Stage Partial Network (CSPNet) architecture is employed to effectively segment the data flow of the input feature map layer, thereby improving the efficiency of gradient processing. Furthermore, we introduce a fusion structure of CNN and Transformer, leveraging the strengths of convolutional neural networks in local feature extraction and the ViT's capability in long-range information capture, thereby further enhancing the overall network's feature extraction performance. Regarding feature fusion, considering the limitations of traditional top-down unidirectional information flow in effectively merging features with both location and semantic information, BiFPN is incorporated into the YOLOv5-GTB. This enhances the fusion of feature layers extracted from both the end of the backbone network and the first module's fused feature layer, thus improving detection accuracy. Ablation and comparative experiments conducted on the 3C assembly scenario target detection dataset demonstrate the significant advantages of the YOLOv5-GTB model in terms of accuracy and speed. Ultimately, the application of this model to the 3C assembly platform successfully achieves rapid and accurate target recognition in this scenario.

A rapid oriented detection method of virtual components for augmented assembly

Rapid Offline Detection and 3D Annotation of Assembly Elements in the Augmented Assembly

Lightweight and fast visual detection method for 3C assembly

Integrated Registration and Occlusion Handling Based on Deep Learning for Augmented Reality Assisted Assembly Instruction

Fully convolutional network-based registration for augmented assembly systems

A Lightweight Detection Method of Smartphone Assembly Parts

AVFP-MVX: Multimodal VoxelNet with Attention Mechanism and Voxel Feature Pyramid

Rethinking Two-B-Real Net for Real-Time Salient Object Detection

Deep learning-based augmented reality work instruction assistance system for complex manual assembly

Small Object Detection Method Based on Adaptive Spatial Parallel Convolution and Fast Multi-Scale Fusion

LARNet:Towards Lightweight, Accurate and Real-time Salient Object Detection

A digital twin-driven human-machine interactive assembly method based on lightweight multi-target detection and assembly feature generation

Real-time occlusion handling for augmented reality assistance assembly systems with monocular images

PCBDet: An efficient deep neural network object detection architecture for automatic PCB component detection on the edge

QCNet: Query Context Network for Salient Object Detection of Automatic Surface Inspection

VSL-Net: Voxel structure learning for 3D object detection

AGO-Net: Association-Guided 3D Point Cloud Object Detection Network

UltimateDO: An Efficient Framework to Marry Occupancy Prediction with 3D Object Detection via Channel2height

AR-assisted assembly method based on instance segmentation

DVFENet: Dual-branch voxel feature extraction network for 3D object detection

A Simple yet Effective Network based on Vision Transformer for Camouflaged Object and Salient Object Detection