Abstract:In the chip encapsulation process, internal defects arise due to both natural and anthropogenic factors, primarily manifesting as a diverse array of missing Gold Wires and Solder Joints. Accurate delineation of these Gold Wires and Solder Joints through a mask is essential for defect analysis. Notably, Gold Wires exhibit a large spatial scale, while Solder Joints have a smaller scale; both possess intricate textures. Although Transformer methods can effectively model relationships between distant pixels, they tend to lose fine-grained texture information. Conversely, CNN methods excel in learning local information but may compromise spatial relationships between targets. Consequently, utilizing either of these methods alone presents limitations. In addressing this issue, we propose the Global-Local Feature Multilevel Fusion Network architecture—SegCAF, which combines the strengths of CNN and Transformer. Our research introduces a dual-branch interactive parallel network, where the CNN branch extracts local information, and the Transformer branch captures global dependencies. Subsequently, a feature fusion module aligns and aggregates the encoded features from both branches, leveraging both global context and local details. Furthermore, an auxiliary segmentation head is added to the Transformer branch to enhance training efficiency and reinforce information interaction between the two branches. In the experimental phase, we collected and annotated a dataset of X-ray images depicting internal defects in industrially produced chipsets. We conducted feature visualization analysis and model performance evaluations on this dataset. The results demonstrate that the proposed SegCAF model significantly outperforms existing mainstream models, achieving an mIoU of and an mPA of . This indicates that SegCAF effectively addresses the challenge of precise segmentation of chip defects using both local and global information in network design and optimization. Consequently, it enhances the quality of relevant electronic products and improves production inspection efficiency.

Research on Ferrographic Image Fault Diagnosis Based on Channel Overlapping Technique and Information Fusion mechanism

Method of Independent Component Analysis and Its Application to Fault Diagnosis

Fault Diagnosis Based On Fusion Of Multi-Channel Observations By Sensors With Independent Component Analysis And Mutual Information

LAFICNN: A Novel Convolutional Adaptive Fusion Framework for Fault Diagnosis of Rotating Machinery

A New Multisensor Information Fusion Technique Using Processed Images: Algorithms and Application on Hydraulic Components

Multi-channel Data Fusion and Intelligent Fault Diagnosis Based on Deep Learning

Multi-channel Fused Vision Transformer Network for Bearing Fault Diagnosis under Different Working Conditions

Intelligent Recognition of Ferrographic Images Combining Optimal CNN With Transfer Learning Introducing Virtual Images

A Bearing Fault Diagnosis Method Based on Spectrum Map Information Fusion and Convolutional Neural Network

Research on Mechanical Equipment Fault Diagnosis Method Based on Deep Learning and Information Fusion

ECNN: Intelligent Fault Diagnosis Method Using Efficient Convolutional Neural Network

Bearing Fault Diagnosis Method Based on Attention Mechanism and Multilayer Fusion Network.

A hydraulic motor fault diagnosis method based on weighted multi-channel information fusion

A Rotating Machinery Fault Diagnosis Method Based on Multi-Sensor Fusion and ECA-CNN

A novel intelligent fault diagnosis method based on dual convolutional neural network with multi-level information fusion

A convolutional multisensor fusion fault diagnosis framework based on multidimensional distance matrix for rotating machinery

A rolling bearing fault diagnosis method based on a new data fusion mechanism and improved CNN

Transformer fault diagnosis model based on FI-CNN method

A Fuzzy Fusion Rotating Machinery Fault Diagnosis Framework Based on the Enhancement Deep Convolutional Neural Networks

A Global-Local Feature Multilevel Fusion Network for Chip Defect Segmentation

A novel diagnostic framework based on vibration image encoding and multi-scale neural network