Abstract:In the chip encapsulation process, internal defects arise due to both natural and anthropogenic factors, primarily manifesting as a diverse array of missing Gold Wires and Solder Joints. Accurate delineation of these Gold Wires and Solder Joints through a mask is essential for defect analysis. Notably, Gold Wires exhibit a large spatial scale, while Solder Joints have a smaller scale; both possess intricate textures. Although Transformer methods can effectively model relationships between distant pixels, they tend to lose fine-grained texture information. Conversely, CNN methods excel in learning local information but may compromise spatial relationships between targets. Consequently, utilizing either of these methods alone presents limitations. In addressing this issue, we propose the Global-Local Feature Multilevel Fusion Network architecture—SegCAF, which combines the strengths of CNN and Transformer. Our research introduces a dual-branch interactive parallel network, where the CNN branch extracts local information, and the Transformer branch captures global dependencies. Subsequently, a feature fusion module aligns and aggregates the encoded features from both branches, leveraging both global context and local details. Furthermore, an auxiliary segmentation head is added to the Transformer branch to enhance training efficiency and reinforce information interaction between the two branches. In the experimental phase, we collected and annotated a dataset of X-ray images depicting internal defects in industrially produced chipsets. We conducted feature visualization analysis and model performance evaluations on this dataset. The results demonstrate that the proposed SegCAF model significantly outperforms existing mainstream models, achieving an mIoU of and an mPA of . This indicates that SegCAF effectively addresses the challenge of precise segmentation of chip defects using both local and global information in network design and optimization. Consequently, it enhances the quality of relevant electronic products and improves production inspection efficiency.

Hybridformer: an efficient and robust new hybrid network for chip image segmentation

MixFormer: a Mixed CNN-Transformer Backbone for Medical Image Segmentation

A Global-Local Feature Multilevel Fusion Network for Chip Defect Segmentation

CH-Net: A Cross Hybrid Network for Medical Image Segmentation

A Sub-Region Unet for Weak Defects Segmentation with Global Information and Mask-Aware Loss.

An Image Segmentation Approach Based on Fuzzy-Neural-network Hybrid System

A Multi-Branch Hybrid Transformer Networkfor Corneal Endothelial Cell Segmentation

Real-Time Image Segmentation via Hybrid Convolutional-Transformer Architecture Search

Hybrid Dilated Convolution Network Using Attentive Kernels for Real-Time Semantic Segmentation

When Humans Meet Machines: Towards Efficient Segmentation Networks.

Semantic Segmentation of Substation Tools Using an Improved ICNet

A novel joint segmentation approach for wafer surface defect classification based on blended network structure

Transformer and CNN Hybrid Deep Neural Network for Semantic Segmentation of Very-High-Resolution Remote Sensing Imagery

PD-SegNet: Semantic Segmentation of Small Agricultural Targets in Complex Environments

SE-U-Lite: Milling Tool Wear Segmentation Based on Lightweight U-Net Model With Squeeze-and-Excitation Module

A Hybrid Semantic Segmentation Based on Level-Set Evolution Driven by Fully Convolutional Networks

Effective hybrid attention network based on pseudo-color enhancement in ultrasound image segmentation

HCT-net: hybrid CNN-transformer model based on a neural architecture search network for medical image segmentation

Unsupervised Multi-Scale Hybrid Feature Extraction Network for Semantic Segmentation of High-Resolution Remote Sensing Images

High-Resolution Remote Sensing Image Segmentation Algorithm Based on Improved Feature Extraction and Hybrid Attention Mechanism

HmsU-Net: A hybrid multi-scale U-net based on a CNN and transformer for medical image segmentation