Abstract:In the chip encapsulation process, internal defects arise due to both natural and anthropogenic factors, primarily manifesting as a diverse array of missing Gold Wires and Solder Joints. Accurate delineation of these Gold Wires and Solder Joints through a mask is essential for defect analysis. Notably, Gold Wires exhibit a large spatial scale, while Solder Joints have a smaller scale; both possess intricate textures. Although Transformer methods can effectively model relationships between distant pixels, they tend to lose fine-grained texture information. Conversely, CNN methods excel in learning local information but may compromise spatial relationships between targets. Consequently, utilizing either of these methods alone presents limitations. In addressing this issue, we propose the Global-Local Feature Multilevel Fusion Network architecture—SegCAF, which combines the strengths of CNN and Transformer. Our research introduces a dual-branch interactive parallel network, where the CNN branch extracts local information, and the Transformer branch captures global dependencies. Subsequently, a feature fusion module aligns and aggregates the encoded features from both branches, leveraging both global context and local details. Furthermore, an auxiliary segmentation head is added to the Transformer branch to enhance training efficiency and reinforce information interaction between the two branches. In the experimental phase, we collected and annotated a dataset of X-ray images depicting internal defects in industrially produced chipsets. We conducted feature visualization analysis and model performance evaluations on this dataset. The results demonstrate that the proposed SegCAF model significantly outperforms existing mainstream models, achieving an mIoU of and an mPA of . This indicates that SegCAF effectively addresses the challenge of precise segmentation of chip defects using both local and global information in network design and optimization. Consequently, it enhances the quality of relevant electronic products and improves production inspection efficiency.

FabSage: A Large Multimodal Model for IC Defect Detection, Analysis, and Knowledge Querying

FabGPT: An Efficient Large Multimodal Model for Complex Wafer Defect Knowledge Queries

SEMI-DiffusionInst: A Diffusion Model Based Approach for Semiconductor Defect Classification and Segmentation

Machine Vision-Based Lightweight Multiscale Automatic Defect Segmentation Network for MLCC

MDD-Net: A novel defect detection model of material microscope image

Knowledge augmented broad learning system for computer vision based mixed-type defect detection in semiconductor manufacturing

ChipExpert: The Open-Source Integrated-Circuit-Design-Specific Large Language Model

A Global-Local Feature Multilevel Fusion Network for Chip Defect Segmentation

Fab-ME: A Vision State-Space and Attention-Enhanced Framework for Fabric Defect Detection

Effective Transfer of Pretrained Large Visual Model for Fabric Defect Segmentation via Specifc Knowledge Injection

Improved Defect Detection and Classification Method for Advanced IC Nodes by Using Slicing Aided Hyper Inference with Refinement Strategy

Performance, Successes and Limitations of Deep Learning Semantic Segmentation of Multiple Defects in Transmission Electron Micrographs

Contrastive learning-based semantic segmentation for In-situ stratified defect detection in additive manufacturing

Semantic-Masked Intensity Augmentation for Deep Learning-based Analysis of FPGA Images

Advancing SEM Based Nano-Scale Defect Analysis in Semiconductor Manufacturing for Advanced IC Nodes

A Simple Confidence-Supervised Model for High-Resolution Defect Recognition

An Adaptive Image Segmentation Network for Surface Defect Detection

Latent Space Segmentation Model for Visual Surface Defect Inspection

Machine Learning Based Wafer Defect Detection

MemoryMamba: Memory-Augmented State Space Model for Defect Recognition

Surface Defect Detection and Semantic Segmentation with a Novel Lightweight Deep Neural Network