Abstract:Morphology analysis based on atomic force microscopy (AFM) imaging contributes to understanding the characteristics of specimens more deeply. The preliminary and crucial step of implementing morphology analysis is to precisely segment the target area from the complex background. In this study, an automated AFM image segmentation strategy based on a well-designed U-shaped neural network is proposed to achieve accurate and robust segmentation for AFM images of different samples, thus realizing morphology analysis in micro-nano scale. Specifically, the centralized information interaction strategy cooperated with a two-path attention module is introduced to realize efficient cross-scale information interaction, which can fundamentally avoid the negative effects induced by spatial interpolation. Besides, the global information flows are adopted to guide the global information extracted by atrous spatial pyramid pooling to each level of the top-down pathway, which ensures that the high-level semantic information is not diluted during the top-down transmission process, thus locating the target area more precisely. Moreover, an AFM image dataset is constructed to train the network, which will be available online for free to facilitate other data-based AFM research. The segmentation results demonstrate that the proposed strategy has better performance on multiple AFM images compared with traditional Otsu method, fully convolutional network and U-Net. The application of the proposed method is carried out to exhibit the effectiveness in automated morphology analysis. Note to Practitioners—Despite the growing demand of AFM-based morphology analysis in many fields, the automated analysis is still lacking limited by accuracy and robustness of AFM image segmentation. Since manual segmentation, sometimes tedious and time-consuming, heavily depends on the personal judgment, it is thus necessary to develop automated segmentation methods. Although traditional automated segmentation algorithms have good performance on certain types of images, they may be difficult to apply in different scenarios, especially for micro-nano images, due to the limited robustness. Therefore, this paper proposes an automated image segmentation algorithm based on an improved U-shaped neural network to achieve accurate morphology analysis for AFM images. The proposed automated morphology analysis workflow will be a practical tool to help reduce human workload and subjective errors, as well as enhancing the accuracy and robustness of the analysis process. In addition, the constructed AFM image dataset can greatly facilitate the research on data-based AFM image analysis of other practitioners. Moreover, practitioners can benefit from our algorithm to improve the accuracy and robustness of image segmentation in other practical applications.

A deep learning-based approach to extraction of filler morphology in SEM images with the application of automated quality inspection

Automated Detection of Defects with Low Semantic Information in X-ray Images Based on Deep Learning

Fast and Robust DCNN Based Lithography SEM Image Contour Extraction Models

An effective method of contour extraction for SEM image based on DCNN

Automatic Morphological Extraction of Fibers from SEM Images for Quality Control of Short Fiber-Reinforced Composites Manufacturing

Deep Learning based Defect classification and detection in SEM images: A Mask R-CNN approach

Semantic Segmentation of Ferrography Images for Automatic Wear Particle Analysis

Feature extraction of particle morphologies of pharmaceutical excipients from scanning electron microscope images using convolutional neural networks

A Global-Local Feature Multilevel Fusion Network for Chip Defect Segmentation

SEM image contour extraction with deep learning method

Mixup-Based Neural Network for Image Restoration and Structure Prediction From SEM Images

Deep-Learning-Based Automated Morphology Analysis With Atomic Force Microscopy

Deep learning for automated size and shape analysis of nanoparticles in scanning electron microscopy

Deep Learning Methods for Phase Segmentation in Backscattered Electron Images of Cement Paste and SCM-blended Systems

Surface Defect Detection and Semantic Segmentation with a Novel Lightweight Deep Neural Network

Enhancing Cell Instance Segmentation in Scanning Electron Microscopy Images via a Deep Contour Closing Operator

Using Deep Convolutional Neural Networks to Circumvent Morphological Feature Specification when Classifying Subvisible Protein Aggregates from Micro-Flow Images

Mask-R-FCN: A Deep Fusion Network for Semantic Segmentation.

A Deep Learning-Based Approach for the Automated Surface Inspection of Copper Clad Laminate Images

An AI-based approach for detecting cells and microbial byproducts in low volume scanning electron microscope images of biofilms

Detail-semantic guide network based on spatial attention for surface defect detection with fewer samples